2023-11-24T05:53:19.150 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-24T05:53:19.152 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --verbose --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} --archive /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549 --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/orig.config.yaml 2023-11-24T05:53:19.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T05:53:19.358 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} email: null first_in_suite: false job_id: '7465549' kernel: flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mgr-vol-misc sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3305 sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c sleep_before_teardown: 0 suite: fs:volumes suite_branch: rishabh-mgr-vol-misc suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzfUH1Qhkx3UErF1rZEapYX84suSfSoXmfVV9IRb3VCZ7HVR/WVJa0kuNXpwrLyzVFOs9dUYrWxP2fwYTuBjSA= smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKvyZJSGfP9QNiqWO4NqH+y2mCF+JpOK2PEVDl75av/LvnBOQ4sQuRQSGRUwkmeTRiU6MZ8GgEaMs7ABH+10MZw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_05:41:33 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-24T05:53:19.359 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa; will attempt to use it 2023-11-24T05:53:19.360 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks 2023-11-24T05:53:19.360 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-24T05:53:19.362 INFO:teuthology.task.internal:Checking packages... 2023-11-24T05:53:19.394 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a13ea5ff00cb4df7a9cc941166ddeb358881144c' 2023-11-24T05:53:19.394 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-24T05:53:19.394 INFO:teuthology.packaging:ref: None 2023-11-24T05:53:19.394 INFO:teuthology.packaging:tag: None 2023-11-24T05:53:19.395 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-24T05:53:19.395 INFO:teuthology.packaging:sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T05:53:19.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-24T05:53:19.538 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484.ga13ea5ff 2023-11-24T05:53:19.538 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-24T05:53:19.545 INFO:teuthology.task.internal:no buildpackages task found 2023-11-24T05:53:19.546 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-24T05:53:19.599 INFO:teuthology.task.internal:Saving configuration 2023-11-24T05:53:19.617 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-24T05:53:19.633 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T05:53:19.659 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:47:46.131676', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzfUH1Qhkx3UErF1rZEapYX84suSfSoXmfVV9IRb3VCZ7HVR/WVJa0kuNXpwrLyzVFOs9dUYrWxP2fwYTuBjSA='} 2023-11-24T05:53:19.683 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:47:46.133456', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKvyZJSGfP9QNiqWO4NqH+y2mCF+JpOK2PEVDl75av/LvnBOQ4sQuRQSGRUwkmeTRiU6MZ8GgEaMs7ABH+10MZw='} 2023-11-24T05:53:19.683 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-24T05:53:19.696 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-24T05:53:19.696 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-24T05:53:19.696 INFO:teuthology.run_tasks:Running task console_log... 2023-11-24T05:53:19.913 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1e439ffb80>, signals=[15]) 2023-11-24T05:53:19.914 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-24T05:53:19.923 INFO:teuthology.task.internal:Opening connections... 2023-11-24T05:53:19.924 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T05:53:19.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:53:20.033 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T05:53:20.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:53:20.133 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-24T05:53:20.145 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-11-24T05:53:20.164 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-11-24T05:53:20.164 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-11-24T05:53:20.222 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-24T05:53:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2023-11-24T05:53:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T05:53:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-24T05:53:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-24T05:53:20.224 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-11-24T05:53:20.249 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-11-24T05:53:20.267 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-11-24T05:53:20.267 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-11-24T05:53:20.324 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-24T05:53:20.325 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-24T05:53:20.326 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-11-24T05:53:20.350 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-24T05:53:20.365 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-24T05:53:20.394 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-24T05:53:20.395 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2023-11-24T05:53:20.397 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2023-11-24T05:53:20.413 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-24T05:53:20.427 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-24T05:53:20.428 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2023-11-24T05:53:20.457 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2023-11-24T05:53:20.488 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-24T05:53:20.541 INFO:teuthology.run_tasks:Running task kernel... 2023-11-24T05:53:20.562 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-24T05:53:20.562 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, timeout 300 2023-11-24T05:53:20.563 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T05:53:20.563 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T05:53:20.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T05:53:20.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T05:53:20.585 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:53:20.585 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T05:53:20.585 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2023-11-24T05:53:20.586 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:53:20.586 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T05:53:20.586 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-11-24T05:53:20.644 INFO:teuthology.orchestra.run.smithi031.stdout:5.14.0-361.el9.x86_64 2023-11-24T05:53:20.644 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-361.el9.x86_64 2023-11-24T05:53:20.644 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:53:20.645 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T05:53:20.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:53:20.646 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:53:20.646 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T05:53:20.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:53:20.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum upgrade -y linux-firmware 2023-11-24T05:53:20.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum upgrade -y linux-firmware 2023-11-24T05:53:22.927 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-11-24T05:53:23.053 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-11-24T05:53:24.401 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2023-11-24T05:53:24.492 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2023-11-24T05:53:25.266 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-11-24T05:53:25.849 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 7.9 MB 00:01 2023-11-24T05:53:27.700 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 26 MB/s | 18 MB 00:00 2023-11-24T05:53:28.211 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-11-24T05:53:32.804 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.8 MB 00:01 2023-11-24T05:53:33.212 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 5.8 MB 00:01 2023-11-24T05:53:34.179 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 15 kB 00:00 2023-11-24T05:53:35.559 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2023-11-24T05:53:37.263 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-11-24T05:53:38.397 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 4.8 MB/s | 20 MB 00:04 2023-11-24T05:53:42.143 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2023-11-24T05:53:43.362 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-11-24T05:53:44.599 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2023-11-24T05:53:44.608 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 1 Package 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 328 M 2023-11-24T05:53:44.609 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2023-11-24T05:53:45.946 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-11-24T05:53:45.957 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-11-24T05:53:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-11-24T05:53:45.957 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-11-24T05:53:45.957 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2023-11-24T05:53:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-24T05:53:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T05:53:45.957 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-11-24T05:53:45.957 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-11-24T05:53:45.958 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 1 Package 2023-11-24T05:53:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T05:53:45.958 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 328 M 2023-11-24T05:53:45.958 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-11-24T05:53:49.744 INFO:teuthology.orchestra.run.smithi031.stdout:linux-firmware-20231030-141.el9.noarch.rpm 64 MB/s | 328 MB 00:05 2023-11-24T05:53:49.745 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2023-11-24T05:53:49.746 INFO:teuthology.orchestra.run.smithi031.stdout:Total 64 MB/s | 328 MB 00:05 2023-11-24T05:53:49.746 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2023-11-24T05:53:49.835 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2023-11-24T05:53:49.835 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2023-11-24T05:53:51.228 INFO:teuthology.orchestra.run.smithi022.stdout:linux-firmware-20231030-141.el9.noarch.rpm 62 MB/s | 328 MB 00:05 2023-11-24T05:53:51.229 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-11-24T05:53:51.230 INFO:teuthology.orchestra.run.smithi022.stdout:Total 62 MB/s | 328 MB 00:05 2023-11-24T05:53:51.230 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-11-24T05:53:51.336 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-11-24T05:53:51.337 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-11-24T05:53:52.026 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2023-11-24T05:53:52.026 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2023-11-24T05:53:53.560 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-11-24T05:53:53.560 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-11-24T05:53:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2023-11-24T05:53:58.184 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T05:53:58.280 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:53:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:53:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T05:53:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-11-24T05:53:59.629 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:53:59.629 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T05:53:59.629 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2023-11-24T05:53:59.629 INFO:teuthology.orchestra.run.smithi031.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-24T05:53:59.629 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T05:53:59.629 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2023-11-24T05:53:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T05:53:59.905 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-24T05:53:59.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:53:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:54:00.051 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-24T05:54:00.052 DEBUG:teuthology.orchestra.run.smithi031:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-24T05:54:00.054 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi031.front.sepia.ceph.com to complete... 2023-11-24T05:54:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:54:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T05:54:01.322 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:54:01.322 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T05:54:01.322 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2023-11-24T05:54:01.322 INFO:teuthology.orchestra.run.smithi022.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-24T05:54:01.322 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T05:54:01.322 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-11-24T05:54:01.608 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-24T05:54:01.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:54:01.758 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-24T05:54:01.758 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-24T05:54:01.761 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi022.front.sepia.ceph.com to complete... 2023-11-24T05:54:19.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24 05:54:19 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-24T05:54:19.371 INFO:teuthology.orchestra.run.smithi031.stderr:FINISHED --2023-11-24 05:54:19-- 2023-11-24T05:54:19.371 INFO:teuthology.orchestra.run.smithi031.stderr:Total wall clock time: 19s 2023-11-24T05:54:19.371 INFO:teuthology.orchestra.run.smithi031.stderr:Downloaded: 1 files, 306M in 19s (16.2 MB/s) 2023-11-24T05:54:19.372 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-24T05:54:19.372 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-24T05:54:21.313 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying... ######################################## 2023-11-24T05:54:21.367 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing... ######################################## 2023-11-24T05:54:21.451 INFO:teuthology.orchestra.run.smithi031.stdout:Updating / installing... 2023-11-24T05:54:21.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24 05:54:21 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-24T05:54:21.650 INFO:teuthology.orchestra.run.smithi022.stderr:FINISHED --2023-11-24 05:54:21-- 2023-11-24T05:54:21.650 INFO:teuthology.orchestra.run.smithi022.stderr:Total wall clock time: 20s 2023-11-24T05:54:21.650 INFO:teuthology.orchestra.run.smithi022.stderr:Downloaded: 1 files, 306M in 20s (15.7 MB/s) 2023-11-24T05:54:21.651 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-24T05:54:21.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-24T05:54:23.598 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying... ######################################## 2023-11-24T05:54:23.655 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing... ######################################## 2023-11-24T05:54:23.739 INFO:teuthology.orchestra.run.smithi022.stdout:Updating / installing... 2023-11-24T05:54:28.800 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-24T05:54:31.125 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-24T05:54:43.605 INFO:teuthology.orchestra.run.smithi031.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-24T05:54:46.219 INFO:teuthology.orchestra.run.smithi022.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-24T05:55:05.380 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-24T05:55:05.380 DEBUG:teuthology.orchestra.run.smithi031:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-24T05:55:05.465 INFO:teuthology.orchestra.run.smithi031.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T05:55:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-24T05:55:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T05:55:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-24T05:55:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-24T05:55:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-24T05:55:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-24T05:55:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-24T05:55:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T05:55:05.466 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T05:55:05.467 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T05:55:05.483 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T05:55:05.483 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T05:55:05.483 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T05:55:05.483 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T05:55:05.483 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T05:55:05.483 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T05:55:05.483 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T05:55:05.483 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-24T05:55:05.483 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-24T05:55:05.484 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-24T05:55:05.484 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T05:55:05.484 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-24T05:55:05.484 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T05:55:05.484 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T05:55:05.484 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T05:55:05.484 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-24T05:55:05.485 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T05:55:05.485 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T05:55:05.485 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T05:55:05.485 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-24T05:55:05.485 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T05:55:05.485 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T05:55:05.485 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T05:55:05.485 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T05:55:05.486 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T05:55:05.486 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T05:55:05.486 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T05:55:05.486 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T05:55:05.486 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T05:55:05.486 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T05:55:05.487 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T05:55:05.487 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T05:55:05.487 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T05:55:05.488 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T05:55:05.488 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T05:55:05.488 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T05:55:05.488 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T05:55:05.488 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T05:55:05.488 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T05:55:05.488 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T05:55:05.488 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T05:55:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T05:55:05.490 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T05:55:05.491 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T05:55:05.491 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T05:55:05.491 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T05:55:05.491 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-24T05:55:05.491 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-24T05:55:05.491 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T05:55:05.491 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T05:55:05.492 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-24T05:55:05.492 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T05:55:05.492 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T05:55:05.492 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T05:55:05.492 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T05:55:05.497 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T05:55:05.501 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-24T05:55:05.501 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T05:55:05.501 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T05:55:05.501 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-24T05:55:05.502 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T05:55:05.503 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T05:55:05.503 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T05:55:05.503 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T05:55:05.503 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T05:55:05.503 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T05:55:05.504 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T05:55:05.505 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T05:55:05.505 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T05:55:05.505 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T05:55:05.505 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T05:55:05.505 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T05:55:05.506 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T05:55:05.506 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T05:55:05.506 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T05:55:05.506 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T05:55:05.506 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T05:55:05.506 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T05:55:05.507 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T05:55:05.508 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T05:55:05.509 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-24T05:55:05.510 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-24T05:55:05.510 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T05:55:05.510 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-24T05:55:05.510 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-24T05:55:05.510 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T05:55:05.511 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T05:55:05.512 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-24T05:55:05.512 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-24T05:55:05.513 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T05:55:05.514 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T05:55:05.514 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-24T05:55:05.514 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T05:55:05.515 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T05:55:05.515 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T05:55:05.515 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-24T05:55:05.515 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-24T05:55:05.516 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T05:55:05.517 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-24T05:55:05.517 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-24T05:55:05.517 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T05:55:05.518 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-24T05:55:05.518 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T05:55:05.518 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-24T05:55:05.519 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T05:55:05.519 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T05:55:05.519 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T05:55:05.519 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T05:55:05.520 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T05:55:05.520 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-24T05:55:05.520 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T05:55:05.520 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T05:55:05.520 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T05:55:05.521 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T05:55:05.521 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T05:55:05.521 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T05:55:05.521 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T05:55:05.522 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-24T05:55:05.523 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T05:55:05.523 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T05:55:05.524 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T05:55:05.524 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-24T05:55:05.524 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-24T05:55:05.524 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T05:55:05.524 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T05:55:05.524 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T05:55:05.524 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-24T05:55:05.524 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-24T05:55:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-24T05:55:05.526 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T05:55:05.526 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T05:55:05.526 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-24T05:55:05.526 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-24T05:55:05.526 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-24T05:55:05.527 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T05:55:05.527 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-24T05:55:05.527 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T05:55:05.527 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T05:55:05.527 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T05:55:05.527 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-24T05:55:05.528 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T05:55:05.529 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T05:55:05.530 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T05:55:05.531 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T05:55:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T05:55:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T05:55:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T05:55:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T05:55:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T05:55:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T05:55:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T05:55:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T05:55:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T05:55:05.533 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T05:55:05.533 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T05:55:05.533 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T05:55:05.533 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T05:55:05.533 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T05:55:05.534 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T05:55:05.534 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T05:55:05.534 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T05:55:05.534 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T05:55:05.534 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T05:55:05.534 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T05:55:05.534 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T05:55:05.534 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T05:55:05.535 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T05:55:05.536 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-24T05:55:05.537 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T05:55:05.537 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T05:55:05.537 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T05:55:05.537 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-24T05:55:05.537 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T05:55:05.538 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T05:55:05.538 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T05:55:05.538 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T05:55:05.538 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T05:55:05.538 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T05:55:05.538 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T05:55:05.538 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T05:55:05.539 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T05:55:05.540 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T05:55:05.541 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T05:55:05.542 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T05:55:05.543 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T05:55:05.543 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T05:55:05.543 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T05:55:05.544 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T05:55:05.544 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T05:55:05.544 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T05:55:05.544 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T05:55:05.544 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T05:55:05.544 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T05:55:05.544 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T05:55:05.544 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T05:55:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T05:55:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T05:55:05.547 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T05:55:05.547 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-24T05:55:05.547 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T05:55:05.547 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T05:55:05.547 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T05:55:05.547 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T05:55:05.547 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T05:55:05.547 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T05:55:05.548 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T05:55:05.549 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T05:55:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T05:55:05.551 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T05:55:05.552 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T05:55:05.553 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T05:55:05.553 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T05:55:05.553 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T05:55:05.553 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T05:55:05.553 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-24T05:55:05.553 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T05:55:05.554 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-24T05:55:05.554 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T05:55:05.554 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T05:55:05.554 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-24T05:55:05.554 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-24T05:55:05.555 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-24T05:55:05.556 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T05:55:05.557 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T05:55:05.558 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T05:55:05.559 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T05:55:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T05:55:05.561 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T05:55:05.562 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-24T05:55:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T05:55:05.564 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-24T05:55:05.565 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T05:55:05.565 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T05:55:05.565 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T05:55:05.565 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T05:55:05.565 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-24T05:55:05.565 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-24T05:55:05.565 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T05:55:05.565 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T05:55:05.565 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T05:55:05.566 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-24T05:55:05.567 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T05:55:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T05:55:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-24T05:55:05.570 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T05:55:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-24T05:55:05.572 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-24T05:55:05.573 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T05:55:05.574 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-24T05:55:05.574 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T05:55:05.574 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-24T05:55:05.574 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T05:55:05.574 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-24T05:55:05.574 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T05:55:05.574 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-24T05:55:05.574 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-24T05:55:05.575 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T05:55:05.575 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-24T05:55:05.575 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-24T05:55:05.575 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T05:55:05.575 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T05:55:05.575 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T05:55:05.575 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T05:55:05.575 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T05:55:05.575 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-24T05:55:05.576 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-24T05:55:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T05:55:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T05:55:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-24T05:55:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-24T05:55:05.581 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-24T05:55:05.582 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T05:55:05.582 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-24T05:55:05.582 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T05:55:05.582 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-24T05:55:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T05:55:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T05:55:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-24T05:55:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T05:55:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T05:55:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T05:55:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T05:55:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-24T05:55:05.583 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-24T05:55:05.584 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T05:55:05.584 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T05:55:05.584 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-24T05:55:05.584 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T05:55:05.584 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T05:55:05.584 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T05:55:05.584 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T05:55:05.585 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-24T05:55:05.585 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T05:55:05.585 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-24T05:55:05.585 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T05:55:05.585 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-24T05:55:05.585 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T05:55:05.586 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-24T05:55:05.587 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T05:55:05.588 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T05:55:05.589 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-24T05:55:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-24T05:55:05.591 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T05:55:05.592 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T05:55:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-24T05:55:05.594 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-24T05:55:05.594 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T05:55:05.594 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-24T05:55:05.594 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-24T05:55:05.594 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T05:55:05.594 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T05:55:05.594 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T05:55:05.594 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T05:55:05.594 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T05:55:05.595 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T05:55:05.596 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T05:55:05.597 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T05:55:05.598 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T05:55:05.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T05:55:05.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T05:55:05.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-24T05:55:05.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-24T05:55:05.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T05:55:05.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-24T05:55:05.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T05:55:05.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T05:55:05.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T05:55:05.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-24T05:55:05.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T05:55:05.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T05:55:05.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T05:55:05.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-24T05:55:05.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T05:55:05.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-24T05:55:05.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T05:55:05.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-24T05:55:05.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T05:55:05.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T05:55:05.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-24T05:55:05.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T05:55:05.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-24T05:55:05.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-24T05:55:05.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T05:55:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T05:55:05.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T05:55:05.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T05:55:05.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-24T05:55:05.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T05:55:05.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T05:55:05.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T05:55:05.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T05:55:05.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T05:55:05.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T05:55:05.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T05:55:05.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T05:55:05.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T05:55:05.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T05:55:05.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-24T05:55:05.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T05:55:05.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T05:55:05.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T05:55:05.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T05:55:05.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T05:55:05.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T05:55:05.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T05:55:05.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-24T05:55:05.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T05:55:05.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-24T05:55:05.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T05:55:05.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T05:55:05.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T05:55:05.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T05:55:05.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T05:55:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T05:55:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T05:55:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T05:55:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T05:55:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T05:55:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T05:55:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T05:55:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T05:55:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T05:55:05.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T05:55:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T05:55:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T05:55:05.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T05:55:05.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-24T05:55:05.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-24T05:55:05.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-24T05:55:05.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-24T05:55:05.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-24T05:55:05.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-24T05:55:05.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-24T05:55:05.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T05:55:05.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T05:55:05.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-24T05:55:05.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T05:55:05.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T05:55:05.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T05:55:05.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T05:55:05.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T05:55:05.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T05:55:05.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T05:55:05.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T05:55:05.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-24T05:55:05.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T05:55:05.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-24T05:55:05.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-24T05:55:05.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T05:55:05.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T05:55:05.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T05:55:05.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T05:55:05.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T05:55:05.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-24T05:55:05.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T05:55:05.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-24T05:55:05.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T05:55:05.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-24T05:55:05.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-24T05:55:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-24T05:55:05.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-24T05:55:05.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T05:55:05.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T05:55:05.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T05:55:05.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T05:55:05.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T05:55:05.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T05:55:05.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T05:55:05.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T05:55:05.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T05:55:05.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T05:55:05.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T05:55:05.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T05:55:05.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T05:55:05.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T05:55:05.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T05:55:05.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T05:55:05.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T05:55:05.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T05:55:05.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T05:55:05.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T05:55:05.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T05:55:05.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T05:55:05.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T05:55:05.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T05:55:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T05:55:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T05:55:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T05:55:05.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T05:55:05.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T05:55:05.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T05:55:05.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T05:55:05.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T05:55:05.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T05:55:05.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T05:55:05.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T05:55:05.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T05:55:05.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T05:55:05.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T05:55:05.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T05:55:05.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T05:55:05.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T05:55:05.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T05:55:05.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T05:55:05.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T05:55:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T05:55:05.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T05:55:05.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T05:55:05.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T05:55:05.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T05:55:05.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T05:55:05.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T05:55:05.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T05:55:05.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-24T05:55:05.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T05:55:05.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T05:55:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T05:55:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T05:55:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T05:55:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T05:55:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T05:55:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T05:55:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T05:55:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T05:55:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T05:55:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T05:55:05.686 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T05:55:05.686 DEBUG:teuthology.orchestra.run.smithi031:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:postinstall scriptlet (using /bin/sh): 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-24T05:55:05.712 INFO:teuthology.orchestra.run.smithi031.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-24T05:55:05.713 INFO:teuthology.orchestra.run.smithi031.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-24T05:55:05.713 INFO:teuthology.orchestra.run.smithi031.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-24T05:55:05.713 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-24T05:55:05.713 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2023-11-24T05:55:05.713 INFO:teuthology.orchestra.run.smithi031.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-24T05:55:05.713 INFO:teuthology.orchestra.run.smithi031.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-24T05:55:05.713 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-24T05:55:05.713 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2023-11-24T05:55:05.714 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -qi grub2-tools 2023-11-24T05:55:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:Name : grub2-tools 2023-11-24T05:55:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:Epoch : 1 2023-11-24T05:55:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:Version : 2.06 2023-11-24T05:55:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:Release : 68.el9 2023-11-24T05:55:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: x86_64 2023-11-24T05:55:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Group : Unspecified 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Size : 8264254 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:License : GPLv3+ 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Packager : builder@centos.org 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Vendor : CentOS 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Summary : Support tools for GRUB. 2023-11-24T05:55:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:Description : 2023-11-24T05:55:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T05:55:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-24T05:55:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-24T05:55:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-24T05:55:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:hardware devices. 2023-11-24T05:55:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T05:55:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:This subpackage provides tools for support of all platforms. 2023-11-24T05:55:05.800 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-24T05:55:05.800 INFO:teuthology.task.kernel:Updating grub on smithi031 to boot 6.6.0-g8247bbb5b470 2023-11-24T05:55:05.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-24T05:55:06.410 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2023-11-24T05:55:07.764 INFO:teuthology.orchestra.run.smithi031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-24T05:55:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:done 2023-11-24T05:55:07.800 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-11-24T05:55:07.815 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.NaUg58RTRF 2023-11-24T05:55:07.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NaUg58RTRF 2023-11-24T05:55:07.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.NaUg58RTRF 2023-11-24T05:55:08.044 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.NaUg58RTRF is 6KB 2023-11-24T05:55:08.092 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.NaUg58RTRF 2023-11-24T05:55:08.107 DEBUG:teuthology.orchestra.run.smithi031:> sudo /bin/ls /boot/loader/entries || true 2023-11-24T05:55:08.178 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-24T05:55:08.178 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-24T05:55:08.179 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-24T05:55:08.179 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-24T05:55:08.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-24T05:55:08.204 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-24T05:55:08.205 DEBUG:teuthology.orchestra.run.smithi022:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-24T05:55:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T05:55:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-24T05:55:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T05:55:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-24T05:55:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-24T05:55:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-24T05:55:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-24T05:55:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T05:55:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T05:55:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-24T05:55:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T05:55:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T05:55:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T05:55:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T05:55:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T05:55:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T05:55:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T05:55:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T05:55:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T05:55:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T05:55:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T05:55:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T05:55:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T05:55:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T05:55:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T05:55:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T05:55:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T05:55:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T05:55:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-24T05:55:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T05:55:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T05:55:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T05:55:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T05:55:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T05:55:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-24T05:55:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T05:55:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T05:55:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T05:55:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T05:55:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-24T05:55:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T05:55:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T05:55:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-24T05:55:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T05:55:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T05:55:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T05:55:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T05:55:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T05:55:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T05:55:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T05:55:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T05:55:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-24T05:55:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T05:55:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T05:55:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T05:55:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T05:55:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T05:55:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T05:55:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T05:55:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T05:55:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T05:55:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T05:55:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T05:55:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T05:55:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T05:55:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T05:55:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T05:55:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T05:55:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T05:55:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T05:55:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T05:55:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T05:55:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T05:55:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T05:55:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T05:55:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T05:55:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T05:55:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T05:55:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T05:55:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T05:55:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T05:55:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T05:55:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T05:55:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T05:55:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T05:55:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T05:55:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T05:55:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T05:55:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T05:55:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T05:55:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T05:55:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T05:55:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T05:55:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T05:55:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T05:55:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T05:55:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T05:55:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T05:55:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T05:55:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T05:55:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T05:55:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T05:55:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T05:55:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T05:55:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T05:55:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T05:55:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-24T05:55:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T05:55:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-24T05:55:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-24T05:55:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T05:55:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T05:55:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T05:55:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T05:55:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-24T05:55:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T05:55:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-24T05:55:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T05:55:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T05:55:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T05:55:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T05:55:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T05:55:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-24T05:55:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T05:55:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-24T05:55:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T05:55:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T05:55:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T05:55:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T05:55:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-24T05:55:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T05:55:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T05:55:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T05:55:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T05:55:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T05:55:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-24T05:55:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T05:55:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T05:55:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-24T05:55:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-24T05:55:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-24T05:55:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-24T05:55:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T05:55:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T05:55:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T05:55:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-24T05:55:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T05:55:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T05:55:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T05:55:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-24T05:55:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-24T05:55:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T05:55:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-24T05:55:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T05:55:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T05:55:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-24T05:55:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T05:55:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-24T05:55:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-24T05:55:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T05:55:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-24T05:55:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-24T05:55:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T05:55:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T05:55:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T05:55:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T05:55:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T05:55:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T05:55:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-24T05:55:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T05:55:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-24T05:55:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T05:55:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-24T05:55:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T05:55:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T05:55:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-24T05:55:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T05:55:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-24T05:55:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-24T05:55:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T05:55:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-24T05:55:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T05:55:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T05:55:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-24T05:55:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T05:55:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T05:55:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-24T05:55:08.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T05:55:08.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-24T05:55:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T05:55:08.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T05:55:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-24T05:55:08.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T05:55:08.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-24T05:55:08.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T05:55:08.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T05:55:08.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-24T05:55:08.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T05:55:08.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T05:55:08.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T05:55:08.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T05:55:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T05:55:08.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T05:55:08.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T05:55:08.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-24T05:55:08.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T05:55:08.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T05:55:08.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T05:55:08.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-24T05:55:08.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-24T05:55:08.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-24T05:55:08.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T05:55:08.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-24T05:55:08.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T05:55:08.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-24T05:55:08.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T05:55:08.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-24T05:55:08.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-24T05:55:08.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T05:55:08.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-24T05:55:08.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T05:55:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T05:55:08.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T05:55:08.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T05:55:08.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T05:55:08.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T05:55:08.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T05:55:08.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T05:55:08.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T05:55:08.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T05:55:08.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T05:55:08.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T05:55:08.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-24T05:55:08.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T05:55:08.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T05:55:08.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-24T05:55:08.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-24T05:55:08.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T05:55:08.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T05:55:08.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T05:55:08.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T05:55:08.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-24T05:55:08.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T05:55:08.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T05:55:08.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T05:55:08.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T05:55:08.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T05:55:08.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T05:55:08.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T05:55:08.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T05:55:08.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T05:55:08.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T05:55:08.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T05:55:08.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T05:55:08.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T05:55:08.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-24T05:55:08.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T05:55:08.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T05:55:08.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T05:55:08.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T05:55:08.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T05:55:08.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-24T05:55:08.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T05:55:08.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T05:55:08.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-24T05:55:08.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-24T05:55:08.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T05:55:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-24T05:55:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T05:55:08.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T05:55:08.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T05:55:08.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T05:55:08.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T05:55:08.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T05:55:08.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T05:55:08.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T05:55:08.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T05:55:08.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-24T05:55:08.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T05:55:08.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T05:55:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T05:55:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T05:55:08.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-24T05:55:08.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T05:55:08.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T05:55:08.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T05:55:08.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T05:55:08.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T05:55:08.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T05:55:08.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T05:55:08.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T05:55:08.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T05:55:08.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T05:55:08.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T05:55:08.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T05:55:08.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T05:55:08.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T05:55:08.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T05:55:08.417 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T05:55:08.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T05:55:08.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T05:55:08.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T05:55:08.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T05:55:08.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T05:55:08.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T05:55:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-24T05:55:08.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-24T05:55:08.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T05:55:08.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T05:55:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T05:55:08.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-24T05:55:08.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-24T05:55:08.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T05:55:08.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-24T05:55:08.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-24T05:55:08.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-24T05:55:08.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-24T05:55:08.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T05:55:08.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-24T05:55:08.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T05:55:08.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-24T05:55:08.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T05:55:08.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-24T05:55:08.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T05:55:08.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-24T05:55:08.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T05:55:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T05:55:08.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T05:55:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T05:55:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T05:55:08.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T05:55:08.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T05:55:08.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T05:55:08.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T05:55:08.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T05:55:08.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T05:55:08.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T05:55:08.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T05:55:08.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T05:55:08.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T05:55:08.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-24T05:55:08.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-24T05:55:08.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T05:55:08.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-24T05:55:08.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T05:55:08.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-24T05:55:08.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T05:55:08.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T05:55:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T05:55:08.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T05:55:08.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-24T05:55:08.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-24T05:55:08.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T05:55:08.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T05:55:08.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T05:55:08.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T05:55:08.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-24T05:55:08.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T05:55:08.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-24T05:55:08.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T05:55:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T05:55:08.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T05:55:08.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T05:55:08.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T05:55:08.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T05:55:08.455 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T05:55:08.456 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T05:55:08.457 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T05:55:08.457 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T05:55:08.457 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T05:55:08.462 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T05:55:08.462 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T05:55:08.462 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T05:55:08.462 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T05:55:08.463 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-24T05:55:08.464 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T05:55:08.465 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T05:55:08.466 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T05:55:08.467 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T05:55:08.468 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T05:55:08.469 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T05:55:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T05:55:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T05:55:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T05:55:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T05:55:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T05:55:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T05:55:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T05:55:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T05:55:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T05:55:08.471 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-24T05:55:08.472 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T05:55:08.472 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T05:55:08.472 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T05:55:08.473 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T05:55:08.474 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T05:55:08.475 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T05:55:08.475 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T05:55:08.475 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T05:55:08.475 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T05:55:08.475 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T05:55:08.475 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T05:55:08.475 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T05:55:08.475 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T05:55:08.476 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T05:55:08.477 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-24T05:55:08.478 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T05:55:08.479 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T05:55:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T05:55:08.481 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T05:55:08.482 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T05:55:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T05:55:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T05:55:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T05:55:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T05:55:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T05:55:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T05:55:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T05:55:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T05:55:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T05:55:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-24T05:55:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T05:55:08.486 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T05:55:08.487 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T05:55:08.487 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T05:55:08.487 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T05:55:08.487 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T05:55:08.487 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T05:55:08.487 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T05:55:08.487 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T05:55:08.487 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T05:55:08.488 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T05:55:08.488 DEBUG:teuthology.orchestra.run.smithi022:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-24T05:55:08.489 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:postinstall scriptlet (using /bin/sh): 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-24T05:55:08.515 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-24T05:55:08.516 INFO:teuthology.orchestra.run.smithi022.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-24T05:55:08.516 INFO:teuthology.orchestra.run.smithi022.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-24T05:55:08.516 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-24T05:55:08.516 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2023-11-24T05:55:08.516 INFO:teuthology.orchestra.run.smithi022.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-24T05:55:08.516 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-24T05:55:08.516 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-24T05:55:08.516 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2023-11-24T05:55:08.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2023-11-24T05:55:08.580 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-11-24T05:55:08.608 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2023-11-24T05:55:08.608 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2023-11-24T05:55:08.608 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.06 2023-11-24T05:55:08.609 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 68.el9 2023-11-24T05:55:08.609 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2023-11-24T05:55:08.609 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-24T05:55:08.609 INFO:teuthology.orchestra.run.smithi022.stdout:Group : Unspecified 2023-11-24T05:55:08.610 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 8264254 2023-11-24T05:55:08.610 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2023-11-24T05:55:08.610 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-24T05:55:08.610 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-24T05:55:08.610 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-24T05:55:08.610 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-24T05:55:08.611 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : builder@centos.org 2023-11-24T05:55:08.611 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2023-11-24T05:55:08.612 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-24T05:55:08.612 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2023-11-24T05:55:08.612 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2023-11-24T05:55:08.612 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T05:55:08.612 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-24T05:55:08.613 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-24T05:55:08.613 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-24T05:55:08.613 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2023-11-24T05:55:08.613 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T05:55:08.613 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2023-11-24T05:55:08.614 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-24T05:55:08.614 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 6.6.0-g8247bbb5b470 2023-11-24T05:55:08.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-24T05:55:09.166 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2023-11-24T05:55:10.583 INFO:teuthology.orchestra.run.smithi022.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-24T05:55:10.605 INFO:teuthology.orchestra.run.smithi022.stderr:done 2023-11-24T05:55:10.605 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2023-11-24T05:55:10.621 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.p6th6dUDCv 2023-11-24T05:55:10.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.p6th6dUDCv 2023-11-24T05:55:10.694 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.p6th6dUDCv 2023-11-24T05:55:10.841 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.p6th6dUDCv is 6KB 2023-11-24T05:55:10.890 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.p6th6dUDCv 2023-11-24T05:55:10.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2023-11-24T05:55:10.974 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-24T05:55:10.974 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-24T05:55:10.974 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-24T05:55:10.974 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-24T05:55:10.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-24T05:55:11.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2023-11-24T05:55:38.518 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-24T05:55:38.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-24T05:55:38.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:55:41.165 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-24T05:55:41.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-11-24T05:55:41.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:55:56.905 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-24T05:55:59.718 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-11-24T05:56:05.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-24T05:56:05.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:56:08.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-11-24T05:56:08.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:57:05.973 DEBUG:teuthology.orchestra.remote:timed out 2023-11-24T05:57:08.727 DEBUG:teuthology.orchestra.remote:timed out 2023-11-24T05:57:17.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-24T05:57:17.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:57:18.460 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-11-24T05:57:19.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-24T05:57:19.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g8247bbb5b470"... 2023-11-24T05:57:19.121 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2023-11-24T05:57:19.180 INFO:teuthology.orchestra.run.smithi031.stdout:6.6.0-g8247bbb5b470 2023-11-24T05:57:19.180 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T05:57:19.180 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T05:57:19.180 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-24T05:57:20.181 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-24T05:57:20.181 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-24T05:57:20.338 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2023-11-24T05:57:20.376 DEBUG:teuthology.parallel:result is None 2023-11-24T05:57:20.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-11-24T05:57:20.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:57:21.199 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-11-24T05:57:21.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-11-24T05:57:21.941 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g8247bbb5b470"... 2023-11-24T05:57:21.941 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-11-24T05:57:22.006 INFO:teuthology.orchestra.run.smithi022.stdout:6.6.0-g8247bbb5b470 2023-11-24T05:57:22.007 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T05:57:22.008 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T05:57:22.008 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-24T05:57:23.008 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-24T05:57:23.009 DEBUG:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-24T05:57:23.141 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2023-11-24T05:57:23.194 DEBUG:teuthology.parallel:result is None 2023-11-24T05:57:23.195 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-24T05:57:23.209 INFO:teuthology.task.internal:Creating test directory... 2023-11-24T05:57:23.209 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T05:57:23.224 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T05:57:23.286 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-24T05:57:23.295 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-24T05:57:23.317 INFO:teuthology.task.internal:Creating archive directory... 2023-11-24T05:57:23.317 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T05:57:23.342 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T05:57:23.426 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-24T05:57:23.433 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-24T05:57:23.434 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T05:57:23.444 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T05:57:23.571 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T05:57:23.577 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T05:57:23.616 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T05:57:23.628 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T05:57:23.632 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-24T05:57:23.641 INFO:teuthology.task.internal:Configuring sudo... 2023-11-24T05:57:23.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T05:57:23.661 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T05:57:23.772 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-24T05:57:23.787 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-24T05:57:23.794 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T05:57:23.807 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T05:57:23.872 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T05:57:23.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T05:57:24.090 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T05:57:24.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T05:57:24.289 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T05:57:24.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T05:57:24.397 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T05:57:24.500 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T05:57:24.642 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T05:57:24.734 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T05:57:24.844 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T05:57:24.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T05:57:24.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2023-11-24T05:57:24.958 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2023-11-24T05:57:25.087 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T05:57:25.127 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T05:57:25.460 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-24T05:57:25.469 INFO:teuthology.task.internal:Starting timer... 2023-11-24T05:57:25.469 INFO:teuthology.run_tasks:Running task pcp... 2023-11-24T05:57:25.516 INFO:teuthology.run_tasks:Running task selinux... 2023-11-24T05:57:25.563 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2023-11-24T05:57:25.711 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2023-11-24T05:57:25.716 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2023-11-24T05:57:25.882 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2023-11-24T05:57:25.887 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-24T05:57:25.888 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2023-11-24T05:57:25.960 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2023-11-24T05:57:25.967 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2023-11-24T05:57:26.035 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2023-11-24T05:57:26.035 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi031.front.sepia.ceph.com': 'permissive'} 2023-11-24T05:57:26.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T05:57:26.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T05:57:26.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T05:57:26.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T05:57:26.252 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-24T05:57:26.252 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2023-11-24T05:57:26.365 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2023-11-24T05:57:26.474 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-24T05:57:26.486 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-24T05:57:26.518 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-24T05:57:26.946 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-24T05:57:27.011 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-24T05:57:27.013 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi031.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-24T06:08:43.970 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi031.front.sepia.ceph.com')] 2023-11-24T06:08:43.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-11-24T06:08:43.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:08:44.118 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-11-24T06:08:44.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-11-24T06:08:44.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-24T06:08:44.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:08:44.426 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-11-24T06:08:44.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-24T06:08:44.579 INFO:teuthology.run_tasks:Running task clock... 2023-11-24T06:08:44.589 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-24T06:08:44.589 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T06:08:44.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:08:44.598 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T06:08:44.598 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:08:44.706 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T06:08:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T06:08:44.767 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T06:08:44.770 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T06:08:44.870 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2023-11-24T06:08:44.871 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2023-11-24T06:08:44.915 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2023-11-24T06:08:44.916 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2023-11-24T06:08:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T06:08:44.971 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T06:08:45.030 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T06:08:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T06:08:45.158 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2023-11-24T06:08:45.160 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2023-11-24T06:08:45.167 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:08:45.167 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2023-11-24T06:08:45.167 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:08:45.167 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:08:45.167 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:08:45.167 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:08:45.168 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:08:45.169 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2023-11-24T06:08:45.169 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:08:45.169 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:08:45.169 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:08:45.169 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:08:45.170 INFO:teuthology.run_tasks:Running task install... 2023-11-24T06:08:45.178 DEBUG:teuthology.task.install:project ceph 2023-11-24T06:08:45.178 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}} 2023-11-24T06:08:45.178 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'} 2023-11-24T06:08:45.178 INFO:teuthology.task.install:Using flavor: default 2023-11-24T06:08:45.184 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-24T06:08:45.184 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-24T06:08:45.185 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T06:08:45.185 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:08:45.187 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T06:08:45.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:08:45.334 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/ 2023-11-24T06:08:45.334 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T06:08:45.442 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T06:08:45.442 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:08:45.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T06:08:45.452 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/ 2023-11-24T06:08:45.452 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T06:08:45.554 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T06:08:45.555 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T06:08:45.559 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T06:08:45.560 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:08:45.560 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T06:08:45.668 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T06:08:45.669 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T06:08:45.704 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T06:08:45.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T06:08:45.852 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T06:08:45.955 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2023-11-24T06:08:45.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2023-11-24T06:08:45.966 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T06:08:46.062 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2023-11-24T06:08:46.066 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2023-11-24T06:08:46.341 INFO:teuthology.orchestra.run.smithi022.stdout:73 files removed 2023-11-24T06:08:46.381 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T06:08:46.437 INFO:teuthology.orchestra.run.smithi031.stdout:73 files removed 2023-11-24T06:08:46.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T06:08:47.652 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 105 kB/s | 78 kB 00:00 2023-11-24T06:08:47.956 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 82 kB/s | 78 kB 00:00 2023-11-24T06:08:48.285 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 18 kB/s | 9.5 kB 00:00 2023-11-24T06:08:48.624 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 17 kB/s | 9.5 kB 00:00 2023-11-24T06:08:48.959 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 3.2 kB/s | 1.9 kB 00:00 2023-11-24T06:08:49.424 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 2.6 kB/s | 1.9 kB 00:00 2023-11-24T06:08:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - AppStream 8.3 MB/s | 6.4 MB 00:00 2023-11-24T06:08:50.171 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - AppStream 9.6 MB/s | 6.4 MB 00:00 2023-11-24T06:08:51.472 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2023-11-24T06:08:51.896 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2023-11-24T06:08:53.319 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 7.9 MB 00:01 2023-11-24T06:08:54.417 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 7.9 MB 00:02 2023-11-24T06:08:55.453 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 21 MB/s | 18 MB 00:00 2023-11-24T06:08:59.440 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 18 MB 00:03 2023-11-24T06:09:02.029 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 5.8 MB 00:02 2023-11-24T06:09:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 15 kB 00:00 2023-11-24T06:09:07.162 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 6.9 MB/s | 20 MB 00:02 2023-11-24T06:09:08.302 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 5.8 MB 00:05 2023-11-24T06:09:10.053 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2023-11-24T06:09:13.042 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-11-24T06:09:13.042 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-11-24T06:09:15.987 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T06:09:15.989 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T06:09:16.010 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-24T06:09:16.011 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-24T06:09:16.013 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-24T06:09:16.014 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-24T06:09:16.017 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-24T06:09:16.021 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-24T06:09:16.022 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-24T06:09:16.110 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-11-24T06:09:16.133 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================================ 2023-11-24T06:09:16.133 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-11-24T06:09:16.133 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================================ 2023-11-24T06:09:16.133 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-11-24T06:09:16.133 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-24T06:09:16.133 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 6.5 k 2023-11-24T06:09:16.133 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 5.2 M 2023-11-24T06:09:16.133 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 859 k 2023-11-24T06:09:16.133 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 141 k 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 1.5 M 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 133 k 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 1.8 M 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 7.4 M 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 50 k 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 8.6 M 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 41 M 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 262 k 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 772 k 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 217 k 2023-11-24T06:09:16.134 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 18 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 31 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 719 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 126 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-24T06:09:16.135 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 162 k 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 319 k 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 298 k 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 99 k 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 85 k 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 170 k 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-24T06:09:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.3 M 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-24T06:09:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 19 M 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 28 k 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 2.1 M 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 243 k 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.4 M 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 18 M 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 15 k 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 24 k 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-24T06:09:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 163 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 476 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.8 M 2023-11-24T06:09:16.139 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-24T06:09:16.140 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 45 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 129 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-24T06:09:16.141 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-24T06:09:16.142 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-24T06:09:16.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-24T06:09:16.144 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================================ 2023-11-24T06:09:16.145 INFO:teuthology.orchestra.run.smithi022.stdout:Install 132 Packages 2023-11-24T06:09:16.146 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 15 Packages 2023-11-24T06:09:16.146 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:09:16.146 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 204 M 2023-11-24T06:09:16.146 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-11-24T06:09:17.372 INFO:teuthology.orchestra.run.smithi022.stdout:(1/147): ceph-18.0.0-7484.ga13ea5ff.el9.x86_64. 18 kB/s | 6.5 kB 00:00 2023-11-24T06:09:17.920 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2023-11-24T06:09:18.623 INFO:teuthology.orchestra.run.smithi022.stdout:(2/147): ceph-base-18.0.0-7484.ga13ea5ff.el9.x8 3.2 MB/s | 5.2 MB 00:01 2023-11-24T06:09:18.674 INFO:teuthology.orchestra.run.smithi022.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 2.8 MB/s | 141 kB 00:00 2023-11-24T06:09:18.833 INFO:teuthology.orchestra.run.smithi022.stdout:(4/147): ceph-fuse-18.0.0-7484.ga13ea5ff.el9.x8 589 kB/s | 859 kB 00:01 2023-11-24T06:09:18.958 INFO:teuthology.orchestra.run.smithi022.stdout:(5/147): ceph-mds-18.0.0-7484.ga13ea5ff.el9.x86 7.4 MB/s | 2.1 MB 00:00 2023-11-24T06:09:19.466 INFO:teuthology.orchestra.run.smithi022.stdout:(6/147): ceph-mon-18.0.0-7484.ga13ea5ff.el9.x86 8.7 MB/s | 4.4 MB 00:00 2023-11-24T06:09:19.792 INFO:teuthology.orchestra.run.smithi022.stdout:(7/147): ceph-common-18.0.0-7484.ga13ea5ff.el9. 6.8 MB/s | 19 MB 00:02 2023-11-24T06:09:20.242 INFO:teuthology.orchestra.run.smithi022.stdout:(8/147): ceph-mgr-18.0.0-7484.ga13ea5ff.el9.x86 1.0 MB/s | 1.5 MB 00:01 2023-11-24T06:09:20.359 INFO:teuthology.orchestra.run.smithi022.stdout:(9/147): ceph-selinux-18.0.0-7484.ga13ea5ff.el9 208 kB/s | 24 kB 00:00 2023-11-24T06:09:20.759 INFO:teuthology.orchestra.run.smithi022.stdout:(10/147): ceph-radosgw-18.0.0-7484.ga13ea5ff.el 8.9 MB/s | 8.6 MB 00:00 2023-11-24T06:09:20.818 INFO:teuthology.orchestra.run.smithi022.stdout:(11/147): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 3.7 MB/s | 217 kB 00:00 2023-11-24T06:09:20.868 INFO:teuthology.orchestra.run.smithi022.stdout:(12/147): libcephfs-devel-18.0.0-7484.ga13ea5ff 634 kB/s | 31 kB 00:00 2023-11-24T06:09:20.975 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T06:09:20.977 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T06:09:20.997 INFO:teuthology.orchestra.run.smithi031.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-24T06:09:20.999 INFO:teuthology.orchestra.run.smithi031.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-24T06:09:21.000 INFO:teuthology.orchestra.run.smithi031.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-24T06:09:21.002 INFO:teuthology.orchestra.run.smithi031.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-24T06:09:21.004 INFO:teuthology.orchestra.run.smithi031.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-24T06:09:21.008 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-24T06:09:21.009 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-24T06:09:21.093 INFO:teuthology.orchestra.run.smithi022.stdout:(13/147): ceph-osd-18.0.0-7484.ga13ea5ff.el9.x8 11 MB/s | 18 MB 00:01 2023-11-24T06:09:21.095 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2023-11-24T06:09:21.115 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================================ 2023-11-24T06:09:21.115 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2023-11-24T06:09:21.115 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================================ 2023-11-24T06:09:21.115 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2023-11-24T06:09:21.115 INFO:teuthology.orchestra.run.smithi031.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 6.5 k 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 5.2 M 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 859 k 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 141 k 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 1.5 M 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 133 k 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 1.8 M 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 7.4 M 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 50 k 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 8.6 M 2023-11-24T06:09:21.116 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 41 M 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 262 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 772 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 217 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 18 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 31 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 719 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 126 k 2023-11-24T06:09:21.117 INFO:teuthology.orchestra.run.smithi031.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 162 k 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 319 k 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 298 k 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 99 k 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 85 k 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T06:09:21.118 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 170 k 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-24T06:09:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.3 M 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-24T06:09:21.120 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 19 M 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 28 k 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 2.1 M 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 243 k 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.4 M 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 18 M 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 15 k 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 24 k 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-24T06:09:21.121 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 163 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 476 k 2023-11-24T06:09:21.122 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.8 M 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-24T06:09:21.123 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 45 k 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 129 k 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-24T06:09:21.124 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-24T06:09:21.125 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-24T06:09:21.126 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-24T06:09:21.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-24T06:09:21.128 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-24T06:09:21.129 INFO:teuthology.orchestra.run.smithi031.stdout:Installing weak dependencies: 2023-11-24T06:09:21.129 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-24T06:09:21.129 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:09:21.129 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2023-11-24T06:09:21.129 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================================ 2023-11-24T06:09:21.129 INFO:teuthology.orchestra.run.smithi031.stdout:Install 132 Packages 2023-11-24T06:09:21.129 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 15 Packages 2023-11-24T06:09:21.129 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:09:21.129 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 204 M 2023-11-24T06:09:21.130 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2023-11-24T06:09:21.143 INFO:teuthology.orchestra.run.smithi022.stdout:(14/147): libcephfs2-18.0.0-7484.ga13ea5ff.el9. 2.6 MB/s | 719 kB 00:00 2023-11-24T06:09:21.169 INFO:teuthology.orchestra.run.smithi022.stdout:(15/147): libcephsqlite-18.0.0-7484.ga13ea5ff.e 2.1 MB/s | 163 kB 00:00 2023-11-24T06:09:21.228 INFO:teuthology.orchestra.run.smithi022.stdout:(16/147): librados-devel-18.0.0-7484.ga13ea5ff. 1.5 MB/s | 126 kB 00:00 2023-11-24T06:09:21.270 INFO:teuthology.orchestra.run.smithi022.stdout:(17/147): libradosstriper1-18.0.0-7484.ga13ea5f 4.7 MB/s | 476 kB 00:00 2023-11-24T06:09:21.403 INFO:teuthology.orchestra.run.smithi022.stdout:(18/147): python3-ceph-argparse-18.0.0-7484.ga1 340 kB/s | 45 kB 00:00 2023-11-24T06:09:21.470 INFO:teuthology.orchestra.run.smithi022.stdout:(19/147): python3-ceph-common-18.0.0-7484.ga13e 1.9 MB/s | 129 kB 00:00 2023-11-24T06:09:21.537 INFO:teuthology.orchestra.run.smithi022.stdout:(20/147): python3-cephfs-18.0.0-7484.ga13ea5ff. 2.4 MB/s | 162 kB 00:00 2023-11-24T06:09:21.637 INFO:teuthology.orchestra.run.smithi022.stdout:(21/147): librgw2-18.0.0-7484.ga13ea5ff.el9.x86 12 MB/s | 4.8 MB 00:00 2023-11-24T06:09:21.679 INFO:teuthology.orchestra.run.smithi022.stdout:(22/147): python3-rados-18.0.0-7484.ga13ea5ff.e 2.2 MB/s | 319 kB 00:00 2023-11-24T06:09:21.713 INFO:teuthology.orchestra.run.smithi022.stdout:(23/147): python3-rbd-18.0.0-7484.ga13ea5ff.el9 3.9 MB/s | 298 kB 00:00 2023-11-24T06:09:21.746 INFO:teuthology.orchestra.run.smithi022.stdout:(24/147): python3-rgw-18.0.0-7484.ga13ea5ff.el9 1.5 MB/s | 99 kB 00:00 2023-11-24T06:09:21.772 INFO:teuthology.orchestra.run.smithi022.stdout:(25/147): rbd-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.4 MB/s | 85 kB 00:00 2023-11-24T06:09:21.847 INFO:teuthology.orchestra.run.smithi022.stdout:(26/147): rbd-nbd-18.0.0-7484.ga13ea5ff.el9.x86 2.2 MB/s | 170 kB 00:00 2023-11-24T06:09:21.975 INFO:teuthology.orchestra.run.smithi022.stdout:(27/147): rbd-mirror-18.0.0-7484.ga13ea5ff.el9. 13 MB/s | 3.0 MB 00:00 2023-11-24T06:09:22.006 INFO:teuthology.orchestra.run.smithi022.stdout:(28/147): ceph-grafana-dashboards-18.0.0-7484.g 178 kB/s | 28 kB 00:00 2023-11-24T06:09:22.056 INFO:teuthology.orchestra.run.smithi022.stdout:(29/147): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 2.7 MB/s | 133 kB 00:00 2023-11-24T06:09:22.198 INFO:teuthology.orchestra.run.smithi022.stdout:(30/147): ceph-mgr-dashboard-18.0.0-7484.ga13ea 9.2 MB/s | 1.8 MB 00:00 2023-11-24T06:09:22.272 INFO:teuthology.orchestra.run.smithi031.stdout:(1/147): ceph-18.0.0-7484.ga13ea5ff.el9.x86_64. 22 kB/s | 6.5 kB 00:00 2023-11-24T06:09:22.290 INFO:teuthology.orchestra.run.smithi022.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7484.ga1 2.6 MB/s | 243 kB 00:00 2023-11-24T06:09:22.390 INFO:teuthology.orchestra.run.smithi022.stdout:(32/147): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 507 kB/s | 50 kB 00:00 2023-11-24T06:09:22.441 INFO:teuthology.orchestra.run.smithi022.stdout:(33/147): ceph-prometheus-alerts-18.0.0-7484.ga 311 kB/s | 15 kB 00:00 2023-11-24T06:09:22.574 INFO:teuthology.orchestra.run.smithi022.stdout:(34/147): ceph-mgr-diskprediction-local-18.0.0- 14 MB/s | 7.4 MB 00:00 2023-11-24T06:09:22.608 INFO:teuthology.orchestra.run.smithi022.stdout:(35/147): ceph-volume-18.0.0-7484.ga13ea5ff.el9 1.5 MB/s | 262 kB 00:00 2023-11-24T06:09:22.666 INFO:teuthology.orchestra.run.smithi022.stdout:(36/147): cephadm-18.0.0-7484.ga13ea5ff.el9.noa 8.3 MB/s | 772 kB 00:00 2023-11-24T06:09:22.692 INFO:teuthology.orchestra.run.smithi022.stdout:(37/147): cephfs-top-18.0.0-7484.ga13ea5ff.el9. 221 kB/s | 18 kB 00:00 2023-11-24T06:09:22.992 INFO:teuthology.orchestra.run.smithi022.stdout:(38/147): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 920 kB 00:00 2023-11-24T06:09:23.025 INFO:teuthology.orchestra.run.smithi022.stdout:(39/147): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2023-11-24T06:09:23.030 INFO:teuthology.orchestra.run.smithi031.stdout:(2/147): ceph-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.1 MB/s | 859 kB 00:00 2023-11-24T06:09:23.051 INFO:teuthology.orchestra.run.smithi022.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-11-24T06:09:23.084 INFO:teuthology.orchestra.run.smithi022.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 376 kB/s | 21 kB 00:00 2023-11-24T06:09:23.122 INFO:teuthology.orchestra.run.smithi031.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 1.5 MB/s | 141 kB 00:00 2023-11-24T06:09:23.126 INFO:teuthology.orchestra.run.smithi022.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2023-11-24T06:09:23.152 INFO:teuthology.orchestra.run.smithi022.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 500 kB/s | 32 kB 00:00 2023-11-24T06:09:23.294 INFO:teuthology.orchestra.run.smithi022.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2023-11-24T06:09:23.319 INFO:teuthology.orchestra.run.smithi022.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 105 kB/s | 17 kB 00:00 2023-11-24T06:09:23.369 INFO:teuthology.orchestra.run.smithi022.stdout:(46/147): jq-1.6-16.el9.x86_64.rpm 3.7 MB/s | 186 kB 00:00 2023-11-24T06:09:23.394 INFO:teuthology.orchestra.run.smithi022.stdout:(47/147): libaio-devel-0.3.111-13.el9.x86_64.rp 136 kB/s | 10 kB 00:00 2023-11-24T06:09:23.445 INFO:teuthology.orchestra.run.smithi022.stdout:(48/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 910 kB/s | 44 kB 00:00 2023-11-24T06:09:23.478 INFO:teuthology.orchestra.run.smithi022.stdout:(49/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2023-11-24T06:09:23.537 INFO:teuthology.orchestra.run.smithi022.stdout:(50/147): librdkafka-1.6.1-102.el9.x86_64.rpm 7.2 MB/s | 661 kB 00:00 2023-11-24T06:09:23.587 INFO:teuthology.orchestra.run.smithi022.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 5.6 MB/s | 578 kB 00:00 2023-11-24T06:09:23.613 INFO:teuthology.orchestra.run.smithi022.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 354 kB/s | 24 kB 00:00 2023-11-24T06:09:23.614 INFO:teuthology.orchestra.run.smithi031.stdout:(4/147): ceph-mds-18.0.0-7484.ga13ea5ff.el9.x86 4.3 MB/s | 2.1 MB 00:00 2023-11-24T06:09:23.638 INFO:teuthology.orchestra.run.smithi022.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 46 kB 00:00 2023-11-24T06:09:23.671 INFO:teuthology.orchestra.run.smithi022.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-11-24T06:09:23.705 INFO:teuthology.orchestra.run.smithi022.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-11-24T06:09:23.730 INFO:teuthology.orchestra.run.smithi022.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 611 kB/s | 34 kB 00:00 2023-11-24T06:09:23.839 INFO:teuthology.orchestra.run.smithi031.stdout:(5/147): ceph-mgr-18.0.0-7484.ga13ea5ff.el9.x86 6.5 MB/s | 1.5 MB 00:00 2023-11-24T06:09:23.872 INFO:teuthology.orchestra.run.smithi022.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 29 MB/s | 4.7 MB 00:00 2023-11-24T06:09:23.923 INFO:teuthology.orchestra.run.smithi022.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 8.8 MB/s | 1.5 MB 00:00 2023-11-24T06:09:23.965 INFO:teuthology.orchestra.run.smithi022.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 8.8 MB/s | 811 kB 00:00 2023-11-24T06:09:23.990 INFO:teuthology.orchestra.run.smithi022.stdout:(60/147): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2023-11-24T06:09:24.149 INFO:teuthology.orchestra.run.smithi022.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2023-11-24T06:09:24.316 INFO:teuthology.orchestra.run.smithi022.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2023-11-24T06:09:24.331 INFO:teuthology.orchestra.run.smithi031.stdout:(6/147): ceph-mon-18.0.0-7484.ga13ea5ff.el9.x86 8.9 MB/s | 4.4 MB 00:00 2023-11-24T06:09:24.340 INFO:teuthology.orchestra.run.smithi022.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2023-11-24T06:09:24.391 INFO:teuthology.orchestra.run.smithi022.stdout:(64/147): python3-jsonpatch-1.21-16.el9.noarch. 501 kB/s | 24 kB 00:00 2023-11-24T06:09:24.416 INFO:teuthology.orchestra.run.smithi022.stdout:(65/147): python3-jsonpointer-2.0-4.el9.noarch. 246 kB/s | 18 kB 00:00 2023-11-24T06:09:24.466 INFO:teuthology.orchestra.run.smithi022.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-11-24T06:09:24.491 INFO:teuthology.orchestra.run.smithi022.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 428 kB/s | 32 kB 00:00 2023-11-24T06:09:24.542 INFO:teuthology.orchestra.run.smithi022.stdout:(68/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.4 MB/s | 217 kB 00:00 2023-11-24T06:09:24.675 INFO:teuthology.orchestra.run.smithi022.stdout:(69/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-11-24T06:09:24.700 INFO:teuthology.orchestra.run.smithi022.stdout:(70/147): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2023-11-24T06:09:24.742 INFO:teuthology.orchestra.run.smithi022.stdout:(71/147): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2023-11-24T06:09:24.768 INFO:teuthology.orchestra.run.smithi022.stdout:(72/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-11-24T06:09:24.815 INFO:teuthology.orchestra.run.smithi031.stdout:(7/147): ceph-common-18.0.0-7484.ga13ea5ff.el9. 6.7 MB/s | 19 MB 00:02 2023-11-24T06:09:24.818 INFO:teuthology.orchestra.run.smithi022.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 4.2 MB/s | 211 kB 00:00 2023-11-24T06:09:24.835 INFO:teuthology.orchestra.run.smithi022.stdout:(74/147): python3-pytz-2021.1-5.el9.noarch.rpm 724 kB/s | 47 kB 00:00 2023-11-24T06:09:24.896 INFO:teuthology.orchestra.run.smithi022.stdout:(75/147): python3-requests-oauthlib-1.3.0-12.el 723 kB/s | 43 kB 00:00 2023-11-24T06:09:25.179 INFO:teuthology.orchestra.run.smithi022.stdout:(76/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2023-11-24T06:09:25.196 INFO:teuthology.orchestra.run.smithi022.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 135 kB/s | 39 kB 00:00 2023-11-24T06:09:25.238 INFO:teuthology.orchestra.run.smithi022.stdout:(78/147): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 56 kB 00:00 2023-11-24T06:09:25.272 INFO:teuthology.orchestra.run.smithi022.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 300 kB 00:00 2023-11-24T06:09:25.289 INFO:teuthology.orchestra.run.smithi022.stdout:(80/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.8 MB/s | 85 kB 00:00 2023-11-24T06:09:25.314 INFO:teuthology.orchestra.run.smithi022.stdout:(81/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-11-24T06:09:25.331 INFO:teuthology.orchestra.run.smithi022.stdout:(82/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-11-24T06:09:25.365 INFO:teuthology.orchestra.run.smithi022.stdout:(83/147): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-11-24T06:09:25.415 INFO:teuthology.orchestra.run.smithi022.stdout:(84/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.5 MB/s | 803 kB 00:00 2023-11-24T06:09:25.448 INFO:teuthology.orchestra.run.smithi022.stdout:(85/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2023-11-24T06:09:25.482 INFO:teuthology.orchestra.run.smithi022.stdout:(86/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-11-24T06:09:25.541 INFO:teuthology.orchestra.run.smithi022.stdout:(87/147): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2023-11-24T06:09:25.566 INFO:teuthology.orchestra.run.smithi022.stdout:(88/147): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-11-24T06:09:25.578 INFO:teuthology.orchestra.run.smithi031.stdout:(8/147): ceph-radosgw-18.0.0-7484.ga13ea5ff.el9 11 MB/s | 8.6 MB 00:00 2023-11-24T06:09:25.591 INFO:teuthology.orchestra.run.smithi022.stdout:(89/147): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-11-24T06:09:25.617 INFO:teuthology.orchestra.run.smithi022.stdout:(90/147): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-11-24T06:09:25.623 INFO:teuthology.orchestra.run.smithi031.stdout:(9/147): ceph-selinux-18.0.0-7484.ga13ea5ff.el9 543 kB/s | 24 kB 00:00 2023-11-24T06:09:25.650 INFO:teuthology.orchestra.run.smithi022.stdout:(91/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-24T06:09:25.859 INFO:teuthology.orchestra.run.smithi022.stdout:(92/147): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2023-11-24T06:09:25.986 INFO:teuthology.orchestra.run.smithi031.stdout:(10/147): ceph-osd-18.0.0-7484.ga13ea5ff.el9.x8 11 MB/s | 18 MB 00:01 2023-11-24T06:09:26.078 INFO:teuthology.orchestra.run.smithi031.stdout:(11/147): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 2.3 MB/s | 217 kB 00:00 2023-11-24T06:09:26.128 INFO:teuthology.orchestra.run.smithi031.stdout:(12/147): libcephfs-devel-18.0.0-7484.ga13ea5ff 635 kB/s | 31 kB 00:00 2023-11-24T06:09:26.237 INFO:teuthology.orchestra.run.smithi031.stdout:(13/147): libcephfs2-18.0.0-7484.ga13ea5ff.el9. 6.5 MB/s | 719 kB 00:00 2023-11-24T06:09:26.312 INFO:teuthology.orchestra.run.smithi031.stdout:(14/147): libcephsqlite-18.0.0-7484.ga13ea5ff.e 2.2 MB/s | 163 kB 00:00 2023-11-24T06:09:26.379 INFO:teuthology.orchestra.run.smithi031.stdout:(15/147): librados-devel-18.0.0-7484.ga13ea5ff. 1.9 MB/s | 126 kB 00:00 2023-11-24T06:09:26.471 INFO:teuthology.orchestra.run.smithi031.stdout:(16/147): libradosstriper1-18.0.0-7484.ga13ea5f 5.1 MB/s | 476 kB 00:00 2023-11-24T06:09:26.717 INFO:teuthology.orchestra.run.smithi022.stdout:(93/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.8 MB/s | 4.1 MB 00:01 2023-11-24T06:09:26.751 INFO:teuthology.orchestra.run.smithi022.stdout:(94/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 347 kB/s | 309 kB 00:00 2023-11-24T06:09:26.913 INFO:teuthology.orchestra.run.smithi031.stdout:(17/147): librgw2-18.0.0-7484.ga13ea5ff.el9.x86 11 MB/s | 4.8 MB 00:00 2023-11-24T06:09:26.926 INFO:teuthology.orchestra.run.smithi022.stdout:(95/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 140 kB/s | 24 kB 00:00 2023-11-24T06:09:26.989 INFO:teuthology.orchestra.run.smithi031.stdout:(18/147): python3-ceph-argparse-18.0.0-7484.ga1 611 kB/s | 45 kB 00:00 2023-11-24T06:09:27.060 INFO:teuthology.orchestra.run.smithi022.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 366 kB/s | 49 kB 00:00 2023-11-24T06:09:27.064 INFO:teuthology.orchestra.run.smithi031.stdout:(19/147): python3-ceph-common-18.0.0-7484.ga13e 1.7 MB/s | 129 kB 00:00 2023-11-24T06:09:27.131 INFO:teuthology.orchestra.run.smithi031.stdout:(20/147): python3-cephfs-18.0.0-7484.ga13ea5ff. 2.4 MB/s | 162 kB 00:00 2023-11-24T06:09:27.202 INFO:teuthology.orchestra.run.smithi022.stdout:(97/147): libunwind-1.6.2-1.el9.x86_64.rpm 477 kB/s | 67 kB 00:00 2023-11-24T06:09:27.223 INFO:teuthology.orchestra.run.smithi031.stdout:(21/147): python3-rados-18.0.0-7484.ga13ea5ff.e 3.4 MB/s | 319 kB 00:00 2023-11-24T06:09:27.290 INFO:teuthology.orchestra.run.smithi031.stdout:(22/147): python3-rbd-18.0.0-7484.ga13ea5ff.el9 4.4 MB/s | 298 kB 00:00 2023-11-24T06:09:27.373 INFO:teuthology.orchestra.run.smithi031.stdout:(23/147): python3-rgw-18.0.0-7484.ga13ea5ff.el9 1.2 MB/s | 99 kB 00:00 2023-11-24T06:09:27.440 INFO:teuthology.orchestra.run.smithi031.stdout:(24/147): rbd-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.3 MB/s | 85 kB 00:00 2023-11-24T06:09:27.535 INFO:teuthology.orchestra.run.smithi022.stdout:(98/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.5 MB/s | 837 kB 00:00 2023-11-24T06:09:27.741 INFO:teuthology.orchestra.run.smithi031.stdout:(25/147): rbd-mirror-18.0.0-7484.ga13ea5ff.el9. 10 MB/s | 3.0 MB 00:00 2023-11-24T06:09:27.761 INFO:teuthology.orchestra.run.smithi022.stdout:(99/147): python3-asyncssh-2.13.2-3.el9.noarch. 2.4 MB/s | 548 kB 00:00 2023-11-24T06:09:27.807 INFO:teuthology.orchestra.run.smithi031.stdout:(26/147): rbd-nbd-18.0.0-7484.ga13ea5ff.el9.x86 2.5 MB/s | 170 kB 00:00 2023-11-24T06:09:27.867 INFO:teuthology.orchestra.run.smithi031.stdout:(27/147): ceph-grafana-dashboards-18.0.0-7484.g 488 kB/s | 28 kB 00:00 2023-11-24T06:09:27.903 INFO:teuthology.orchestra.run.smithi022.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 308 kB/s | 43 kB 00:00 2023-11-24T06:09:27.924 INFO:teuthology.orchestra.run.smithi031.stdout:(28/147): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 2.3 MB/s | 133 kB 00:00 2023-11-24T06:09:28.037 INFO:teuthology.orchestra.run.smithi022.stdout:(101/147): libarrow-9.0.0-9.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2023-11-24T06:09:28.062 INFO:teuthology.orchestra.run.smithi022.stdout:(102/147): python3-cachetools-4.2.4-1.el9.noarc 204 kB/s | 32 kB 00:00 2023-11-24T06:09:28.163 INFO:teuthology.orchestra.run.smithi022.stdout:(103/147): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2023-11-24T06:09:28.221 INFO:teuthology.orchestra.run.smithi022.stdout:(104/147): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2023-11-24T06:09:28.321 INFO:teuthology.orchestra.run.smithi022.stdout:(105/147): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2023-11-24T06:09:28.358 INFO:teuthology.orchestra.run.smithi031.stdout:(29/147): ceph-test-18.0.0-7484.ga13ea5ff.el9.x 15 MB/s | 41 MB 00:02 2023-11-24T06:09:28.363 INFO:teuthology.orchestra.run.smithi022.stdout:(106/147): python3-google-auth-2.23.4-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-11-24T06:09:28.447 INFO:teuthology.orchestra.run.smithi022.stdout:(107/147): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2023-11-24T06:09:28.483 INFO:teuthology.orchestra.run.smithi031.stdout:(30/147): ceph-mgr-dashboard-18.0.0-7484.ga13ea 3.2 MB/s | 1.8 MB 00:00 2023-11-24T06:09:28.497 INFO:teuthology.orchestra.run.smithi022.stdout:(108/147): python3-jaraco-classes-3.2.1-5.el9.n 133 kB/s | 18 kB 00:00 2023-11-24T06:09:28.559 INFO:teuthology.orchestra.run.smithi031.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7484.ga1 3.2 MB/s | 243 kB 00:00 2023-11-24T06:09:28.589 INFO:teuthology.orchestra.run.smithi022.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 164 kB/s | 23 kB 00:00 2023-11-24T06:09:28.617 INFO:teuthology.orchestra.run.smithi031.stdout:(32/147): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 874 kB/s | 50 kB 00:00 2023-11-24T06:09:28.623 INFO:teuthology.orchestra.run.smithi022.stdout:(110/147): python3-jaraco-functools-3.5.0-2.el9 156 kB/s | 19 kB 00:00 2023-11-24T06:09:28.668 INFO:teuthology.orchestra.run.smithi031.stdout:(33/147): ceph-prometheus-alerts-18.0.0-7484.ga 308 kB/s | 15 kB 00:00 2023-11-24T06:09:28.734 INFO:teuthology.orchestra.run.smithi031.stdout:(34/147): ceph-volume-18.0.0-7484.ga13ea5ff.el9 3.9 MB/s | 262 kB 00:00 2023-11-24T06:09:28.748 INFO:teuthology.orchestra.run.smithi022.stdout:(111/147): python3-jwt+crypto-2.4.0-1.el9.noarc 73 kB/s | 9.0 kB 00:00 2023-11-24T06:09:28.773 INFO:teuthology.orchestra.run.smithi022.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 107 kB/s | 20 kB 00:00 2023-11-24T06:09:28.903 INFO:teuthology.orchestra.run.smithi022.stdout:(113/147): python3-jwt-2.4.0-1.el9.noarch.rpm 267 kB/s | 41 kB 00:00 2023-11-24T06:09:28.926 INFO:teuthology.orchestra.run.smithi031.stdout:(35/147): ceph-mgr-diskprediction-local-18.0.0- 13 MB/s | 7.4 MB 00:00 2023-11-24T06:09:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:(114/147): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2023-11-24T06:09:28.985 INFO:teuthology.orchestra.run.smithi031.stdout:(36/147): cephadm-18.0.0-7484.ga13ea5ff.el9.noa 3.0 MB/s | 772 kB 00:00 2023-11-24T06:09:29.010 INFO:teuthology.orchestra.run.smithi031.stdout:(37/147): cephfs-top-18.0.0-7484.ga13ea5ff.el9. 221 kB/s | 18 kB 00:00 2023-11-24T06:09:29.049 INFO:teuthology.orchestra.run.smithi022.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 318 kB/s | 46 kB 00:00 2023-11-24T06:09:29.116 INFO:teuthology.orchestra.run.smithi022.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 527 kB/s | 79 kB 00:00 2023-11-24T06:09:29.217 INFO:teuthology.orchestra.run.smithi022.stdout:(117/147): python3-natsort-7.1.1-5.el9.noarch.r 347 kB/s | 58 kB 00:00 2023-11-24T06:09:29.267 INFO:teuthology.orchestra.run.smithi022.stdout:(118/147): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2023-11-24T06:09:29.302 INFO:teuthology.orchestra.run.smithi031.stdout:(38/147): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 662 kB 00:00 2023-11-24T06:09:29.359 INFO:teuthology.orchestra.run.smithi022.stdout:(119/147): python3-portend-3.1.0-2.el9.noarch.r 116 kB/s | 16 kB 00:00 2023-11-24T06:09:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 920 kB 00:00 2023-11-24T06:09:29.386 INFO:teuthology.orchestra.run.smithi031.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 106 kB 00:00 2023-11-24T06:09:29.409 INFO:teuthology.orchestra.run.smithi022.stdout:(120/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 638 kB/s | 90 kB 00:00 2023-11-24T06:09:29.411 INFO:teuthology.orchestra.run.smithi031.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 441 kB/s | 21 kB 00:00 2023-11-24T06:09:29.461 INFO:teuthology.orchestra.run.smithi031.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 307 kB 00:00 2023-11-24T06:09:29.484 INFO:teuthology.orchestra.run.smithi022.stdout:(121/147): python3-repoze-lru-0.7-16.el9.noarch 246 kB/s | 31 kB 00:00 2023-11-24T06:09:29.486 INFO:teuthology.orchestra.run.smithi031.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 441 kB/s | 32 kB 00:00 2023-11-24T06:09:29.543 INFO:teuthology.orchestra.run.smithi022.stdout:(122/147): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2023-11-24T06:09:29.595 INFO:teuthology.orchestra.run.smithi031.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 23 MB/s | 3.0 MB 00:00 2023-11-24T06:09:29.610 INFO:teuthology.orchestra.run.smithi022.stdout:(123/147): python3-rsa-4.9-2.el9.noarch.rpm 474 kB/s | 59 kB 00:00 2023-11-24T06:09:29.620 INFO:teuthology.orchestra.run.smithi031.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 135 kB/s | 17 kB 00:00 2023-11-24T06:09:29.677 INFO:teuthology.orchestra.run.smithi022.stdout:(124/147): python3-tempora-5.0.0-2.el9.noarch.r 269 kB/s | 36 kB 00:00 2023-11-24T06:09:29.679 INFO:teuthology.orchestra.run.smithi031.stdout:(46/147): jq-1.6-16.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2023-11-24T06:09:29.704 INFO:teuthology.orchestra.run.smithi031.stdout:(47/147): libaio-devel-0.3.111-13.el9.x86_64.rp 122 kB/s | 10 kB 00:00 2023-11-24T06:09:29.736 INFO:teuthology.orchestra.run.smithi022.stdout:(125/147): python3-typing-extensions-4.4.0-2.el 409 kB/s | 51 kB 00:00 2023-11-24T06:09:29.754 INFO:teuthology.orchestra.run.smithi031.stdout:(48/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 908 kB/s | 44 kB 00:00 2023-11-24T06:09:29.780 INFO:teuthology.orchestra.run.smithi031.stdout:(49/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-11-24T06:09:29.828 INFO:teuthology.orchestra.run.smithi022.stdout:(126/147): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2023-11-24T06:09:29.830 INFO:teuthology.orchestra.run.smithi031.stdout:(50/147): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2023-11-24T06:09:29.861 INFO:teuthology.orchestra.run.smithi022.stdout:(127/147): python3-websocket-client-1.2.3-2.el9 720 kB/s | 90 kB 00:00 2023-11-24T06:09:29.872 INFO:teuthology.orchestra.run.smithi031.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 6.7 MB/s | 578 kB 00:00 2023-11-24T06:09:29.922 INFO:teuthology.orchestra.run.smithi031.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 283 kB/s | 24 kB 00:00 2023-11-24T06:09:29.964 INFO:teuthology.orchestra.run.smithi031.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 509 kB/s | 46 kB 00:00 2023-11-24T06:09:29.987 INFO:teuthology.orchestra.run.smithi022.stdout:(128/147): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2023-11-24T06:09:29.998 INFO:teuthology.orchestra.run.smithi031.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-11-24T06:09:30.012 INFO:teuthology.orchestra.run.smithi022.stdout:(129/147): python3-zc-lockfile-2.0-10.el9.noarc 133 kB/s | 20 kB 00:00 2023-11-24T06:09:30.031 INFO:teuthology.orchestra.run.smithi031.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.4 MB/s | 217 kB 00:00 2023-11-24T06:09:30.057 INFO:teuthology.orchestra.run.smithi031.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 615 kB/s | 34 kB 00:00 2023-11-24T06:09:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:(130/147): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2023-11-24T06:09:30.199 INFO:teuthology.orchestra.run.smithi031.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 29 MB/s | 4.7 MB 00:00 2023-11-24T06:09:30.249 INFO:teuthology.orchestra.run.smithi031.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 8.5 MB/s | 1.5 MB 00:00 2023-11-24T06:09:30.279 INFO:teuthology.orchestra.run.smithi022.stdout:(131/147): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2023-11-24T06:09:30.324 INFO:teuthology.orchestra.run.smithi031.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2023-11-24T06:09:30.350 INFO:teuthology.orchestra.run.smithi031.stdout:(60/147): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2023-11-24T06:09:30.463 INFO:teuthology.orchestra.run.smithi022.stdout:(132/147): librados2-18.0.0-7484.ga13ea5ff.el9. 9.5 MB/s | 3.3 MB 00:00 2023-11-24T06:09:30.513 INFO:teuthology.orchestra.run.smithi022.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-11-24T06:09:30.516 INFO:teuthology.orchestra.run.smithi031.stdout:(61/147): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2023-11-24T06:09:30.622 INFO:teuthology.orchestra.run.smithi022.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-11-24T06:09:30.658 INFO:teuthology.orchestra.run.smithi031.stdout:(62/147): postgresql-server-13.11-1.el9.x86_64. 18 MB/s | 5.7 MB 00:00 2023-11-24T06:09:30.683 INFO:teuthology.orchestra.run.smithi031.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-11-24T06:09:30.714 INFO:teuthology.orchestra.run.smithi022.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 19 MB/s | 1.8 MB 00:00 2023-11-24T06:09:30.725 INFO:teuthology.orchestra.run.smithi031.stdout:(64/147): python3-jsonpatch-1.21-16.el9.noarch. 601 kB/s | 24 kB 00:00 2023-11-24T06:09:30.764 INFO:teuthology.orchestra.run.smithi022.stdout:(136/147): NetworkManager-team-1.45.6-1.el9.x86 871 kB/s | 42 kB 00:00 2023-11-24T06:09:30.848 INFO:teuthology.orchestra.run.smithi022.stdout:(137/147): librbd1-18.0.0-7484.ga13ea5ff.el9.x8 5.3 MB/s | 3.0 MB 00:00 2023-11-24T06:09:30.867 INFO:teuthology.orchestra.run.smithi031.stdout:(65/147): python3-jsonpointer-2.0-4.el9.noarch. 99 kB/s | 18 kB 00:00 2023-11-24T06:09:30.881 INFO:teuthology.orchestra.run.smithi022.stdout:(138/147): NetworkManager-tui-1.45.6-1.el9.x86_ 2.1 MB/s | 245 kB 00:00 2023-11-24T06:09:30.915 INFO:teuthology.orchestra.run.smithi022.stdout:(139/147): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2023-11-24T06:09:30.917 INFO:teuthology.orchestra.run.smithi031.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 755 kB/s | 144 kB 00:00 2023-11-24T06:09:30.940 INFO:teuthology.orchestra.run.smithi022.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 640 kB/s | 36 kB 00:00 2023-11-24T06:09:30.943 INFO:teuthology.orchestra.run.smithi031.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 432 kB/s | 32 kB 00:00 2023-11-24T06:09:30.974 INFO:teuthology.orchestra.run.smithi022.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 3.3 MB/s | 192 kB 00:00 2023-11-24T06:09:31.007 INFO:teuthology.orchestra.run.smithi022.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 3.9 MB/s | 255 kB 00:00 2023-11-24T06:09:31.033 INFO:teuthology.orchestra.run.smithi022.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 393 kB/s | 22 kB 00:00 2023-11-24T06:09:31.066 INFO:teuthology.orchestra.run.smithi022.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-11-24T06:09:31.076 INFO:teuthology.orchestra.run.smithi031.stdout:(68/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-11-24T06:09:31.101 INFO:teuthology.orchestra.run.smithi031.stdout:(69/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2023-11-24T06:09:31.152 INFO:teuthology.orchestra.run.smithi031.stdout:(70/147): python3-oauthlib-3.1.1-5.el9.noarch.r 3.5 MB/s | 174 kB 00:00 2023-11-24T06:09:31.168 INFO:teuthology.orchestra.run.smithi031.stdout:(71/147): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 41 kB 00:00 2023-11-24T06:09:31.219 INFO:teuthology.orchestra.run.smithi031.stdout:(72/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-24T06:09:31.244 INFO:teuthology.orchestra.run.smithi031.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2023-11-24T06:09:31.277 INFO:teuthology.orchestra.run.smithi031.stdout:(74/147): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-11-24T06:09:31.294 INFO:teuthology.orchestra.run.smithi031.stdout:(75/147): python3-requests-oauthlib-1.3.0-12.el 867 kB/s | 43 kB 00:00 2023-11-24T06:09:31.344 INFO:teuthology.orchestra.run.smithi031.stdout:(76/147): python3-toml-0.10.2-6.el9.noarch.rpm 796 kB/s | 39 kB 00:00 2023-11-24T06:09:31.503 INFO:teuthology.orchestra.run.smithi031.stdout:(77/147): ceph-base-18.0.0-7484.ga13ea5ff.el9.x 560 kB/s | 5.2 MB 00:09 2023-11-24T06:09:31.720 INFO:teuthology.orchestra.run.smithi031.stdout:(78/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2023-11-24T06:09:31.745 INFO:teuthology.orchestra.run.smithi031.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 777 kB/s | 300 kB 00:00 2023-11-24T06:09:31.821 INFO:teuthology.orchestra.run.smithi031.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 186 kB/s | 56 kB 00:00 2023-11-24T06:09:31.871 INFO:teuthology.orchestra.run.smithi031.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 694 kB/s | 85 kB 00:00 2023-11-24T06:09:31.896 INFO:teuthology.orchestra.run.smithi031.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 426 kB/s | 63 kB 00:00 2023-11-24T06:09:31.921 INFO:teuthology.orchestra.run.smithi031.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 449 kB/s | 44 kB 00:00 2023-11-24T06:09:31.955 INFO:teuthology.orchestra.run.smithi031.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-11-24T06:09:31.997 INFO:teuthology.orchestra.run.smithi031.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.0 MB/s | 803 kB 00:00 2023-11-24T06:09:32.039 INFO:teuthology.orchestra.run.smithi031.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.7 MB/s | 195 kB 00:00 2023-11-24T06:09:32.081 INFO:teuthology.orchestra.run.smithi031.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2023-11-24T06:09:32.122 INFO:teuthology.orchestra.run.smithi031.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 9.4 MB/s | 1.1 MB 00:00 2023-11-24T06:09:32.148 INFO:teuthology.orchestra.run.smithi031.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2023-11-24T06:09:32.181 INFO:teuthology.orchestra.run.smithi031.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2023-11-24T06:09:32.206 INFO:teuthology.orchestra.run.smithi031.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.3 MB/s | 113 kB 00:00 2023-11-24T06:09:32.240 INFO:teuthology.orchestra.run.smithi031.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 2.1 MB/s | 187 kB 00:00 2023-11-24T06:09:32.500 INFO:teuthology.orchestra.run.smithi022.stdout:(145/147): openssl-3.0.7-25.el9.x86_64.rpm 849 kB/s | 1.2 MB 00:01 2023-11-24T06:09:32.582 INFO:teuthology.orchestra.run.smithi031.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 659 kB/s | 245 kB 00:00 2023-11-24T06:09:32.759 INFO:teuthology.orchestra.run.smithi022.stdout:(146/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 1.3 MB/s | 2.2 MB 00:01 2023-11-24T06:09:32.841 INFO:teuthology.orchestra.run.smithi031.stdout:(94/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 6.5 MB/s | 4.1 MB 00:00 2023-11-24T06:09:33.016 INFO:teuthology.orchestra.run.smithi031.stdout:(95/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 399 kB/s | 309 kB 00:00 2023-11-24T06:09:33.158 INFO:teuthology.orchestra.run.smithi031.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 345 kB/s | 49 kB 00:00 2023-11-24T06:09:33.200 INFO:teuthology.orchestra.run.smithi031.stdout:(97/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 68 kB/s | 24 kB 00:00 2023-11-24T06:09:33.316 INFO:teuthology.orchestra.run.smithi031.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 427 kB/s | 67 kB 00:00 2023-11-24T06:09:33.608 INFO:teuthology.orchestra.run.smithi031.stdout:(99/147): python3-asyncssh-2.13.2-3.el9.noarch. 1.8 MB/s | 548 kB 00:00 2023-11-24T06:09:33.759 INFO:teuthology.orchestra.run.smithi031.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 292 kB/s | 43 kB 00:00 2023-11-24T06:09:33.917 INFO:teuthology.orchestra.run.smithi031.stdout:(101/147): libarrow-9.0.0-9.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2023-11-24T06:09:33.942 INFO:teuthology.orchestra.run.smithi031.stdout:(102/147): python3-cachetools-4.2.4-1.el9.noarc 176 kB/s | 32 kB 00:00 2023-11-24T06:09:33.984 INFO:teuthology.orchestra.run.smithi031.stdout:(103/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.0 MB/s | 837 kB 00:00 2023-11-24T06:09:34.035 INFO:teuthology.orchestra.run.smithi031.stdout:(104/147): python3-certifi-2021.10.8-2.el9.noar 129 kB/s | 15 kB 00:00 2023-11-24T06:09:34.085 INFO:teuthology.orchestra.run.smithi031.stdout:(105/147): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2023-11-24T06:09:34.152 INFO:teuthology.orchestra.run.smithi031.stdout:(106/147): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2023-11-24T06:09:34.185 INFO:teuthology.orchestra.run.smithi031.stdout:(107/147): python3-google-auth-2.23.4-1.el9.noa 1.3 MB/s | 197 kB 00:00 2023-11-24T06:09:34.210 INFO:teuthology.orchestra.run.smithi031.stdout:(108/147): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2023-11-24T06:09:34.286 INFO:teuthology.orchestra.run.smithi031.stdout:(109/147): python3-jaraco-classes-3.2.1-5.el9.n 132 kB/s | 18 kB 00:00 2023-11-24T06:09:34.305 INFO:teuthology.orchestra.run.smithi031.stdout:(110/147): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2023-11-24T06:09:34.320 INFO:teuthology.orchestra.run.smithi031.stdout:(111/147): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2023-11-24T06:09:34.403 INFO:teuthology.orchestra.run.smithi031.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2023-11-24T06:09:34.420 INFO:teuthology.orchestra.run.smithi031.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 78 kB/s | 9.0 kB 00:00 2023-11-24T06:09:34.437 INFO:teuthology.orchestra.run.smithi031.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 351 kB/s | 41 kB 00:00 2023-11-24T06:09:34.546 INFO:teuthology.orchestra.run.smithi031.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 372 kB/s | 46 kB 00:00 2023-11-24T06:09:34.571 INFO:teuthology.orchestra.run.smithi031.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 593 kB/s | 79 kB 00:00 2023-11-24T06:09:34.646 INFO:teuthology.orchestra.run.smithi031.stdout:(117/147): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2023-11-24T06:09:34.671 INFO:teuthology.orchestra.run.smithi031.stdout:(118/147): python3-natsort-7.1.1-5.el9.noarch.r 464 kB/s | 58 kB 00:00 2023-11-24T06:09:34.705 INFO:teuthology.orchestra.run.smithi031.stdout:(119/147): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2023-11-24T06:09:34.772 INFO:teuthology.orchestra.run.smithi031.stdout:(120/147): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2023-11-24T06:09:34.797 INFO:teuthology.orchestra.run.smithi031.stdout:(121/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 718 kB/s | 90 kB 00:00 2023-11-24T06:09:34.823 INFO:teuthology.orchestra.run.smithi031.stdout:(122/147): python3-repoze-lru-0.7-16.el9.noarch 263 kB/s | 31 kB 00:00 2023-11-24T06:09:34.906 INFO:teuthology.orchestra.run.smithi031.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2023-11-24T06:09:34.932 INFO:teuthology.orchestra.run.smithi031.stdout:(124/147): python3-rsa-4.9-2.el9.noarch.rpm 442 kB/s | 59 kB 00:00 2023-11-24T06:09:34.958 INFO:teuthology.orchestra.run.smithi031.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 268 kB/s | 36 kB 00:00 2023-11-24T06:09:35.032 INFO:teuthology.orchestra.run.smithi031.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 408 kB/s | 51 kB 00:00 2023-11-24T06:09:35.090 INFO:teuthology.orchestra.run.smithi031.stdout:(127/147): python3-websocket-client-1.2.3-2.el9 675 kB/s | 90 kB 00:00 2023-11-24T06:09:35.116 INFO:teuthology.orchestra.run.smithi031.stdout:(128/147): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2023-11-24T06:09:35.183 INFO:teuthology.orchestra.run.smithi031.stdout:(129/147): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2023-11-24T06:09:35.235 INFO:teuthology.orchestra.run.smithi031.stdout:(130/147): python3-zc-lockfile-2.0-10.el9.noarc 139 kB/s | 20 kB 00:00 2023-11-24T06:09:35.275 INFO:teuthology.orchestra.run.smithi031.stdout:(131/147): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2023-11-24T06:09:35.409 INFO:teuthology.orchestra.run.smithi031.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2023-11-24T06:09:35.459 INFO:teuthology.orchestra.run.smithi031.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-11-24T06:09:35.559 INFO:teuthology.orchestra.run.smithi031.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 23 MB/s | 2.2 MB 00:00 2023-11-24T06:09:35.651 INFO:teuthology.orchestra.run.smithi031.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 19 MB/s | 1.8 MB 00:00 2023-11-24T06:09:35.751 INFO:teuthology.orchestra.run.smithi031.stdout:(136/147): librados2-18.0.0-7484.ga13ea5ff.el9. 6.4 MB/s | 3.3 MB 00:00 2023-11-24T06:09:35.777 INFO:teuthology.orchestra.run.smithi031.stdout:(137/147): NetworkManager-team-1.45.6-1.el9.x86 337 kB/s | 42 kB 00:00 2023-11-24T06:09:35.810 INFO:teuthology.orchestra.run.smithi031.stdout:(138/147): NetworkManager-tui-1.45.6-1.el9.x86_ 4.2 MB/s | 245 kB 00:00 2023-11-24T06:09:35.835 INFO:teuthology.orchestra.run.smithi031.stdout:(139/147): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-11-24T06:09:35.871 INFO:teuthology.orchestra.run.smithi031.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 621 kB/s | 36 kB 00:00 2023-11-24T06:09:35.902 INFO:teuthology.orchestra.run.smithi031.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 2.9 MB/s | 192 kB 00:00 2023-11-24T06:09:35.936 INFO:teuthology.orchestra.run.smithi031.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 4.0 MB/s | 255 kB 00:00 2023-11-24T06:09:35.961 INFO:teuthology.orchestra.run.smithi031.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 395 kB/s | 22 kB 00:00 2023-11-24T06:09:35.995 INFO:teuthology.orchestra.run.smithi031.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-11-24T06:09:37.179 INFO:teuthology.orchestra.run.smithi031.stdout:(145/147): openssl-3.0.7-25.el9.x86_64.rpm 1.0 MB/s | 1.2 MB 00:01 2023-11-24T06:09:37.387 INFO:teuthology.orchestra.run.smithi031.stdout:(146/147): librbd1-18.0.0-7484.ga13ea5ff.el9.x8 1.4 MB/s | 3.0 MB 00:02 2023-11-24T06:09:38.458 INFO:teuthology.orchestra.run.smithi022.stdout:(147/147): ceph-test-18.0.0-7484.ga13ea5ff.el9. 2.3 MB/s | 41 MB 00:18 2023-11-24T06:09:38.472 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-11-24T06:09:38.473 INFO:teuthology.orchestra.run.smithi022.stdout:Total 9.1 MB/s | 204 MB 00:22 2023-11-24T06:09:38.702 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-11-24T06:09:38.804 INFO:teuthology.orchestra.run.smithi031.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 786 kB/s | 2.2 MB 00:02 2023-11-24T06:09:38.812 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2023-11-24T06:09:38.813 INFO:teuthology.orchestra.run.smithi031.stdout:Total 12 MB/s | 204 MB 00:17 2023-11-24T06:09:38.998 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-11-24T06:09:38.999 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-11-24T06:09:39.048 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2023-11-24T06:09:39.346 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2023-11-24T06:09:39.346 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2023-11-24T06:09:41.235 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-11-24T06:09:41.235 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-11-24T06:09:41.645 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2023-11-24T06:09:41.647 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2023-11-24T06:09:47.817 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-11-24T06:09:47.972 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-24T06:09:48.007 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-24T06:09:48.078 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-24T06:09:48.130 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2023-11-24T06:09:48.130 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-24T06:09:48.158 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-24T06:09:48.281 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-24T06:09:48.339 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-24T06:09:48.379 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-24T06:09:48.457 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-24T06:09:48.515 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-24T06:09:48.545 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-24T06:09:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-24T06:09:48.695 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-24T06:09:48.798 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:09:48.953 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:09:49.016 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:09:49.056 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-24T06:09:49.093 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:09:49.150 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:09:49.196 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T06:09:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-24T06:09:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:09:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:09:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:09:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T06:09:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-24T06:09:49.601 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-24T06:09:49.663 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-24T06:09:49.687 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T06:09:49.867 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T06:09:49.872 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-24T06:09:49.897 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T06:09:49.924 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-24T06:09:49.949 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T06:09:49.989 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T06:09:50.090 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T06:09:50.124 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T06:09:50.307 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-24T06:09:50.350 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T06:09:50.460 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T06:09:50.557 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T06:09:50.691 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-24T06:09:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:09:50.805 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:09:50.888 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T06:09:50.976 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T06:09:51.179 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:09:51.232 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:09:51.259 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:09:51.310 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-24T06:09:51.427 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-24T06:09:51.506 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-24T06:09:51.540 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-24T06:09:51.589 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-24T06:09:51.646 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:09:51.651 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-24T06:09:51.695 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-24T06:09:51.760 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-24T06:09:51.797 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-24T06:09:51.809 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-24T06:09:51.842 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-24T06:09:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-24T06:09:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-24T06:09:51.960 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-24T06:09:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-24T06:09:52.006 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 29/162 2023-11-24T06:09:52.029 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-24T06:09:52.084 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 30/162 2023-11-24T06:09:52.149 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-24T06:09:52.194 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-24T06:09:52.198 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 31/162 2023-11-24T06:09:52.219 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-24T06:09:52.324 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-24T06:09:52.365 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 29/162 2023-11-24T06:09:52.391 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-24T06:09:52.417 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 30/162 2023-11-24T06:09:52.451 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-24T06:09:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 31/162 2023-11-24T06:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-24T06:09:52.825 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-24T06:09:53.175 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-24T06:09:53.518 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-24T06:09:53.595 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-24T06:09:53.625 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-24T06:09:53.652 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-24T06:09:53.678 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-24T06:09:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-24T06:09:53.731 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-24T06:09:53.769 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 38/162 2023-11-24T06:09:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 38/162 2023-11-24T06:09:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-24T06:09:53.845 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-24T06:09:54.043 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-24T06:09:54.047 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-24T06:09:54.098 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-24T06:09:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-24T06:09:54.233 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-24T06:09:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-24T06:09:54.279 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-24T06:09:54.312 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-24T06:09:54.419 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-24T06:09:54.520 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-24T06:09:54.562 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-24T06:09:54.572 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-24T06:09:54.594 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-24T06:09:54.663 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-24T06:09:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-24T06:09:54.717 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-24T06:09:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-24T06:09:54.769 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-24T06:09:54.778 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-24T06:09:54.848 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-24T06:09:54.911 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-24T06:09:54.972 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-24T06:09:54.974 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-24T06:09:55.018 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-24T06:09:55.065 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-24T06:09:55.194 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-24T06:09:55.195 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-24T06:09:55.247 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-24T06:09:55.258 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-24T06:09:55.307 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-24T06:09:55.315 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-24T06:09:55.343 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-24T06:09:55.448 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-24T06:09:55.508 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-24T06:09:55.508 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-24T06:09:55.557 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-24T06:09:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-24T06:09:55.607 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-24T06:09:55.628 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-24T06:09:55.709 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-24T06:09:55.772 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-24T06:09:55.829 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-24T06:09:55.910 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-24T06:09:55.974 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-24T06:09:56.017 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-24T06:09:56.034 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-24T06:09:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-24T06:09:56.262 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-24T06:09:56.278 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-24T06:09:56.286 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-24T06:09:56.325 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-24T06:09:56.346 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-24T06:09:56.368 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-24T06:09:56.415 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-24T06:09:56.456 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-24T06:09:56.513 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-24T06:09:56.521 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-24T06:09:56.592 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-24T06:09:56.607 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-24T06:09:56.632 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-24T06:09:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-24T06:09:56.676 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-24T06:09:56.726 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-24T06:09:56.770 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-24T06:09:56.797 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-24T06:09:56.821 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-24T06:09:56.843 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-24T06:09:56.870 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-24T06:09:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-24T06:09:56.932 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-24T06:09:56.974 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-24T06:09:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-24T06:09:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-24T06:09:57.123 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-24T06:09:57.162 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-24T06:09:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-24T06:09:57.230 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-24T06:09:57.265 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-24T06:09:57.306 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-24T06:09:57.329 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-24T06:09:57.368 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-24T06:09:57.369 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-24T06:09:57.549 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-24T06:09:57.593 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-24T06:09:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-24T06:09:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-24T06:09:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-24T06:09:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-24T06:09:58.468 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-24T06:09:58.501 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-24T06:09:58.756 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-24T06:09:58.789 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-24T06:09:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-24T06:09:58.894 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-24T06:09:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-24T06:09:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-24T06:09:58.972 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-24T06:09:59.236 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-24T06:09:59.284 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-24T06:09:59.401 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-24T06:09:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-24T06:09:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-24T06:10:00.265 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-24T06:10:00.417 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-24T06:10:01.531 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-24T06:10:01.627 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-24T06:10:01.665 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-24T06:10:01.695 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-24T06:10:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-24T06:10:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-24T06:10:02.092 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-24T06:10:02.165 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-24T06:10:02.193 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T06:10:02.195 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-24T06:10:02.267 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-24T06:10:02.298 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-24T06:10:02.322 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T06:10:02.345 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-24T06:10:02.357 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 100/162 2023-11-24T06:10:02.394 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-24T06:10:02.413 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-24T06:10:02.790 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-24T06:10:02.819 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T06:10:02.917 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-24T06:10:02.940 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T06:10:02.946 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T06:10:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 100/162 2023-11-24T06:10:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-24T06:10:03.037 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T06:10:03.065 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 104/162 2023-11-24T06:10:03.538 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-24T06:10:03.572 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T06:10:03.714 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T06:10:03.741 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 104/162 2023-11-24T06:10:05.806 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:10:05.844 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:10:06.517 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:10:06.565 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T06:10:06.764 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T06:10:06.764 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-24T06:10:06.764 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-24T06:10:06.764 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:06.765 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:10:06.807 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T06:10:06.813 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:10:07.475 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:10:07.515 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T06:10:07.710 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T06:10:07.710 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-24T06:10:07.714 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-24T06:10:07.714 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:07.749 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T06:10:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T06:10:19.768 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2023-11-24T06:10:19.768 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2023-11-24T06:10:19.768 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2023-11-24T06:10:19.768 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2023-11-24T06:10:19.769 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2023-11-24T06:10:19.769 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2023-11-24T06:10:19.769 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2023-11-24T06:10:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:19.987 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T06:10:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T06:10:20.038 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:20.038 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-24T06:10:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T06:10:21.073 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2023-11-24T06:10:21.073 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2023-11-24T06:10:21.073 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2023-11-24T06:10:21.073 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2023-11-24T06:10:21.074 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2023-11-24T06:10:21.074 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /root 2023-11-24T06:10:21.074 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2023-11-24T06:10:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:21.368 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T06:10:21.413 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T06:10:21.413 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:21.414 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-24T06:10:21.414 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:21.806 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T06:10:21.894 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T06:10:21.894 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:21.894 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-24T06:10:21.894 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T06:10:21.894 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T06:10:21.895 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:22.139 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T06:10:22.214 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T06:10:22.214 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:22.215 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-24T06:10:22.215 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T06:10:22.215 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T06:10:22.215 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:22.740 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T06:10:22.816 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T06:10:22.816 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:22.816 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-24T06:10:22.816 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T06:10:22.816 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T06:10:22.817 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:22.933 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-24T06:10:23.179 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T06:10:23.280 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T06:10:23.280 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:23.280 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-24T06:10:23.280 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T06:10:23.280 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T06:10:23.280 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:23.478 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T06:10:23.509 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T06:10:23.539 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T06:10:23.554 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 114/162 2023-11-24T06:10:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T06:10:23.621 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:23.621 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-24T06:10:23.621 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T06:10:23.621 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T06:10:23.621 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:23.681 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 115/162 2023-11-24T06:10:23.714 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T06:10:24.039 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T06:10:24.073 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T06:10:24.165 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T06:10:24.246 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T06:10:24.246 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:24.246 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-24T06:10:24.246 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T06:10:24.246 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T06:10:24.246 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:24.367 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-24T06:10:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T06:10:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T06:10:25.229 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T06:10:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 114/162 2023-11-24T06:10:25.265 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T06:10:25.344 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 115/162 2023-11-24T06:10:25.371 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T06:10:25.417 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T06:10:25.589 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 119/162 2023-11-24T06:10:25.617 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T06:10:25.702 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T06:10:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-24T06:10:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T06:10:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T06:10:25.702 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:25.704 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T06:10:25.738 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T06:10:25.801 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T06:10:25.843 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T06:10:25.937 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 122/162 2023-11-24T06:10:26.853 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-24T06:10:26.895 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T06:10:26.927 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T06:10:26.964 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T06:10:26.975 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T06:10:26.975 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:26.975 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-24T06:10:26.975 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:10:26.975 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:10:26.976 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:27.029 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T06:10:27.102 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T06:10:27.102 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:27.102 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-24T06:10:27.103 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:27.114 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T06:10:27.179 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T06:10:27.276 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T06:10:27.276 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:27.276 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-24T06:10:27.276 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:10:27.276 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:10:27.276 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:27.288 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 119/162 2023-11-24T06:10:27.324 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T06:10:27.429 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T06:10:27.430 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:27.430 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-24T06:10:27.430 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T06:10:27.430 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T06:10:27.430 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:27.492 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T06:10:27.534 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T06:10:27.591 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 122/162 2023-11-24T06:10:27.638 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T06:10:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T06:10:27.724 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:27.724 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-24T06:10:27.724 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T06:10:27.724 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T06:10:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:28.519 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-24T06:10:28.560 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T06:10:28.635 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T06:10:28.635 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:28.635 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-24T06:10:28.635 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:10:28.635 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:10:28.635 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:28.686 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T06:10:28.787 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T06:10:28.787 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:28.787 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-24T06:10:28.787 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:28.870 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T06:10:28.983 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T06:10:28.983 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:28.984 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-24T06:10:28.984 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:10:28.984 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:10:28.984 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:29.396 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T06:10:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T06:10:29.497 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:10:29.497 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-24T06:10:29.498 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T06:10:29.498 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T06:10:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:32.086 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 128/162 2023-11-24T06:10:32.140 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 129/162 2023-11-24T06:10:32.204 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 130/162 2023-11-24T06:10:32.243 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-24T06:10:32.538 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-24T06:10:32.673 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-24T06:10:32.722 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 134/162 2023-11-24T06:10:32.756 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 135/162 2023-11-24T06:10:32.798 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-24T06:10:32.844 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-24T06:10:32.954 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-24T06:10:33.039 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-24T06:10:33.085 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-24T06:10:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 128/162 2023-11-24T06:10:33.938 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 129/162 2023-11-24T06:10:33.952 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:10:33.995 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 130/162 2023-11-24T06:10:33.999 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:10:34.033 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-24T06:10:34.069 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:10:34.327 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-24T06:10:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-24T06:10:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 134/162 2023-11-24T06:10:34.537 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 135/162 2023-11-24T06:10:34.577 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-24T06:10:34.615 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-24T06:10:34.775 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-24T06:10:34.838 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-24T06:10:34.880 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-24T06:10:35.461 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 142/162 2023-11-24T06:10:35.743 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-24T06:10:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:10:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:10:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:10:36.064 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-24T06:10:36.166 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-24T06:10:36.338 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-24T06:10:36.374 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-24T06:10:36.408 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-24T06:10:36.434 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-24T06:10:36.474 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-24T06:10:36.475 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T06:10:36.625 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T06:10:36.676 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-24T06:10:36.722 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-24T06:10:36.754 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-24T06:10:36.754 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T06:10:36.883 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T06:10:36.914 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-24T06:10:36.954 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:10:36.955 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:10:37.280 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:10:37.280 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T06:10:37.339 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 142/162 2023-11-24T06:10:37.447 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T06:10:37.463 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-24T06:10:37.483 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-24T06:10:37.515 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-24T06:10:37.517 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-24T06:10:37.552 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-24T06:10:37.612 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-24T06:10:37.682 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T06:10:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-24T06:10:37.819 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-24T06:10:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-24T06:10:37.895 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-24T06:10:37.938 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-24T06:10:37.939 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T06:10:37.966 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T06:10:37.966 INFO:teuthology.orchestra.run.smithi022.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-24T06:10:37.966 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:38.094 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T06:10:38.146 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-24T06:10:38.191 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-24T06:10:38.223 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-24T06:10:38.224 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T06:10:38.369 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T06:10:38.400 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-24T06:10:38.441 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:10:38.442 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:10:38.774 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:10:38.775 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T06:10:38.918 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T06:10:38.953 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-24T06:10:38.986 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-24T06:10:39.054 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-24T06:10:39.176 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T06:10:39.448 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T06:10:39.448 INFO:teuthology.orchestra.run.smithi031.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-24T06:10:39.448 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:42.562 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 1/162 2023-11-24T06:10:42.562 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2/162 2023-11-24T06:10:42.562 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 3/162 2023-11-24T06:10:42.562 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 4/162 2023-11-24T06:10:42.562 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/162 2023-11-24T06:10:42.562 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 6/162 2023-11-24T06:10:42.562 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 7/162 2023-11-24T06:10:42.562 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:10:42.562 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 11/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 12/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 13/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 14/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 15/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 16/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 17/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 18/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 19/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 21/162 2023-11-24T06:10:42.563 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 22/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 23/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 24/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 25/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 26/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 27/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 28/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 30/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 31/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/162 2023-11-24T06:10:42.564 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 34/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 36/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 37/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 38/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-24T06:10:42.565 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-24T06:10:42.566 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-24T06:10:42.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-24T06:10:42.568 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-24T06:10:42.569 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-24T06:10:42.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-24T06:10:42.571 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 133/162 2023-11-24T06:10:42.572 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 135/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-24T06:10:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-24T06:10:42.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-24T06:10:42.575 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-24T06:10:42.575 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-24T06:10:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 1/162 2023-11-24T06:10:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2/162 2023-11-24T06:10:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 3/162 2023-11-24T06:10:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 4/162 2023-11-24T06:10:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/162 2023-11-24T06:10:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 6/162 2023-11-24T06:10:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 7/162 2023-11-24T06:10:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:10:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:10:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T06:10:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 11/162 2023-11-24T06:10:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 12/162 2023-11-24T06:10:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 13/162 2023-11-24T06:10:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 14/162 2023-11-24T06:10:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 15/162 2023-11-24T06:10:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 16/162 2023-11-24T06:10:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 17/162 2023-11-24T06:10:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 18/162 2023-11-24T06:10:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 19/162 2023-11-24T06:10:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/162 2023-11-24T06:10:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 21/162 2023-11-24T06:10:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 22/162 2023-11-24T06:10:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 23/162 2023-11-24T06:10:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 24/162 2023-11-24T06:10:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 25/162 2023-11-24T06:10:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 26/162 2023-11-24T06:10:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 27/162 2023-11-24T06:10:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 28/162 2023-11-24T06:10:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/162 2023-11-24T06:10:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 30/162 2023-11-24T06:10:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 31/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 34/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 36/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 37/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 38/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-24T06:10:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-24T06:10:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-24T06:10:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-24T06:10:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-24T06:10:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-24T06:10:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-24T06:10:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-24T06:10:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 133/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 135/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-24T06:10:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-24T06:10:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-24T06:10:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-24T06:10:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-24T06:10:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-24T06:10:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-24T06:10:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-24T06:10:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-24T06:10:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-24T06:10:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-24T06:10:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:44.913 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2023-11-24T06:10:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-24T06:10:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-24T06:10:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-24T06:10:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-24T06:10:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: acl-2.3.1-4.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-11-24T06:10:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.2-8.el9.noarch 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.7.4-5.el9.x86_64 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.4-9.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: jq-1.6-16.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-24T06:10:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-24T06:10:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-13.11-1.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-24T06:10:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-24T06:10:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-24T06:10:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-24T06:10:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-24T06:10:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-24T06:10:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-24T06:10:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-24T06:10:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-24T06:10:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-24T06:10:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-24T06:10:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-24T06:10:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-24T06:10:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-3.el9.x86_64 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-24T06:10:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-24T06:10:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-24T06:10:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:44.926 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-11-24T06:10:45.573 DEBUG:teuthology.parallel:result is None 2023-11-24T06:10:46.438 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-24T06:10:46.438 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:46.438 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2023-11-24T06:10:46.438 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-24T06:10:46.438 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-24T06:10:46.438 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-24T06:10:46.438 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-24T06:10:46.438 INFO:teuthology.orchestra.run.smithi031.stdout: acl-2.3.1-4.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2023-11-24T06:10:46.439 INFO:teuthology.orchestra.run.smithi031.stdout: automake-1.16.2-8.el9.noarch 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: bison-3.7.4-5.el9.x86_64 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.440 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.441 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: flex-2.6.4-9.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: jq-1.6-16.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-24T06:10:46.442 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-24T06:10:46.443 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-13.11-1.el9.x86_64 2023-11-24T06:10:46.444 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-24T06:10:46.445 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-24T06:10:46.446 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply-3.11-14.el9.noarch 2023-11-24T06:10:46.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-24T06:10:46.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.450 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:10:46.450 INFO:teuthology.orchestra.run.smithi031.stdout: re2-1:20211101-3.el9.x86_64 2023-11-24T06:10:46.450 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-24T06:10:46.450 INFO:teuthology.orchestra.run.smithi031.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-24T06:10:46.450 INFO:teuthology.orchestra.run.smithi031.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-24T06:10:46.450 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-24T06:10:46.450 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-24T06:10:46.450 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-24T06:10:46.450 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:46.451 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2023-11-24T06:10:47.050 DEBUG:teuthology.parallel:result is None 2023-11-24T06:10:47.050 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:10:47.194 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T06:10:47.267 INFO:teuthology.orchestra.run.smithi022.stdout:18.0.0-7484.ga13ea5ff.el9 2023-11-24T06:10:47.267 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el9 2023-11-24T06:10:47.268 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T06:10:47.268 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:10:47.409 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T06:10:47.472 INFO:teuthology.orchestra.run.smithi031.stdout:18.0.0-7484.ga13ea5ff.el9 2023-11-24T06:10:47.472 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el9 2023-11-24T06:10:47.472 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T06:10:47.472 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-24T06:10:47.473 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:47.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T06:10:47.559 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:10:47.559 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T06:10:47.645 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-24T06:10:47.645 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:47.645 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T06:10:47.733 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T06:10:47.804 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:10:47.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T06:10:47.914 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T06:10:47.996 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-24T06:10:47.996 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:47.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T06:10:48.105 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T06:10:48.239 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:10:48.239 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T06:10:48.321 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T06:10:48.437 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-24T06:10:48.438 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:48.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T06:10:48.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T06:10:48.629 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:10:48.629 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T06:10:48.710 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T06:10:48.832 INFO:teuthology.run_tasks:Running task ceph... 2023-11-24T06:10:48.908 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-24T06:10:48.908 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2023-11-24T06:10:48.914 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2023-11-24T06:10:48.996 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-24T06:10:48.996 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T06:10:49.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T06:10:49.082 INFO:tasks.ceph:Creating extra log directories... 2023-11-24T06:10:49.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T06:10:49.087 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T06:10:49.176 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-24T06:10:49.176 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-24T06:10:49.177 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-24T06:10:49.177 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:49.177 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T06:10:49.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T06:10:49.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T06:10:49.519 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:10:49.519 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T06:10:49.568 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T06:10:49.790 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T06:10:49.885 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-24T06:10:49.885 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-24T06:10:49.886 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}', 'email': None, 'first_in_suite': False, 'job_id': '7465549', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mgr-vol-misc', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3305, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'rishabh-mgr-vol-misc', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi022.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzfUH1Qhkx3UErF1rZEapYX84suSfSoXmfVV9IRb3VCZ7HVR/WVJa0kuNXpwrLyzVFOs9dUYrWxP2fwYTuBjSA=', 'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKvyZJSGfP9QNiqWO4NqH+y2mCF+JpOK2PEVDl75av/LvnBOQ4sQuRQSGRUwkmeTRiU6MZ8GgEaMs7ABH+10MZw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_05:41:33', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-24T06:10:49.886 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T06:10:49.892 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T06:10:49.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T06:10:49.944 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T06:10:50.056 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:50.056 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T06:10:50.097 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T06:10:50.098 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2023-11-24T06:10:50.185 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T06:10:50.185 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:10:50.185 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-11-24T06:10:50.186 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:10:50.186 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:10:50.186 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-11-24 06:10:38.469285781 +0000 2023-11-24T06:10:50.186 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-11-24 06:07:53.663946630 +0000 2023-11-24T06:10:50.186 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-11-24 06:07:53.663946630 +0000 2023-11-24T06:10:50.186 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-11-24 06:07:53.663946630 +0000 2023-11-24T06:10:50.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T06:10:50.263 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-11-24T06:10:50.263 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-11-24T06:10:50.264 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000269651 s, 1.9 MB/s 2023-11-24T06:10:50.269 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T06:10:50.315 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2023-11-24T06:10:50.401 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T06:10:50.401 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:10:50.402 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-11-24T06:10:50.402 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:10:50.402 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:10:50.402 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-11-24 06:10:38.469285781 +0000 2023-11-24T06:10:50.402 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-11-24 06:07:54.726932730 +0000 2023-11-24T06:10:50.402 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-11-24 06:07:54.726932730 +0000 2023-11-24T06:10:50.402 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-11-24 06:07:54.726932730 +0000 2023-11-24T06:10:50.402 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T06:10:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-11-24T06:10:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-11-24T06:10:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000223469 s, 2.3 MB/s 2023-11-24T06:10:50.520 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T06:10:50.565 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2023-11-24T06:10:50.646 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T06:10:50.646 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:10:50.646 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 672 Links: 1 2023-11-24T06:10:50.646 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:10:50.646 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:10:50.646 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-11-24 06:10:38.470285768 +0000 2023-11-24T06:10:50.647 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-11-24 06:07:55.782918922 +0000 2023-11-24T06:10:50.647 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-11-24 06:07:55.782918922 +0000 2023-11-24T06:10:50.647 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-11-24 06:07:55.782918922 +0000 2023-11-24T06:10:50.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T06:10:50.754 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-11-24T06:10:50.755 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-11-24T06:10:50.755 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000179474 s, 2.9 MB/s 2023-11-24T06:10:50.758 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T06:10:50.805 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2023-11-24T06:10:50.889 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T06:10:50.952 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:10:50.952 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-11-24T06:10:50.952 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:10:50.952 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:10:50.953 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-11-24 06:10:38.471285755 +0000 2023-11-24T06:10:50.953 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-11-24 06:07:56.866904748 +0000 2023-11-24T06:10:50.953 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-11-24 06:07:56.866904748 +0000 2023-11-24T06:10:50.953 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-11-24 06:07:56.866904748 +0000 2023-11-24T06:10:50.953 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T06:10:51.033 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-11-24T06:10:51.034 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-11-24T06:10:51.034 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000183634 s, 2.8 MB/s 2023-11-24T06:10:51.036 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T06:10:51.089 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:10:51.089 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:10:51.089 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T06:10:51.133 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T06:10:51.133 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2023-11-24T06:10:51.215 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T06:10:51.216 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:10:51.216 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-11-24T06:10:51.216 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:10:51.216 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:10:51.216 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-24 06:10:39.919878183 +0000 2023-11-24T06:10:51.216 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-24 06:07:53.659112611 +0000 2023-11-24T06:10:51.216 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-24 06:07:53.659112611 +0000 2023-11-24T06:10:51.216 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-11-24 06:07:53.659112611 +0000 2023-11-24T06:10:51.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T06:10:51.328 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-24T06:10:51.328 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-24T06:10:51.328 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000375964 s, 1.4 MB/s 2023-11-24T06:10:51.331 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T06:10:51.375 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2023-11-24T06:10:51.458 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T06:10:51.458 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:10:51.458 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-11-24T06:10:51.458 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:10:51.458 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:10:51.458 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-24 06:10:39.919878183 +0000 2023-11-24T06:10:51.458 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-24 06:07:54.712095211 +0000 2023-11-24T06:10:51.459 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-24 06:07:54.712095211 +0000 2023-11-24T06:10:51.459 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-11-24 06:07:54.712095211 +0000 2023-11-24T06:10:51.459 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T06:10:51.567 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-24T06:10:51.568 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-24T06:10:51.568 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000282303 s, 1.8 MB/s 2023-11-24T06:10:51.571 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T06:10:51.614 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2023-11-24T06:10:51.708 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T06:10:51.708 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:10:51.708 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-11-24T06:10:51.709 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:10:51.709 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:10:51.709 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-24 06:10:39.920878166 +0000 2023-11-24T06:10:51.709 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-24 06:07:55.751078042 +0000 2023-11-24T06:10:51.709 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-24 06:07:55.751078042 +0000 2023-11-24T06:10:51.709 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-11-24 06:07:55.751078042 +0000 2023-11-24T06:10:51.710 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T06:10:51.785 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-24T06:10:51.785 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-24T06:10:51.785 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000327 s, 1.6 MB/s 2023-11-24T06:10:51.788 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T06:10:51.828 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2023-11-24T06:10:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T06:10:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:10:51.908 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-11-24T06:10:51.909 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:10:51.909 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:10:51.909 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-24 06:10:39.921878149 +0000 2023-11-24T06:10:51.909 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-24 06:07:56.802060674 +0000 2023-11-24T06:10:51.909 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-24 06:07:56.802060674 +0000 2023-11-24T06:10:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-11-24 06:07:56.802060674 +0000 2023-11-24T06:10:51.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T06:10:52.021 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-24T06:10:52.021 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-24T06:10:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000273471 s, 1.9 MB/s 2023-11-24T06:10:52.024 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T06:10:52.063 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:10:52.063 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T06:10:52.064 INFO:tasks.ceph:Generating config... 2023-11-24T06:10:52.065 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-24T06:10:52.065 INFO:tasks.ceph:[client] debug client = 20 2023-11-24T06:10:52.065 INFO:tasks.ceph:[client] debug ms = 1 2023-11-24T06:10:52.065 INFO:tasks.ceph:[client] pid file = 2023-11-24T06:10:52.065 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-24T06:10:52.066 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-24T06:10:52.066 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-24T06:10:52.066 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-24T06:10:52.066 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-24T06:10:52.066 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-24T06:10:52.066 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-24T06:10:52.066 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-24T06:10:52.067 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-24T06:10:52.067 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-24T06:10:52.067 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-24T06:10:52.067 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-24T06:10:52.067 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-24T06:10:52.067 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-24T06:10:52.067 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-24T06:10:52.068 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-24T06:10:52.068 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-24T06:10:52.068 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-24T06:10:52.068 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-24T06:10:52.068 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-24T06:10:52.068 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-24T06:10:52.068 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-24T06:10:52.069 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-24T06:10:52.069 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-24T06:10:52.069 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-24T06:10:52.069 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-24T06:10:52.069 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-24T06:10:52.069 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-24T06:10:52.069 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-24T06:10:52.069 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-24T06:10:52.070 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-24T06:10:52.070 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-24T06:10:52.070 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-24T06:10:52.070 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-24T06:10:52.070 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-24T06:10:52.070 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-24T06:10:52.071 INFO:tasks.ceph:Setting up mon.a... 2023-11-24T06:10:52.071 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-24T06:10:52.252 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.keyring 2023-11-24T06:10:52.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-24T06:10:52.411 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:10:52.510 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.22'), ('mon.b', '172.21.15.31'), ('mon.c', '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]')] 2023-11-24T06:10:52.510 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.22,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-24T06:10:52.511 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:52.511 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T06:10:52.570 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.22 --add b 172.21.15.31 --addv c '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:10:52.733 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:10:52.733 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: generated fsid d0664f6f-6758-42fa-85ad-04f9384b4bc8 2023-11-24T06:10:52.733 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = pacific 2023-11-24T06:10:52.733 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 0 2023-11-24T06:10:52.733 INFO:teuthology.orchestra.run.smithi022.stdout:fsid d0664f6f-6758-42fa-85ad-04f9384b4bc8 2023-11-24T06:10:52.733 INFO:teuthology.orchestra.run.smithi022.stdout:last_changed 2023-11-24T06:10:52.731053+0000 2023-11-24T06:10:52.734 INFO:teuthology.orchestra.run.smithi022.stdout:created 2023-11-24T06:10:52.731053+0000 2023-11-24T06:10:52.734 INFO:teuthology.orchestra.run.smithi022.stdout:min_mon_release 16 (pacific) 2023-11-24T06:10:52.734 INFO:teuthology.orchestra.run.smithi022.stdout:election_strategy: 1 2023-11-24T06:10:52.734 INFO:teuthology.orchestra.run.smithi022.stdout:0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2023-11-24T06:10:52.734 INFO:teuthology.orchestra.run.smithi022.stdout:1: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.b 2023-11-24T06:10:52.734 INFO:teuthology.orchestra.run.smithi022.stdout:2: [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] mon.c 2023-11-24T06:10:52.734 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-24T06:10:52.737 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T06:10:52.791 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d0664f6f-6758-42fa-85ad-04f9384b4bc8... 2023-11-24T06:10:52.793 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T06:10:52.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T06:10:52.964 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2023-11-24T06:10:52.964 INFO:teuthology.orchestra.run.smithi022.stdout: chdir = "" 2023-11-24T06:10:52.964 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T06:10:52.964 INFO:teuthology.orchestra.run.smithi022.stdout: auth supported = cephx 2023-11-24T06:10:52.964 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.964 INFO:teuthology.orchestra.run.smithi022.stdout: filestore xattr use omap = true 2023-11-24T06:10:52.964 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.964 INFO:teuthology.orchestra.run.smithi022.stdout: mon clock drift allowed = 1.000 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: osd crush chooseleaf type = 0 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: auth debug = true 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on old message = true 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on bug = true 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn max object skew = 0 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T06:10:52.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default size = 2 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow primary affinity = true 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow pg remap = true 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on legacy crush tunables = false 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on crush straw calc version zero = false 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on no sortbitwise = false 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = false 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on too few osds = false 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T06:10:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: mon_allow_pool_size_one = true 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: osd default data pool replay window = 5 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: mon allow pool delete = true 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: mon cluster log file level = debug 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: debug asserts on shutdown = true 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: mon health detail to clog = false 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: mon host = "172.21.15.22,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2023-11-24T06:10:52.967 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = d0664f6f-6758-42fa-85ad-04f9384b4bc8 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout:[osd] 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: osd journal size = 100 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub load threshold = 5.0 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub max interval = 600 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: osd mclock profile = high_recovery_ops 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: osd recover clone overlap = true 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: osd recovery max chunk = 1048576 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug shutdown = true 2023-11-24T06:10:52.968 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug op order = true 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify stray on activate = true 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug trim objects = true 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: osd open classes on start = true 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug pg log writeout = true 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: osd deep scrub update digest min age = 30 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: osd map max advance = 10 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.969 INFO:teuthology.orchestra.run.smithi022.stdout: journal zero on create = true 2023-11-24T06:10:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: filestore ondisk finisher threads = 3 2023-11-24T06:10:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: filestore apply finisher threads = 3 2023-11-24T06:10:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: bdev debug aio = true 2023-11-24T06:10:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug misdirected ops = true 2023-11-24T06:10:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: bdev async discard = True 2023-11-24T06:10:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: bdev enable discard = True 2023-11-24T06:10:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore allocator = bitmap 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore block size = 96636764160 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore fsck on mount = True 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluefs = 1/20 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluestore = 1/20 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: debug osd = 20 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: debug rocksdb = 4/10 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd full ratio = 0.9 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd nearfull ratio = 0.8 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: osd failsafe full ratio = 0.95 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: osd objectstore = bluestore 2023-11-24T06:10:52.971 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr] 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: debug mgr = 20 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: mgr/telemetry/nag = false 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: debug finisher = 20 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.972 INFO:teuthology.orchestra.run.smithi022.stdout:[mon] 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: debug paxos = 20 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: mon data avail warn = 5 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: mon mgr mkfs grace = 240 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd reporter subtree level = osd 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd prime pg temp = true 2023-11-24T06:10:52.973 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: # 1m isn't quite enough 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: mon_down_mkfs_grace = 2m 2023-11-24T06:10:52.974 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_filestore_osds = false 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: mon op complaint time = 120 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout:[client] 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: rgw cache enabled = true 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable ops log = true 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable usage log = true 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: client mount timeout = 600 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = "" 2023-11-24T06:10:52.975 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.a] 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.b] 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.c] 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout:[mds] 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds = 20 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds balancer = 20 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-11-24T06:10:52.976 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug frag = True 2023-11-24T06:10:52.977 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug scatterstat = True 2023-11-24T06:10:52.977 INFO:teuthology.orchestra.run.smithi022.stdout: mds op complaint time = 180 2023-11-24T06:10:52.977 INFO:teuthology.orchestra.run.smithi022.stdout: mds verify scatter = True 2023-11-24T06:10:52.977 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2023-11-24T06:10:52.977 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2023-11-24T06:10:52.977 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2023-11-24T06:10:52.992 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2023-11-24T06:10:52.992 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2023-11-24T06:10:52.992 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T06:10:52.992 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2023-11-24T06:10:52.992 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.992 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.993 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T06:10:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T06:10:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2023-11-24T06:10:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2023-11-24T06:10:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2023-11-24T06:10:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2023-11-24T06:10:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2023-11-24T06:10:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2023-11-24T06:10:52.995 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.22,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = d0664f6f-6758-42fa-85ad-04f9384b4bc8 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2023-11-24T06:10:52.996 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2023-11-24T06:10:52.997 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2023-11-24T06:10:52.998 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2023-11-24T06:10:52.999 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2023-11-24T06:10:53.000 INFO:teuthology.orchestra.run.smithi031.stdout: debug finisher = 20 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:10:53.001 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2023-11-24T06:10:53.002 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2023-11-24T06:10:53.003 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2023-11-24T06:10:53.004 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2023-11-24T06:10:53.005 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-24T06:10:53.005 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2023-11-24T06:10:53.005 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2023-11-24T06:10:53.005 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2023-11-24T06:10:53.005 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2023-11-24T06:10:53.005 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-11-24T06:10:53.005 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-11-24T06:10:53.005 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-11-24T06:10:53.042 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-24T06:10:53.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-24T06:10:53.205 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-24T06:10:53.205 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:53.205 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-24T06:10:53.261 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:53.262 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-24T06:10:53.313 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:10:53.313 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:53.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T06:10:53.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:10:53.472 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:10:53.472 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:10:53.575 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:10:53.575 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:10:53.575 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T06:10:53.575 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:10:53.747 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:10:53.747 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:10:53.849 INFO:tasks.ceph:Setting up mon nodes... 2023-11-24T06:10:53.849 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-24T06:10:53.849 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T06:10:54.059 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T06:10:54.070 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T06:10:54.278 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T06:10:54.289 INFO:tasks.ceph:Setting up mds nodes... 2023-11-24T06:10:54.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T06:10:54.501 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T06:10:54.511 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-24T06:10:54.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T06:10:54.811 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T06:10:54.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-24T06:10:54.916 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T06:10:55.116 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T06:10:55.126 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-24T06:10:55.222 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T06:10:55.417 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T06:10:55.426 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-24T06:10:55.525 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-24T06:10:55.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-24T06:10:55.670 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-24T06:10:55.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-24T06:10:55.868 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-24T06:10:55.940 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-24T06:10:56.079 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-24T06:10:56.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-24T06:10:56.284 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-24T06:10:56.339 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-24T06:10:56.339 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T06:10:56.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-24T06:10:56.450 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:10:56.450 INFO:tasks.ceph:role: osd.0 2023-11-24T06:10:56.450 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:10:56.451 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T06:10:56.550 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:10:56.550 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:10:56.551 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:10:56.551 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:10:56.551 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:10:56.551 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:10:56.551 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:10:56.551 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:10:56.551 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:10:56.551 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:10:56.584 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-11-24T06:10:56.590 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-11-24T06:10:56.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-24T06:10:56.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-24T06:10:56.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-24T06:10:56.877 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:10:56.877 INFO:tasks.ceph:role: osd.1 2023-11-24T06:10:56.877 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:10:56.877 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T06:10:56.968 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:10:56.968 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:10:56.968 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:10:56.969 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:10:56.969 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:10:56.969 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:10:56.969 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:10:56.969 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:10:56.969 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:10:56.969 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:10:57.006 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-11-24T06:10:57.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-11-24T06:10:57.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-24T06:10:57.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-24T06:10:57.212 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-24T06:10:57.306 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:10:57.307 INFO:tasks.ceph:role: osd.2 2023-11-24T06:10:57.307 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:10:57.307 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T06:10:57.406 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:10:57.406 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:10:57.406 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:10:57.407 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:10:57.407 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:10:57.407 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:10:57.407 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:10:57.407 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:10:57.407 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:10:57.407 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:10:57.440 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-11-24T06:10:57.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-11-24T06:10:57.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-24T06:10:57.558 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-24T06:10:57.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-24T06:10:57.729 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:10:57.729 INFO:tasks.ceph:role: osd.3 2023-11-24T06:10:57.730 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:10:57.730 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T06:10:57.827 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:10:57.827 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:10:57.827 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:10:57.827 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:10:57.827 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:10:57.827 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:10:57.827 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:10:57.827 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:10:57.828 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:10:57.828 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:10:57.861 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-11-24T06:10:57.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-11-24T06:10:57.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-24T06:10:57.983 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-24T06:10:58.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:10:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:10:58.213+0000 7f5a0761b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-24T06:10:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:10:58.214+0000 7f5a0761b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-24T06:10:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:10:58.214+0000 7f5a0761b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:10:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:10:58.214+0000 7f5a0761b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:10:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:10:58.214+0000 7f5a0761b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:10:58.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:10:58.217+0000 7f5a0761b500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-24T06:11:01.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-24T06:11:01.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:11:01.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:01.660+0000 7fccf6c00500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-24T06:11:01.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:01.660+0000 7fccf6c00500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-24T06:11:01.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:01.660+0000 7fccf6c00500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:11:01.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:01.660+0000 7fccf6c00500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:11:01.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:01.660+0000 7fccf6c00500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:11:01.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:01.662+0000 7fccf6c00500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-24T06:11:04.852 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-24T06:11:04.956 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:11:05.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:05.100+0000 7efc4551e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-24T06:11:05.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:05.101+0000 7efc4551e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-24T06:11:05.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:05.101+0000 7efc4551e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:11:05.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:05.101+0000 7efc4551e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:11:05.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:05.101+0000 7efc4551e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:11:05.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:05.103+0000 7efc4551e500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-24T06:11:08.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-24T06:11:08.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:11:08.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:08.265+0000 7fc7a3010500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-24T06:11:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:08.266+0000 7fc7a3010500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-24T06:11:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:08.266+0000 7fc7a3010500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:11:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:08.266+0000 7fc7a3010500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:11:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:08.266+0000 7fc7a3010500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:11:08.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:08.268+0000 7fc7a3010500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-24T06:11:11.443 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-24T06:11:11.553 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-24T06:11:11.667 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:11:11.667 INFO:tasks.ceph:role: osd.4 2023-11-24T06:11:11.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:11:11.667 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T06:11:11.778 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:11:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:11:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:11:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:11:11.779 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:11:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:11:11.779 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:11:11.779 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:11:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:11:11.779 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:11:12.289 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-24T06:11:12.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-24T06:11:12.298 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-24T06:11:12.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-24T06:11:12.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-24T06:11:12.725 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:11:12.725 INFO:tasks.ceph:role: osd.5 2023-11-24T06:11:12.725 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:11:12.725 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T06:11:12.822 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:11:12.822 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:11:12.822 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:11:12.822 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:11:12.822 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:11:12.822 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:11:12.822 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:11:12.823 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:11:12.823 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:11:12.823 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:11:13.306 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-24T06:11:13.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-24T06:11:13.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-24T06:11:13.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-24T06:11:13.548 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-24T06:11:13.634 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:11:13.634 INFO:tasks.ceph:role: osd.6 2023-11-24T06:11:13.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:11:13.634 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T06:11:13.714 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:11:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:11:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:11:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:11:13.714 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:11:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:11:13.714 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:11:13.714 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:11:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:11:13.715 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:11:14.212 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-24T06:11:14.217 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-24T06:11:14.218 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-24T06:11:14.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-24T06:11:14.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-24T06:11:14.591 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:11:14.591 INFO:tasks.ceph:role: osd.7 2023-11-24T06:11:14.591 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:11:14.591 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T06:11:14.697 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:11:14.698 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:11:14.698 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:11:14.698 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:11:14.698 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:11:14.698 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:11:14.699 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:11:14.699 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:11:14.699 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:11:14.699 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:11:15.149 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-24T06:11:15.155 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-24T06:11:15.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-24T06:11:15.302 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-24T06:11:15.405 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:11:15.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:15.556+0000 7f17fbafa500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-24T06:11:15.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:15.558+0000 7f17fbafa500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-24T06:11:15.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:15.558+0000 7f17fbafa500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:11:15.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:15.558+0000 7f17fbafa500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:11:15.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:15.558+0000 7f17fbafa500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:11:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:15.567+0000 7f17fbafa500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-24T06:11:18.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-24T06:11:18.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:11:19.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:19.010+0000 7f9c5f20d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-24T06:11:19.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:19.010+0000 7f9c5f20d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-24T06:11:19.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:19.010+0000 7f9c5f20d500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:11:19.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:19.010+0000 7f9c5f20d500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:11:19.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:19.010+0000 7f9c5f20d500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:11:19.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:19.013+0000 7f9c5f20d500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-24T06:11:19.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:11:19.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:11:22.203 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-24T06:11:22.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:11:22.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:22.461+0000 7fad40c0c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-24T06:11:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:22.462+0000 7fad40c0c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-24T06:11:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:22.462+0000 7fad40c0c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:11:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:22.462+0000 7fad40c0c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:11:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:22.462+0000 7fad40c0c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:11:22.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:22.464+0000 7fad40c0c500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-24T06:11:25.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-24T06:11:25.756 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:11:25.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:25.905+0000 7f87bce0c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-24T06:11:25.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:25.906+0000 7f87bce0c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-24T06:11:25.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:25.906+0000 7f87bce0c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:11:25.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:25.906+0000 7f87bce0c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:11:25.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:25.906+0000 7f87bce0c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:11:25.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:25.908+0000 7f87bce0c500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-24T06:11:29.094 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-24T06:11:29.202 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-24T06:11:29.203 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:29.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-24T06:11:29.313 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:29.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-24T06:11:29.417 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:29.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-24T06:11:29.522 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:29.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-24T06:11:29.625 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:29.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-24T06:11:29.727 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:29.727 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-24T06:11:29.831 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:29.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-24T06:11:29.934 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:29.934 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-24T06:11:30.045 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:30.045 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-24T06:11:30.144 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:30.144 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-24T06:11:30.251 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:30.252 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-24T06:11:30.356 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:30.357 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-24T06:11:30.462 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:30.462 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-24T06:11:30.566 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:30.566 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-24T06:11:30.669 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:30.669 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-24T06:11:30.735 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:30.735 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-24T06:11:30.792 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:30.792 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-24T06:11:30.856 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:30.856 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-24T06:11:30.913 INFO:tasks.ceph:Adding keys to all mons... 2023-11-24T06:11:30.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T06:11:30.922 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T06:11:31.012 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.y] 2023-11-24T06:11:31.012 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBuPmBl35NuAxAAr2yZZ37B4v9xkzTh/HGQhg== 2023-11-24T06:11:31.012 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2023-11-24T06:11:31.012 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBuPmBlC0/KHRAAP3OMqK3lsC21mJ3yyEa2uQ== 2023-11-24T06:11:31.012 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBuPmBlfblGMBAAjEBBQvn4tcLAx4BB3IjQrw== 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQByPmBl1c3MDBAAG4T9x4tKBMvnezzPu4t21g== 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQB1PmBlnqt2JxAASc03pLw8zZ4XPH46+FtW3Q== 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQB5PmBld+YeBhAA8jBhyD2sGPOXouNHKK4mUQ== 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQB8PmBlx3blDxAAuB/aw9Wmh3rIxKpm7HK73A== 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBuPmBlLBh/EBAA1PD6yyS4WDatwZsP2fu8Nw== 2023-11-24T06:11:31.013 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBvPmBl1X/aBhAAY61uwiv5vBaTPkDByOLPmw== 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBvPmBlxcDDGBAAMX5i2Zfh+M5ZvjS1gKUVwA== 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.4] 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCDPmBlows5IRAAcEuvr47gyOcmFYg2HRRakw== 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.5] 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCHPmBlYK2jABAAJ093DHd2vAmF07tYS/qHzA== 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.6] 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCKPmBlYV2SGxAAArDvmB2DRwHwVy+cOu3JNw== 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.7] 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCNPmBlyZsANhAAKCXDIC1kjqyk42AJqK93/g== 2023-11-24T06:11:31.014 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2023-11-24T06:11:31.015 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBvPmBlp6jYJxAA527jQJV49tBf9Am4wak0NA== 2023-11-24T06:11:31.015 INFO:teuthology.orchestra.run.smithi022.stdout:[client.2] 2023-11-24T06:11:31.015 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBvPmBld3CuMxAAwvncg0GHEOgekURnLX45ow== 2023-11-24T06:11:31.015 INFO:teuthology.orchestra.run.smithi022.stdout:[client.1] 2023-11-24T06:11:31.015 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBwPmBlGvWoBBAAvbXYydB5FV2WWwhJpeoP/A== 2023-11-24T06:11:31.015 INFO:teuthology.orchestra.run.smithi022.stdout:[client.3] 2023-11-24T06:11:31.015 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBwPmBlWinREBAALUxc6wrq/vbCi/RkUtnoLw== 2023-11-24T06:11:31.020 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBuPmBl35NuAxAAr2yZZ37B4v9xkzTh/HGQhg== 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBuPmBlC0/KHRAAP3OMqK3lsC21mJ3yyEa2uQ== 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBuPmBlfblGMBAAjEBBQvn4tcLAx4BB3IjQrw== 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQByPmBl1c3MDBAAG4T9x4tKBMvnezzPu4t21g== 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB1PmBlnqt2JxAASc03pLw8zZ4XPH46+FtW3Q== 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2023-11-24T06:11:31.021 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB5PmBld+YeBhAA8jBhyD2sGPOXouNHKK4mUQ== 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB8PmBlx3blDxAAuB/aw9Wmh3rIxKpm7HK73A== 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBuPmBlLBh/EBAA1PD6yyS4WDatwZsP2fu8Nw== 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBvPmBl1X/aBhAAY61uwiv5vBaTPkDByOLPmw== 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBvPmBlxcDDGBAAMX5i2Zfh+M5ZvjS1gKUVwA== 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCDPmBlows5IRAAcEuvr47gyOcmFYg2HRRakw== 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2023-11-24T06:11:31.022 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCHPmBlYK2jABAAJ093DHd2vAmF07tYS/qHzA== 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCKPmBlYV2SGxAAArDvmB2DRwHwVy+cOu3JNw== 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCNPmBlyZsANhAAKCXDIC1kjqyk42AJqK93/g== 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBvPmBlp6jYJxAA527jQJV49tBf9Am4wak0NA== 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout:[client.2] 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBvPmBld3CuMxAAwvncg0GHEOgekURnLX45ow== 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBwPmBlGvWoBBAAvbXYydB5FV2WWwhJpeoP/A== 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout:[client.3] 2023-11-24T06:11:31.023 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBwPmBlWinREBAALUxc6wrq/vbCi/RkUtnoLw== 2023-11-24T06:11:31.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:11:31.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:11:31.185 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:11:31.194 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:11:31.352 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:11:31.361 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:11:31.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:31.524 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:31.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:31.690 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:31.837 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:31.842 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:31.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:32.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:32.152 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:11:32.161 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:11:32.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:11:32.326 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:11:32.485 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:11:32.494 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:11:32.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:32.663 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:32.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:32.826 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:32.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:32.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:33.155 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:33.164 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:11:33.321 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:11:33.329 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:11:33.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:11:33.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:11:33.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:11:33.662 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:11:33.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:11:33.829 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:11:33.992 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-24T06:11:33.992 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-24T06:11:34.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:11:34.266 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-24T06:11:34.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-24T06:11:34.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:11:34.646 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-24T06:11:34.744 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-24T06:11:34.848 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:11:35.013 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-24T06:11:35.112 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:11:35.121 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:11:35.179 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-24T06:11:35.179 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-24T06:11:35.179 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-24T06:11:35.185 INFO:tasks.ceph.mon.a:Started 2023-11-24T06:11:35.185 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-24T06:11:35.185 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-24T06:11:35.191 INFO:tasks.ceph.mon.b:Started 2023-11-24T06:11:35.191 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-24T06:11:35.191 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-24T06:11:35.196 INFO:tasks.ceph.mon.c:Started 2023-11-24T06:11:35.196 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-24T06:11:35.196 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-24T06:11:35.197 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-24T06:11:35.204 INFO:tasks.ceph.mgr.y:Started 2023-11-24T06:11:35.205 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-24T06:11:35.205 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-24T06:11:35.209 INFO:tasks.ceph.mgr.x:Started 2023-11-24T06:11:35.209 INFO:tasks.ceph:Setting crush tunables to default 2023-11-24T06:11:35.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd crush tunables default 2023-11-24T06:11:35.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.391+0000 7f5782168640 1 Processor -- start 2023-11-24T06:11:35.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.391+0000 7f5782168640 1 -- start start 2023-11-24T06:11:35.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.392+0000 7f5782168640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f577c0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:35.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.392+0000 7f5782168640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577c15b730 con 0x7f577c0adb60 2023-11-24T06:11:35.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.392+0000 7f5782168640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577c0ac740 con 0x7f577c15b350 2023-11-24T06:11:35.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.392+0000 7f5782168640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c0ac460 con 0x7f577c09cb30 2023-11-24T06:11:35.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.392+0000 7f577bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f577c0adb60 0x7f577c0adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59940/0 (socket says 172.21.15.22:59940) 2023-11-24T06:11:35.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.393+0000 7f577bfff640 1 -- 172.21.15.22:0/1359318291 learned_addr learned my addr 172.21.15.22:0/1359318291 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:35.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.393+0000 7f5773fff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f577c0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:35.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.393+0000 7f5773fff640 1 -- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 msgr2=0x7f577c0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T06:11:35.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.393+0000 7f5773fff640 1 -- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 msgr2=0x7f577c0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T06:11:35.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.393+0000 7f5773fff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f577c0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T06:11:35.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.393+0000 7f5773fff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f577c0abe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T06:11:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.595+0000 7f5773fff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f577c0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.595+0000 7f5773fff640 1 -- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 msgr2=0x7f577c0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T06:11:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.595+0000 7f5773fff640 1 -- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 msgr2=0x7f577c0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T06:11:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.595+0000 7f5773fff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f577c0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T06:11:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.595+0000 7f5773fff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f577c0abe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T06:11:35.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.644+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810206507 0 0) 0x7f5774001490 con 0x7f577c0adb60 2023-11-24T06:11:35.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.644+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5768003520 con 0x7f577c0adb60 2023-11-24T06:11:35.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.644+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623782450 0 0) 0x7f576c001110 con 0x7f577c15b350 2023-11-24T06:11:35.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.644+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5774001490 con 0x7f577c15b350 2023-11-24T06:11:35.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.645+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 947830213 0 0) 0x7f5768003520 con 0x7f577c0adb60 2023-11-24T06:11:35.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.645+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 msgr2=0x7f577c0abe80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:11:35.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.645+0000 7f577affd640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f577c0abe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.645+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 >> v1:172.21.15.31:6789/0 conn(0x7f577c15b350 legacy=0x7f577c0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.645+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c0b2a50 con 0x7f577c0adb60 2023-11-24T06:11:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.645+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f5774001b80 con 0x7f577c0adb60 2023-11-24T06:11:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.645+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 >> v1:172.21.15.22:6789/0 conn(0x7f577c0adb60 legacy=0x7f577c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.645+0000 7f577affd640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f5768004b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.645+0000 7f577affd640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768005140 0x7f5768003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.646+0000 7f577affd640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f5768004120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:35.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.646+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c0ac460 con 0x7f5768003ca0 2023-11-24T06:11:35.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.646+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576800bb70 con 0x7f5768005140 2023-11-24T06:11:35.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.646+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576800bd30 con 0x7f577c09cb30 2023-11-24T06:11:35.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.646+0000 7f577bfff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f5768004120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:35.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.646+0000 7f577b7fe640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f5768004b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:35.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.647+0000 7f5773fff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768005140 0x7f5768003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:35.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.647+0000 7f577bfff640 1 -- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 msgr2=0x7f5768004b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:35.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.647+0000 7f577bfff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c09cb30 0x7f5768004b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:35.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.647+0000 7f577bfff640 1 -- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768005140 msgr2=0x7f5768003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:35.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.647+0000 7f577bfff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768005140 0x7f5768003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:35.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.647+0000 7f577bfff640 1 -- 172.21.15.22:0/1359318291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768003520 con 0x7f5768003ca0 2023-11-24T06:11:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.649+0000 7f577bfff640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f5768004120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f577400a6f0 tx=0x7f57680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853d8f8b8442350a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:35.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.650+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774035880 con 0x7f5768003ca0 2023-11-24T06:11:35.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.650+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57740359e0 con 0x7f5768003ca0 2023-11-24T06:11:35.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.650+0000 7f577affd640 1 -- 172.21.15.22:0/1359318291 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774035d90 con 0x7f5768003ca0 2023-11-24T06:11:35.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.651+0000 7f5782168640 1 -- 172.21.15.22:0/1359318291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 msgr2=0x7f5768004120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:35.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.651+0000 7f5782168640 1 --2- 172.21.15.22:0/1359318291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f5768004120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f577400a6f0 tx=0x7f57680057f0 comp rx=0 tx=0).stop 2023-11-24T06:11:35.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.651+0000 7f577bfff640 1 -- 172.21.15.22:0/1359318291 reap_dead start 2023-11-24T06:11:35.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.652+0000 7f5782168640 1 -- 172.21.15.22:0/1359318291 shutdown_connections 2023-11-24T06:11:35.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.652+0000 7f5782168640 1 -- 172.21.15.22:0/1359318291 >> 172.21.15.22:0/1359318291 conn(0x7f577c0b0ba0 msgr2=0x7f577c0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:35.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.652+0000 7f5782168640 1 -- 172.21.15.22:0/1359318291 shutdown_connections 2023-11-24T06:11:35.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.652+0000 7f5782168640 1 -- 172.21.15.22:0/1359318291 wait complete. 2023-11-24T06:11:35.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.656+0000 7f5782168640 1 Processor -- start 2023-11-24T06:11:35.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.657+0000 7f5782168640 1 -- start start 2023-11-24T06:11:35.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.659+0000 7f5782168640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f577c139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:35.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.659+0000 7f5782168640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c14a7f0 0x7f577c149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:35.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.659+0000 7f5782168640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c13bdb0 0x7f577c14b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:35.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.659+0000 7f5782168640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c158d60 con 0x7f5768003ca0 2023-11-24T06:11:35.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.659+0000 7f5782168640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c159040 con 0x7f577c14a7f0 2023-11-24T06:11:35.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.659+0000 7f5782168640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c159320 con 0x7f577c13bdb0 2023-11-24T06:11:35.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.659+0000 7f577b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f577c139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:35.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.660+0000 7f577b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f577c139200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33718/0 (socket says 172.21.15.22:33718) 2023-11-24T06:11:35.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.660+0000 7f577b7fe640 1 -- 172.21.15.22:0/3084235425 learned_addr learned my addr 172.21.15.22:0/3084235425 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:35.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.660+0000 7f577bfff640 1 --2- 172.21.15.22:0/3084235425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c13bdb0 0x7f577c14b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:35.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.660+0000 7f5773fff640 1 --2- 172.21.15.22:0/3084235425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c14a7f0 0x7f577c149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:35.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.660+0000 7f577b7fe640 1 -- 172.21.15.22:0/3084235425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c13bdb0 msgr2=0x7f577c14b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:35.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.660+0000 7f577b7fe640 1 --2- 172.21.15.22:0/3084235425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c13bdb0 0x7f577c14b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:35.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.660+0000 7f577b7fe640 1 -- 172.21.15.22:0/3084235425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c14a7f0 msgr2=0x7f577c149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:35.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.660+0000 7f577b7fe640 1 --2- 172.21.15.22:0/3084235425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c14a7f0 0x7f577c149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.660+0000 7f577b7fe640 1 -- 172.21.15.22:0/3084235425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c159600 con 0x7f5768003ca0 2023-11-24T06:11:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.661+0000 7f577b7fe640 1 --2- 172.21.15.22:0/3084235425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f577c139200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f576c00e6c0 tx=0x7f576c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.661+0000 7f5778ff9640 1 -- 172.21.15.22:0/3084235425 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0050d0 con 0x7f5768003ca0 2023-11-24T06:11:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.661+0000 7f5778ff9640 1 -- 172.21.15.22:0/3084235425 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c005250 con 0x7f5768003ca0 2023-11-24T06:11:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.661+0000 7f5782168640 1 -- 172.21.15.22:0/3084235425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c1598e0 con 0x7f5768003ca0 2023-11-24T06:11:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.661+0000 7f5778ff9640 1 -- 172.21.15.22:0/3084235425 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00c6c0 con 0x7f5768003ca0 2023-11-24T06:11:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.661+0000 7f5782168640 1 -- 172.21.15.22:0/3084235425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c139740 con 0x7f5768003ca0 2023-11-24T06:11:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.662+0000 7f5778ff9640 1 -- 172.21.15.22:0/3084235425 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f576c016070 con 0x7f5768003ca0 2023-11-24T06:11:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.662+0000 7f5778ff9640 1 -- 172.21.15.22:0/3084235425 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f576c019470 con 0x7f5768003ca0 2023-11-24T06:11:35.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.663+0000 7f5782168640 1 -- 172.21.15.22:0/3084235425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c09d200 con 0x7f5768003ca0 2023-11-24T06:11:35.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.666+0000 7f5778ff9640 1 -- 172.21.15.22:0/3084235425 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f576c01e020 con 0x7f5768003ca0 2023-11-24T06:11:35.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.742+0000 7f5782168640 1 -- 172.21.15.22:0/3084235425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f577c04e920 con 0x7f5768003ca0 2023-11-24T06:11:35.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.746+0000 7f5778ff9640 1 -- 172.21.15.22:0/3084235425 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f577c0ac740 con 0x7f5768003ca0 2023-11-24T06:11:35.749 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2023-11-24T06:11:35.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.747+0000 7f5782168640 1 -- 172.21.15.22:0/3084235425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 msgr2=0x7f577c139200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.747+0000 7f5782168640 1 --2- 172.21.15.22:0/3084235425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f577c139200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f576c00e6c0 tx=0x7f576c00eb80 comp rx=0 tx=0).stop 2023-11-24T06:11:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.747+0000 7f5782168640 1 -- 172.21.15.22:0/3084235425 shutdown_connections 2023-11-24T06:11:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.747+0000 7f5782168640 1 --2- 172.21.15.22:0/3084235425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c13bdb0 0x7f577c14b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.747+0000 7f5782168640 1 --2- 172.21.15.22:0/3084235425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c14a7f0 0x7f577c149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.747+0000 7f5782168640 1 --2- 172.21.15.22:0/3084235425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5768003ca0 0x7f577c139200 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.747+0000 7f5782168640 1 -- 172.21.15.22:0/3084235425 >> 172.21.15.22:0/3084235425 conn(0x7f577c0b0ba0 msgr2=0x7f577c0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.748+0000 7f5782168640 1 -- 172.21.15.22:0/3084235425 shutdown_connections 2023-11-24T06:11:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:35.748+0000 7f5782168640 1 -- 172.21.15.22:0/3084235425 wait complete. 2023-11-24T06:11:35.775 INFO:tasks.ceph:check_enable_crimson: False 2023-11-24T06:11:35.775 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-24T06:11:35.776 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:35.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-24T06:11:35.860 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:35.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-24T06:11:36.002 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:36.002 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-24T06:11:36.101 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:11:36.101 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-24T06:11:36.194 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:36.194 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-24T06:11:36.237 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:36.235+0000 7fed8c856040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T06:11:36.298 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:36.298 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-24T06:11:36.300 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:36.297+0000 7fed8c856040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T06:11:36.391 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:36.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-24T06:11:36.480 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:11:36.480 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-24T06:11:36.558 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:36.555+0000 7f59ab40e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T06:11:36.574 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new e2532170-60c2-45eb-a4ef-a4334335c962 0 2023-11-24T06:11:36.632 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:36.629+0000 7f59ab40e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T06:11:36.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.781+0000 7fce5e0ff640 1 Processor -- start 2023-11-24T06:11:36.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.781+0000 7fce5e0ff640 1 -- start start 2023-11-24T06:11:36.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.782+0000 7fce5e0ff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce5815d3b0 0x7fce580ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:36.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.782+0000 7fce5e0ff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce580d0fa0 0x7fce580d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.782+0000 7fce5e0ff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce580c6bf0 con 0x7fce580d1bc0 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.782+0000 7fce5e0ff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce580d1430 con 0x7fce5815d3b0 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.782+0000 7fce5e0ff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce580d1fa0 con 0x7fce580d0fa0 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.783+0000 7fce5c8fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce580d0fa0 0x7fce580d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.783+0000 7fce5c8fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce580d0fa0 0x7fce580d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38868/0 (socket says 172.21.15.31:38868) 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.783+0000 7fce5c8fc640 1 -- 172.21.15.31:0/3554152301 learned_addr learned my addr 172.21.15.31:0/3554152301 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.783+0000 7fce5d0fd640 1 --2- 172.21.15.31:0/3554152301 >> v2:172.21.15.22:3300/0 conn(0x7fce5815d3b0 0x7fce580ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.783+0000 7fce5c8fc640 1 -- 172.21.15.31:0/3554152301 >> v2:172.21.15.22:3300/0 conn(0x7fce5815d3b0 msgr2=0x7fce580ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.783+0000 7fce5c8fc640 1 --2- 172.21.15.31:0/3554152301 >> v2:172.21.15.22:3300/0 conn(0x7fce5815d3b0 0x7fce580ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.783+0000 7fce5c8fc640 1 -- 172.21.15.31:0/3554152301 >> v1:172.21.15.22:6789/0 conn(0x7fce580d1bc0 legacy=0x7fce580b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:36.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.783+0000 7fce5c8fc640 1 -- 172.21.15.31:0/3554152301 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce580cedc0 con 0x7fce580d0fa0 2023-11-24T06:11:36.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.784+0000 7fce5c8fc640 1 --2- 172.21.15.31:0/3554152301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce580d0fa0 0x7fce580d1680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce5808c4a0 tx=0x7fce4802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55f76b40f568a291 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:36.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce4ffff640 1 -- 172.21.15.31:0/3554152301 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480317e0 con 0x7fce580d0fa0 2023-11-24T06:11:36.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce4ffff640 1 -- 172.21.15.31:0/3554152301 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce48031940 con 0x7fce580d0fa0 2023-11-24T06:11:36.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce4ffff640 1 -- 172.21.15.31:0/3554152301 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48031cd0 con 0x7fce580d0fa0 2023-11-24T06:11:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce5e0ff640 1 -- 172.21.15.31:0/3554152301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce580d0fa0 msgr2=0x7fce580d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce5e0ff640 1 --2- 172.21.15.31:0/3554152301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce580d0fa0 0x7fce580d1680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce5808c4a0 tx=0x7fce4802b880 comp rx=0 tx=0).stop 2023-11-24T06:11:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce5e0ff640 1 -- 172.21.15.31:0/3554152301 shutdown_connections 2023-11-24T06:11:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce5e0ff640 1 --2- 172.21.15.31:0/3554152301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce580d0fa0 0x7fce580d1680 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce5e0ff640 1 --2- 172.21.15.31:0/3554152301 >> v2:172.21.15.22:3300/0 conn(0x7fce5815d3b0 0x7fce580ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce5e0ff640 1 -- 172.21.15.31:0/3554152301 >> 172.21.15.31:0/3554152301 conn(0x7fce580d30a0 msgr2=0x7fce580d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:36.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.785+0000 7fce5e0ff640 1 -- 172.21.15.31:0/3554152301 shutdown_connections 2023-11-24T06:11:36.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.786+0000 7fce5e0ff640 1 -- 172.21.15.31:0/3554152301 wait complete. 2023-11-24T06:11:36.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.787+0000 7fce5e0ff640 1 Processor -- start 2023-11-24T06:11:36.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.787+0000 7fce5e0ff640 1 -- start start 2023-11-24T06:11:36.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.788+0000 7fce5e0ff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce580d0fa0 0x7fce5815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:36.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.788+0000 7fce5e0ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce580d1bc0 0x7fce580a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.788+0000 7fce5e0ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5815d3b0 0x7fce581f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.788+0000 7fce5e0ff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5815cb60 con 0x7fce5815d3b0 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.788+0000 7fce5e0ff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5809d7a0 con 0x7fce580d1bc0 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.788+0000 7fce5e0ff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5809da00 con 0x7fce580d0fa0 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.788+0000 7fce5d0fd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce580d0fa0 0x7fce5815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5c8fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce580d1bc0 0x7fce580a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d0fd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce580d0fa0 0x7fce5815c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34328/0 (socket says 172.21.15.31:34328) 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d0fd640 1 -- 172.21.15.31:0/2182086213 learned_addr learned my addr 172.21.15.31:0/2182086213 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d8fe640 1 --2- 172.21.15.31:0/2182086213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5815d3b0 0x7fce581f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d0fd640 1 -- 172.21.15.31:0/2182086213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce580d1bc0 msgr2=0x7fce580a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d0fd640 1 --2- 172.21.15.31:0/2182086213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce580d1bc0 0x7fce580a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d0fd640 1 -- 172.21.15.31:0/2182086213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5815d3b0 msgr2=0x7fce581f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d0fd640 1 --2- 172.21.15.31:0/2182086213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5815d3b0 0x7fce581f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d0fd640 1 -- 172.21.15.31:0/2182086213 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480094d0 con 0x7fce580d0fa0 2023-11-24T06:11:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d8fe640 1 --2- 172.21.15.31:0/2182086213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5815d3b0 0x7fce581f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:11:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce5d0fd640 1 --2- 172.21.15.31:0/2182086213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce580d0fa0 0x7fce5815c620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce54007ef0 tx=0x7fce5400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.789+0000 7fce4dffb640 1 -- 172.21.15.31:0/2182086213 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54014620 con 0x7fce580d0fa0 2023-11-24T06:11:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.790+0000 7fce4dffb640 1 -- 172.21.15.31:0/2182086213 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54014780 con 0x7fce580d0fa0 2023-11-24T06:11:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.790+0000 7fce4dffb640 1 -- 172.21.15.31:0/2182086213 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54014b30 con 0x7fce580d0fa0 2023-11-24T06:11:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.790+0000 7fce5e0ff640 1 -- 172.21.15.31:0/2182086213 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5809dce0 con 0x7fce580d0fa0 2023-11-24T06:11:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.790+0000 7fce5e0ff640 1 -- 172.21.15.31:0/2182086213 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5809e2a0 con 0x7fce580d0fa0 2023-11-24T06:11:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.790+0000 7fce4dffb640 1 -- 172.21.15.31:0/2182086213 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fce5401e460 con 0x7fce580d0fa0 2023-11-24T06:11:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.790+0000 7fce4dffb640 1 -- 172.21.15.31:0/2182086213 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fce5401d450 con 0x7fce580d0fa0 2023-11-24T06:11:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.791+0000 7fce5e0ff640 1 -- 172.21.15.31:0/2182086213 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5809e430 con 0x7fce580d0fa0 2023-11-24T06:11:36.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.794+0000 7fce4dffb640 1 -- 172.21.15.31:0/2182086213 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fce5401e8a0 con 0x7fce580d0fa0 2023-11-24T06:11:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.874+0000 7fce5e0ff640 1 -- 172.21.15.31:0/2182086213 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e2532170-60c2-45eb-a4ef-a4334335c962", "id": 0} v 0) v1 -- 0x7fce5804e840 con 0x7fce580d0fa0 2023-11-24T06:11:36.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.880+0000 7fce4dffb640 1 -- 172.21.15.31:0/2182086213 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2532170-60c2-45eb-a4ef-a4334335c962", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce5401ea40 con 0x7fce580d0fa0 2023-11-24T06:11:36.884 INFO:teuthology.orchestra.run.smithi031.stdout:0 2023-11-24T06:11:36.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.881+0000 7fce5e0ff640 1 -- 172.21.15.31:0/2182086213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce580d0fa0 msgr2=0x7fce5815c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:36.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.881+0000 7fce5e0ff640 1 --2- 172.21.15.31:0/2182086213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce580d0fa0 0x7fce5815c620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce54007ef0 tx=0x7fce5400e4b0 comp rx=0 tx=0).stop 2023-11-24T06:11:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.881+0000 7fce5e0ff640 1 -- 172.21.15.31:0/2182086213 shutdown_connections 2023-11-24T06:11:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.881+0000 7fce5e0ff640 1 --2- 172.21.15.31:0/2182086213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5815d3b0 0x7fce581f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.881+0000 7fce5e0ff640 1 --2- 172.21.15.31:0/2182086213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce580d1bc0 0x7fce580a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.881+0000 7fce5e0ff640 1 --2- 172.21.15.31:0/2182086213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce580d0fa0 0x7fce5815c620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.881+0000 7fce5e0ff640 1 -- 172.21.15.31:0/2182086213 >> 172.21.15.31:0/2182086213 conn(0x7fce580d30a0 msgr2=0x7fce5806c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:36.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.881+0000 7fce5e0ff640 1 -- 172.21.15.31:0/2182086213 shutdown_connections 2023-11-24T06:11:36.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:36.882+0000 7fce5e0ff640 1 -- 172.21.15.31:0/2182086213 wait complete. 2023-11-24T06:11:36.902 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new a76af5ff-8a66-4296-9f11-79883330c1bf 1 2023-11-24T06:11:36.917 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:36.914+0000 7fed8c856040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T06:11:36.981 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:36.978+0000 7fed8c856040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T06:11:37.034 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:37.032+0000 7fed8c856040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T06:11:37.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.097+0000 7fa263ada640 1 Processor -- start 2023-11-24T06:11:37.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.097+0000 7fa263ada640 1 -- start start 2023-11-24T06:11:37.101 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:37.098+0000 7fed8c856040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T06:11:37.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa263ada640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa25c160bd0 0x7fa25c0b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa263ada640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa25c0b3210 0x7fa25c167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa263ada640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c0b23e0 con 0x7fa25c0b48d0 2023-11-24T06:11:37.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa263ada640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c0cdc70 con 0x7fa25c0b3210 2023-11-24T06:11:37.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa263ada640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c0b2870 con 0x7fa25c160bd0 2023-11-24T06:11:37.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa261876640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa25c160bd0 0x7fa25c0b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa261075640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa25c0b48d0 0x7fa25c0b2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60176/0 (socket says 172.21.15.31:60176) 2023-11-24T06:11:37.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa261876640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa25c160bd0 0x7fa25c0b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38888/0 (socket says 172.21.15.31:38888) 2023-11-24T06:11:37.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa261075640 1 -- 172.21.15.31:0/3104781287 learned_addr learned my addr 172.21.15.31:0/3104781287 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-24T06:11:37.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.099+0000 7fa262077640 1 --2- 172.21.15.31:0/3104781287 >> v2:172.21.15.22:3300/0 conn(0x7fa25c0b3210 0x7fa25c167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.100+0000 7fa261876640 1 -- 172.21.15.31:0/3104781287 >> v2:172.21.15.22:3300/0 conn(0x7fa25c0b3210 msgr2=0x7fa25c167290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:37.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.100+0000 7fa261876640 1 --2- 172.21.15.31:0/3104781287 >> v2:172.21.15.22:3300/0 conn(0x7fa25c0b3210 0x7fa25c167290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.100+0000 7fa261876640 1 -- 172.21.15.31:0/3104781287 >> v1:172.21.15.31:6789/0 conn(0x7fa25c0b48d0 legacy=0x7fa25c0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.100+0000 7fa261876640 1 -- 172.21.15.31:0/3104781287 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c0d41b0 con 0x7fa25c160bd0 2023-11-24T06:11:37.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.101+0000 7fa261876640 1 --2- 172.21.15.31:0/3104781287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c160bd0 0x7fa25c0b1ea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0cda60 tx=0x7fa25802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=873c4848706c54b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:37.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.102+0000 7fa260874640 1 -- 172.21.15.31:0/3104781287 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25802e070 con 0x7fa25c160bd0 2023-11-24T06:11:37.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.102+0000 7fa260874640 1 -- 172.21.15.31:0/3104781287 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2580315a0 con 0x7fa25c160bd0 2023-11-24T06:11:37.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.102+0000 7fa260874640 1 -- 172.21.15.31:0/3104781287 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258031930 con 0x7fa25c160bd0 2023-11-24T06:11:37.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.102+0000 7fa263ada640 1 -- 172.21.15.31:0/3104781287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c160bd0 msgr2=0x7fa25c0b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.102+0000 7fa263ada640 1 --2- 172.21.15.31:0/3104781287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c160bd0 0x7fa25c0b1ea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0cda60 tx=0x7fa25802b840 comp rx=0 tx=0).stop 2023-11-24T06:11:37.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.103+0000 7fa263ada640 1 -- 172.21.15.31:0/3104781287 shutdown_connections 2023-11-24T06:11:37.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.103+0000 7fa263ada640 1 --2- 172.21.15.31:0/3104781287 >> v2:172.21.15.22:3300/0 conn(0x7fa25c0b3210 0x7fa25c167290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.103+0000 7fa263ada640 1 --2- 172.21.15.31:0/3104781287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c160bd0 0x7fa25c0b1ea0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.103+0000 7fa263ada640 1 -- 172.21.15.31:0/3104781287 >> 172.21.15.31:0/3104781287 conn(0x7fa25c09c5a0 msgr2=0x7fa25c0d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:37.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.103+0000 7fa263ada640 1 -- 172.21.15.31:0/3104781287 shutdown_connections 2023-11-24T06:11:37.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.103+0000 7fa263ada640 1 -- 172.21.15.31:0/3104781287 wait complete. 2023-11-24T06:11:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.104+0000 7fa263ada640 1 Processor -- start 2023-11-24T06:11:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.105+0000 7fa263ada640 1 -- start start 2023-11-24T06:11:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.105+0000 7fa263ada640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c0b3210 0x7fa25c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa263ada640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa25c0b48d0 0x7fa25c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa263ada640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa25c160bd0 0x7fa25c0cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa263ada640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0cb760 con 0x7fa25c160bd0 2023-11-24T06:11:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa263ada640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0cba40 con 0x7fa25c0b3210 2023-11-24T06:11:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa263ada640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0cbd20 con 0x7fa25c0b48d0 2023-11-24T06:11:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261876640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c0b3210 0x7fa25c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261075640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa25c0b48d0 0x7fa25c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261876640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c0b3210 0x7fa25c0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38902/0 (socket says 172.21.15.31:38902) 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261876640 1 -- 172.21.15.31:0/2952070815 learned_addr learned my addr 172.21.15.31:0/2952070815 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa262077640 1 --2- 172.21.15.31:0/2952070815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa25c160bd0 0x7fa25c0cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261876640 1 -- 172.21.15.31:0/2952070815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa25c0b48d0 msgr2=0x7fa25c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261876640 1 --2- 172.21.15.31:0/2952070815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa25c0b48d0 0x7fa25c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261876640 1 -- 172.21.15.31:0/2952070815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa25c160bd0 msgr2=0x7fa25c0cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261876640 1 --2- 172.21.15.31:0/2952070815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa25c160bd0 0x7fa25c0cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261876640 1 -- 172.21.15.31:0/2952070815 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258009400 con 0x7fa25c0b3210 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.106+0000 7fa261075640 1 --2- 172.21.15.31:0/2952070815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa25c0b48d0 0x7fa25c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:11:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.107+0000 7fa261876640 1 --2- 172.21.15.31:0/2952070815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c0b3210 0x7fa25c0c9740 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa258009890 tx=0x7fa2580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:37.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.107+0000 7fa2527fc640 1 -- 172.21.15.31:0/2952070815 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258032840 con 0x7fa25c0b3210 2023-11-24T06:11:37.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.107+0000 7fa2527fc640 1 -- 172.21.15.31:0/2952070815 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2580329a0 con 0x7fa25c0b3210 2023-11-24T06:11:37.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.107+0000 7fa263ada640 1 -- 172.21.15.31:0/2952070815 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c0cc000 con 0x7fa25c0b3210 2023-11-24T06:11:37.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.107+0000 7fa2527fc640 1 -- 172.21.15.31:0/2952070815 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258032d50 con 0x7fa25c0b3210 2023-11-24T06:11:37.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.107+0000 7fa263ada640 1 -- 172.21.15.31:0/2952070815 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c1f48a0 con 0x7fa25c0b3210 2023-11-24T06:11:37.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.107+0000 7fa2527fc640 1 -- 172.21.15.31:0/2952070815 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa2580456f0 con 0x7fa25c0b3210 2023-11-24T06:11:37.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.108+0000 7fa2527fc640 1 -- 172.21.15.31:0/2952070815 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa25804d930 con 0x7fa25c0b3210 2023-11-24T06:11:37.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.108+0000 7fa263ada640 1 -- 172.21.15.31:0/2952070815 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c0a1210 con 0x7fa25c0b3210 2023-11-24T06:11:37.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.112+0000 7fa2527fc640 1 -- 172.21.15.31:0/2952070815 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa258045b30 con 0x7fa25c0b3210 2023-11-24T06:11:37.153 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:37.150+0000 7fed8c856040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T06:11:37.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.190+0000 7fa263ada640 1 -- 172.21.15.31:0/2952070815 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a76af5ff-8a66-4296-9f11-79883330c1bf", "id": 1} v 0) v1 -- 0x7fa25c0cfdd0 con 0x7fa25c0b3210 2023-11-24T06:11:37.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.198+0000 7fa2527fc640 1 -- 172.21.15.31:0/2952070815 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a76af5ff-8a66-4296-9f11-79883330c1bf", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa258045cd0 con 0x7fa25c0b3210 2023-11-24T06:11:37.201 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-11-24T06:11:37.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.199+0000 7fa263ada640 1 -- 172.21.15.31:0/2952070815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c0b3210 msgr2=0x7fa25c0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.199+0000 7fa263ada640 1 --2- 172.21.15.31:0/2952070815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c0b3210 0x7fa25c0c9740 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa258009890 tx=0x7fa2580046c0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.200+0000 7fa263ada640 1 -- 172.21.15.31:0/2952070815 shutdown_connections 2023-11-24T06:11:37.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.200+0000 7fa263ada640 1 --2- 172.21.15.31:0/2952070815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa25c160bd0 0x7fa25c0cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.200+0000 7fa263ada640 1 --2- 172.21.15.31:0/2952070815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa25c0b48d0 0x7fa25c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.200+0000 7fa263ada640 1 --2- 172.21.15.31:0/2952070815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa25c0b3210 0x7fa25c0c9740 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.200+0000 7fa263ada640 1 -- 172.21.15.31:0/2952070815 >> 172.21.15.31:0/2952070815 conn(0x7fa25c09c5a0 msgr2=0x7fa25c0cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:37.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.200+0000 7fa263ada640 1 -- 172.21.15.31:0/2952070815 shutdown_connections 2023-11-24T06:11:37.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.200+0000 7fa263ada640 1 -- 172.21.15.31:0/2952070815 wait complete. 2023-11-24T06:11:37.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new bce2b13a-ab53-49bc-ba86-3e989e813e4e 2 2023-11-24T06:11:37.273 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:37.270+0000 7fed8c856040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T06:11:37.289 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.286+0000 7f59ab40e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T06:11:37.354 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.350+0000 7f59ab40e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T06:11:37.356 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:37.354+0000 7fed8c856040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T06:11:37.408 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.405+0000 7f59ab40e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T06:11:37.412 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:37.410+0000 7fed8c856040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T06:11:37.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.412+0000 7f5cd0de5640 1 Processor -- start 2023-11-24T06:11:37.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.412+0000 7f5cd0de5640 1 -- start start 2023-11-24T06:11:37.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.413+0000 7f5cd0de5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ccc0d0260 0x7f5ccc0d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.413+0000 7f5cd0de5640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ccc0cf240 con 0x7f5ccc15d730 2023-11-24T06:11:37.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.413+0000 7f5cd0de5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ccc0d1fb0 con 0x7f5ccc15d350 2023-11-24T06:11:37.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.413+0000 7f5cd0de5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ccc0ce050 con 0x7f5ccc0d0260 2023-11-24T06:11:37.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.414+0000 7f5cca59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5ccc15d350 0x7f5ccc0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60178/0 (socket says 172.21.15.31:60178) 2023-11-24T06:11:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.414+0000 7f5cca59c640 1 -- 172.21.15.31:0/1070038550 learned_addr learned my addr 172.21.15.31:0/1070038550 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-24T06:11:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.414+0000 7f5ccad9d640 1 --2- 172.21.15.31:0/1070038550 >> v2:172.21.15.31:3300/0 conn(0x7f5ccc0d0260 0x7f5ccc0d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.414+0000 7f5ccad9d640 1 -- 172.21.15.31:0/1070038550 >> v1:172.21.15.31:6789/0 conn(0x7f5ccc15d350 legacy=0x7f5ccc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.414+0000 7f5ccad9d640 1 -- 172.21.15.31:0/1070038550 >> v1:172.21.15.22:6789/0 conn(0x7f5ccc15d730 legacy=0x7f5ccc0cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.414+0000 7f5cc959a640 1 -- 172.21.15.31:0/1070038550 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865427885 0 0) 0x7f5ccc0d1fb0 con 0x7f5ccc15d350 2023-11-24T06:11:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.414+0000 7f5ccad9d640 1 -- 172.21.15.31:0/1070038550 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0ce330 con 0x7f5ccc0d0260 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.415+0000 7f5ccad9d640 1 --2- 172.21.15.31:0/1070038550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc0d0260 0x7f5ccc0d3d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009d90 tx=0x7f5cc402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f61f27391638e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cc959a640 1 -- 172.21.15.31:0/1070038550 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc402cbd0 con 0x7f5ccc0d0260 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cc959a640 1 -- 172.21.15.31:0/1070038550 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc402cd30 con 0x7f5ccc0d0260 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cc959a640 1 -- 172.21.15.31:0/1070038550 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc402cea0 con 0x7f5ccc0d0260 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cd0de5640 1 -- 172.21.15.31:0/1070038550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc0d0260 msgr2=0x7f5ccc0d3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cd0de5640 1 --2- 172.21.15.31:0/1070038550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc0d0260 0x7f5ccc0d3d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009d90 tx=0x7f5cc402be20 comp rx=0 tx=0).stop 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cd0de5640 1 -- 172.21.15.31:0/1070038550 shutdown_connections 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cd0de5640 1 --2- 172.21.15.31:0/1070038550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc0d0260 0x7f5ccc0d3d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cd0de5640 1 -- 172.21.15.31:0/1070038550 >> 172.21.15.31:0/1070038550 conn(0x7f5ccc09c5c0 msgr2=0x7f5ccc0d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cd0de5640 1 -- 172.21.15.31:0/1070038550 shutdown_connections 2023-11-24T06:11:37.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.416+0000 7f5cd0de5640 1 -- 172.21.15.31:0/1070038550 wait complete. 2023-11-24T06:11:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.419+0000 7f5cd0de5640 1 Processor -- start 2023-11-24T06:11:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.419+0000 7f5cd0de5640 1 -- start start 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5cd0de5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ccc0d0260 0x7f5ccc0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5cd0de5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc15d350 0x7f5ccc14a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5cd0de5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ccc15d730 0x7f5ccc1f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5cd0de5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc157f20 con 0x7f5ccc0d0260 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5cd0de5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0b6360 con 0x7f5ccc15d350 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5cd0de5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0cbd60 con 0x7f5ccc15d730 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5ccad9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ccc15d730 0x7f5ccc1f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5cc9d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc15d350 0x7f5ccc14a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5ccad9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ccc15d730 0x7f5ccc1f32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34344/0 (socket says 172.21.15.31:34344) 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5ccad9d640 1 -- 172.21.15.31:0/3817802776 learned_addr learned my addr 172.21.15.31:0/3817802776 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.421+0000 7f5cca59c640 1 --2- 172.21.15.31:0/3817802776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ccc0d0260 0x7f5ccc0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5ccad9d640 1 -- 172.21.15.31:0/3817802776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc15d350 msgr2=0x7f5ccc14a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5ccad9d640 1 --2- 172.21.15.31:0/3817802776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc15d350 0x7f5ccc14a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5ccad9d640 1 -- 172.21.15.31:0/3817802776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ccc0d0260 msgr2=0x7f5ccc0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5ccad9d640 1 --2- 172.21.15.31:0/3817802776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ccc0d0260 0x7f5ccc0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5ccad9d640 1 -- 172.21.15.31:0/3817802776 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4009a70 con 0x7f5ccc15d730 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5cc9d9b640 1 --2- 172.21.15.31:0/3817802776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc15d350 0x7f5ccc14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5ccad9d640 1 --2- 172.21.15.31:0/3817802776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ccc15d730 0x7f5ccc1f32a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009eb0 tx=0x7f5cc4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5cbaffd640 1 -- 172.21.15.31:0/3817802776 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc402cea0 con 0x7f5ccc15d730 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5cbaffd640 1 -- 172.21.15.31:0/3817802776 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc403e630 con 0x7f5ccc15d730 2023-11-24T06:11:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5cbaffd640 1 -- 172.21.15.31:0/3817802776 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc403e9e0 con 0x7f5ccc15d730 2023-11-24T06:11:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.422+0000 7f5cd0de5640 1 -- 172.21.15.31:0/3817802776 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc0cb2b0 con 0x7f5ccc15d730 2023-11-24T06:11:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.423+0000 7f5cd0de5640 1 -- 172.21.15.31:0/3817802776 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc0cc290 con 0x7f5ccc15d730 2023-11-24T06:11:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.423+0000 7f5cbaffd640 1 -- 172.21.15.31:0/3817802776 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5cc403b050 con 0x7f5ccc15d730 2023-11-24T06:11:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.423+0000 7f5cbaffd640 1 -- 172.21.15.31:0/3817802776 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5cc403ee40 con 0x7f5ccc15d730 2023-11-24T06:11:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.424+0000 7f5cd0de5640 1 -- 172.21.15.31:0/3817802776 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc0a1230 con 0x7f5ccc15d730 2023-11-24T06:11:37.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.427+0000 7f5cbaffd640 1 -- 172.21.15.31:0/3817802776 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5cc404e060 con 0x7f5ccc15d730 2023-11-24T06:11:37.476 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:37.473+0000 7fed8c856040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T06:11:37.499 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.495+0000 7f59ab40e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T06:11:37.533 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:37.530+0000 7fed8c856040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T06:11:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.531+0000 7f5cd0de5640 1 -- 172.21.15.31:0/3817802776 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bce2b13a-ab53-49bc-ba86-3e989e813e4e", "id": 2} v 0) v1 -- 0x7f5ccc04e920 con 0x7f5ccc15d730 2023-11-24T06:11:37.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.539+0000 7f5cbaffd640 1 -- 172.21.15.31:0/3817802776 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bce2b13a-ab53-49bc-ba86-3e989e813e4e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5cc4044070 con 0x7f5ccc15d730 2023-11-24T06:11:37.543 INFO:teuthology.orchestra.run.smithi031.stdout:2 2023-11-24T06:11:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.541+0000 7f5cd0de5640 1 -- 172.21.15.31:0/3817802776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ccc15d730 msgr2=0x7f5ccc1f32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.541+0000 7f5cd0de5640 1 --2- 172.21.15.31:0/3817802776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ccc15d730 0x7f5ccc1f32a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009eb0 tx=0x7f5cc4004a40 comp rx=0 tx=0).stop 2023-11-24T06:11:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.541+0000 7f5cd0de5640 1 -- 172.21.15.31:0/3817802776 shutdown_connections 2023-11-24T06:11:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.541+0000 7f5cd0de5640 1 --2- 172.21.15.31:0/3817802776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ccc15d730 0x7f5ccc1f32a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.541+0000 7f5cd0de5640 1 --2- 172.21.15.31:0/3817802776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ccc15d350 0x7f5ccc14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.541+0000 7f5cd0de5640 1 --2- 172.21.15.31:0/3817802776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ccc0d0260 0x7f5ccc0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.541+0000 7f5cd0de5640 1 -- 172.21.15.31:0/3817802776 >> 172.21.15.31:0/3817802776 conn(0x7f5ccc09c5c0 msgr2=0x7f5ccc0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.541+0000 7f5cd0de5640 1 -- 172.21.15.31:0/3817802776 shutdown_connections 2023-11-24T06:11:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.541+0000 7f5cd0de5640 1 -- 172.21.15.31:0/3817802776 wait complete. 2023-11-24T06:11:37.552 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.549+0000 7f59ab40e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T06:11:37.559 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 788a69fe-610a-4be7-8ae9-c90e6aa9f772 3 2023-11-24T06:11:37.675 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.671+0000 7f59ab40e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T06:11:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.751+0000 7ff799e2d640 1 Processor -- start 2023-11-24T06:11:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.751+0000 7ff799e2d640 1 -- start start 2023-11-24T06:11:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.753+0000 7ff799e2d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.753+0000 7ff799e2d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff79415d730 0x7ff7940d1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.753+0000 7ff799e2d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7940d1d80 con 0x7ff7940ceb30 2023-11-24T06:11:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.753+0000 7ff799e2d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7940d1fb0 con 0x7ff79415d730 2023-11-24T06:11:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.753+0000 7ff799e2d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940ce050 con 0x7ff79415d350 2023-11-24T06:11:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.753+0000 7ff7937fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.753+0000 7ff7937fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940d3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34360/0 (socket says 172.21.15.31:34360) 2023-11-24T06:11:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.753+0000 7ff7937fe640 1 -- 172.21.15.31:0/467945598 learned_addr learned my addr 172.21.15.31:0/467945598 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.753+0000 7ff792ffd640 1 --2- 172.21.15.31:0/467945598 >> v2:172.21.15.22:3300/0 conn(0x7ff79415d730 0x7ff7940d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.754+0000 7ff7937fe640 1 -- 172.21.15.31:0/467945598 >> v2:172.21.15.22:3300/0 conn(0x7ff79415d730 msgr2=0x7ff7940d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.754+0000 7ff7937fe640 1 --2- 172.21.15.31:0/467945598 >> v2:172.21.15.22:3300/0 conn(0x7ff79415d730 0x7ff7940d1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.754+0000 7ff7937fe640 1 -- 172.21.15.31:0/467945598 >> v1:172.21.15.22:6789/0 conn(0x7ff7940ceb30 legacy=0x7ff7940cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.754+0000 7ff7937fe640 1 -- 172.21.15.31:0/467945598 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940ce330 con 0x7ff79415d350 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.755+0000 7ff7937fe640 1 --2- 172.21.15.31:0/467945598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940d3d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff784009870 tx=0x7ff78402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5374b2dad770c5f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.755+0000 7ff7927fc640 1 -- 172.21.15.31:0/467945598 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784030840 con 0x7ff79415d350 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.755+0000 7ff7927fc640 1 -- 172.21.15.31:0/467945598 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7840309a0 con 0x7ff79415d350 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.755+0000 7ff7927fc640 1 -- 172.21.15.31:0/467945598 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784030d30 con 0x7ff79415d350 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.756+0000 7ff799e2d640 1 -- 172.21.15.31:0/467945598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 msgr2=0x7ff7940d3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.756+0000 7ff799e2d640 1 --2- 172.21.15.31:0/467945598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940d3d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff784009870 tx=0x7ff78402b980 comp rx=0 tx=0).stop 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.756+0000 7ff799e2d640 1 -- 172.21.15.31:0/467945598 shutdown_connections 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.756+0000 7ff799e2d640 1 --2- 172.21.15.31:0/467945598 >> v2:172.21.15.22:3300/0 conn(0x7ff79415d730 0x7ff7940d1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.756+0000 7ff799e2d640 1 --2- 172.21.15.31:0/467945598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940d3d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.756+0000 7ff799e2d640 1 -- 172.21.15.31:0/467945598 >> 172.21.15.31:0/467945598 conn(0x7ff79409c5c0 msgr2=0x7ff7940d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.756+0000 7ff799e2d640 1 -- 172.21.15.31:0/467945598 shutdown_connections 2023-11-24T06:11:37.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.756+0000 7ff799e2d640 1 -- 172.21.15.31:0/467945598 wait complete. 2023-11-24T06:11:37.761 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.758+0000 7f59ab40e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T06:11:37.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.758+0000 7ff799e2d640 1 Processor -- start 2023-11-24T06:11:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.758+0000 7ff799e2d640 1 -- start start 2023-11-24T06:11:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff799e2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940ceb30 0x7ff7941550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff799e2d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff799e2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff79415d730 0x7ff7940cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff799e2d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7941556a0 con 0x7ff79415d730 2023-11-24T06:11:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff799e2d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7941e7690 con 0x7ff7940ceb30 2023-11-24T06:11:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff799e2d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff794160630 con 0x7ff79415d350 2023-11-24T06:11:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff792ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff7937fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940ceb30 0x7ff7941550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff792ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34366/0 (socket says 172.21.15.31:34366) 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff792ffd640 1 -- 172.21.15.31:0/1269017183 learned_addr learned my addr 172.21.15.31:0/1269017183 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.759+0000 7ff793fff640 1 --2- 172.21.15.31:0/1269017183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff79415d730 0x7ff7940cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff792ffd640 1 -- 172.21.15.31:0/1269017183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940ceb30 msgr2=0x7ff7941550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff792ffd640 1 --2- 172.21.15.31:0/1269017183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940ceb30 0x7ff7941550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff792ffd640 1 -- 172.21.15.31:0/1269017183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff79415d730 msgr2=0x7ff7940cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff792ffd640 1 --2- 172.21.15.31:0/1269017183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff79415d730 0x7ff7940cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff792ffd640 1 -- 172.21.15.31:0/1269017183 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7840094d0 con 0x7ff79415d350 2023-11-24T06:11:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff792ffd640 1 --2- 172.21.15.31:0/1269017183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940cacd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff78800d5c0 tx=0x7ff78800da80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff77bfff640 1 -- 172.21.15.31:0/1269017183 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880125f0 con 0x7ff79415d350 2023-11-24T06:11:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff77bfff640 1 -- 172.21.15.31:0/1269017183 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff788012750 con 0x7ff79415d350 2023-11-24T06:11:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff77bfff640 1 -- 172.21.15.31:0/1269017183 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788012b00 con 0x7ff79415d350 2023-11-24T06:11:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff799e2d640 1 -- 172.21.15.31:0/1269017183 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff794160910 con 0x7ff79415d350 2023-11-24T06:11:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.760+0000 7ff799e2d640 1 -- 172.21.15.31:0/1269017183 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7941558b0 con 0x7ff79415d350 2023-11-24T06:11:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.761+0000 7ff77bfff640 1 -- 172.21.15.31:0/1269017183 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff78801e460 con 0x7ff79415d350 2023-11-24T06:11:37.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.761+0000 7ff77bfff640 1 -- 172.21.15.31:0/1269017183 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7ff78801eba0 con 0x7ff79415d350 2023-11-24T06:11:37.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.762+0000 7ff799e2d640 1 -- 172.21.15.31:0/1269017183 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7940a1230 con 0x7ff79415d350 2023-11-24T06:11:37.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.764+0000 7ff77bfff640 1 -- 172.21.15.31:0/1269017183 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff78801e710 con 0x7ff79415d350 2023-11-24T06:11:37.841 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.838+0000 7f59ab40e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T06:11:37.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.872+0000 7ff799e2d640 1 -- 172.21.15.31:0/1269017183 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "788a69fe-610a-4be7-8ae9-c90e6aa9f772", "id": 3} v 0) v1 -- 0x7ff79404e920 con 0x7ff79415d350 2023-11-24T06:11:37.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.879+0000 7ff77bfff640 1 -- 172.21.15.31:0/1269017183 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "788a69fe-610a-4be7-8ae9-c90e6aa9f772", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff78801e930 con 0x7ff79415d350 2023-11-24T06:11:37.882 INFO:teuthology.orchestra.run.smithi031.stdout:3 2023-11-24T06:11:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.880+0000 7ff799e2d640 1 -- 172.21.15.31:0/1269017183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 msgr2=0x7ff7940cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:37.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.880+0000 7ff799e2d640 1 --2- 172.21.15.31:0/1269017183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940cacd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff78800d5c0 tx=0x7ff78800da80 comp rx=0 tx=0).stop 2023-11-24T06:11:37.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.880+0000 7ff799e2d640 1 -- 172.21.15.31:0/1269017183 shutdown_connections 2023-11-24T06:11:37.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.880+0000 7ff799e2d640 1 --2- 172.21.15.31:0/1269017183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff79415d730 0x7ff7940cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.880+0000 7ff799e2d640 1 --2- 172.21.15.31:0/1269017183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff79415d350 0x7ff7940cacd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.880+0000 7ff799e2d640 1 --2- 172.21.15.31:0/1269017183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940ceb30 0x7ff7941550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:37.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.880+0000 7ff799e2d640 1 -- 172.21.15.31:0/1269017183 >> 172.21.15.31:0/1269017183 conn(0x7ff79409c5c0 msgr2=0x7ff7940b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:37.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.880+0000 7ff799e2d640 1 -- 172.21.15.31:0/1269017183 shutdown_connections 2023-11-24T06:11:37.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:37.880+0000 7ff799e2d640 1 -- 172.21.15.31:0/1269017183 wait complete. 2023-11-24T06:11:37.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new b1a62b11-eaac-4ceb-a90b-9d00731801b7 4 2023-11-24T06:11:37.907 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.904+0000 7f59ab40e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T06:11:37.966 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:37.962+0000 7f59ab40e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T06:11:38.008 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:38.005+0000 7fed8c856040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T06:11:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.097+0000 7f190723d640 1 Processor -- start 2023-11-24T06:11:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.097+0000 7f190723d640 1 -- start start 2023-11-24T06:11:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.099+0000 7f190723d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1900160bd0 0x7f19000b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.099+0000 7f190723d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000b23e0 con 0x7f19000b3210 2023-11-24T06:11:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.099+0000 7f190723d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000d41b0 con 0x7f19000b48d0 2023-11-24T06:11:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.099+0000 7f190723d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000cdc70 con 0x7f1900160bd0 2023-11-24T06:11:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.099+0000 7f1904fd9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1900160bd0 0x7f19000b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.099+0000 7f1904fd9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1900160bd0 0x7f19000b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38942/0 (socket says 172.21.15.31:38942) 2023-11-24T06:11:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.099+0000 7f1904fd9640 1 -- 172.21.15.31:0/820248367 learned_addr learned my addr 172.21.15.31:0/820248367 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.099+0000 7f18f7fff640 1 --1- 172.21.15.31:0/820248367 >> v1:172.21.15.31:6789/0 conn(0x7f19000b48d0 0x7f19000b2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60194/0 (socket says 172.21.15.31:60194) 2023-11-24T06:11:38.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.100+0000 7f1904fd9640 1 -- 172.21.15.31:0/820248367 >> v1:172.21.15.31:6789/0 conn(0x7f19000b48d0 legacy=0x7f19000b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.100+0000 7f1904fd9640 1 -- 172.21.15.31:0/820248367 >> v1:172.21.15.22:6789/0 conn(0x7f19000b3210 legacy=0x7f1900167290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:38.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.100+0000 7f1904fd9640 1 -- 172.21.15.31:0/820248367 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900160fb0 con 0x7f1900160bd0 2023-11-24T06:11:38.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.101+0000 7f1904fd9640 1 --2- 172.21.15.31:0/820248367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 0x7f19000b1ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f19000cddb0 tx=0x7f18fc02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8084c82a98d1eb28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:38.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.101+0000 7f18f77fe640 1 -- 172.21.15.31:0/820248367 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc02ca70 con 0x7f1900160bd0 2023-11-24T06:11:38.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.101+0000 7f18f77fe640 1 -- 172.21.15.31:0/820248367 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc02cbd0 con 0x7f1900160bd0 2023-11-24T06:11:38.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.101+0000 7f18f77fe640 1 -- 172.21.15.31:0/820248367 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0343f0 con 0x7f1900160bd0 2023-11-24T06:11:38.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.102+0000 7f190723d640 1 -- 172.21.15.31:0/820248367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 msgr2=0x7f19000b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.102+0000 7f190723d640 1 --2- 172.21.15.31:0/820248367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 0x7f19000b1ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f19000cddb0 tx=0x7f18fc02bed0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.102+0000 7f190723d640 1 -- 172.21.15.31:0/820248367 shutdown_connections 2023-11-24T06:11:38.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.102+0000 7f190723d640 1 --2- 172.21.15.31:0/820248367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 0x7f19000b1ea0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.102+0000 7f190723d640 1 -- 172.21.15.31:0/820248367 >> 172.21.15.31:0/820248367 conn(0x7f190009c5a0 msgr2=0x7f19000d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:38.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.102+0000 7f190723d640 1 -- 172.21.15.31:0/820248367 shutdown_connections 2023-11-24T06:11:38.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.102+0000 7f190723d640 1 -- 172.21.15.31:0/820248367 wait complete. 2023-11-24T06:11:38.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.104+0000 7f190723d640 1 Processor -- start 2023-11-24T06:11:38.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.104+0000 7f190723d640 1 -- start start 2023-11-24T06:11:38.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f190723d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19000b3210 0x7f19000cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f190723d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19000b48d0 0x7f19001588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f190723d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 0x7f19000b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f190723d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000cd350 con 0x7f19000b3210 2023-11-24T06:11:38.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f190723d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000cbd70 con 0x7f1900160bd0 2023-11-24T06:11:38.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f190723d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000cc050 con 0x7f19000b48d0 2023-11-24T06:11:38.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19000b48d0 0x7f19001588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f19057da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 0x7f19000b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19000b48d0 0x7f19001588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34368/0 (socket says 172.21.15.31:34368) 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f18f7fff640 1 -- 172.21.15.31:0/152324546 learned_addr learned my addr 172.21.15.31:0/152324546 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f1904fd9640 1 --2- 172.21.15.31:0/152324546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19000b3210 0x7f19000cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f18f7fff640 1 -- 172.21.15.31:0/152324546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 msgr2=0x7f19000b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f18f7fff640 1 --2- 172.21.15.31:0/152324546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 0x7f19000b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f18f7fff640 1 -- 172.21.15.31:0/152324546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19000b3210 msgr2=0x7f19000cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f18f7fff640 1 --2- 172.21.15.31:0/152324546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19000b3210 0x7f19000cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f18f7fff640 1 -- 172.21.15.31:0/152324546 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc009b30 con 0x7f19000b48d0 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.105+0000 7f19057da640 1 --2- 172.21.15.31:0/152324546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 0x7f19000b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:11:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.106+0000 7f18f7fff640 1 --2- 172.21.15.31:0/152324546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19000b48d0 0x7f19001588c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f18f000c460 tx=0x7f18f000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:38.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.106+0000 7f18f57fa640 1 -- 172.21.15.31:0/152324546 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0007480 con 0x7f19000b48d0 2023-11-24T06:11:38.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.106+0000 7f18f57fa640 1 -- 172.21.15.31:0/152324546 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f00075e0 con 0x7f19000b48d0 2023-11-24T06:11:38.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.106+0000 7f18f57fa640 1 -- 172.21.15.31:0/152324546 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0004a00 con 0x7f19000b48d0 2023-11-24T06:11:38.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.106+0000 7f190723d640 1 -- 172.21.15.31:0/152324546 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19000cc330 con 0x7f19000b48d0 2023-11-24T06:11:38.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.106+0000 7f190723d640 1 -- 172.21.15.31:0/152324546 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19000cc8f0 con 0x7f19000b48d0 2023-11-24T06:11:38.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.106+0000 7f18f57fa640 1 -- 172.21.15.31:0/152324546 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f18f0012440 con 0x7f19000b48d0 2023-11-24T06:11:38.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.106+0000 7f18f57fa640 1 -- 172.21.15.31:0/152324546 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f18f001b870 con 0x7f19000b48d0 2023-11-24T06:11:38.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.108+0000 7f190723d640 1 -- 172.21.15.31:0/152324546 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19000ccb00 con 0x7f19000b48d0 2023-11-24T06:11:38.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.110+0000 7f18f57fa640 1 -- 172.21.15.31:0/152324546 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f18f0018070 con 0x7f19000b48d0 2023-11-24T06:11:38.177 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:38.174+0000 7fed8c856040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T06:11:38.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.275+0000 7f190723d640 1 -- 172.21.15.31:0/152324546 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b1a62b11-eaac-4ceb-a90b-9d00731801b7", "id": 4} v 0) v1 -- 0x7f19000d2610 con 0x7f19000b48d0 2023-11-24T06:11:38.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.285+0000 7f18f57fa640 1 -- 172.21.15.31:0/152324546 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b1a62b11-eaac-4ceb-a90b-9d00731801b7", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f18f001b360 con 0x7f19000b48d0 2023-11-24T06:11:38.289 INFO:teuthology.orchestra.run.smithi031.stdout:4 2023-11-24T06:11:38.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.287+0000 7f190723d640 1 -- 172.21.15.31:0/152324546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19000b48d0 msgr2=0x7f19001588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.287+0000 7f190723d640 1 --2- 172.21.15.31:0/152324546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19000b48d0 0x7f19001588c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f18f000c460 tx=0x7f18f000c920 comp rx=0 tx=0).stop 2023-11-24T06:11:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.287+0000 7f190723d640 1 -- 172.21.15.31:0/152324546 shutdown_connections 2023-11-24T06:11:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.287+0000 7f190723d640 1 --2- 172.21.15.31:0/152324546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1900160bd0 0x7f19000b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.287+0000 7f190723d640 1 --2- 172.21.15.31:0/152324546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19000b48d0 0x7f19001588c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.287+0000 7f190723d640 1 --2- 172.21.15.31:0/152324546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19000b3210 0x7f19000cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.287+0000 7f190723d640 1 -- 172.21.15.31:0/152324546 >> 172.21.15.31:0/152324546 conn(0x7f190009c5a0 msgr2=0x7f19000d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.287+0000 7f190723d640 1 -- 172.21.15.31:0/152324546 shutdown_connections 2023-11-24T06:11:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.287+0000 7f190723d640 1 -- 172.21.15.31:0/152324546 wait complete. 2023-11-24T06:11:38.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 64739292-4eae-4bd0-8535-26e29f391124 5 2023-11-24T06:11:38.313 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:38.310+0000 7fed8c856040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T06:11:38.368 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:38.365+0000 7fed8c856040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T06:11:38.483 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:38.480+0000 7fed8c856040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:11:38.519 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:38.516+0000 7f59ab40e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T06:11:38.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.552+0000 7f3297fa9640 1 Processor -- start 2023-11-24T06:11:38.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.553+0000 7f3297fa9640 1 -- start start 2023-11-24T06:11:38.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3297fa9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3290160bd0 0x7f32900b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3297fa9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f32900b48d0 0x7f32900b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3297fa9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32900b3040 0x7f3290166280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3297fa9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900cdc70 con 0x7f32900b3040 2023-11-24T06:11:38.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3297fa9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900b2870 con 0x7f32900b48d0 2023-11-24T06:11:38.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3297fa9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32900b23e0 con 0x7f3290160bd0 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3295d45640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3290160bd0 0x7f32900b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3295d45640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3290160bd0 0x7f32900b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34382/0 (socket says 172.21.15.31:34382) 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3295544640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f32900b48d0 0x7f32900b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.554+0000 7f3295d45640 1 -- 172.21.15.31:0/2423875355 learned_addr learned my addr 172.21.15.31:0/2423875355 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.555+0000 7f3296546640 1 --2- 172.21.15.31:0/2423875355 >> v2:172.21.15.22:3300/0 conn(0x7f32900b3040 0x7f3290166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.555+0000 7f3295d45640 1 -- 172.21.15.31:0/2423875355 >> v2:172.21.15.31:3300/0 conn(0x7f32900b48d0 msgr2=0x7f32900b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.555+0000 7f3295d45640 1 --2- 172.21.15.31:0/2423875355 >> v2:172.21.15.31:3300/0 conn(0x7f32900b48d0 0x7f32900b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.555+0000 7f3295d45640 1 -- 172.21.15.31:0/2423875355 >> v2:172.21.15.22:3300/0 conn(0x7f32900b3040 msgr2=0x7f3290166280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.555+0000 7f3295d45640 1 --2- 172.21.15.31:0/2423875355 >> v2:172.21.15.22:3300/0 conn(0x7f32900b3040 0x7f3290166280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.555+0000 7f3295d45640 1 -- 172.21.15.31:0/2423875355 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32900d41b0 con 0x7f3290160bd0 2023-11-24T06:11:38.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.556+0000 7f3295d45640 1 --2- 172.21.15.31:0/2423875355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3290160bd0 0x7f32900b1ea0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f329008b970 tx=0x7f328c02b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d9f29b7a270f08 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.556+0000 7f3294d43640 1 -- 172.21.15.31:0/2423875355 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c0317e0 con 0x7f3290160bd0 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.556+0000 7f3294d43640 1 -- 172.21.15.31:0/2423875355 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c031940 con 0x7f3290160bd0 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.556+0000 7f3294d43640 1 -- 172.21.15.31:0/2423875355 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c031cd0 con 0x7f3290160bd0 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.557+0000 7f3297fa9640 1 -- 172.21.15.31:0/2423875355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3290160bd0 msgr2=0x7f32900b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.557+0000 7f3297fa9640 1 --2- 172.21.15.31:0/2423875355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3290160bd0 0x7f32900b1ea0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f329008b970 tx=0x7f328c02b880 comp rx=0 tx=0).stop 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.557+0000 7f3297fa9640 1 -- 172.21.15.31:0/2423875355 shutdown_connections 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.557+0000 7f3297fa9640 1 --2- 172.21.15.31:0/2423875355 >> v2:172.21.15.22:3300/0 conn(0x7f32900b3040 0x7f3290166280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.557+0000 7f3297fa9640 1 --2- 172.21.15.31:0/2423875355 >> v2:172.21.15.31:3300/0 conn(0x7f32900b48d0 0x7f32900b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.557+0000 7f3297fa9640 1 --2- 172.21.15.31:0/2423875355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3290160bd0 0x7f32900b1ea0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.557+0000 7f3297fa9640 1 -- 172.21.15.31:0/2423875355 >> 172.21.15.31:0/2423875355 conn(0x7f329009c5a0 msgr2=0x7f32900d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.557+0000 7f3297fa9640 1 -- 172.21.15.31:0/2423875355 shutdown_connections 2023-11-24T06:11:38.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.557+0000 7f3297fa9640 1 -- 172.21.15.31:0/2423875355 wait complete. 2023-11-24T06:11:38.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.559+0000 7f3297fa9640 1 Processor -- start 2023-11-24T06:11:38.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.559+0000 7f3297fa9640 1 -- start start 2023-11-24T06:11:38.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3297fa9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32900b3040 0x7f329014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3297fa9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32900b48d0 0x7f32900b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3297fa9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290160bd0 0x7f32900c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3297fa9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900c8030 con 0x7f32900b48d0 2023-11-24T06:11:38.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3297fa9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900b6870 con 0x7f3290160bd0 2023-11-24T06:11:38.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3297fa9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32900b6b50 con 0x7f32900b3040 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3295d45640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32900b3040 0x7f329014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3296546640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290160bd0 0x7f32900c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3295d45640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32900b3040 0x7f329014b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34392/0 (socket says 172.21.15.31:34392) 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3295d45640 1 -- 172.21.15.31:0/2713811605 learned_addr learned my addr 172.21.15.31:0/2713811605 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.560+0000 7f3295544640 1 --2- 172.21.15.31:0/2713811605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32900b48d0 0x7f32900b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f3296546640 1 -- 172.21.15.31:0/2713811605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32900b3040 msgr2=0x7f329014b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f3296546640 1 --2- 172.21.15.31:0/2713811605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32900b3040 0x7f329014b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f3296546640 1 -- 172.21.15.31:0/2713811605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32900b48d0 msgr2=0x7f32900b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f3296546640 1 --2- 172.21.15.31:0/2713811605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32900b48d0 0x7f32900b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f3296546640 1 -- 172.21.15.31:0/2713811605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0094d0 con 0x7f3290160bd0 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f3295d45640 1 --2- 172.21.15.31:0/2713811605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32900b3040 0x7f329014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:11:38.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f3296546640 1 --2- 172.21.15.31:0/2713811605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290160bd0 0x7f32900c8b10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3288007d40 tx=0x7f328800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:38.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f32867fc640 1 -- 172.21.15.31:0/2713811605 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288003990 con 0x7f3290160bd0 2023-11-24T06:11:38.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f32867fc640 1 -- 172.21.15.31:0/2713811605 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288003b10 con 0x7f3290160bd0 2023-11-24T06:11:38.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f32867fc640 1 -- 172.21.15.31:0/2713811605 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288004030 con 0x7f3290160bd0 2023-11-24T06:11:38.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f3297fa9640 1 -- 172.21.15.31:0/2713811605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32900b6e30 con 0x7f3290160bd0 2023-11-24T06:11:38.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.561+0000 7f3297fa9640 1 -- 172.21.15.31:0/2713811605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32900b73f0 con 0x7f3290160bd0 2023-11-24T06:11:38.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.562+0000 7f32867fc640 1 -- 172.21.15.31:0/2713811605 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3288004490 con 0x7f3290160bd0 2023-11-24T06:11:38.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.562+0000 7f32867fc640 1 -- 172.21.15.31:0/2713811605 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3288004740 con 0x7f3290160bd0 2023-11-24T06:11:38.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.562+0000 7f3297fa9640 1 -- 172.21.15.31:0/2713811605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32900a1210 con 0x7f3290160bd0 2023-11-24T06:11:38.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.565+0000 7f32867fc640 1 -- 172.21.15.31:0/2713811605 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3288019070 con 0x7f3290160bd0 2023-11-24T06:11:38.600 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:38.597+0000 7fed8c856040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T06:11:38.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.645+0000 7f3297fa9640 1 -- 172.21.15.31:0/2713811605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "64739292-4eae-4bd0-8535-26e29f391124", "id": 5} v 0) v1 -- 0x7f329004e920 con 0x7f3290160bd0 2023-11-24T06:11:38.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.652+0000 7f32867fc640 1 -- 172.21.15.31:0/2713811605 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64739292-4eae-4bd0-8535-26e29f391124", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f328801e440 con 0x7f3290160bd0 2023-11-24T06:11:38.656 INFO:teuthology.orchestra.run.smithi031.stdout:5 2023-11-24T06:11:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.654+0000 7f3297fa9640 1 -- 172.21.15.31:0/2713811605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290160bd0 msgr2=0x7f32900c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.654+0000 7f3297fa9640 1 --2- 172.21.15.31:0/2713811605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290160bd0 0x7f32900c8b10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3288007d40 tx=0x7f328800e4b0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.654+0000 7f3297fa9640 1 -- 172.21.15.31:0/2713811605 shutdown_connections 2023-11-24T06:11:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.654+0000 7f3297fa9640 1 --2- 172.21.15.31:0/2713811605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290160bd0 0x7f32900c8b10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.654+0000 7f3297fa9640 1 --2- 172.21.15.31:0/2713811605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32900b48d0 0x7f32900b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.654+0000 7f3297fa9640 1 --2- 172.21.15.31:0/2713811605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32900b3040 0x7f329014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.654+0000 7f3297fa9640 1 -- 172.21.15.31:0/2713811605 >> 172.21.15.31:0/2713811605 conn(0x7f329009c5a0 msgr2=0x7f329015e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.654+0000 7f3297fa9640 1 -- 172.21.15.31:0/2713811605 shutdown_connections 2023-11-24T06:11:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.654+0000 7f3297fa9640 1 -- 172.21.15.31:0/2713811605 wait complete. 2023-11-24T06:11:38.680 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5 6 2023-11-24T06:11:38.699 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:38.696+0000 7f59ab40e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T06:11:38.769 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:38.765+0000 7fed8c856040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:11:38.820 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:38.818+0000 7fed8c856040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T06:11:38.852 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:38.848+0000 7f59ab40e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T06:11:38.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.882+0000 7fdeac7a9640 1 Processor -- start 2023-11-24T06:11:38.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.882+0000 7fdeac7a9640 1 -- start start 2023-11-24T06:11:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.884+0000 7fdeac7a9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.884+0000 7fdeac7a9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdea40b3210 0x7fdea4167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.884+0000 7fdeac7a9640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea40b23e0 con 0x7fdea4160bd0 2023-11-24T06:11:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.884+0000 7fdeac7a9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea40cdc70 con 0x7fdea40b3210 2023-11-24T06:11:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.884+0000 7fdeac7a9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40b2870 con 0x7fdea40b48d0 2023-11-24T06:11:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.884+0000 7fdeaad46640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdea40b3210 0x7fdea4167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.884+0000 7fdea9d44640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.884+0000 7fdeaad46640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdea40b3210 0x7fdea4167290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38984/0 (socket says 172.21.15.31:38984) 2023-11-24T06:11:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.884+0000 7fdeaad46640 1 -- 172.21.15.31:0/3518231284 learned_addr learned my addr 172.21.15.31:0/3518231284 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:38.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.885+0000 7fdeaad46640 1 -- 172.21.15.31:0/3518231284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 msgr2=0x7fdea40b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:38.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.885+0000 7fdeaad46640 1 --2- 172.21.15.31:0/3518231284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.885+0000 7fdeaad46640 1 -- 172.21.15.31:0/3518231284 >> v1:172.21.15.22:6789/0 conn(0x7fdea4160bd0 legacy=0x7fdea40b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.885+0000 7fdeaad46640 1 -- 172.21.15.31:0/3518231284 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea40d41b0 con 0x7fdea40b3210 2023-11-24T06:11:38.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.885+0000 7fdea9d44640 1 --2- 172.21.15.31:0/3518231284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:11:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.886+0000 7fdeaad46640 1 --2- 172.21.15.31:0/3518231284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea40b3210 0x7fdea4167290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009e50 tx=0x7fde9c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a365ce3e541efa2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.886+0000 7fdea9543640 1 -- 172.21.15.31:0/3518231284 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c02ca80 con 0x7fdea40b3210 2023-11-24T06:11:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.886+0000 7fdea9543640 1 -- 172.21.15.31:0/3518231284 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c02cbe0 con 0x7fdea40b3210 2023-11-24T06:11:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.886+0000 7fdea9543640 1 -- 172.21.15.31:0/3518231284 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0343f0 con 0x7fdea40b3210 2023-11-24T06:11:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.887+0000 7fdeac7a9640 1 -- 172.21.15.31:0/3518231284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea40b3210 msgr2=0x7fdea4167290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.887+0000 7fdeac7a9640 1 --2- 172.21.15.31:0/3518231284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea40b3210 0x7fdea4167290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009e50 tx=0x7fde9c02bee0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.887+0000 7fdeac7a9640 1 -- 172.21.15.31:0/3518231284 shutdown_connections 2023-11-24T06:11:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.887+0000 7fdeac7a9640 1 --2- 172.21.15.31:0/3518231284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea40b3210 0x7fdea4167290 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.887+0000 7fdeac7a9640 1 --2- 172.21.15.31:0/3518231284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.887+0000 7fdeac7a9640 1 -- 172.21.15.31:0/3518231284 >> 172.21.15.31:0/3518231284 conn(0x7fdea409c5a0 msgr2=0x7fdea40d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.887+0000 7fdeac7a9640 1 -- 172.21.15.31:0/3518231284 shutdown_connections 2023-11-24T06:11:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.887+0000 7fdeac7a9640 1 -- 172.21.15.31:0/3518231284 wait complete. 2023-11-24T06:11:38.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.889+0000 7fdeac7a9640 1 Processor -- start 2023-11-24T06:11:38.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.889+0000 7fdeac7a9640 1 -- start start 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdeac7a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdea40b3210 0x7fdea40ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdeac7a9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdeac7a9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea4160bd0 0x7fdea415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdeac7a9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40c83c0 con 0x7fdea40b3210 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdeac7a9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40c7d00 con 0x7fdea4160bd0 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdeac7a9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40c7fe0 con 0x7fdea40b48d0 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdeaad46640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea4160bd0 0x7fdea415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdea9d44640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdeaad46640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea4160bd0 0x7fdea415cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38998/0 (socket says 172.21.15.31:38998) 2023-11-24T06:11:38.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.890+0000 7fdeaad46640 1 -- 172.21.15.31:0/1918367215 learned_addr learned my addr 172.21.15.31:0/1918367215 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.891+0000 7fdeaa545640 1 --2- 172.21.15.31:0/1918367215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdea40b3210 0x7fdea40ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.891+0000 7fdeaad46640 1 -- 172.21.15.31:0/1918367215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 msgr2=0x7fdea40b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.891+0000 7fdeaad46640 1 --2- 172.21.15.31:0/1918367215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.891+0000 7fdeaad46640 1 -- 172.21.15.31:0/1918367215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdea40b3210 msgr2=0x7fdea40ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.891+0000 7fdeaad46640 1 --2- 172.21.15.31:0/1918367215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdea40b3210 0x7fdea40ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.891+0000 7fdeaad46640 1 -- 172.21.15.31:0/1918367215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94009400 con 0x7fdea4160bd0 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.891+0000 7fdea9d44640 1 --2- 172.21.15.31:0/1918367215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.891+0000 7fdeaad46640 1 --2- 172.21.15.31:0/1918367215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea4160bd0 0x7fdea415cf10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009e50 tx=0x7fde9c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.891+0000 7fde9affd640 1 -- 172.21.15.31:0/1918367215 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c009510 con 0x7fdea4160bd0 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.892+0000 7fde9affd640 1 -- 172.21.15.31:0/1918367215 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c03e450 con 0x7fdea4160bd0 2023-11-24T06:11:38.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.892+0000 7fde9affd640 1 -- 172.21.15.31:0/1918367215 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c03e800 con 0x7fdea4160bd0 2023-11-24T06:11:38.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.892+0000 7fdeac7a9640 1 -- 172.21.15.31:0/1918367215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c009b30 con 0x7fdea4160bd0 2023-11-24T06:11:38.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.892+0000 7fdeac7a9640 1 -- 172.21.15.31:0/1918367215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea40c88f0 con 0x7fdea4160bd0 2023-11-24T06:11:38.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.892+0000 7fde9affd640 1 -- 172.21.15.31:0/1918367215 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fde9c02cd50 con 0x7fdea4160bd0 2023-11-24T06:11:38.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.892+0000 7fde9affd640 1 -- 172.21.15.31:0/1918367215 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fde9c048db0 con 0x7fdea4160bd0 2023-11-24T06:11:38.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.893+0000 7fdeac7a9640 1 -- 172.21.15.31:0/1918367215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea40c68f0 con 0x7fdea4160bd0 2023-11-24T06:11:38.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.897+0000 7fde9affd640 1 -- 172.21.15.31:0/1918367215 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fde9c066ce0 con 0x7fdea4160bd0 2023-11-24T06:11:38.911 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:38.908+0000 7f59ab40e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T06:11:38.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.978+0000 7fdeac7a9640 1 -- 172.21.15.31:0/1918367215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5", "id": 6} v 0) v1 -- 0x7fdea40c8ae0 con 0x7fdea4160bd0 2023-11-24T06:11:38.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.984+0000 7fde9affd640 1 -- 172.21.15.31:0/1918367215 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde9c055030 con 0x7fdea4160bd0 2023-11-24T06:11:38.988 INFO:teuthology.orchestra.run.smithi031.stdout:6 2023-11-24T06:11:38.988 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:38.985+0000 7fed8c856040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T06:11:38.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.986+0000 7fdeac7a9640 1 -- 172.21.15.31:0/1918367215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea4160bd0 msgr2=0x7fdea415cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.986+0000 7fdeac7a9640 1 --2- 172.21.15.31:0/1918367215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea4160bd0 0x7fdea415cf10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009e50 tx=0x7fde9c004a40 comp rx=0 tx=0).stop 2023-11-24T06:11:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.986+0000 7fdeac7a9640 1 -- 172.21.15.31:0/1918367215 shutdown_connections 2023-11-24T06:11:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.986+0000 7fdeac7a9640 1 --2- 172.21.15.31:0/1918367215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdea4160bd0 0x7fdea415cf10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.986+0000 7fdeac7a9640 1 --2- 172.21.15.31:0/1918367215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdea40b48d0 0x7fdea40b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.986+0000 7fdeac7a9640 1 --2- 172.21.15.31:0/1918367215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdea40b3210 0x7fdea40ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.986+0000 7fdeac7a9640 1 -- 172.21.15.31:0/1918367215 >> 172.21.15.31:0/1918367215 conn(0x7fdea409c5a0 msgr2=0x7fdea415fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.986+0000 7fdeac7a9640 1 -- 172.21.15.31:0/1918367215 shutdown_connections 2023-11-24T06:11:38.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:38.986+0000 7fdeac7a9640 1 -- 172.21.15.31:0/1918367215 wait complete. 2023-11-24T06:11:39.004 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 6a9301bd-e40a-4141-a2fc-a5cd45bd45ce 7 2023-11-24T06:11:39.029 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:39.026+0000 7f59ab40e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:11:39.151 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:39.148+0000 7f59ab40e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T06:11:39.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.230+0000 7ff1daa6b640 1 Processor -- start 2023-11-24T06:11:39.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.230+0000 7ff1daa6b640 1 -- start start 2023-11-24T06:11:39.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.231+0000 7ff1daa6b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d4160bd0 0x7ff1d40b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1daa6b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1d40b3210 0x7ff1d4167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1daa6b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d40b23e0 con 0x7ff1d40b48d0 2023-11-24T06:11:39.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1daa6b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d40cdc70 con 0x7ff1d40b3210 2023-11-24T06:11:39.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1daa6b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d40b2870 con 0x7ff1d4160bd0 2023-11-24T06:11:39.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1d8807640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d4160bd0 0x7ff1d40b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1d8807640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d4160bd0 0x7ff1d40b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34414/0 (socket says 172.21.15.31:34414) 2023-11-24T06:11:39.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1d8807640 1 -- 172.21.15.31:0/661005952 learned_addr learned my addr 172.21.15.31:0/661005952 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:39.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1d9008640 1 --2- 172.21.15.31:0/661005952 >> v2:172.21.15.22:3300/0 conn(0x7ff1d40b3210 0x7ff1d4167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1d8807640 1 -- 172.21.15.31:0/661005952 >> v2:172.21.15.22:3300/0 conn(0x7ff1d40b3210 msgr2=0x7ff1d4167290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1d8807640 1 --2- 172.21.15.31:0/661005952 >> v2:172.21.15.22:3300/0 conn(0x7ff1d40b3210 0x7ff1d4167290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1d8807640 1 -- 172.21.15.31:0/661005952 >> v1:172.21.15.22:6789/0 conn(0x7ff1d40b48d0 legacy=0x7ff1d40b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.232+0000 7ff1d8807640 1 -- 172.21.15.31:0/661005952 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d40d41b0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.234+0000 7ff1d8807640 1 --2- 172.21.15.31:0/661005952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d4160bd0 0x7ff1d40b1ea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009870 tx=0x7ff1c802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8266c2f047ab061 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.234+0000 7ff1d37fe640 1 -- 172.21.15.31:0/661005952 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80317c0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.234+0000 7ff1d37fe640 1 -- 172.21.15.31:0/661005952 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c8031920 con 0x7ff1d4160bd0 2023-11-24T06:11:39.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.234+0000 7ff1d37fe640 1 -- 172.21.15.31:0/661005952 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8031cb0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.235+0000 7ff1daa6b640 1 -- 172.21.15.31:0/661005952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d4160bd0 msgr2=0x7ff1d40b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.235+0000 7ff1daa6b640 1 --2- 172.21.15.31:0/661005952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d4160bd0 0x7ff1d40b1ea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009870 tx=0x7ff1c802b860 comp rx=0 tx=0).stop 2023-11-24T06:11:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.235+0000 7ff1daa6b640 1 -- 172.21.15.31:0/661005952 shutdown_connections 2023-11-24T06:11:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.235+0000 7ff1daa6b640 1 --2- 172.21.15.31:0/661005952 >> v2:172.21.15.22:3300/0 conn(0x7ff1d40b3210 0x7ff1d4167290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.235+0000 7ff1daa6b640 1 --2- 172.21.15.31:0/661005952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d4160bd0 0x7ff1d40b1ea0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.235+0000 7ff1daa6b640 1 -- 172.21.15.31:0/661005952 >> 172.21.15.31:0/661005952 conn(0x7ff1d409c5a0 msgr2=0x7ff1d40d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.235+0000 7ff1daa6b640 1 -- 172.21.15.31:0/661005952 shutdown_connections 2023-11-24T06:11:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.235+0000 7ff1daa6b640 1 -- 172.21.15.31:0/661005952 wait complete. 2023-11-24T06:11:39.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.237+0000 7ff1daa6b640 1 Processor -- start 2023-11-24T06:11:39.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.237+0000 7ff1daa6b640 1 -- start start 2023-11-24T06:11:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1daa6b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d40b3210 0x7ff1d40b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1daa6b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d40b48d0 0x7ff1d40b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1daa6b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1d4160bd0 0x7ff1d415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1daa6b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d415d530 con 0x7ff1d40b48d0 2023-11-24T06:11:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1daa6b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d40cae60 con 0x7ff1d4160bd0 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1daa6b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d40cb0d0 con 0x7ff1d40b3210 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1d8807640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d40b3210 0x7ff1d40b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1d8807640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d40b3210 0x7ff1d40b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34426/0 (socket says 172.21.15.31:34426) 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1d8807640 1 -- 172.21.15.31:0/1941173812 learned_addr learned my addr 172.21.15.31:0/1941173812 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1d9008640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1d4160bd0 0x7ff1d415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.238+0000 7ff1d3fff640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d40b48d0 0x7ff1d40b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d9008640 1 -- 172.21.15.31:0/1941173812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d40b3210 msgr2=0x7ff1d40b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d9008640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d40b3210 0x7ff1d40b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d9008640 1 -- 172.21.15.31:0/1941173812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d40b48d0 msgr2=0x7ff1d40b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d9008640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d40b48d0 0x7ff1d40b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d9008640 1 -- 172.21.15.31:0/1941173812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c80094d0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d8807640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d40b3210 0x7ff1d40b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:11:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d3fff640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d40b48d0 0x7ff1d40b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:11:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d9008640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1d4160bd0 0x7ff1d415c990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc007dc0 tx=0x7ff1cc00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d17fa640 1 -- 172.21.15.31:0/1941173812 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc018070 con 0x7ff1d4160bd0 2023-11-24T06:11:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d17fa640 1 -- 172.21.15.31:0/1941173812 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc00edd0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1d17fa640 1 -- 172.21.15.31:0/1941173812 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc003bb0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1daa6b640 1 -- 172.21.15.31:0/1941173812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d40cb3b0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.239+0000 7ff1daa6b640 1 -- 172.21.15.31:0/1941173812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d415ced0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.240+0000 7ff1d17fa640 1 -- 172.21.15.31:0/1941173812 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff1cc004320 con 0x7ff1d4160bd0 2023-11-24T06:11:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.240+0000 7ff1d17fa640 1 -- 172.21.15.31:0/1941173812 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff1cc014d50 con 0x7ff1d4160bd0 2023-11-24T06:11:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.241+0000 7ff1daa6b640 1 -- 172.21.15.31:0/1941173812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d40cb8d0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.243+0000 7ff1d17fa640 1 -- 172.21.15.31:0/1941173812 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff1cc003d10 con 0x7ff1d4160bd0 2023-11-24T06:11:39.323 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:39.320+0000 7f59ab40e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:11:39.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.323+0000 7ff1daa6b640 1 -- 172.21.15.31:0/1941173812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6a9301bd-e40a-4141-a2fc-a5cd45bd45ce", "id": 7} v 0) v1 -- 0x7ff1d40cff50 con 0x7ff1d4160bd0 2023-11-24T06:11:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.328+0000 7ff1d17fa640 1 -- 172.21.15.31:0/1941173812 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a9301bd-e40a-4141-a2fc-a5cd45bd45ce", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff1cc0045d0 con 0x7ff1d4160bd0 2023-11-24T06:11:39.333 INFO:teuthology.orchestra.run.smithi031.stdout:7 2023-11-24T06:11:39.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.330+0000 7ff1daa6b640 1 -- 172.21.15.31:0/1941173812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1d4160bd0 msgr2=0x7ff1d415c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:39.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.330+0000 7ff1daa6b640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1d4160bd0 0x7ff1d415c990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc007dc0 tx=0x7ff1cc00e4b0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.330+0000 7ff1daa6b640 1 -- 172.21.15.31:0/1941173812 shutdown_connections 2023-11-24T06:11:39.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.330+0000 7ff1daa6b640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1d4160bd0 0x7ff1d415c990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.330+0000 7ff1daa6b640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d40b48d0 0x7ff1d40b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.330+0000 7ff1daa6b640 1 --2- 172.21.15.31:0/1941173812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1d40b3210 0x7ff1d40b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.330+0000 7ff1daa6b640 1 -- 172.21.15.31:0/1941173812 >> 172.21.15.31:0/1941173812 conn(0x7ff1d409c5a0 msgr2=0x7ff1d40cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.330+0000 7ff1daa6b640 1 -- 172.21.15.31:0/1941173812 shutdown_connections 2023-11-24T06:11:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:11:39.330+0000 7ff1daa6b640 1 -- 172.21.15.31:0/1941173812 wait complete. 2023-11-24T06:11:39.350 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-24T06:11:39.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-24T06:11:39.358 INFO:tasks.ceph.osd.0:Started 2023-11-24T06:11:39.359 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-24T06:11:39.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-24T06:11:39.367 INFO:tasks.ceph.osd.1:Started 2023-11-24T06:11:39.367 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-24T06:11:39.367 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-24T06:11:39.373 INFO:tasks.ceph.osd.2:Started 2023-11-24T06:11:39.373 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-24T06:11:39.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-24T06:11:39.377 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:39.374+0000 7f59ab40e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T06:11:39.379 INFO:tasks.ceph.osd.3:Started 2023-11-24T06:11:39.379 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-24T06:11:39.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-24T06:11:39.388 INFO:tasks.ceph.osd.4:Started 2023-11-24T06:11:39.388 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-24T06:11:39.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-24T06:11:39.396 INFO:tasks.ceph.osd.5:Started 2023-11-24T06:11:39.396 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-24T06:11:39.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-24T06:11:39.404 INFO:tasks.ceph.osd.6:Started 2023-11-24T06:11:39.405 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-24T06:11:39.405 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-24T06:11:39.412 INFO:tasks.ceph.osd.7:Started 2023-11-24T06:11:39.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:11:39.574 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:39.569+0000 7f59ab40e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T06:11:39.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.622+0000 7fce51f33640 1 Processor -- start 2023-11-24T06:11:39.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.622+0000 7fce51f33640 1 -- start start 2023-11-24T06:11:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.623+0000 7fce51f33640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce4c15d4a0 0x7fce4c0af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.623+0000 7fce51f33640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce4c0af6c0 0x7fce4c06a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.623+0000 7fce51f33640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c15d880 con 0x7fce4c06ab40 2023-11-24T06:11:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.623+0000 7fce51f33640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c0afb30 con 0x7fce4c0af6c0 2023-11-24T06:11:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.623+0000 7fce51f33640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c06af90 con 0x7fce4c15d4a0 2023-11-24T06:11:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.624+0000 7fce4affd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce4c0af6c0 0x7fce4c06a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.624+0000 7fce4affd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce4c0af6c0 0x7fce4c06a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33748/0 (socket says 172.21.15.22:33748) 2023-11-24T06:11:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.624+0000 7fce4affd640 1 -- 172.21.15.22:0/3427408507 learned_addr learned my addr 172.21.15.22:0/3427408507 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.624+0000 7fce4b7fe640 1 --2- 172.21.15.22:0/3427408507 >> v2:172.21.15.31:3300/0 conn(0x7fce4c15d4a0 0x7fce4c0af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.624+0000 7fce4affd640 1 -- 172.21.15.22:0/3427408507 >> v2:172.21.15.31:3300/0 conn(0x7fce4c15d4a0 msgr2=0x7fce4c0af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.624+0000 7fce4affd640 1 --2- 172.21.15.22:0/3427408507 >> v2:172.21.15.31:3300/0 conn(0x7fce4c15d4a0 0x7fce4c0af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.624+0000 7fce4affd640 1 -- 172.21.15.22:0/3427408507 >> v1:172.21.15.22:6789/0 conn(0x7fce4c06ab40 legacy=0x7fce4c160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.624+0000 7fce4affd640 1 -- 172.21.15.22:0/3427408507 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c06fba0 con 0x7fce4c0af6c0 2023-11-24T06:11:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.625+0000 7fce4affd640 1 --2- 172.21.15.22:0/3427408507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 0x7fce4c06a600 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0686c0 tx=0x7fce4002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8485a868b3d27b2f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.625+0000 7fce4a7fc640 1 -- 172.21.15.22:0/3427408507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40030870 con 0x7fce4c0af6c0 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.625+0000 7fce4a7fc640 1 -- 172.21.15.22:0/3427408507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce400309d0 con 0x7fce4c0af6c0 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.625+0000 7fce4a7fc640 1 -- 172.21.15.22:0/3427408507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40030d60 con 0x7fce4c0af6c0 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.626+0000 7fce51f33640 1 -- 172.21.15.22:0/3427408507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 msgr2=0x7fce4c06a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.626+0000 7fce51f33640 1 --2- 172.21.15.22:0/3427408507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 0x7fce4c06a600 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0686c0 tx=0x7fce4002b9b0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.626+0000 7fce51f33640 1 -- 172.21.15.22:0/3427408507 shutdown_connections 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.626+0000 7fce51f33640 1 --2- 172.21.15.22:0/3427408507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 0x7fce4c06a600 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.626+0000 7fce51f33640 1 --2- 172.21.15.22:0/3427408507 >> v2:172.21.15.31:3300/0 conn(0x7fce4c15d4a0 0x7fce4c0af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.626+0000 7fce51f33640 1 -- 172.21.15.22:0/3427408507 >> 172.21.15.22:0/3427408507 conn(0x7fce4c06d490 msgr2=0x7fce4c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.626+0000 7fce51f33640 1 -- 172.21.15.22:0/3427408507 shutdown_connections 2023-11-24T06:11:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.626+0000 7fce51f33640 1 -- 172.21.15.22:0/3427408507 wait complete. 2023-11-24T06:11:39.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.628+0000 7fce51f33640 1 Processor -- start 2023-11-24T06:11:39.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.628+0000 7fce51f33640 1 -- start start 2023-11-24T06:11:39.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce51f33640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce4c06ab40 0x7fce4c141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce51f33640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 0x7fce4c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce51f33640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce4c15d4a0 0x7fce4c0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:39.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce51f33640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1538a0 con 0x7fce4c0af6c0 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce51f33640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c153b80 con 0x7fce4c15d4a0 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce51f33640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c153e60 con 0x7fce4c06ab40 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 0x7fce4c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 0x7fce4c154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33752/0 (socket says 172.21.15.22:33752) 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce4affd640 1 -- 172.21.15.22:0/4062293812 learned_addr learned my addr 172.21.15.22:0/4062293812 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce4bfff640 1 --2- 172.21.15.22:0/4062293812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce4c15d4a0 0x7fce4c0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.629+0000 7fce4b7fe640 1 --2- 172.21.15.22:0/4062293812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce4c06ab40 0x7fce4c141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce4affd640 1 -- 172.21.15.22:0/4062293812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce4c06ab40 msgr2=0x7fce4c141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce4affd640 1 --2- 172.21.15.22:0/4062293812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce4c06ab40 0x7fce4c141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce4affd640 1 -- 172.21.15.22:0/4062293812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce4c15d4a0 msgr2=0x7fce4c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce4affd640 1 --2- 172.21.15.22:0/4062293812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce4c15d4a0 0x7fce4c0cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce4affd640 1 -- 172.21.15.22:0/4062293812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce400094d0 con 0x7fce4c0af6c0 2023-11-24T06:11:39.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce4affd640 1 --2- 172.21.15.22:0/4062293812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 0x7fce4c154940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fce4002b9f0 tx=0x7fce40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:39.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce33fff640 1 -- 172.21.15.22:0/4062293812 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40039c10 con 0x7fce4c0af6c0 2023-11-24T06:11:39.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce33fff640 1 -- 172.21.15.22:0/4062293812 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce40039d90 con 0x7fce4c0af6c0 2023-11-24T06:11:39.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce51f33640 1 -- 172.21.15.22:0/4062293812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c154140 con 0x7fce4c0af6c0 2023-11-24T06:11:39.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce33fff640 1 -- 172.21.15.22:0/4062293812 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40043640 con 0x7fce4c0af6c0 2023-11-24T06:11:39.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.630+0000 7fce51f33640 1 -- 172.21.15.22:0/4062293812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c153530 con 0x7fce4c0af6c0 2023-11-24T06:11:39.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.631+0000 7fce33fff640 1 -- 172.21.15.22:0/4062293812 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fce40043aa0 con 0x7fce4c0af6c0 2023-11-24T06:11:39.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.631+0000 7fce33fff640 1 -- 172.21.15.22:0/4062293812 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fce4003e070 con 0x7fce4c0af6c0 2023-11-24T06:11:39.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.631+0000 7fce51f33640 1 -- 172.21.15.22:0/4062293812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c073c90 con 0x7fce4c0af6c0 2023-11-24T06:11:39.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.634+0000 7fce33fff640 1 -- 172.21.15.22:0/4062293812 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fce40034070 con 0x7fce4c0af6c0 2023-11-24T06:11:39.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.699+0000 7fce51f33640 1 -- 172.21.15.22:0/4062293812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce4c074770 con 0x7fce4c0af6c0 2023-11-24T06:11:39.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.700+0000 7fce33fff640 1 -- 172.21.15.22:0/4062293812 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fce4004d460 con 0x7fce4c0af6c0 2023-11-24T06:11:39.703 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:11:39.703 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":10,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:11:39.325872+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:11:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.701+0000 7fce51f33640 1 -- 172.21.15.22:0/4062293812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 msgr2=0x7fce4c154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.701+0000 7fce51f33640 1 --2- 172.21.15.22:0/4062293812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 0x7fce4c154940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fce4002b9f0 tx=0x7fce40004730 comp rx=0 tx=0).stop 2023-11-24T06:11:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.701+0000 7fce51f33640 1 -- 172.21.15.22:0/4062293812 shutdown_connections 2023-11-24T06:11:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.701+0000 7fce51f33640 1 --2- 172.21.15.22:0/4062293812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce4c15d4a0 0x7fce4c0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.701+0000 7fce51f33640 1 --2- 172.21.15.22:0/4062293812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce4c0af6c0 0x7fce4c154940 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.701+0000 7fce51f33640 1 --2- 172.21.15.22:0/4062293812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce4c06ab40 0x7fce4c141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.701+0000 7fce51f33640 1 -- 172.21.15.22:0/4062293812 >> 172.21.15.22:0/4062293812 conn(0x7fce4c06d490 msgr2=0x7fce4c072060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.701+0000 7fce51f33640 1 -- 172.21.15.22:0/4062293812 shutdown_connections 2023-11-24T06:11:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:39.701+0000 7fce51f33640 1 -- 172.21.15.22:0/4062293812 wait complete. 2023-11-24T06:11:39.719 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-24T06:11:39.719 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-24T06:11:40.092 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-24T06:11:40.089+0000 7f07f0024500 -1 Falling back to public interface 2023-11-24T06:11:40.092 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-24T06:11:40.089+0000 7fc77b424500 -1 Falling back to public interface 2023-11-24T06:11:40.093 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-11-24T06:11:40.090+0000 7f11ce410500 -1 Falling back to public interface 2023-11-24T06:11:40.094 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-11-24T06:11:40.091+0000 7f1dc1e0f500 -1 Falling back to public interface 2023-11-24T06:11:40.094 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-11-24T06:11:40.091+0000 7f1fff014500 -1 Falling back to public interface 2023-11-24T06:11:40.106 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-11-24T06:11:40.103+0000 7fea622a9500 -1 Falling back to public interface 2023-11-24T06:11:40.112 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:40.110+0000 7fed8c856040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T06:11:40.129 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-24T06:11:40.126+0000 7f6923512500 -1 Falling back to public interface 2023-11-24T06:11:40.133 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-24T06:11:40.130+0000 7f4f6b937500 -1 Falling back to public interface 2023-11-24T06:11:40.440 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:40.438+0000 7fed8c856040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T06:11:40.503 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:40.500+0000 7fed8c856040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T06:11:40.524 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:11:40.623 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:40.620+0000 7fed8c856040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T06:11:40.696 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.693+0000 7fe65d3ec640 1 Processor -- start 2023-11-24T06:11:40.696 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.693+0000 7fe65d3ec640 1 -- start start 2023-11-24T06:11:40.697 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.694+0000 7fe65d3ec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6580ccf70 0x7fe6580cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:40.697 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe65d3ec640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65806d1e0 con 0x7fe65806d670 2023-11-24T06:11:40.697 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe65d3ec640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6580ce3a0 con 0x7fe65814b3b0 2023-11-24T06:11:40.698 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe65d3ec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65806c5d0 con 0x7fe6580ccf70 2023-11-24T06:11:40.698 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe6577fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe65806d670 0x7fe6580c94e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59992/0 (socket says 172.21.15.22:59992) 2023-11-24T06:11:40.698 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe6577fe640 1 -- 172.21.15.22:0/2197965913 learned_addr learned my addr 172.21.15.22:0/2197965913 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:40.698 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe6567fc640 1 --2- 172.21.15.22:0/2197965913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6580ccf70 0x7fe6580cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:40.699 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe655ffb640 1 -- 172.21.15.22:0/2197965913 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436418465 0 0) 0x7fe65806d1e0 con 0x7fe65806d670 2023-11-24T06:11:40.699 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe655ffb640 1 -- 172.21.15.22:0/2197965913 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe640003520 con 0x7fe65806d670 2023-11-24T06:11:40.699 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe6567fc640 1 -- 172.21.15.22:0/2197965913 >> v1:172.21.15.31:6789/0 conn(0x7fe65814b3b0 legacy=0x7fe658070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:40.699 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe655ffb640 1 -- 172.21.15.22:0/2197965913 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780941613 0 0) 0x7fe6580ce3a0 con 0x7fe65814b3b0 2023-11-24T06:11:40.699 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe6567fc640 1 -- 172.21.15.22:0/2197965913 >> v1:172.21.15.22:6789/0 conn(0x7fe65806d670 legacy=0x7fe6580c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:40.699 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.695+0000 7fe6567fc640 1 -- 172.21.15.22:0/2197965913 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65806c8b0 con 0x7fe6580ccf70 2023-11-24T06:11:40.699 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.696+0000 7fe6567fc640 1 --2- 172.21.15.22:0/2197965913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6580ccf70 0x7fe6580cde60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097d0 tx=0x7fe64c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d209ba93b29f10 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:40.700 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe655ffb640 1 -- 172.21.15.22:0/2197965913 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c02d040 con 0x7fe6580ccf70 2023-11-24T06:11:40.700 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe655ffb640 1 -- 172.21.15.22:0/2197965913 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c031810 con 0x7fe6580ccf70 2023-11-24T06:11:40.700 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe655ffb640 1 -- 172.21.15.22:0/2197965913 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c031ba0 con 0x7fe6580ccf70 2023-11-24T06:11:40.700 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2197965913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6580ccf70 msgr2=0x7fe6580cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:40.701 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe65d3ec640 1 --2- 172.21.15.22:0/2197965913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6580ccf70 0x7fe6580cde60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097d0 tx=0x7fe64c02b8b0 comp rx=0 tx=0).stop 2023-11-24T06:11:40.701 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2197965913 shutdown_connections 2023-11-24T06:11:40.701 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe65d3ec640 1 --2- 172.21.15.22:0/2197965913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6580ccf70 0x7fe6580cde60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:40.701 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2197965913 >> 172.21.15.22:0/2197965913 conn(0x7fe6580cee90 msgr2=0x7fe6580cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:40.701 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2197965913 shutdown_connections 2023-11-24T06:11:40.701 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.697+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2197965913 wait complete. 2023-11-24T06:11:40.702 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.699+0000 7fe65d3ec640 1 Processor -- start 2023-11-24T06:11:40.702 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.699+0000 7fe65d3ec640 1 -- start start 2023-11-24T06:11:40.703 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe65d3ec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65806d670 0x7fe658161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe65d3ec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6580ccf70 0x7fe6580cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe65d3ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65814b3b0 0x7fe6580cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe65d3ec640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65813e200 con 0x7fe6580ccf70 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe65d3ec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65813d960 con 0x7fe65814b3b0 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe65d3ec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65813dc40 con 0x7fe65806d670 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe6567fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6580ccf70 0x7fe6580cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe6567fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6580ccf70 0x7fe6580cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33806/0 (socket says 172.21.15.22:33806) 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe6567fc640 1 -- 172.21.15.22:0/2573808239 learned_addr learned my addr 172.21.15.22:0/2573808239 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe656ffd640 1 --2- 172.21.15.22:0/2573808239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65806d670 0x7fe658161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.700+0000 7fe6577fe640 1 --2- 172.21.15.22:0/2573808239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65814b3b0 0x7fe6580cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe6567fc640 1 -- 172.21.15.22:0/2573808239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65806d670 msgr2=0x7fe658161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:40.704 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe6567fc640 1 --2- 172.21.15.22:0/2573808239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65806d670 0x7fe658161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:40.705 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe6567fc640 1 -- 172.21.15.22:0/2573808239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65814b3b0 msgr2=0x7fe6580cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:40.705 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe6567fc640 1 --2- 172.21.15.22:0/2573808239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65814b3b0 0x7fe6580cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:40.705 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe6567fc640 1 -- 172.21.15.22:0/2573808239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c009400 con 0x7fe6580ccf70 2023-11-24T06:11:40.706 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe6567fc640 1 --2- 172.21.15.22:0/2573808239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6580ccf70 0x7fe6580cd690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097d0 tx=0x7fe64c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:40.706 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe63f7fe640 1 -- 172.21.15.22:0/2573808239 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c006e10 con 0x7fe6580ccf70 2023-11-24T06:11:40.706 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe63f7fe640 1 -- 172.21.15.22:0/2573808239 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c03aad0 con 0x7fe6580ccf70 2023-11-24T06:11:40.706 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe63f7fe640 1 -- 172.21.15.22:0/2573808239 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c03ae60 con 0x7fe6580ccf70 2023-11-24T06:11:40.706 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.701+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2573808239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65813df20 con 0x7fe6580ccf70 2023-11-24T06:11:40.706 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.702+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2573808239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe658161670 con 0x7fe6580ccf70 2023-11-24T06:11:40.706 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.703+0000 7fe63f7fe640 1 -- 172.21.15.22:0/2573808239 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 2) v1 ==== 44567+0+0 (secure 0 0 0) 0x7fe64c042070 con 0x7fe6580ccf70 2023-11-24T06:11:40.706 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.703+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2573808239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe658161860 con 0x7fe6580ccf70 2023-11-24T06:11:40.706 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.703+0000 7fe63f7fe640 1 -- 172.21.15.22:0/2573808239 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe64c06b1f0 con 0x7fe6580ccf70 2023-11-24T06:11:40.708 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.705+0000 7fe63f7fe640 1 -- 172.21.15.22:0/2573808239 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe64c04bb70 con 0x7fe6580ccf70 2023-11-24T06:11:40.719 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:40.716+0000 7f59ab40e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T06:11:40.774 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.771+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2573808239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe658140ee0 con 0x7fe6580ccf70 2023-11-24T06:11:40.775 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.772+0000 7fe63f7fe640 1 -- 172.21.15.22:0/2573808239 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe658140ee0 con 0x7fe6580ccf70 2023-11-24T06:11:40.775 INFO:teuthology.misc.health.smithi022.stdout: 2023-11-24T06:11:40.775 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:11:39.325872+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:11:40.776 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.773+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2573808239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6580ccf70 msgr2=0x7fe6580cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:40.776 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.773+0000 7fe65d3ec640 1 --2- 172.21.15.22:0/2573808239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6580ccf70 0x7fe6580cd690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097d0 tx=0x7fe64c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:11:40.776 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.773+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2573808239 shutdown_connections 2023-11-24T06:11:40.776 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.773+0000 7fe65d3ec640 1 --2- 172.21.15.22:0/2573808239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65814b3b0 0x7fe6580cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:40.776 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.773+0000 7fe65d3ec640 1 --2- 172.21.15.22:0/2573808239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6580ccf70 0x7fe6580cd690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:40.776 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.773+0000 7fe65d3ec640 1 --2- 172.21.15.22:0/2573808239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65806d670 0x7fe658161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:40.777 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.773+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2573808239 >> 172.21.15.22:0/2573808239 conn(0x7fe6580cee90 msgr2=0x7fe658162400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:40.777 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.773+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2573808239 shutdown_connections 2023-11-24T06:11:40.777 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:40.773+0000 7fe65d3ec640 1 -- 172.21.15.22:0/2573808239 wait complete. 2023-11-24T06:11:40.789 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T06:11:41.050 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:41.047+0000 7f59ab40e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T06:11:41.112 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:41.108+0000 7f59ab40e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T06:11:41.229 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-24T06:11:41.226+0000 7f59ab40e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T06:11:41.695 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:41.691+0000 7fed2dcbc640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-24T06:11:41.695 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:11:41.693+0000 7fed2dcbc640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-24T06:11:43.637 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-11-24T06:11:43.634+0000 7f11ce410500 -1 osd.1 0 log_to_monitors true 2023-11-24T06:11:43.679 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-24T06:11:43.676+0000 7f07f0024500 -1 osd.6 0 log_to_monitors true 2023-11-24T06:11:43.684 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-11-24T06:11:43.681+0000 7fea622a9500 -1 osd.3 0 log_to_monitors true 2023-11-24T06:11:43.695 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-24T06:11:43.692+0000 7f6923512500 -1 osd.5 0 log_to_monitors true 2023-11-24T06:11:43.699 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-24T06:11:43.696+0000 7f4f6b937500 -1 osd.7 0 log_to_monitors true 2023-11-24T06:11:43.871 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-24T06:11:43.868+0000 7fc77b424500 -1 osd.4 0 log_to_monitors true 2023-11-24T06:11:43.919 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-11-24T06:11:43.916+0000 7f1dc1e0f500 -1 osd.0 0 log_to_monitors true 2023-11-24T06:11:43.920 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-11-24T06:11:43.918+0000 7f1fff014500 -1 osd.2 0 log_to_monitors true 2023-11-24T06:11:45.978 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-11-24T06:11:45.975+0000 7f11c95fe640 -1 osd.1 0 waiting for initial osdmap 2023-11-24T06:11:45.988 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-11-24T06:11:45.985+0000 7f11c1c37640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:11:47.172 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-11-24T06:11:47.170+0000 7fea5da14640 -1 osd.3 0 waiting for initial osdmap 2023-11-24T06:11:47.179 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-11-24T06:11:47.176+0000 7fea5604d640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:11:47.214 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-11-24T06:11:47.211+0000 7f1dbcfaa640 -1 osd.0 0 waiting for initial osdmap 2023-11-24T06:11:47.217 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-11-24T06:11:47.214+0000 7f1ffa154640 -1 osd.2 0 waiting for initial osdmap 2023-11-24T06:11:47.222 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-11-24T06:11:47.219+0000 7f1db55e3640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:11:47.225 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-11-24T06:11:47.223+0000 7f1ff278d640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:11:47.594 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:11:47.795 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.792+0000 7f74425a5640 1 Processor -- start 2023-11-24T06:11:47.795 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.793+0000 7f74425a5640 1 -- start start 2023-11-24T06:11:47.797 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.794+0000 7f74425a5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 0x7f743c0abf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:47.797 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.794+0000 7f74425a5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f743c06a860 0x7f743c06acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:47.797 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.794+0000 7f74425a5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c0ae6c0 con 0x7f743c0ad890 2023-11-24T06:11:47.798 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.794+0000 7f74425a5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c06c670 con 0x7f743c06a860 2023-11-24T06:11:47.798 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.795+0000 7f74425a5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c06d1a0 con 0x7f743c15b010 2023-11-24T06:11:47.798 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.795+0000 7f74415a3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 0x7f743c0abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:47.798 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.795+0000 7f74415a3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 0x7f743c0abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:51848/0 (socket says 172.21.15.22:51848) 2023-11-24T06:11:47.798 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.796+0000 7f74415a3640 1 -- 172.21.15.22:0/2718228832 learned_addr learned my addr 172.21.15.22:0/2718228832 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:47.799 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.796+0000 7f74415a3640 1 -- 172.21.15.22:0/2718228832 >> v2:172.21.15.31:3300/0 conn(0x7f743c06a860 msgr2=0x7f743c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:47.799 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.796+0000 7f74415a3640 1 --2- 172.21.15.22:0/2718228832 >> v2:172.21.15.31:3300/0 conn(0x7f743c06a860 0x7f743c06acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:47.799 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.796+0000 7f74415a3640 1 -- 172.21.15.22:0/2718228832 >> v1:172.21.15.31:6789/0 conn(0x7f743c0ad890 legacy=0x7f743c06ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:47.799 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.796+0000 7f74415a3640 1 -- 172.21.15.22:0/2718228832 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0ae100 con 0x7f743c15b010 2023-11-24T06:11:47.800 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.798+0000 7f74415a3640 1 --2- 172.21.15.22:0/2718228832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 0x7f743c0abf50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7430009e50 tx=0x7f743002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c615f3d07e42a95 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:47.808 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.805+0000 7f743bfff640 1 -- 172.21.15.22:0/2718228832 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743002ca70 con 0x7f743c15b010 2023-11-24T06:11:47.808 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.805+0000 7f743bfff640 1 -- 172.21.15.22:0/2718228832 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743002cbd0 con 0x7f743c15b010 2023-11-24T06:11:47.808 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.805+0000 7f743bfff640 1 -- 172.21.15.22:0/2718228832 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300343f0 con 0x7f743c15b010 2023-11-24T06:11:47.809 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.806+0000 7f74425a5640 1 -- 172.21.15.22:0/2718228832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 msgr2=0x7f743c0abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:47.809 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.806+0000 7f74425a5640 1 --2- 172.21.15.22:0/2718228832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 0x7f743c0abf50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7430009e50 tx=0x7f743002bed0 comp rx=0 tx=0).stop 2023-11-24T06:11:47.809 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.806+0000 7f74425a5640 1 -- 172.21.15.22:0/2718228832 shutdown_connections 2023-11-24T06:11:47.809 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.806+0000 7f74425a5640 1 --2- 172.21.15.22:0/2718228832 >> v2:172.21.15.31:3300/0 conn(0x7f743c06a860 0x7f743c06acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:47.809 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.806+0000 7f74425a5640 1 --2- 172.21.15.22:0/2718228832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 0x7f743c0abf50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:47.810 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.806+0000 7f74425a5640 1 -- 172.21.15.22:0/2718228832 >> 172.21.15.22:0/2718228832 conn(0x7f743c0b0d00 msgr2=0x7f743c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:47.810 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.806+0000 7f74425a5640 1 -- 172.21.15.22:0/2718228832 shutdown_connections 2023-11-24T06:11:47.810 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.806+0000 7f74425a5640 1 -- 172.21.15.22:0/2718228832 wait complete. 2023-11-24T06:11:47.810 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.808+0000 7f74425a5640 1 Processor -- start 2023-11-24T06:11:47.811 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.808+0000 7f74425a5640 1 -- start start 2023-11-24T06:11:47.812 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f74425a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f743c06a860 0x7f743c0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f74425a5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743c0ad890 0x7f743c15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f74425a5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 0x7f743c0cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f74425a5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c15d650 con 0x7f743c06a860 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f74425a5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c15d090 con 0x7f743c0ad890 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f74425a5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c15d370 con 0x7f743c15b010 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f74415a3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f743c06a860 0x7f743c0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f74415a3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f743c06a860 0x7f743c0b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55740/0 (socket says 172.21.15.22:55740) 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f74415a3640 1 -- 172.21.15.22:0/4062992249 learned_addr learned my addr 172.21.15.22:0/4062992249 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.809+0000 7f7440da2640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743c0ad890 0x7f743c15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f74415a3640 1 -- 172.21.15.22:0/4062992249 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 msgr2=0x7f743c0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:47.813 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f74415a3640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 0x7f743c0cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:47.814 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f74415a3640 1 -- 172.21.15.22:0/4062992249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743c0ad890 msgr2=0x7f743c15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:47.814 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f74415a3640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743c0ad890 0x7f743c15c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:47.814 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f74415a3640 1 -- 172.21.15.22:0/4062992249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009b30 con 0x7f743c06a860 2023-11-24T06:11:47.814 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f74415a3640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f743c06a860 0x7f743c0b2a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7430009e50 tx=0x7f7430004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:47.815 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f7439ffb640 1 -- 172.21.15.22:0/4062992249 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743003e450 con 0x7f743c06a860 2023-11-24T06:11:47.815 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f7439ffb640 1 -- 172.21.15.22:0/4062992249 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743003e5b0 con 0x7f743c06a860 2023-11-24T06:11:47.815 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f7439ffb640 1 -- 172.21.15.22:0/4062992249 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743003e960 con 0x7f743c06a860 2023-11-24T06:11:47.815 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.810+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c0cae90 con 0x7f743c06a860 2023-11-24T06:11:47.815 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.811+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c0b2f40 con 0x7f743c06a860 2023-11-24T06:11:47.815 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.812+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c0b30d0 con 0x7f743c06a860 2023-11-24T06:11:47.815 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.813+0000 7f7439ffb640 1 -- 172.21.15.22:0/4062992249 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f743003eac0 con 0x7f743c06a860 2023-11-24T06:11:47.816 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.813+0000 7f7439ffb640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f742006adb0 0x7f742006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:47.816 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.813+0000 7f7439ffb640 1 -- 172.21.15.22:0/4062992249 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f74300ab7c0 con 0x7f743c06a860 2023-11-24T06:11:47.816 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.814+0000 7f7440da2640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f742006adb0 0x7f742006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:47.817 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.814+0000 7f7440da2640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f742006adb0 0x7f742006d270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f743c0b3790 tx=0x7f7428009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:47.821 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:47.818+0000 7f7439ffb640 1 -- 172.21.15.22:0/4062992249 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74300775f0 con 0x7f743c06a860 2023-11-24T06:11:48.009 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.006+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f743c0cb350 con 0x7f743c06a860 2023-11-24T06:11:48.010 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.008+0000 7f7439ffb640 1 -- 172.21.15.22:0/4062992249 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7554 (secure 0 0 0) 0x7f7430043090 con 0x7f743c06a860 2023-11-24T06:11:48.011 INFO:teuthology.misc.health.smithi022.stdout: 2023-11-24T06:11:48.011 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":14,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:11:47.017077+0000","last_up_change":"2023-11-24T06:11:47.017077+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f742006adb0 msgr2=0x7f742006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f742006adb0 0x7f742006d270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f743c0b3790 tx=0x7f7428009040 comp rx=0 tx=0).stop 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f743c06a860 msgr2=0x7f743c0b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f743c06a860 0x7f743c0b2a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7430009e50 tx=0x7f7430004a40 comp rx=0 tx=0).stop 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 shutdown_connections 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f742006adb0 0x7f742006d270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743c15b010 0x7f743c0cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743c0ad890 0x7f743c15c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 --2- 172.21.15.22:0/4062992249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f743c06a860 0x7f743c0b2a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 >> 172.21.15.22:0/4062992249 conn(0x7f743c0b0d00 msgr2=0x7f743c15e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:48.015 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 shutdown_connections 2023-11-24T06:11:48.016 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:48.012+0000 7f74425a5640 1 -- 172.21.15.22:0/4062992249 wait complete. 2023-11-24T06:11:48.028 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-11-24T06:11:48.125 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-24T06:11:48.121+0000 7fc776545640 -1 osd.4 0 waiting for initial osdmap 2023-11-24T06:11:48.134 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-24T06:11:48.131+0000 7fc76eb7e640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:11:48.145 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-24T06:11:48.142+0000 7f07ec97d640 -1 osd.6 0 waiting for initial osdmap 2023-11-24T06:11:48.148 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-24T06:11:48.145+0000 7f4f670a2640 -1 osd.7 0 waiting for initial osdmap 2023-11-24T06:11:48.158 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-24T06:11:48.155+0000 7f4f5f6db640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:11:48.162 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-24T06:11:48.159+0000 7f07e377e640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:11:48.164 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-24T06:11:48.161+0000 7f691ec7d640 -1 osd.5 0 waiting for initial osdmap 2023-11-24T06:11:48.185 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-24T06:11:48.182+0000 7f69172b6640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:11:50.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:11:50.060 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:11:54.834 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:11:55.027 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.024+0000 7fc899b83640 1 Processor -- start 2023-11-24T06:11:55.027 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.024+0000 7fc899b83640 1 -- start start 2023-11-24T06:11:55.029 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.026+0000 7fc899b83640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc894160a70 0x7fc8940cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.029 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.026+0000 7fc899b83640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc8940d3b40 0x7fc8940cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.029 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.026+0000 7fc899b83640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc8940cfba0 0x7fc8940d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.029 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.026+0000 7fc899b83640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8940d0030 con 0x7fc8940cfba0 2023-11-24T06:11:55.029 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.026+0000 7fc899b83640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8940b6660 con 0x7fc8940d3b40 2023-11-24T06:11:55.029 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.026+0000 7fc899b83640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940cedb0 con 0x7fc894160a70 2023-11-24T06:11:55.030 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.026+0000 7fc899382640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc8940cfba0 0x7fc8940d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.030 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc899382640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc8940cfba0 0x7fc8940d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48758/0 (socket says 172.21.15.22:48758) 2023-11-24T06:11:55.030 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc899382640 1 -- 172.21.15.22:0/2133240373 learned_addr learned my addr 172.21.15.22:0/2133240373 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:55.030 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc898b81640 1 --2- 172.21.15.22:0/2133240373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc894160a70 0x7fc8940cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.030 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc893fff640 1 --2- 172.21.15.22:0/2133240373 >> v2:172.21.15.31:3300/0 conn(0x7fc8940d3b40 0x7fc8940cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.031 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc899382640 1 -- 172.21.15.22:0/2133240373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc894160a70 msgr2=0x7fc8940cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:55.031 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc899382640 1 --2- 172.21.15.22:0/2133240373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc894160a70 0x7fc8940cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.031 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc899382640 1 -- 172.21.15.22:0/2133240373 >> v2:172.21.15.31:3300/0 conn(0x7fc8940d3b40 msgr2=0x7fc8940cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:55.031 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc899382640 1 --2- 172.21.15.22:0/2133240373 >> v2:172.21.15.31:3300/0 conn(0x7fc8940d3b40 0x7fc8940cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.031 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc899382640 1 -- 172.21.15.22:0/2133240373 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940b6010 con 0x7fc8940cfba0 2023-11-24T06:11:55.031 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.027+0000 7fc893fff640 1 --2- 172.21.15.22:0/2133240373 >> v2:172.21.15.31:3300/0 conn(0x7fc8940d3b40 0x7fc8940cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:11:55.031 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.029+0000 7fc899382640 1 --2- 172.21.15.22:0/2133240373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940cfba0 0x7fc8940d0f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc89408b920 tx=0x7fc88c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a197e5c0707c5c71 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:55.032 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.029+0000 7fc8937fe640 1 -- 172.21.15.22:0/2133240373 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c02ca70 con 0x7fc8940cfba0 2023-11-24T06:11:55.032 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.029+0000 7fc8937fe640 1 -- 172.21.15.22:0/2133240373 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c02cbd0 con 0x7fc8940cfba0 2023-11-24T06:11:55.032 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.029+0000 7fc8937fe640 1 -- 172.21.15.22:0/2133240373 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c0343f0 con 0x7fc8940cfba0 2023-11-24T06:11:55.033 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.030+0000 7fc899b83640 1 -- 172.21.15.22:0/2133240373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940cfba0 msgr2=0x7fc8940d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.033 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.030+0000 7fc899b83640 1 --2- 172.21.15.22:0/2133240373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940cfba0 0x7fc8940d0f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc89408b920 tx=0x7fc88c02bed0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.033 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.030+0000 7fc899b83640 1 -- 172.21.15.22:0/2133240373 shutdown_connections 2023-11-24T06:11:55.033 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.030+0000 7fc899b83640 1 --2- 172.21.15.22:0/2133240373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940cfba0 0x7fc8940d0f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.033 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.030+0000 7fc899b83640 1 --2- 172.21.15.22:0/2133240373 >> v2:172.21.15.31:3300/0 conn(0x7fc8940d3b40 0x7fc8940cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.033 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.030+0000 7fc899b83640 1 --2- 172.21.15.22:0/2133240373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc894160a70 0x7fc8940cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.033 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.030+0000 7fc899b83640 1 -- 172.21.15.22:0/2133240373 >> 172.21.15.22:0/2133240373 conn(0x7fc8940d3020 msgr2=0x7fc8940d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:55.033 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.030+0000 7fc899b83640 1 -- 172.21.15.22:0/2133240373 shutdown_connections 2023-11-24T06:11:55.033 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.030+0000 7fc899b83640 1 -- 172.21.15.22:0/2133240373 wait complete. 2023-11-24T06:11:55.034 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.032+0000 7fc899b83640 1 Processor -- start 2023-11-24T06:11:55.034 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.032+0000 7fc899b83640 1 -- start start 2023-11-24T06:11:55.036 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc899b83640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8940cfba0 0x7fc8940c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.036 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc899b83640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940d3b40 0x7fc8940b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.036 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc899b83640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc894160a70 0x7fc89414f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.036 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc899b83640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940c9da0 con 0x7fc8940d3b40 2023-11-24T06:11:55.036 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc899b83640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940b1c60 con 0x7fc894160a70 2023-11-24T06:11:55.036 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc899b83640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89414ed20 con 0x7fc8940cfba0 2023-11-24T06:11:55.036 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc893fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940d3b40 0x7fc8940b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.036 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc893fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940d3b40 0x7fc8940b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48770/0 (socket says 172.21.15.22:48770) 2023-11-24T06:11:55.036 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc893fff640 1 -- 172.21.15.22:0/1726715668 learned_addr learned my addr 172.21.15.22:0/1726715668 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:55.037 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.033+0000 7fc898b81640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8940cfba0 0x7fc8940c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc899382640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc894160a70 0x7fc89414f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc893fff640 1 -- 172.21.15.22:0/1726715668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8940cfba0 msgr2=0x7fc8940c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc893fff640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8940cfba0 0x7fc8940c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc893fff640 1 -- 172.21.15.22:0/1726715668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc894160a70 msgr2=0x7fc89414f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc893fff640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc894160a70 0x7fc89414f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc893fff640 1 -- 172.21.15.22:0/1726715668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c009b30 con 0x7fc8940d3b40 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc893fff640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940d3b40 0x7fc8940b0720 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc88000e7e0 tx=0x7fc88000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc8917fa640 1 -- 172.21.15.22:0/1726715668 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880004030 con 0x7fc8940d3b40 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc8917fa640 1 -- 172.21.15.22:0/1726715668 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc880004190 con 0x7fc8940d3b40 2023-11-24T06:11:55.038 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc8917fa640 1 -- 172.21.15.22:0/1726715668 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880004500 con 0x7fc8940d3b40 2023-11-24T06:11:55.039 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8940b1050 con 0x7fc8940d3b40 2023-11-24T06:11:55.039 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.034+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8940b1610 con 0x7fc8940d3b40 2023-11-24T06:11:55.039 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.036+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8940b1e10 con 0x7fc8940d3b40 2023-11-24T06:11:55.039 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.037+0000 7fc8917fa640 1 -- 172.21.15.22:0/1726715668 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc88000c6d0 con 0x7fc8940d3b40 2023-11-24T06:11:55.040 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.037+0000 7fc8917fa640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc87806ae40 0x7fc87806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.040 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.038+0000 7fc8917fa640 1 -- 172.21.15.22:0/1726715668 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc880088e50 con 0x7fc8940d3b40 2023-11-24T06:11:55.040 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.038+0000 7fc898b81640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc87806ae40 0x7fc87806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.041 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.038+0000 7fc898b81640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc87806ae40 0x7fc87806d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc888009a10 tx=0x7fc888008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:55.045 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.043+0000 7fc8917fa640 1 -- 172.21.15.22:0/1726715668 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8940b1e10 con 0x7fc8940d3b40 2023-11-24T06:11:55.238 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.235+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc894067930 con 0x7fc8940d3b40 2023-11-24T06:11:55.240 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.237+0000 7fc8917fa640 1 -- 172.21.15.22:0/1726715668 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12802 (secure 0 0 0) 0x7fc880054240 con 0x7fc8940d3b40 2023-11-24T06:11:55.240 INFO:teuthology.misc.health.smithi022.stdout: 2023-11-24T06:11:55.240 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":18,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:11:51.370471+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:11:55.243 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc87806ae40 msgr2=0x7fc87806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.243 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc87806ae40 0x7fc87806d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc888009a10 tx=0x7fc888008040 comp rx=0 tx=0).stop 2023-11-24T06:11:55.243 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940d3b40 msgr2=0x7fc8940b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.244 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940d3b40 0x7fc8940b0720 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc88000e7e0 tx=0x7fc88000eca0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.244 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 shutdown_connections 2023-11-24T06:11:55.244 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc87806ae40 0x7fc87806d300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.244 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc894160a70 0x7fc89414f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.244 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8940d3b40 0x7fc8940b0720 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.244 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 --2- 172.21.15.22:0/1726715668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8940cfba0 0x7fc8940c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.244 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 >> 172.21.15.22:0/1726715668 conn(0x7fc8940d3020 msgr2=0x7fc8940b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:55.244 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 shutdown_connections 2023-11-24T06:11:55.244 INFO:teuthology.misc.health.smithi022.stderr:2023-11-24T06:11:55.240+0000 7fc899b83640 1 -- 172.21.15.22:0/1726715668 wait complete. 2023-11-24T06:11:55.258 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-24T06:11:55.258 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-24T06:11:55.258 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:11:55.258 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:11:55.267 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:11:55.267 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:11:55.267 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:11:55.276 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:11:55.276 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:11:55.276 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:11:55.285 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:11:55.285 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:11:55.285 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:11:55.295 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:11:55.295 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-24T06:11:55.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:11:55.423 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-11-24T06:11:55.438 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-11-24T06:11:55.469 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2023-11-24T06:11:55.469 INFO:tasks.ceph.mds.d.smithi031.stdout:starting mds.d at 2023-11-24T06:11:55.471 INFO:tasks.ceph.mds.b.smithi031.stderr:2023-11-24T06:11:55.468+0000 7f349e6bd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-24T06:11:55.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.484+0000 7ff574c02640 1 Processor -- start 2023-11-24T06:11:55.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.484+0000 7ff574c02640 1 -- start start 2023-11-24T06:11:55.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.485+0000 7ff574c02640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff57006f1a0 0x7ff5700b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff574c02640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57015d970 con 0x7ff5700d0fe0 2023-11-24T06:11:55.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff574c02640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5700d14e0 con 0x7ff570145f80 2023-11-24T06:11:55.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff574c02640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5700b4f80 con 0x7ff57006f1a0 2023-11-24T06:11:55.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff56ed9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff5700d0fe0 0x7ff57006bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53772/0 (socket says 172.21.15.22:53772) 2023-11-24T06:11:55.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff56ed9d640 1 -- 172.21.15.22:0/605579282 learned_addr learned my addr 172.21.15.22:0/605579282 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:55.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff567fff640 1 --2- 172.21.15.22:0/605579282 >> v2:172.21.15.22:3300/0 conn(0x7ff57006f1a0 0x7ff5700b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff567fff640 1 -- 172.21.15.22:0/605579282 >> v1:172.21.15.31:6789/0 conn(0x7ff570145f80 legacy=0x7ff57006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff567fff640 1 -- 172.21.15.22:0/605579282 >> v1:172.21.15.22:6789/0 conn(0x7ff5700d0fe0 legacy=0x7ff57006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff567fff640 1 -- 172.21.15.22:0/605579282 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700d17c0 con 0x7ff57006f1a0 2023-11-24T06:11:55.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.486+0000 7ff56dd9b640 1 -- 172.21.15.22:0/605579282 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473654753 0 0) 0x7ff568001490 con 0x7ff5700d0fe0 2023-11-24T06:11:55.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.487+0000 7ff567fff640 1 --2- 172.21.15.22:0/605579282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff57006f1a0 0x7ff5700b4a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff5580097a0 tx=0x7ff55802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c2775859492f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:55.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.488+0000 7ff56dd9b640 1 -- 172.21.15.22:0/605579282 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558030610 con 0x7ff57006f1a0 2023-11-24T06:11:55.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.488+0000 7ff56dd9b640 1 -- 172.21.15.22:0/605579282 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558030770 con 0x7ff57006f1a0 2023-11-24T06:11:55.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.488+0000 7ff56dd9b640 1 -- 172.21.15.22:0/605579282 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558030b00 con 0x7ff57006f1a0 2023-11-24T06:11:55.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.488+0000 7ff574c02640 1 -- 172.21.15.22:0/605579282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff57006f1a0 msgr2=0x7ff5700b4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.488+0000 7ff574c02640 1 --2- 172.21.15.22:0/605579282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff57006f1a0 0x7ff5700b4a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff5580097a0 tx=0x7ff55802b960 comp rx=0 tx=0).stop 2023-11-24T06:11:55.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.488+0000 7ff574c02640 1 -- 172.21.15.22:0/605579282 shutdown_connections 2023-11-24T06:11:55.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.488+0000 7ff574c02640 1 --2- 172.21.15.22:0/605579282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff57006f1a0 0x7ff5700b4a40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.488+0000 7ff574c02640 1 -- 172.21.15.22:0/605579282 >> 172.21.15.22:0/605579282 conn(0x7ff5700663d0 msgr2=0x7ff5700667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:55.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.488+0000 7ff574c02640 1 -- 172.21.15.22:0/605579282 shutdown_connections 2023-11-24T06:11:55.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.489+0000 7ff574c02640 1 -- 172.21.15.22:0/605579282 wait complete. 2023-11-24T06:11:55.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.490+0000 7ff574c02640 1 Processor -- start 2023-11-24T06:11:55.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.490+0000 7ff574c02640 1 -- start start 2023-11-24T06:11:55.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff574c02640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff57006f1a0 0x7ff57013d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff574c02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5700d0fe0 0x7ff5701f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff574c02640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff570145f80 0x7ff57015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff574c02640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57013db30 con 0x7ff5700d0fe0 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff574c02640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5701f66e0 con 0x7ff570145f80 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff574c02640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5701f5100 con 0x7ff57006f1a0 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff567fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5700d0fe0 0x7ff5701f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff567fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5700d0fe0 0x7ff5701f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48810/0 (socket says 172.21.15.22:48810) 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff567fff640 1 -- 172.21.15.22:0/3236007172 learned_addr learned my addr 172.21.15.22:0/3236007172 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff56ed9d640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff570145f80 0x7ff57015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.491+0000 7ff56e59c640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff57006f1a0 0x7ff57013d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.492+0000 7ff567fff640 1 -- 172.21.15.22:0/3236007172 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff57006f1a0 msgr2=0x7ff57013d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.492+0000 7ff567fff640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff57006f1a0 0x7ff57013d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.492+0000 7ff567fff640 1 -- 172.21.15.22:0/3236007172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff570145f80 msgr2=0x7ff57015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.492+0000 7ff567fff640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff570145f80 0x7ff57015ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.492+0000 7ff567fff640 1 -- 172.21.15.22:0/3236007172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558009400 con 0x7ff5700d0fe0 2023-11-24T06:11:55.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.492+0000 7ff567fff640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5700d0fe0 0x7ff5701f61a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5580098c0 tx=0x7ff558004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:55.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.493+0000 7ff566ffd640 1 -- 172.21.15.22:0/3236007172 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55803e040 con 0x7ff5700d0fe0 2023-11-24T06:11:55.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.493+0000 7ff566ffd640 1 -- 172.21.15.22:0/3236007172 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558039cb0 con 0x7ff5700d0fe0 2023-11-24T06:11:55.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.493+0000 7ff566ffd640 1 -- 172.21.15.22:0/3236007172 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558044630 con 0x7ff5700d0fe0 2023-11-24T06:11:55.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.493+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5701f53e0 con 0x7ff5700d0fe0 2023-11-24T06:11:55.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.493+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5701f59a0 con 0x7ff5700d0fe0 2023-11-24T06:11:55.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.494+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff570074770 con 0x7ff5700d0fe0 2023-11-24T06:11:55.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.495+0000 7ff566ffd640 1 -- 172.21.15.22:0/3236007172 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff558043390 con 0x7ff5700d0fe0 2023-11-24T06:11:55.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.495+0000 7ff566ffd640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff55006ae40 0x7ff55006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.496+0000 7ff566ffd640 1 -- 172.21.15.22:0/3236007172 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff5580ab5e0 con 0x7ff5700d0fe0 2023-11-24T06:11:55.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.496+0000 7ff56e59c640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff55006ae40 0x7ff55006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.496+0000 7ff56e59c640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff55006ae40 0x7ff55006d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff560000f60 tx=0x7ff560009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:55.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.500+0000 7ff566ffd640 1 -- 172.21.15.22:0/3236007172 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff558076a80 con 0x7ff5700d0fe0 2023-11-24T06:11:55.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.697+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff57006d520 con 0x7ff5700d0fe0 2023-11-24T06:11:55.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.699+0000 7ff566ffd640 1 -- 172.21.15.22:0/3236007172 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12802 (secure 0 0 0) 0x7ff55807a0a0 con 0x7ff5700d0fe0 2023-11-24T06:11:55.702 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:11:55.702 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":18,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:11:51.370471+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:11:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff55006ae40 msgr2=0x7ff55006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff55006ae40 0x7ff55006d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff560000f60 tx=0x7ff560009040 comp rx=0 tx=0).stop 2023-11-24T06:11:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5700d0fe0 msgr2=0x7ff5701f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5700d0fe0 0x7ff5701f61a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5580098c0 tx=0x7ff558004730 comp rx=0 tx=0).stop 2023-11-24T06:11:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 shutdown_connections 2023-11-24T06:11:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff55006ae40 0x7ff55006d300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff570145f80 0x7ff57015ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5700d0fe0 0x7ff5701f61a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 --2- 172.21.15.22:0/3236007172 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff57006f1a0 0x7ff57013d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 >> 172.21.15.22:0/3236007172 conn(0x7ff5700663d0 msgr2=0x7ff570144d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 shutdown_connections 2023-11-24T06:11:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.702+0000 7ff574c02640 1 -- 172.21.15.22:0/3236007172 wait complete. 2023-11-24T06:11:55.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:11:55.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:11:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.941+0000 7f540dc48640 1 Processor -- start 2023-11-24T06:11:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.941+0000 7f540dc48640 1 -- start start 2023-11-24T06:11:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.943+0000 7f540dc48640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f540815b350 0x7f54080abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.943+0000 7f540dc48640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540815b730 con 0x7f540809cb30 2023-11-24T06:11:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.943+0000 7f540dc48640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54080ac740 con 0x7f54080adb60 2023-11-24T06:11:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.943+0000 7f540dc48640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080ac460 con 0x7f540815b350 2023-11-24T06:11:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.943+0000 7f5406ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f540809cb30 0x7f54080b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53784/0 (socket says 172.21.15.22:53784) 2023-11-24T06:11:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.943+0000 7f5406ffd640 1 -- 172.21.15.22:0/1972991447 learned_addr learned my addr 172.21.15.22:0/1972991447 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.943+0000 7f54077fe640 1 --2- 172.21.15.22:0/1972991447 >> v2:172.21.15.31:3300/0 conn(0x7f540815b350 0x7f54080abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.943+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100086373 0 0) 0x7f53fc001110 con 0x7f540809cb30 2023-11-24T06:11:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.943+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f0003520 con 0x7f540809cb30 2023-11-24T06:11:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4176696637 0 0) 0x7f53f0003520 con 0x7f540809cb30 2023-11-24T06:11:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 >> v2:172.21.15.31:3300/0 conn(0x7f540815b350 msgr2=0x7f54080abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 --2- 172.21.15.22:0/1972991447 >> v2:172.21.15.31:3300/0 conn(0x7f540815b350 0x7f54080abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 >> v1:172.21.15.31:6789/0 conn(0x7f54080adb60 legacy=0x7f54080adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54080b2a50 con 0x7f540809cb30 2023-11-24T06:11:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f53fc001800 con 0x7f540809cb30 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 >> v1:172.21.15.22:6789/0 conn(0x7f540809cb30 legacy=0x7f54080b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00039c0 0x7f53f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f00047c0 0x7f53f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f0005180 0x7f53f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54080ac460 con 0x7f53f00047c0 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f000c080 con 0x7f53f0005180 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f000c240 con 0x7f53f00039c0 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.944+0000 7f5406ffd640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f00047c0 0x7f53f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.945+0000 7f5407fff640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f0005180 0x7f53f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.945+0000 7f54077fe640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00039c0 0x7f53f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.945+0000 7f5406ffd640 1 -- 172.21.15.22:0/1972991447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00039c0 msgr2=0x7f53f0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.945+0000 7f5406ffd640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00039c0 0x7f53f0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.945+0000 7f5406ffd640 1 -- 172.21.15.22:0/1972991447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f0005180 msgr2=0x7f53f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.945+0000 7f5406ffd640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f0005180 0x7f53f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.945+0000 7f5406ffd640 1 -- 172.21.15.22:0/1972991447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f0003520 con 0x7f53f00047c0 2023-11-24T06:11:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.945+0000 7f5407fff640 1 -- 172.21.15.22:0/1972991447 reap_dead start 2023-11-24T06:11:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.945+0000 7f54077fe640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00039c0 0x7f53f0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.946+0000 7f5406ffd640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f00047c0 0x7f53f0004c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53fc007fc0 tx=0x7f53f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7b09ae5187d60e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.946+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc005ad0 con 0x7f53f00047c0 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.946+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc005c50 con 0x7f53f00047c0 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.946+0000 7f54067fc640 1 -- 172.21.15.22:0/1972991447 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc02c7e0 con 0x7f53f00047c0 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.947+0000 7f540dc48640 1 -- 172.21.15.22:0/1972991447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f00047c0 msgr2=0x7f53f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.947+0000 7f540dc48640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f00047c0 0x7f53f0004c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53fc007fc0 tx=0x7f53f00057f0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.947+0000 7f540dc48640 1 -- 172.21.15.22:0/1972991447 shutdown_connections 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.947+0000 7f540dc48640 1 --2- 172.21.15.22:0/1972991447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f00047c0 0x7f53f0004c40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.947+0000 7f540dc48640 1 -- 172.21.15.22:0/1972991447 >> 172.21.15.22:0/1972991447 conn(0x7f54080b0ba0 msgr2=0x7f54080b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.947+0000 7f540dc48640 1 -- 172.21.15.22:0/1972991447 shutdown_connections 2023-11-24T06:11:55.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.947+0000 7f540dc48640 1 -- 172.21.15.22:0/1972991447 wait complete. 2023-11-24T06:11:55.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.949+0000 7f540dc48640 1 Processor -- start 2023-11-24T06:11:55.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.949+0000 7f540dc48640 1 -- start start 2023-11-24T06:11:55.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.950+0000 7f540dc48640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00047c0 0x7f5408070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.950+0000 7f540dc48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5408147b60 0x7f5408155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.950+0000 7f540dc48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54081e5650 0x7f54081e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.950+0000 7f540dc48640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54081e6010 con 0x7f5408147b60 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.950+0000 7f540dc48640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54081484a0 con 0x7f54081e5650 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.950+0000 7f540dc48640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5408147fe0 con 0x7f53f00047c0 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.950+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5408147b60 0x7f5408155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.950+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5408147b60 0x7f5408155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48822/0 (socket says 172.21.15.22:48822) 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.950+0000 7f5406ffd640 1 -- 172.21.15.22:0/998253256 learned_addr learned my addr 172.21.15.22:0/998253256 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f5407fff640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54081e5650 0x7f54081e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f54077fe640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00047c0 0x7f5408070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f5406ffd640 1 -- 172.21.15.22:0/998253256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00047c0 msgr2=0x7f5408070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f5406ffd640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00047c0 0x7f5408070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f5406ffd640 1 -- 172.21.15.22:0/998253256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54081e5650 msgr2=0x7f54081e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:55.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f5406ffd640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54081e5650 0x7f54081e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:55.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f5406ffd640 1 -- 172.21.15.22:0/998253256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408156360 con 0x7f5408147b60 2023-11-24T06:11:55.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f54077fe640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00047c0 0x7f5408070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:11:55.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f5406ffd640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5408147b60 0x7f5408155e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53fc02c450 tx=0x7f53fc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:55.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f53effff640 1 -- 172.21.15.22:0/998253256 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc03c040 con 0x7f5408147b60 2023-11-24T06:11:55.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f53effff640 1 -- 172.21.15.22:0/998253256 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc02cbf0 con 0x7f5408147b60 2023-11-24T06:11:55.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f53effff640 1 -- 172.21.15.22:0/998253256 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc007070 con 0x7f5408147b60 2023-11-24T06:11:55.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5408071480 con 0x7f5408147b60 2023-11-24T06:11:55.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.951+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5408071a40 con 0x7f5408147b60 2023-11-24T06:11:55.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.952+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540809d200 con 0x7f5408147b60 2023-11-24T06:11:55.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.953+0000 7f53effff640 1 -- 172.21.15.22:0/998253256 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53fc032070 con 0x7f5408147b60 2023-11-24T06:11:55.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.954+0000 7f53effff640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53f406ae40 0x7f53f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:55.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.954+0000 7f53effff640 1 -- 172.21.15.22:0/998253256 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f53fc0aa3f0 con 0x7f5408147b60 2023-11-24T06:11:55.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.955+0000 7f54077fe640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53f406ae40 0x7f53f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:55.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.955+0000 7f54077fe640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53f406ae40 0x7f53f406d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5408068d90 tx=0x7f53f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:55.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:55.959+0000 7f53effff640 1 -- 172.21.15.22:0/998253256 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f53fc075880 con 0x7f5408147b60 2023-11-24T06:11:56.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.148+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f540815b730 con 0x7f5408147b60 2023-11-24T06:11:56.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.149+0000 7f53effff640 1 -- 172.21.15.22:0/998253256 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f540815b730 con 0x7f5408147b60 2023-11-24T06:11:56.152 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:11:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53f406ae40 msgr2=0x7f53f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53f406ae40 0x7f53f406d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5408068d90 tx=0x7f53f8008040 comp rx=0 tx=0).stop 2023-11-24T06:11:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5408147b60 msgr2=0x7f5408155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5408147b60 0x7f5408155e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53fc02c450 tx=0x7f53fc02e070 comp rx=0 tx=0).stop 2023-11-24T06:11:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 shutdown_connections 2023-11-24T06:11:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53f406ae40 0x7f53f406d300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54081e5650 0x7f54081e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5408147b60 0x7f5408155e20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 --2- 172.21.15.22:0/998253256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53f00047c0 0x7f5408070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.151+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 >> 172.21.15.22:0/998253256 conn(0x7f54080b0ba0 msgr2=0x7f5408159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.152+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 shutdown_connections 2023-11-24T06:11:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.152+0000 7f540dc48640 1 -- 172.21.15.22:0/998253256 wait complete. 2023-11-24T06:11:56.172 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:11:56.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.391+0000 7f78f0aea640 1 Processor -- start 2023-11-24T06:11:56.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.391+0000 7f78f0aea640 1 -- start start 2023-11-24T06:11:56.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.393+0000 7f78f0aea640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78ec0cf050 0x7f78ec0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.393+0000 7f78f0aea640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f78ec0cd7b0 0x7f78ec0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.393+0000 7f78f0aea640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec15fa70 con 0x7f78ec13dfd0 2023-11-24T06:11:56.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.393+0000 7f78f0aea640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec0cfa40 con 0x7f78ec0cd7b0 2023-11-24T06:11:56.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.393+0000 7f78f0aea640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec15c580 con 0x7f78ec0cf050 2023-11-24T06:11:56.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78ebfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f78ec0cd7b0 0x7f78ec0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78ebfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f78ec0cd7b0 0x7f78ec0cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48830/0 (socket says 172.21.15.22:48830) 2023-11-24T06:11:56.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78ebfff640 1 -- 172.21.15.22:0/1268871143 learned_addr learned my addr 172.21.15.22:0/1268871143 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:56.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78eb7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f78ec13dfd0 0x7f78ec15be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53796/0 (socket says 172.21.15.22:53796) 2023-11-24T06:11:56.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78e2ffd640 1 --2- 172.21.15.22:0/1268871143 >> v2:172.21.15.31:3300/0 conn(0x7f78ec0cf050 0x7f78ec0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78ebfff640 1 -- 172.21.15.22:0/1268871143 >> v2:172.21.15.31:3300/0 conn(0x7f78ec0cf050 msgr2=0x7f78ec0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:56.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78ebfff640 1 --2- 172.21.15.22:0/1268871143 >> v2:172.21.15.31:3300/0 conn(0x7f78ec0cf050 0x7f78ec0cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78ebfff640 1 -- 172.21.15.22:0/1268871143 >> v1:172.21.15.22:6789/0 conn(0x7f78ec13dfd0 legacy=0x7f78ec15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78ebfff640 1 -- 172.21.15.22:0/1268871143 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec140900 con 0x7f78ec0cd7b0 2023-11-24T06:11:56.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.394+0000 7f78eaffd640 1 -- 172.21.15.22:0/1268871143 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517403660 0 0) 0x7f78ec15fa70 con 0x7f78ec13dfd0 2023-11-24T06:11:56.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.395+0000 7f78ebfff640 1 --2- 172.21.15.22:0/1268871143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cd7b0 0x7f78ec0cdbb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f78ec06e070 tx=0x7f78e402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0e7fde3da23c69 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:56.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78eaffd640 1 -- 172.21.15.22:0/1268871143 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4030860 con 0x7f78ec0cd7b0 2023-11-24T06:11:56.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78eaffd640 1 -- 172.21.15.22:0/1268871143 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e40309c0 con 0x7f78ec0cd7b0 2023-11-24T06:11:56.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78eaffd640 1 -- 172.21.15.22:0/1268871143 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4030d50 con 0x7f78ec0cd7b0 2023-11-24T06:11:56.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78f0aea640 1 -- 172.21.15.22:0/1268871143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cd7b0 msgr2=0x7f78ec0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78f0aea640 1 --2- 172.21.15.22:0/1268871143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cd7b0 0x7f78ec0cdbb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f78ec06e070 tx=0x7f78e402b9a0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78f0aea640 1 -- 172.21.15.22:0/1268871143 shutdown_connections 2023-11-24T06:11:56.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78f0aea640 1 --2- 172.21.15.22:0/1268871143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cd7b0 0x7f78ec0cdbb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78f0aea640 1 --2- 172.21.15.22:0/1268871143 >> v2:172.21.15.31:3300/0 conn(0x7f78ec0cf050 0x7f78ec0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78f0aea640 1 -- 172.21.15.22:0/1268871143 >> 172.21.15.22:0/1268871143 conn(0x7f78ec06a860 msgr2=0x7f78ec06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:56.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78f0aea640 1 -- 172.21.15.22:0/1268871143 shutdown_connections 2023-11-24T06:11:56.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.396+0000 7f78f0aea640 1 -- 172.21.15.22:0/1268871143 wait complete. 2023-11-24T06:11:56.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.398+0000 7f78f0aea640 1 Processor -- start 2023-11-24T06:11:56.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.398+0000 7f78f0aea640 1 -- start start 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.399+0000 7f78f0aea640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec0cd7b0 0x7f78ec138a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.399+0000 7f78f0aea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cf050 0x7f78ec0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.399+0000 7f78f0aea640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec13dfd0 0x7f78ec1f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.399+0000 7f78f0aea640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec138f80 con 0x7f78ec0cf050 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.399+0000 7f78f0aea640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec157060 con 0x7f78ec0cd7b0 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.399+0000 7f78f0aea640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec157340 con 0x7f78ec13dfd0 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78e2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cf050 0x7f78ec0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78e2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cf050 0x7f78ec0b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48838/0 (socket says 172.21.15.22:48838) 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78e2ffd640 1 -- 172.21.15.22:0/3213527284 learned_addr learned my addr 172.21.15.22:0/3213527284 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78eb7fe640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec0cd7b0 0x7f78ec138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78ebfff640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec13dfd0 0x7f78ec1f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78e2ffd640 1 -- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec13dfd0 msgr2=0x7f78ec1f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78e2ffd640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec13dfd0 0x7f78ec1f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78e2ffd640 1 -- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec0cd7b0 msgr2=0x7f78ec138a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78e2ffd640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec0cd7b0 0x7f78ec138a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78e2ffd640 1 -- 172.21.15.22:0/3213527284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e40094d0 con 0x7f78ec0cf050 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78ebfff640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec13dfd0 0x7f78ec1f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78eb7fe640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec0cd7b0 0x7f78ec138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.400+0000 7f78e2ffd640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cf050 0x7f78ec0b3140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f78d4007ef0 tx=0x7f78d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.401+0000 7f78e8ff9640 1 -- 172.21.15.22:0/3213527284 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4014620 con 0x7f78ec0cf050 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.401+0000 7f78e8ff9640 1 -- 172.21.15.22:0/3213527284 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d4014780 con 0x7f78ec0cf050 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.401+0000 7f78e8ff9640 1 -- 172.21.15.22:0/3213527284 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4014b30 con 0x7f78ec0cf050 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.401+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec157620 con 0x7f78ec0cf050 2023-11-24T06:11:56.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.401+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec157be0 con 0x7f78ec0cf050 2023-11-24T06:11:56.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.402+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec157da0 con 0x7f78ec0cf050 2023-11-24T06:11:56.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.403+0000 7f78e8ff9640 1 -- 172.21.15.22:0/3213527284 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78d4014c90 con 0x7f78ec0cf050 2023-11-24T06:11:56.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.404+0000 7f78e8ff9640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f78cc06ae40 0x7f78cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.404+0000 7f78e8ff9640 1 -- 172.21.15.22:0/3213527284 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f78d4089d30 con 0x7f78ec0cf050 2023-11-24T06:11:56.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.404+0000 7f78eb7fe640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f78cc06ae40 0x7f78cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.405+0000 7f78eb7fe640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f78cc06ae40 0x7f78cc06d300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f78dc000f60 tx=0x7f78dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:56.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.409+0000 7f78e8ff9640 1 -- 172.21.15.22:0/3213527284 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78d4055090 con 0x7f78ec0cf050 2023-11-24T06:11:56.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.639+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78ec04e840 con 0x7f78ec0cf050 2023-11-24T06:11:56.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.640+0000 7f78e8ff9640 1 -- 172.21.15.22:0/3213527284 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f78d40586b0 con 0x7f78ec0cf050 2023-11-24T06:11:56.646 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:11:56.646 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2596011389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2596011389},{"type":"v1","addr":"172.21.15.22:6837","nonce":2596011389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1715395658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1715395658},{"type":"v1","addr":"172.21.15.31:6834","nonce":1715395658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2020783180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2020783180},{"type":"v1","addr":"172.21.15.31:6835","nonce":2020783180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/4189980327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":4189980327},{"type":"v1","addr":"172.21.15.22:6835","nonce":4189980327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-24T06:11:56.647 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 3 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.642+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f78cc06ae40 msgr2=0x7f78cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.642+0000 7f78f0aea640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f78cc06ae40 0x7f78cc06d300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f78dc000f60 tx=0x7f78dc009040 comp rx=0 tx=0).stop 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.642+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cf050 msgr2=0x7f78ec0b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.642+0000 7f78f0aea640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cf050 0x7f78ec0b3140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f78d4007ef0 tx=0x7f78d400e4b0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.643+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 shutdown_connections 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.643+0000 7f78f0aea640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f78cc06ae40 0x7f78cc06d300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.643+0000 7f78f0aea640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78ec13dfd0 0x7f78ec1f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.643+0000 7f78f0aea640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec0cf050 0x7f78ec0b3140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.643+0000 7f78f0aea640 1 --2- 172.21.15.22:0/3213527284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78ec0cd7b0 0x7f78ec138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.643+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 >> 172.21.15.22:0/3213527284 conn(0x7f78ec06a860 msgr2=0x7f78ec13bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.643+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 shutdown_connections 2023-11-24T06:11:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.643+0000 7f78f0aea640 1 -- 172.21.15.22:0/3213527284 wait complete. 2023-11-24T06:11:56.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:11:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.873+0000 7f299e788640 1 Processor -- start 2023-11-24T06:11:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.873+0000 7f299e788640 1 -- start start 2023-11-24T06:11:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.875+0000 7f299e788640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2998150540 0x7f2998071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.875+0000 7f299e788640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299815e080 con 0x7f299806c840 2023-11-24T06:11:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.875+0000 7f299e788640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29980716f0 con 0x7f2998150920 2023-11-24T06:11:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.875+0000 7f299e788640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2998070dc0 con 0x7f2998150540 2023-11-24T06:11:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.875+0000 7f299df87640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f299806c840 0x7f299815d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53806/0 (socket says 172.21.15.22:53806) 2023-11-24T06:11:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f299df87640 1 -- 172.21.15.22:0/2921669115 learned_addr learned my addr 172.21.15.22:0/2921669115 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f299d786640 1 --2- 172.21.15.22:0/2921669115 >> v2:172.21.15.31:3300/0 conn(0x7f2998150540 0x7f2998071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548744337 0 0) 0x7f299815e080 con 0x7f299806c840 2023-11-24T06:11:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2984003520 con 0x7f299806c840 2023-11-24T06:11:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3861777950 0 0) 0x7f2984003520 con 0x7f299806c840 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 >> v2:172.21.15.31:3300/0 conn(0x7f2998150540 msgr2=0x7f2998071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 --2- 172.21.15.22:0/2921669115 >> v2:172.21.15.31:3300/0 conn(0x7f2998150540 0x7f2998071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 >> v1:172.21.15.31:6789/0 conn(0x7f2998150920 legacy=0x7f299806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29980710a0 con 0x7f299806c840 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f29900019f0 con 0x7f299806c840 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 >> v1:172.21.15.22:6789/0 conn(0x7f299806c840 legacy=0x7f299815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.876+0000 7f298ffff640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29840039e0 0x7f2984003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f298ffff640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f2984004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f298ffff640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29840051f0 0x7f298400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2998070dc0 con 0x7f29840047c0 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298400c150 con 0x7f29840039e0 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298400c310 con 0x7f29840051f0 2023-11-24T06:11:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f299cf85640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f2984004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f299d786640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29840039e0 0x7f2984003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f299df87640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29840051f0 0x7f298400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f299cf85640 1 -- 172.21.15.22:0/2921669115 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29840051f0 msgr2=0x7f298400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f299cf85640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29840051f0 0x7f298400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f299cf85640 1 -- 172.21.15.22:0/2921669115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29840039e0 msgr2=0x7f2984003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f299cf85640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29840039e0 0x7f2984003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f299cf85640 1 -- 172.21.15.22:0/2921669115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2984003520 con 0x7f29840047c0 2023-11-24T06:11:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.877+0000 7f299df87640 1 -- 172.21.15.22:0/2921669115 reap_dead start 2023-11-24T06:11:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.878+0000 7f299cf85640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f2984004c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2988001720 tx=0x7f29840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9034b148a61ebfb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880052d0 con 0x7f29840047c0 2023-11-24T06:11:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298802e050 con 0x7f29840047c0 2023-11-24T06:11:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f298ffff640 1 -- 172.21.15.22:0/2921669115 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988003830 con 0x7f29840047c0 2023-11-24T06:11:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f299e788640 1 -- 172.21.15.22:0/2921669115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 msgr2=0x7f2984004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f299e788640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f2984004c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2988001720 tx=0x7f29840057f0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f299e788640 1 -- 172.21.15.22:0/2921669115 shutdown_connections 2023-11-24T06:11:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f299e788640 1 --2- 172.21.15.22:0/2921669115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f2984004c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f299e788640 1 -- 172.21.15.22:0/2921669115 >> 172.21.15.22:0/2921669115 conn(0x7f299806a860 msgr2=0x7f299806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f299e788640 1 -- 172.21.15.22:0/2921669115 shutdown_connections 2023-11-24T06:11:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.879+0000 7f299e788640 1 -- 172.21.15.22:0/2921669115 wait complete. 2023-11-24T06:11:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.881+0000 7f299e788640 1 Processor -- start 2023-11-24T06:11:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.882+0000 7f299e788640 1 -- start start 2023-11-24T06:11:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299e788640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f29981f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299e788640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29981e67b0 0x7f299815d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299e788640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29981405f0 0x7f29980afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299e788640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29981f6bb0 con 0x7f29840047c0 2023-11-24T06:11:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299e788640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29981f6e90 con 0x7f29981405f0 2023-11-24T06:11:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299e788640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29981f7170 con 0x7f29981e67b0 2023-11-24T06:11:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299d786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f29981f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299d786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f29981f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48864/0 (socket says 172.21.15.22:48864) 2023-11-24T06:11:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299d786640 1 -- 172.21.15.22:0/876985241 learned_addr learned my addr 172.21.15.22:0/876985241 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299cf85640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29981e67b0 0x7f299815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299df87640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29981405f0 0x7f29980afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299d786640 1 -- 172.21.15.22:0/876985241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29981e67b0 msgr2=0x7f299815d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299d786640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29981e67b0 0x7f299815d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299d786640 1 -- 172.21.15.22:0/876985241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29981405f0 msgr2=0x7f29980afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299d786640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29981405f0 0x7f29980afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.883+0000 7f299d786640 1 -- 172.21.15.22:0/876985241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299813fdf0 con 0x7f29840047c0 2023-11-24T06:11:56.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.884+0000 7f299d786640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f29981f6380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29940109f0 tx=0x7f2994010eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:56.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.884+0000 7f298dffb640 1 -- 172.21.15.22:0/876985241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400ecc0 con 0x7f29840047c0 2023-11-24T06:11:56.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.884+0000 7f298dffb640 1 -- 172.21.15.22:0/876985241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299400ee20 con 0x7f29840047c0 2023-11-24T06:11:56.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.884+0000 7f298dffb640 1 -- 172.21.15.22:0/876985241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994012630 con 0x7f29840047c0 2023-11-24T06:11:56.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.884+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29981400d0 con 0x7f29840047c0 2023-11-24T06:11:56.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.884+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299815d940 con 0x7f29840047c0 2023-11-24T06:11:56.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.885+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299804e840 con 0x7f29840047c0 2023-11-24T06:11:56.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.886+0000 7f298dffb640 1 -- 172.21.15.22:0/876985241 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2994012790 con 0x7f29840047c0 2023-11-24T06:11:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.887+0000 7f298dffb640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f297c06ae70 0x7f297c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.887+0000 7f298dffb640 1 -- 172.21.15.22:0/876985241 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2994016070 con 0x7f29840047c0 2023-11-24T06:11:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.887+0000 7f299cf85640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f297c06ae70 0x7f297c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.888+0000 7f299cf85640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f297c06ae70 0x7f297c06d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2988033000 tx=0x7f2988009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:56.891+0000 7f298dffb640 1 -- 172.21.15.22:0/876985241 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2994054fd0 con 0x7f29840047c0 2023-11-24T06:11:57.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.086+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2998070720 con 0x7f29840047c0 2023-11-24T06:11:57.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.088+0000 7f298dffb640 1 -- 172.21.15.22:0/876985241 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f29940585f0 con 0x7f29840047c0 2023-11-24T06:11:57.091 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:11:57.091 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":18,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:11:51.370471+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f297c06ae70 msgr2=0x7f297c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f297c06ae70 0x7f297c06d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2988033000 tx=0x7f2988009030 comp rx=0 tx=0).stop 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 msgr2=0x7f29981f6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f29981f6380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29940109f0 tx=0x7f2994010eb0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 shutdown_connections 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f297c06ae70 0x7f297c06d330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29981405f0 0x7f29980afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29981e67b0 0x7f299815d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 --2- 172.21.15.22:0/876985241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29840047c0 0x7f29981f6380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 >> 172.21.15.22:0/876985241 conn(0x7f299806a860 msgr2=0x7f29981e4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:57.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 shutdown_connections 2023-11-24T06:11:57.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.091+0000 7f299e788640 1 -- 172.21.15.22:0/876985241 wait complete. 2023-11-24T06:11:57.113 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:11:57.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:11:57.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.333+0000 7fbddc8e1640 1 Processor -- start 2023-11-24T06:11:57.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.334+0000 7fbddc8e1640 1 -- start start 2023-11-24T06:11:57.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.335+0000 7fbddc8e1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbdd8153ea0 0x7fbdd80ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.336+0000 7fbddc8e1640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd80ce650 con 0x7fbdd8154280 2023-11-24T06:11:57.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.336+0000 7fbddc8e1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd8154710 con 0x7fbdd8070850 2023-11-24T06:11:57.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.336+0000 7fbddc8e1640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd815e0a0 con 0x7fbdd8153ea0 2023-11-24T06:11:57.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.336+0000 7fbdd77fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbdd8153ea0 0x7fbdd80ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.336+0000 7fbdd6ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbdd8154280 0x7fbdd815d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53818/0 (socket says 172.21.15.22:53818) 2023-11-24T06:11:57.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.336+0000 7fbdd6ffd640 1 -- 172.21.15.22:0/255439969 learned_addr learned my addr 172.21.15.22:0/255439969 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:57.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.336+0000 7fbdd77fe640 1 -- 172.21.15.22:0/255439969 >> v1:172.21.15.31:6789/0 conn(0x7fbdd8070850 legacy=0x7fbdd8071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:57.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.337+0000 7fbdd77fe640 1 -- 172.21.15.22:0/255439969 >> v1:172.21.15.22:6789/0 conn(0x7fbdd8154280 legacy=0x7fbdd815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.337+0000 7fbdd77fe640 1 -- 172.21.15.22:0/255439969 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd815e380 con 0x7fbdd8153ea0 2023-11-24T06:11:57.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.337+0000 7fbdd67fc640 1 -- 172.21.15.22:0/255439969 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883608016 0 0) 0x7fbdd80ce650 con 0x7fbdd8154280 2023-11-24T06:11:57.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.338+0000 7fbdd77fe640 1 --2- 172.21.15.22:0/255439969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8153ea0 0x7fbdd80ad450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009d90 tx=0x7fbdc802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6f1fa83555e338 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:57.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.338+0000 7fbdd67fc640 1 -- 172.21.15.22:0/255439969 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc802cc60 con 0x7fbdd8153ea0 2023-11-24T06:11:57.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.338+0000 7fbdd67fc640 1 -- 172.21.15.22:0/255439969 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc802cdc0 con 0x7fbdd8153ea0 2023-11-24T06:11:57.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.338+0000 7fbdd67fc640 1 -- 172.21.15.22:0/255439969 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8034660 con 0x7fbdd8153ea0 2023-11-24T06:11:57.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.339+0000 7fbddc8e1640 1 -- 172.21.15.22:0/255439969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8153ea0 msgr2=0x7fbdd80ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.339+0000 7fbddc8e1640 1 --2- 172.21.15.22:0/255439969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8153ea0 0x7fbdd80ad450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009d90 tx=0x7fbdc802beb0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.339+0000 7fbddc8e1640 1 -- 172.21.15.22:0/255439969 shutdown_connections 2023-11-24T06:11:57.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.339+0000 7fbddc8e1640 1 --2- 172.21.15.22:0/255439969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8153ea0 0x7fbdd80ad450 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.339+0000 7fbddc8e1640 1 -- 172.21.15.22:0/255439969 >> 172.21.15.22:0/255439969 conn(0x7fbdd80cec10 msgr2=0x7fbdd80cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:57.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.339+0000 7fbddc8e1640 1 -- 172.21.15.22:0/255439969 shutdown_connections 2023-11-24T06:11:57.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.339+0000 7fbddc8e1640 1 -- 172.21.15.22:0/255439969 wait complete. 2023-11-24T06:11:57.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.341+0000 7fbddc8e1640 1 Processor -- start 2023-11-24T06:11:57.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.341+0000 7fbddc8e1640 1 -- start start 2023-11-24T06:11:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbddc8e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8070850 0x7fbdd8150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbddc8e1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd8153ea0 0x7fbdd8156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbddc8e1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd8154280 0x7fbdd8157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbddc8e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8150c50 con 0x7fbdd8070850 2023-11-24T06:11:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbddc8e1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80b04d0 con 0x7fbdd8153ea0 2023-11-24T06:11:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbddc8e1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80b0260 con 0x7fbdd8154280 2023-11-24T06:11:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8070850 0x7fbdd8150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8070850 0x7fbdd8150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48886/0 (socket says 172.21.15.22:48886) 2023-11-24T06:11:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbdd77fe640 1 -- 172.21.15.22:0/547318659 learned_addr learned my addr 172.21.15.22:0/547318659 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:57.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbdd77fe640 1 -- 172.21.15.22:0/547318659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd8154280 msgr2=0x7fbdd8157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbdd77fe640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd8154280 0x7fbdd8157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbdd6ffd640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd8153ea0 0x7fbdd8156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbdd77fe640 1 -- 172.21.15.22:0/547318659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd8153ea0 msgr2=0x7fbdd8156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.342+0000 7fbdd77fe640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd8153ea0 0x7fbdd8156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.343+0000 7fbdd77fe640 1 -- 172.21.15.22:0/547318659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc8009a70 con 0x7fbdd8070850 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.343+0000 7fbdd77fe640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8070850 0x7fbdd8150710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009eb0 tx=0x7fbdc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.343+0000 7fbdcffff640 1 -- 172.21.15.22:0/547318659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8003b90 con 0x7fbdd8070850 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.343+0000 7fbdcffff640 1 -- 172.21.15.22:0/547318659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8003cf0 con 0x7fbdd8070850 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.343+0000 7fbdcffff640 1 -- 172.21.15.22:0/547318659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8004250 con 0x7fbdd8070850 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.343+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd80b0740 con 0x7fbdd8070850 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.343+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd80b0d00 con 0x7fbdd8070850 2023-11-24T06:11:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.345+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd806da30 con 0x7fbdd8070850 2023-11-24T06:11:57.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.346+0000 7fbdcffff640 1 -- 172.21.15.22:0/547318659 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbdc80043b0 con 0x7fbdd8070850 2023-11-24T06:11:57.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.346+0000 7fbdcffff640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbdb806ae70 0x7fbdb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.346+0000 7fbdcffff640 1 -- 172.21.15.22:0/547318659 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbdc80ac160 con 0x7fbdd8070850 2023-11-24T06:11:57.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.347+0000 7fbdd6ffd640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbdb806ae70 0x7fbdb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.347+0000 7fbdd6ffd640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbdb806ae70 0x7fbdb806d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8153930 tx=0x7fbdc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:57.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.351+0000 7fbdcffff640 1 -- 172.21.15.22:0/547318659 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbdc80775f0 con 0x7fbdd8070850 2023-11-24T06:11:57.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.541+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbdd804e840 con 0x7fbdd8070850 2023-11-24T06:11:57.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.543+0000 7fbdcffff640 1 -- 172.21.15.22:0/547318659 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbdc804d020 con 0x7fbdd8070850 2023-11-24T06:11:57.613 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:11:57.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbdb806ae70 msgr2=0x7fbdb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbdb806ae70 0x7fbdb806d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8153930 tx=0x7fbdc0009040 comp rx=0 tx=0).stop 2023-11-24T06:11:57.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8070850 msgr2=0x7fbdd8150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8070850 0x7fbdd8150710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009eb0 tx=0x7fbdc8004a40 comp rx=0 tx=0).stop 2023-11-24T06:11:57.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 shutdown_connections 2023-11-24T06:11:57.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbdb806ae70 0x7fbdb806d330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd8154280 0x7fbdd8157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd8153ea0 0x7fbdd8156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 --2- 172.21.15.22:0/547318659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdd8070850 0x7fbdd8150710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 >> 172.21.15.22:0/547318659 conn(0x7fbdd80cec10 msgr2=0x7fbdd80ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:57.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 shutdown_connections 2023-11-24T06:11:57.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.546+0000 7fbddc8e1640 1 -- 172.21.15.22:0/547318659 wait complete. 2023-11-24T06:11:57.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:11:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.832+0000 7f4bb21db640 1 Processor -- start 2023-11-24T06:11:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.833+0000 7f4bb21db640 1 -- start start 2023-11-24T06:11:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.834+0000 7f4bb21db640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4bac0d14a0 0x7f4bac0d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.834+0000 7f4bb21db640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac0b0640 0x7f4bac0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.834+0000 7f4bb21db640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac0cf0c0 con 0x7f4bac15d5b0 2023-11-24T06:11:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.834+0000 7f4bb21db640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0b01b0 con 0x7f4bac0d14a0 2023-11-24T06:11:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.834+0000 7f4bb21db640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac15d990 con 0x7f4bac0b0640 2023-11-24T06:11:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.834+0000 7f4bb11d9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4bac15d5b0 0x7f4bac0d3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53828/0 (socket says 172.21.15.22:53828) 2023-11-24T06:11:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.834+0000 7f4bb11d9640 1 -- 172.21.15.22:0/185340682 learned_addr learned my addr 172.21.15.22:0/185340682 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.834+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732082689 0 0) 0x7f4bac0cf0c0 con 0x7f4bac15d5b0 2023-11-24T06:11:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4bb19da640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac0b0640 0x7f4bac0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b98003520 con 0x7f4bac15d5b0 2023-11-24T06:11:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4bb09d8640 1 --2- 172.21.15.22:0/185340682 >> v2:172.21.15.22:3300/0 conn(0x7f4bac0d14a0 0x7f4bac0d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3489839708 0 0) 0x7f4b98003520 con 0x7f4bac15d5b0 2023-11-24T06:11:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac0b0640 msgr2=0x7f4bac0b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac0b0640 0x7f4bac0b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 >> v2:172.21.15.22:3300/0 conn(0x7f4bac0d14a0 msgr2=0x7f4bac0d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 --2- 172.21.15.22:0/185340682 >> v2:172.21.15.22:3300/0 conn(0x7f4bac0d14a0 0x7f4bac0d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0d1e40 con 0x7f4bac15d5b0 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f4ba8001670 con 0x7f4bac15d5b0 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 >> v1:172.21.15.22:6789/0 conn(0x7f4bac15d5b0 legacy=0x7f4bac0d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac0b0640 0x7f4b980039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b98003f60 0x7f4b980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98004d00 0x7f4b98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0b01b0 con 0x7f4b98003f60 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac15d990 con 0x7f4b98004d00 2023-11-24T06:11:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.835+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9800ba60 con 0x7f4bac0b0640 2023-11-24T06:11:57.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.836+0000 7f4bb11d9640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac0b0640 0x7f4b980039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.836+0000 7f4bb09d8640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b98003f60 0x7f4b980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.836+0000 7f4bb19da640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98004d00 0x7f4b98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.836+0000 7f4bb09d8640 1 -- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac0b0640 msgr2=0x7f4b980039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:57.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.836+0000 7f4bb09d8640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac0b0640 0x7f4b980039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.836+0000 7f4bb09d8640 1 -- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98004d00 msgr2=0x7f4b98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:57.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.836+0000 7f4bb09d8640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98004d00 0x7f4b98005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.837+0000 7f4bb09d8640 1 -- 172.21.15.22:0/185340682 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98003520 con 0x7f4b98003f60 2023-11-24T06:11:57.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.839+0000 7f4bb09d8640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b98003f60 0x7f4b980047c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00ba30 tx=0x7f4b980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434371a1f4a60a6c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:57.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.840+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c032680 con 0x7f4b98003f60 2023-11-24T06:11:57.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.840+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0327e0 con 0x7f4b98003f60 2023-11-24T06:11:57.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.840+0000 7f4ba3fff640 1 -- 172.21.15.22:0/185340682 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c032b70 con 0x7f4b98003f60 2023-11-24T06:11:57.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.841+0000 7f4bb21db640 1 -- 172.21.15.22:0/185340682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b98003f60 msgr2=0x7f4b980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.841+0000 7f4bb21db640 1 --2- 172.21.15.22:0/185340682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b98003f60 0x7f4b980047c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00ba30 tx=0x7f4b980057f0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.841+0000 7f4bb19da640 1 -- 172.21.15.22:0/185340682 reap_dead start 2023-11-24T06:11:57.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.841+0000 7f4bb21db640 1 -- 172.21.15.22:0/185340682 shutdown_connections 2023-11-24T06:11:57.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.841+0000 7f4bb21db640 1 -- 172.21.15.22:0/185340682 >> 172.21.15.22:0/185340682 conn(0x7f4bac09c3b0 msgr2=0x7f4bac0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:57.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.841+0000 7f4bb21db640 1 -- 172.21.15.22:0/185340682 shutdown_connections 2023-11-24T06:11:57.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.841+0000 7f4bb21db640 1 -- 172.21.15.22:0/185340682 wait complete. 2023-11-24T06:11:57.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.843+0000 7f4bb21db640 1 Processor -- start 2023-11-24T06:11:57.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.843+0000 7f4bb21db640 1 -- start start 2023-11-24T06:11:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.844+0000 7f4bb21db640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac1538c0 0x7f4bac06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.844+0000 7f4bb21db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac153ca0 0x7f4bac06bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.844+0000 7f4bb21db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4bac0ca8a0 0x7f4bac0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.844+0000 7f4bb21db640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0cb260 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.844+0000 7f4bb21db640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0c6ba0 con 0x7f4bac153ca0 2023-11-24T06:11:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.844+0000 7f4bb21db640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0c9b40 con 0x7f4bac1538c0 2023-11-24T06:11:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.844+0000 7f4bb19da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4bac0ca8a0 0x7f4bac0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.844+0000 7f4bb19da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4bac0ca8a0 0x7f4bac0cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48920/0 (socket says 172.21.15.22:48920) 2023-11-24T06:11:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.844+0000 7f4bb19da640 1 -- 172.21.15.22:0/2539193212 learned_addr learned my addr 172.21.15.22:0/2539193212 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:57.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4bb11d9640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac1538c0 0x7f4bac06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4bb19da640 1 -- 172.21.15.22:0/2539193212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac1538c0 msgr2=0x7f4bac06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4bb19da640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac1538c0 0x7f4bac06b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4bb19da640 1 -- 172.21.15.22:0/2539193212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac153ca0 msgr2=0x7f4bac06bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4bb19da640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac153ca0 0x7f4bac06bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4bb19da640 1 -- 172.21.15.22:0/2539193212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac1f3f60 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4bb19da640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4bac0ca8a0 0x7f4bac0cad20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4bac08c500 tx=0x7f4ba400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4ba1ffb640 1 -- 172.21.15.22:0/2539193212 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e040 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4ba1ffb640 1 -- 172.21.15.22:0/2539193212 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba400f040 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4ba1ffb640 1 -- 172.21.15.22:0/2539193212 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4015430 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac1f4240 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.845+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac1f4800 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.846+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac04e840 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.847+0000 7f4ba1ffb640 1 -- 172.21.15.22:0/2539193212 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ba4015590 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.848+0000 7f4ba1ffb640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4b9006ae70 0x7f4b9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:57.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.848+0000 7f4ba1ffb640 1 -- 172.21.15.22:0/2539193212 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ba4089970 con 0x7f4bac0ca8a0 2023-11-24T06:11:57.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.849+0000 7f4bb11d9640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4b9006ae70 0x7f4b9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:57.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.849+0000 7f4bb11d9640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4b9006ae70 0x7f4b9006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8004840 tx=0x7f4ba8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:57.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:57.853+0000 7f4ba1ffb640 1 -- 172.21.15.22:0/2539193212 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ba4054d70 con 0x7f4bac0ca8a0 2023-11-24T06:11:58.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.050+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4bac0678d0 con 0x7f4bac0ca8a0 2023-11-24T06:11:58.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.050+0000 7f4ba1ffb640 1 -- 172.21.15.22:0/2539193212 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4ba4058390 con 0x7f4bac0ca8a0 2023-11-24T06:11:58.053 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:11:58.054 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-11-24T06:11:58.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:11:58.054 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-11-24T06:11:58.054 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-11-24T06:11:58.054 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:11:58.054 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-11-24T06:11:58.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4b9006ae70 msgr2=0x7f4b9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4b9006ae70 0x7f4b9006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8004840 tx=0x7f4ba8009040 comp rx=0 tx=0).stop 2023-11-24T06:11:58.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4bac0ca8a0 msgr2=0x7f4bac0cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4bac0ca8a0 0x7f4bac0cad20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4bac08c500 tx=0x7f4ba400f580 comp rx=0 tx=0).stop 2023-11-24T06:11:58.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 shutdown_connections 2023-11-24T06:11:58.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4b9006ae70 0x7f4b9006d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4bac0ca8a0 0x7f4bac0cad20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac153ca0 0x7f4bac06bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 --2- 172.21.15.22:0/2539193212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bac1538c0 0x7f4bac06b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 >> 172.21.15.22:0/2539193212 conn(0x7f4bac09c3b0 msgr2=0x7f4bac15dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:58.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 shutdown_connections 2023-11-24T06:11:58.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.053+0000 7f4bb21db640 1 -- 172.21.15.22:0/2539193212 wait complete. 2023-11-24T06:11:58.074 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:11:58.074 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:11:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.299+0000 7fa939a3d640 1 Processor -- start 2023-11-24T06:11:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.299+0000 7fa939a3d640 1 -- start start 2023-11-24T06:11:58.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.301+0000 7fa939a3d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa9340acd70 0x7fa93406dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.301+0000 7fa939a3d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa934070490 0x7fa934070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.301+0000 7fa939a3d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93406d7a0 con 0x7fa9340ae490 2023-11-24T06:11:58.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.301+0000 7fa939a3d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93415a5b0 con 0x7fa9340acd70 2023-11-24T06:11:58.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa939a3d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93406ce70 con 0x7fa934070490 2023-11-24T06:11:58.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa92a7fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa9340ae490 0x7fa9340ad150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53838/0 (socket says 172.21.15.22:53838) 2023-11-24T06:11:58.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa932ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa9340acd70 0x7fa93406dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa92a7fc640 1 -- 172.21.15.22:0/1090437171 learned_addr learned my addr 172.21.15.22:0/1090437171 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:58.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa9327fc640 1 -- 172.21.15.22:0/1090437171 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534105308 0 0) 0x7fa93406d7a0 con 0x7fa9340ae490 2023-11-24T06:11:58.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa9337fe640 1 --2- 172.21.15.22:0/1090437171 >> v2:172.21.15.31:3300/0 conn(0x7fa934070490 0x7fa934070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa9327fc640 1 -- 172.21.15.22:0/1090437171 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa920003520 con 0x7fa9340ae490 2023-11-24T06:11:58.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa932ffd640 1 -- 172.21.15.22:0/1090437171 >> v2:172.21.15.31:3300/0 conn(0x7fa934070490 msgr2=0x7fa934070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:58.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa932ffd640 1 --2- 172.21.15.22:0/1090437171 >> v2:172.21.15.31:3300/0 conn(0x7fa934070490 0x7fa934070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa932ffd640 1 -- 172.21.15.22:0/1090437171 >> v1:172.21.15.22:6789/0 conn(0x7fa9340ae490 legacy=0x7fa9340ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa932ffd640 1 -- 172.21.15.22:0/1090437171 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93406d150 con 0x7fa9340acd70 2023-11-24T06:11:58.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.302+0000 7fa9337fe640 1 --2- 172.21.15.22:0/1090437171 >> v2:172.21.15.31:3300/0 conn(0x7fa934070490 0x7fa934070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:11:58.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.303+0000 7fa932ffd640 1 --2- 172.21.15.22:0/1090437171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 0x7fa93406dc30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa934067e70 tx=0x7fa92402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75aac3766563e4b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:58.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.304+0000 7fa9327fc640 1 -- 172.21.15.22:0/1090437171 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924031830 con 0x7fa9340acd70 2023-11-24T06:11:58.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.304+0000 7fa9327fc640 1 -- 172.21.15.22:0/1090437171 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa924031990 con 0x7fa9340acd70 2023-11-24T06:11:58.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.304+0000 7fa9327fc640 1 -- 172.21.15.22:0/1090437171 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924031d20 con 0x7fa9340acd70 2023-11-24T06:11:58.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.304+0000 7fa939a3d640 1 -- 172.21.15.22:0/1090437171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 msgr2=0x7fa93406dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.304+0000 7fa939a3d640 1 --2- 172.21.15.22:0/1090437171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 0x7fa93406dc30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa934067e70 tx=0x7fa92402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.304+0000 7fa939a3d640 1 -- 172.21.15.22:0/1090437171 shutdown_connections 2023-11-24T06:11:58.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.304+0000 7fa939a3d640 1 --2- 172.21.15.22:0/1090437171 >> v2:172.21.15.31:3300/0 conn(0x7fa934070490 0x7fa934070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.304+0000 7fa939a3d640 1 --2- 172.21.15.22:0/1090437171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 0x7fa93406dc30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.304+0000 7fa939a3d640 1 -- 172.21.15.22:0/1090437171 >> 172.21.15.22:0/1090437171 conn(0x7fa9340b0ba0 msgr2=0x7fa9340b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:58.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.305+0000 7fa939a3d640 1 -- 172.21.15.22:0/1090437171 shutdown_connections 2023-11-24T06:11:58.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.305+0000 7fa939a3d640 1 -- 172.21.15.22:0/1090437171 wait complete. 2023-11-24T06:11:58.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.306+0000 7fa939a3d640 1 Processor -- start 2023-11-24T06:11:58.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.307+0000 7fa939a3d640 1 -- start start 2023-11-24T06:11:58.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.307+0000 7fa939a3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934070490 0x7fa934143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.307+0000 7fa939a3d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 0x7fa9341532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.307+0000 7fa939a3d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9340ae490 0x7fa934153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.307+0000 7fa939a3d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93409a630 con 0x7fa9340acd70 2023-11-24T06:11:58.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.307+0000 7fa939a3d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341588a0 con 0x7fa934070490 2023-11-24T06:11:58.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.307+0000 7fa939a3d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa934157d20 con 0x7fa9340ae490 2023-11-24T06:11:58.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa92a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 0x7fa9341532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa92a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 0x7fa9341532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48930/0 (socket says 172.21.15.22:48930) 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa92a7fc640 1 -- 172.21.15.22:0/796377826 learned_addr learned my addr 172.21.15.22:0/796377826 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa932ffd640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934070490 0x7fa934143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa9337fe640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9340ae490 0x7fa934153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa92a7fc640 1 -- 172.21.15.22:0/796377826 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9340ae490 msgr2=0x7fa934153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa92a7fc640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9340ae490 0x7fa934153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa92a7fc640 1 -- 172.21.15.22:0/796377826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934070490 msgr2=0x7fa934143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa92a7fc640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934070490 0x7fa934143b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.308+0000 7fa92a7fc640 1 -- 172.21.15.22:0/796377826 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924009400 con 0x7fa9340acd70 2023-11-24T06:11:58.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.309+0000 7fa92a7fc640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 0x7fa9341532f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c500 tx=0x7fa91c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:58.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.309+0000 7fa930ff9640 1 -- 172.21.15.22:0/796377826 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c005ce0 con 0x7fa9340acd70 2023-11-24T06:11:58.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.309+0000 7fa930ff9640 1 -- 172.21.15.22:0/796377826 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c005e40 con 0x7fa9340acd70 2023-11-24T06:11:58.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.309+0000 7fa930ff9640 1 -- 172.21.15.22:0/796377826 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c007330 con 0x7fa9340acd70 2023-11-24T06:11:58.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.309+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa934158000 con 0x7fa9340acd70 2023-11-24T06:11:58.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.309+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9341585c0 con 0x7fa9340acd70 2023-11-24T06:11:58.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.310+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93409d200 con 0x7fa9340acd70 2023-11-24T06:11:58.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.311+0000 7fa930ff9640 1 -- 172.21.15.22:0/796377826 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa91c007550 con 0x7fa9340acd70 2023-11-24T06:11:58.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.312+0000 7fa930ff9640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa91406ae40 0x7fa91406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.312+0000 7fa930ff9640 1 -- 172.21.15.22:0/796377826 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa91c0888d0 con 0x7fa9340acd70 2023-11-24T06:11:58.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.312+0000 7fa932ffd640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa91406ae40 0x7fa91406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.313+0000 7fa932ffd640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa91406ae40 0x7fa91406d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa924036000 tx=0x7fa92403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:58.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.317+0000 7fa930ff9640 1 -- 172.21.15.22:0/796377826 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa91c053e20 con 0x7fa9340acd70 2023-11-24T06:11:58.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.510+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa93404e920 con 0x7fa9340acd70 2023-11-24T06:11:58.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.598+0000 7fa930ff9640 1 -- 172.21.15.22:0/796377826 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa91c017020 con 0x7fa9340acd70 2023-11-24T06:11:58.601 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-11-24T06:11:58.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa91406ae40 msgr2=0x7fa91406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa91406ae40 0x7fa91406d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa924036000 tx=0x7fa92403c040 comp rx=0 tx=0).stop 2023-11-24T06:11:58.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 msgr2=0x7fa9341532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 0x7fa9341532f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c500 tx=0x7fa91c00c9c0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 shutdown_connections 2023-11-24T06:11:58.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa91406ae40 0x7fa91406d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9340ae490 0x7fa934153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9340acd70 0x7fa9341532f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 --2- 172.21.15.22:0/796377826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934070490 0x7fa934143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 >> 172.21.15.22:0/796377826 conn(0x7fa9340b0ba0 msgr2=0x7fa9340ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:58.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 shutdown_connections 2023-11-24T06:11:58.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.602+0000 7fa939a3d640 1 -- 172.21.15.22:0/796377826 wait complete. 2023-11-24T06:11:58.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:11:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.840+0000 7f879411d640 1 Processor -- start 2023-11-24T06:11:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.840+0000 7f879411d640 1 -- start start 2023-11-24T06:11:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.842+0000 7f879411d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f878c1653c0 0x7f878c165810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.842+0000 7f879411d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c162dd0 con 0x7f878c0b1c70 2023-11-24T06:11:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.842+0000 7f879411d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c0b3a80 con 0x7f878c162940 2023-11-24T06:11:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.842+0000 7f879411d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c0b3d60 con 0x7f878c1653c0 2023-11-24T06:11:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.842+0000 7f8791eb9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f878c0b1c70 0x7f878c0b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53840/0 (socket says 172.21.15.22:53840) 2023-11-24T06:11:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.842+0000 7f8791eb9640 1 -- 172.21.15.22:0/2475715887 learned_addr learned my addr 172.21.15.22:0/2475715887 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f87926ba640 1 --2- 172.21.15.22:0/2475715887 >> v2:172.21.15.31:3300/0 conn(0x7f878c1653c0 0x7f878c165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238900993 0 0) 0x7f878c162dd0 con 0x7f878c0b1c70 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8778003520 con 0x7f878c0b1c70 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 564309224 0 0) 0x7f8778003520 con 0x7f878c0b1c70 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 >> v2:172.21.15.31:3300/0 conn(0x7f878c1653c0 msgr2=0x7f878c165810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 --2- 172.21.15.22:0/2475715887 >> v2:172.21.15.31:3300/0 conn(0x7f878c1653c0 0x7f878c165810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 >> v1:172.21.15.31:6789/0 conn(0x7f878c162940 legacy=0x7f878c0b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c162140 con 0x7f878c0b1c70 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f87880019f0 con 0x7f878c0b1c70 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 >> v1:172.21.15.22:6789/0 conn(0x7f878c0b1c70 legacy=0x7f878c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778003970 0x7f8778003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87780047c0 0x7f8778004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.843+0000 7f8790eb7640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8778005180 0x7f877800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b3d60 con 0x7f8778005180 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877800c020 con 0x7f8778003970 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877800c1e0 con 0x7f87780047c0 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f87926ba640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8778005180 0x7f877800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f8791eb9640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778003970 0x7f8778003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f87916b8640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87780047c0 0x7f8778004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f87926ba640 1 -- 172.21.15.22:0/2475715887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87780047c0 msgr2=0x7f8778004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f87926ba640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87780047c0 0x7f8778004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f87926ba640 1 -- 172.21.15.22:0/2475715887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778003970 msgr2=0x7f8778003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f87926ba640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8778003970 0x7f8778003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.844+0000 7f87926ba640 1 -- 172.21.15.22:0/2475715887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778003520 con 0x7f8778005180 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.845+0000 7f87926ba640 1 -- 172.21.15.22:0/2475715887 reap_dead start 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.845+0000 7f87926ba640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8778005180 0x7f877800b980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8784009ac0 tx=0x7f87780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af0149b83f2daea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.846+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784004020 con 0x7f8778005180 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.846+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784004180 con 0x7f8778005180 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.846+0000 7f8790eb7640 1 -- 172.21.15.22:0/2475715887 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840044f0 con 0x7f8778005180 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.846+0000 7f879411d640 1 -- 172.21.15.22:0/2475715887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8778005180 msgr2=0x7f877800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.846+0000 7f879411d640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8778005180 0x7f877800b980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8784009ac0 tx=0x7f87780057f0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.846+0000 7f879411d640 1 -- 172.21.15.22:0/2475715887 shutdown_connections 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.846+0000 7f879411d640 1 --2- 172.21.15.22:0/2475715887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8778005180 0x7f877800b980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.846+0000 7f879411d640 1 -- 172.21.15.22:0/2475715887 >> 172.21.15.22:0/2475715887 conn(0x7f878c06d5a0 msgr2=0x7f878c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.846+0000 7f879411d640 1 -- 172.21.15.22:0/2475715887 shutdown_connections 2023-11-24T06:11:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.847+0000 7f879411d640 1 -- 172.21.15.22:0/2475715887 wait complete. 2023-11-24T06:11:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.848+0000 7f879411d640 1 Processor -- start 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.848+0000 7f879411d640 1 -- start start 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.849+0000 7f879411d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8778005180 0x7f878c148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.849+0000 7f879411d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f878c1570e0 0x7f878c0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.849+0000 7f879411d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c158680 0x7f878c158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.849+0000 7f879411d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c149280 con 0x7f878c1570e0 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.849+0000 7f879411d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1575e0 con 0x7f878c158680 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.849+0000 7f879411d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1578c0 con 0x7f8778005180 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87916b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f878c1570e0 0x7f878c0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87916b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f878c1570e0 0x7f878c0ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48952/0 (socket says 172.21.15.22:48952) 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87916b8640 1 -- 172.21.15.22:0/318555426 learned_addr learned my addr 172.21.15.22:0/318555426 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f8791eb9640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8778005180 0x7f878c148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87916b8640 1 -- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8778005180 msgr2=0x7f878c148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87926ba640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c158680 0x7f878c158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87916b8640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8778005180 0x7f878c148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87916b8640 1 -- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c158680 msgr2=0x7f878c158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87916b8640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c158680 0x7f878c158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87916b8640 1 -- 172.21.15.22:0/318555426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c157ba0 con 0x7f878c1570e0 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f8791eb9640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8778005180 0x7f878c148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87926ba640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c158680 0x7f878c158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.850+0000 7f87916b8640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f878c1570e0 0x7f878c0ce4d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f877c00e480 tx=0x7f877c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.851+0000 7f87827fc640 1 -- 172.21.15.22:0/318555426 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0052e0 con 0x7f878c1570e0 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.851+0000 7f87827fc640 1 -- 172.21.15.22:0/318555426 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c005440 con 0x7f878c1570e0 2023-11-24T06:11:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.851+0000 7f87827fc640 1 -- 172.21.15.22:0/318555426 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c003830 con 0x7f878c1570e0 2023-11-24T06:11:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.851+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c157e80 con 0x7f878c1570e0 2023-11-24T06:11:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.851+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c0cea10 con 0x7f878c1570e0 2023-11-24T06:11:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.852+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c04e920 con 0x7f878c1570e0 2023-11-24T06:11:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.853+0000 7f87827fc640 1 -- 172.21.15.22:0/318555426 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f877c003990 con 0x7f878c1570e0 2023-11-24T06:11:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.854+0000 7f87827fc640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f877006ae70 0x7f877006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:58.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.854+0000 7f87827fc640 1 -- 172.21.15.22:0/318555426 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f877c089100 con 0x7f878c1570e0 2023-11-24T06:11:58.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.854+0000 7f8791eb9640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f877006ae70 0x7f877006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:58.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.855+0000 7f8791eb9640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f877006ae70 0x7f877006d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8788001b20 tx=0x7f8788006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:58.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:58.859+0000 7f87827fc640 1 -- 172.21.15.22:0/318555426 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f877c0544e0 con 0x7f878c1570e0 2023-11-24T06:11:59.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.054+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f878c071b30 con 0x7f878c1570e0 2023-11-24T06:11:59.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.604+0000 7f87827fc640 1 -- 172.21.15.22:0/318555426 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f877c057b00 con 0x7f878c1570e0 2023-11-24T06:11:59.608 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-11-24T06:11:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.608+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f877006ae70 msgr2=0x7f877006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.608+0000 7f879411d640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f877006ae70 0x7f877006d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8788001b20 tx=0x7f8788006040 comp rx=0 tx=0).stop 2023-11-24T06:11:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.608+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f878c1570e0 msgr2=0x7f878c0ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.608+0000 7f879411d640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f878c1570e0 0x7f878c0ce4d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f877c00e480 tx=0x7f877c00e940 comp rx=0 tx=0).stop 2023-11-24T06:11:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.608+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 shutdown_connections 2023-11-24T06:11:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.608+0000 7f879411d640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f877006ae70 0x7f877006d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.608+0000 7f879411d640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c158680 0x7f878c158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.608+0000 7f879411d640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f878c1570e0 0x7f878c0ce4d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.608+0000 7f879411d640 1 --2- 172.21.15.22:0/318555426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8778005180 0x7f878c148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.609+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 >> 172.21.15.22:0/318555426 conn(0x7f878c06d5a0 msgr2=0x7f878c0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.609+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 shutdown_connections 2023-11-24T06:11:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.609+0000 7f879411d640 1 -- 172.21.15.22:0/318555426 wait complete. 2023-11-24T06:11:59.653 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:11:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.840+0000 7fcb05551640 1 Processor -- start 2023-11-24T06:11:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.840+0000 7fcb05551640 1 -- start start 2023-11-24T06:11:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.841+0000 7fcb05551640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb0015b350 0x7fcb000abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.841+0000 7fcb05551640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcb000adb60 0x7fcb000adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.841+0000 7fcb05551640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0015b730 con 0x7fcb0009cb30 2023-11-24T06:11:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.841+0000 7fcb05551640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb000ac740 con 0x7fcb000adb60 2023-11-24T06:11:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.841+0000 7fcb05551640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb000ac460 con 0x7fcb0015b350 2023-11-24T06:11:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.842+0000 7fcafe7fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcb0009cb30 0x7fcb000b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53854/0 (socket says 172.21.15.22:53854) 2023-11-24T06:11:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.842+0000 7fcafe7fc640 1 -- 172.21.15.22:0/1076625879 learned_addr learned my addr 172.21.15.22:0/1076625879 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.842+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882147961 0 0) 0x7fcaf4001110 con 0x7fcb0009cb30 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.842+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae8003520 con 0x7fcb0009cb30 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.842+0000 7fcaff7fe640 1 --2- 172.21.15.22:0/1076625879 >> v2:172.21.15.31:3300/0 conn(0x7fcb000adb60 0x7fcb000adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.842+0000 7fcafeffd640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb0015b350 0x7fcb000abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1102221952 0 0) 0x7fcae8003520 con 0x7fcb0009cb30 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb0015b350 msgr2=0x7fcb000abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb0015b350 0x7fcb000abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 >> v2:172.21.15.31:3300/0 conn(0x7fcb000adb60 msgr2=0x7fcb000adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 --2- 172.21.15.22:0/1076625879 >> v2:172.21.15.31:3300/0 conn(0x7fcb000adb60 0x7fcb000adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb000b2a50 con 0x7fcb0009cb30 2023-11-24T06:11:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fcaf4001800 con 0x7fcb0009cb30 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 >> v1:172.21.15.22:6789/0 conn(0x7fcb0009cb30 legacy=0x7fcb000b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae8003970 0x7fcae8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb0015b350 0x7fcae80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae8004d00 0x7fcae8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb000ac740 con 0x7fcae8003970 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb000ac460 con 0x7fcae8004d00 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae800b980 con 0x7fcb0015b350 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.843+0000 7fcafeffd640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae8003970 0x7fcae8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.844+0000 7fcafe7fc640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb0015b350 0x7fcae80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.844+0000 7fcafeffd640 1 -- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb0015b350 msgr2=0x7fcae80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.844+0000 7fcaff7fe640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae8004d00 0x7fcae8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:59.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.844+0000 7fcafeffd640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcb0015b350 0x7fcae80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.844+0000 7fcafeffd640 1 -- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae8004d00 msgr2=0x7fcae8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:11:59.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.844+0000 7fcafeffd640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae8004d00 0x7fcae8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.844+0000 7fcafeffd640 1 -- 172.21.15.22:0/1076625879 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8003520 con 0x7fcae8003970 2023-11-24T06:11:59.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.844+0000 7fcaff7fe640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae8004d00 0x7fcae8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:11:59.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.845+0000 7fcafeffd640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae8003970 0x7fcae8003d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009ac0 tx=0x7fcae80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297127ed6224c0f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:59.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.845+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf002c6b0 con 0x7fcae8003970 2023-11-24T06:11:59.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.845+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf002c810 con 0x7fcae8003970 2023-11-24T06:11:59.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.845+0000 7fcafdffb640 1 -- 172.21.15.22:0/1076625879 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf002cba0 con 0x7fcae8003970 2023-11-24T06:11:59.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.846+0000 7fcb05551640 1 -- 172.21.15.22:0/1076625879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae8003970 msgr2=0x7fcae8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:59.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.846+0000 7fcb05551640 1 --2- 172.21.15.22:0/1076625879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae8003970 0x7fcae8003d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009ac0 tx=0x7fcae80057f0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.846+0000 7fcaff7fe640 1 -- 172.21.15.22:0/1076625879 reap_dead start 2023-11-24T06:11:59.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.846+0000 7fcb05551640 1 -- 172.21.15.22:0/1076625879 shutdown_connections 2023-11-24T06:11:59.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.846+0000 7fcb05551640 1 -- 172.21.15.22:0/1076625879 >> 172.21.15.22:0/1076625879 conn(0x7fcb000b0ba0 msgr2=0x7fcb000b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:11:59.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.846+0000 7fcb05551640 1 -- 172.21.15.22:0/1076625879 shutdown_connections 2023-11-24T06:11:59.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.846+0000 7fcb05551640 1 -- 172.21.15.22:0/1076625879 wait complete. 2023-11-24T06:11:59.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.848+0000 7fcb05551640 1 Processor -- start 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.848+0000 7fcb05551640 1 -- start start 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcb05551640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae8003970 0x7fcb00151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcb05551640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb00150020 0x7fcb00159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcb05551640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0014f020 0x7fcb0014f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcb05551640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb001539c0 con 0x7fcb0014f020 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcb05551640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00150fd0 con 0x7fcb00150020 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcb05551640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00150480 con 0x7fcae8003970 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcaff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0014f020 0x7fcb0014f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcaff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0014f020 0x7fcb0014f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48964/0 (socket says 172.21.15.22:48964) 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcaff7fe640 1 -- 172.21.15.22:0/1766384862 learned_addr learned my addr 172.21.15.22:0/1766384862 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:11:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.849+0000 7fcafe7fc640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb00150020 0x7fcb00159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:59.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcafeffd640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae8003970 0x7fcb00151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:59.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcaff7fe640 1 -- 172.21.15.22:0/1766384862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae8003970 msgr2=0x7fcb00151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:59.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcaff7fe640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae8003970 0x7fcb00151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcaff7fe640 1 -- 172.21.15.22:0/1766384862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb00150020 msgr2=0x7fcb00159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:11:59.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcaff7fe640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb00150020 0x7fcb00159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:11:59.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcaff7fe640 1 -- 172.21.15.22:0/1766384862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0014f9e0 con 0x7fcb0014f020 2023-11-24T06:11:59.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcaff7fe640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0014f020 0x7fcb0014f4a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb000b5100 tx=0x7fcaf800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:59.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcae77fe640 1 -- 172.21.15.22:0/1766384862 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8017400 con 0x7fcb0014f020 2023-11-24T06:11:59.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcae77fe640 1 -- 172.21.15.22:0/1766384862 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8011040 con 0x7fcb0014f020 2023-11-24T06:11:59.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb00150730 con 0x7fcb0014f020 2023-11-24T06:11:59.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.850+0000 7fcae77fe640 1 -- 172.21.15.22:0/1766384862 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8017780 con 0x7fcb0014f020 2023-11-24T06:11:59.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.851+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb00150cf0 con 0x7fcb0014f020 2023-11-24T06:11:59.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.852+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0009d200 con 0x7fcb0014f020 2023-11-24T06:11:59.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.853+0000 7fcae77fe640 1 -- 172.21.15.22:0/1766384862 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcaf80203b0 con 0x7fcb0014f020 2023-11-24T06:11:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.854+0000 7fcae77fe640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcaec06ae40 0x7fcaec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:11:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.854+0000 7fcae77fe640 1 -- 172.21.15.22:0/1766384862 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcaf8089790 con 0x7fcb0014f020 2023-11-24T06:11:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.854+0000 7fcafeffd640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcaec06ae40 0x7fcaec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:11:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.855+0000 7fcafeffd640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcaec06ae40 0x7fcaec06d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0036000 tx=0x7fcaf0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:11:59.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:11:59.859+0000 7fcae77fe640 1 -- 172.21.15.22:0/1766384862 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcaf80548a0 con 0x7fcb0014f020 2023-11-24T06:12:00.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.090+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcb0004e920 con 0x7fcb0014f020 2023-11-24T06:12:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.626+0000 7fcae77fe640 1 -- 172.21.15.22:0/1766384862 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcaf8057ec0 con 0x7fcb0014f020 2023-11-24T06:12:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2023-11-24T06:12:00.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcaec06ae40 msgr2=0x7fcaec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:00.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcaec06ae40 0x7fcaec06d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0036000 tx=0x7fcaf0030000 comp rx=0 tx=0).stop 2023-11-24T06:12:00.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0014f020 msgr2=0x7fcb0014f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:00.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0014f020 0x7fcb0014f4a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb000b5100 tx=0x7fcaf800f4a0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 shutdown_connections 2023-11-24T06:12:00.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcaec06ae40 0x7fcaec06d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0014f020 0x7fcb0014f4a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb00150020 0x7fcb00159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 --2- 172.21.15.22:0/1766384862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae8003970 0x7fcb00151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 >> 172.21.15.22:0/1766384862 conn(0x7fcb000b0ba0 msgr2=0x7fcb000b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:00.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 shutdown_connections 2023-11-24T06:12:00.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.632+0000 7fcb05551640 1 -- 172.21.15.22:0/1766384862 wait complete. 2023-11-24T06:12:00.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:00.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.851+0000 7fa435402640 1 Processor -- start 2023-11-24T06:12:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.851+0000 7fa435402640 1 -- start start 2023-11-24T06:12:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.853+0000 7fa435402640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4300b7b10 0x7fa4300b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.853+0000 7fa435402640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4300d1af0 con 0x7fa4300b4c80 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.853+0000 7fa435402640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4300d1d50 con 0x7fa4300d2920 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.853+0000 7fa435402640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4300d2030 con 0x7fa4300b7b10 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.853+0000 7fa42effd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa4300b4c80 0x7fa4300b5060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53868/0 (socket says 172.21.15.22:53868) 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.853+0000 7fa42effd640 1 -- 172.21.15.22:0/3301374833 learned_addr learned my addr 172.21.15.22:0/3301374833 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.853+0000 7fa42f7fe640 1 --2- 172.21.15.22:0/3301374833 >> v2:172.21.15.31:3300/0 conn(0x7fa4300b7b10 0x7fa4300b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.853+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326564981 0 0) 0x7fa4300d1af0 con 0x7fa4300b4c80 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa41c003520 con 0x7fa4300b4c80 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263084646 0 0) 0x7fa41c003520 con 0x7fa4300b4c80 2023-11-24T06:12:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 >> v2:172.21.15.31:3300/0 conn(0x7fa4300b7b10 msgr2=0x7fa4300b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 --2- 172.21.15.22:0/3301374833 >> v2:172.21.15.31:3300/0 conn(0x7fa4300b7b10 0x7fa4300b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 >> v1:172.21.15.31:6789/0 conn(0x7fa4300d2920 legacy=0x7fa4300d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300d2310 con 0x7fa4300b4c80 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fa4200019f0 con 0x7fa4300b4c80 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 >> v1:172.21.15.22:6789/0 conn(0x7fa4300b4c80 legacy=0x7fa4300b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa41c003970 0x7fa41c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa41c0047c0 0x7fa41c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c005180 0x7fa41c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300d2030 con 0x7fa41c0047c0 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c00c120 con 0x7fa41c005180 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c00c2e0 con 0x7fa41c003970 2023-11-24T06:12:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42e7fc640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa41c0047c0 0x7fa41c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.854+0000 7fa42effd640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa41c003970 0x7fa41c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.855+0000 7fa42f7fe640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c005180 0x7fa41c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.855+0000 7fa42e7fc640 1 -- 172.21.15.22:0/3301374833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa41c003970 msgr2=0x7fa41c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.855+0000 7fa42e7fc640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa41c003970 0x7fa41c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.855+0000 7fa42e7fc640 1 -- 172.21.15.22:0/3301374833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c005180 msgr2=0x7fa41c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.855+0000 7fa42e7fc640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c005180 0x7fa41c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.855+0000 7fa42e7fc640 1 -- 172.21.15.22:0/3301374833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c003520 con 0x7fa41c0047c0 2023-11-24T06:12:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.855+0000 7fa42f7fe640 1 -- 172.21.15.22:0/3301374833 reap_dead start 2023-11-24T06:12:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.856+0000 7fa42e7fc640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa41c0047c0 0x7fa41c004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa418001720 tx=0x7fa41c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606dbf00887822cd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.856+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180052d0 con 0x7fa41c0047c0 2023-11-24T06:12:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.856+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41802e050 con 0x7fa41c0047c0 2023-11-24T06:12:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.856+0000 7fa42dffb640 1 -- 172.21.15.22:0/3301374833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418003830 con 0x7fa41c0047c0 2023-11-24T06:12:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.857+0000 7fa435402640 1 -- 172.21.15.22:0/3301374833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa41c0047c0 msgr2=0x7fa41c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.857+0000 7fa435402640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa41c0047c0 0x7fa41c004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa418001720 tx=0x7fa41c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.857+0000 7fa435402640 1 -- 172.21.15.22:0/3301374833 shutdown_connections 2023-11-24T06:12:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.857+0000 7fa435402640 1 --2- 172.21.15.22:0/3301374833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa41c0047c0 0x7fa41c004c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.857+0000 7fa435402640 1 -- 172.21.15.22:0/3301374833 >> 172.21.15.22:0/3301374833 conn(0x7fa4300721a0 msgr2=0x7fa4300cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.857+0000 7fa435402640 1 -- 172.21.15.22:0/3301374833 shutdown_connections 2023-11-24T06:12:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.857+0000 7fa435402640 1 -- 172.21.15.22:0/3301374833 wait complete. 2023-11-24T06:12:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.859+0000 7fa435402640 1 Processor -- start 2023-11-24T06:12:00.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.859+0000 7fa435402640 1 -- start start 2023-11-24T06:12:00.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.860+0000 7fa435402640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c0047c0 0x7fa4301f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:00.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.860+0000 7fa435402640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43014ff90 0x7fa4300aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:00.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.860+0000 7fa435402640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4300aabf0 0x7fa43015fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:00.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.860+0000 7fa435402640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300c8bb0 con 0x7fa43014ff90 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.860+0000 7fa435402640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300c7fe0 con 0x7fa41c0047c0 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.860+0000 7fa435402640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300c8280 con 0x7fa4300aabf0 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.860+0000 7fa42e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43014ff90 0x7fa4300aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.860+0000 7fa42e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43014ff90 0x7fa4300aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48982/0 (socket says 172.21.15.22:48982) 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.860+0000 7fa42e7fc640 1 -- 172.21.15.22:0/613866496 learned_addr learned my addr 172.21.15.22:0/613866496 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42f7fe640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4300aabf0 0x7fa43015fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42effd640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c0047c0 0x7fa4301f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42e7fc640 1 -- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4300aabf0 msgr2=0x7fa43015fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42e7fc640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4300aabf0 0x7fa43015fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42e7fc640 1 -- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c0047c0 msgr2=0x7fa4301f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42e7fc640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c0047c0 0x7fa4301f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42e7fc640 1 -- 172.21.15.22:0/613866496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300c8560 con 0x7fa43014ff90 2023-11-24T06:12:00.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42f7fe640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4300aabf0 0x7fa43015fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:00.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42effd640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c0047c0 0x7fa4301f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:00.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa42e7fc640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43014ff90 0x7fa4300aa6b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa41802bbc0 tx=0x7fa418001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:00.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa4277fe640 1 -- 172.21.15.22:0/613866496 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180076c0 con 0x7fa43014ff90 2023-11-24T06:12:00.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa4277fe640 1 -- 172.21.15.22:0/613866496 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa418007a30 con 0x7fa43014ff90 2023-11-24T06:12:00.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4300c8840 con 0x7fa43014ff90 2023-11-24T06:12:00.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.861+0000 7fa4277fe640 1 -- 172.21.15.22:0/613866496 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418006be0 con 0x7fa43014ff90 2023-11-24T06:12:00.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.862+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4301503f0 con 0x7fa43014ff90 2023-11-24T06:12:00.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.863+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4300c8d20 con 0x7fa43014ff90 2023-11-24T06:12:00.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.863+0000 7fa4277fe640 1 -- 172.21.15.22:0/613866496 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa418006d40 con 0x7fa43014ff90 2023-11-24T06:12:00.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.864+0000 7fa4277fe640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa41006ae40 0x7fa41006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:00.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.864+0000 7fa4277fe640 1 -- 172.21.15.22:0/613866496 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4180ab340 con 0x7fa43014ff90 2023-11-24T06:12:00.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.865+0000 7fa42effd640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa41006ae40 0x7fa41006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:00.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.865+0000 7fa42effd640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa41006ae40 0x7fa41006d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa420002230 tx=0x7fa4200020c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:00.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:00.869+0000 7fa4277fe640 1 -- 172.21.15.22:0/613866496 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4180763e0 con 0x7fa43014ff90 2023-11-24T06:12:01.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.060+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa430074770 con 0x7fa43014ff90 2023-11-24T06:12:01.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.064+0000 7fa4277fe640 1 -- 172.21.15.22:0/613866496 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fa418079a00 con 0x7fa43014ff90 2023-11-24T06:12:01.067 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:01.067 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:00.091880+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:01.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa41006ae40 msgr2=0x7fa41006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa41006ae40 0x7fa41006d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa420002230 tx=0x7fa4200020c0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43014ff90 msgr2=0x7fa4300aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43014ff90 0x7fa4300aa6b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa41802bbc0 tx=0x7fa418001120 comp rx=0 tx=0).stop 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 shutdown_connections 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa41006ae40 0x7fa41006d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4300aabf0 0x7fa43015fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43014ff90 0x7fa4300aa6b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 --2- 172.21.15.22:0/613866496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c0047c0 0x7fa4301f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.066+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 >> 172.21.15.22:0/613866496 conn(0x7fa4300721a0 msgr2=0x7fa4300ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.067+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 shutdown_connections 2023-11-24T06:12:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.067+0000 7fa435402640 1 -- 172.21.15.22:0/613866496 wait complete. 2023-11-24T06:12:01.089 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:01.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.313+0000 7f0d9c573640 1 Processor -- start 2023-11-24T06:12:01.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.314+0000 7f0d9c573640 1 -- start start 2023-11-24T06:12:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.315+0000 7f0d9c573640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d940ce040 0x7f0d940ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.315+0000 7f0d9c573640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d940d1e40 0x7f0d940d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.315+0000 7f0d9c573640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d94161b80 con 0x7f0d9415d480 2023-11-24T06:12:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.315+0000 7f0d9c573640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d940ce9f0 con 0x7f0d940d1e40 2023-11-24T06:12:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.315+0000 7f0d9c573640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d94161e60 con 0x7f0d940ce040 2023-11-24T06:12:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.316+0000 7f0d9ab10640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d940d1e40 0x7f0d940d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.316+0000 7f0d9ab10640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d940d1e40 0x7f0d940d2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45956/0 (socket says 172.21.15.22:45956) 2023-11-24T06:12:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.316+0000 7f0d9ab10640 1 -- 172.21.15.22:0/2327102300 learned_addr learned my addr 172.21.15.22:0/2327102300 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.316+0000 7f0d99b0e640 1 --2- 172.21.15.22:0/2327102300 >> v2:172.21.15.31:3300/0 conn(0x7f0d940ce040 0x7f0d940ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.316+0000 7f0d9ab10640 1 -- 172.21.15.22:0/2327102300 >> v2:172.21.15.31:3300/0 conn(0x7f0d940ce040 msgr2=0x7f0d940ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.316+0000 7f0d9ab10640 1 --2- 172.21.15.22:0/2327102300 >> v2:172.21.15.31:3300/0 conn(0x7f0d940ce040 0x7f0d940ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.316+0000 7f0d9ab10640 1 -- 172.21.15.22:0/2327102300 >> v1:172.21.15.31:6789/0 conn(0x7f0d9415d480 legacy=0x7f0d94161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.316+0000 7f0d9ab10640 1 -- 172.21.15.22:0/2327102300 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d940d1360 con 0x7f0d940d1e40 2023-11-24T06:12:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.317+0000 7f0d9ab10640 1 --2- 172.21.15.22:0/2327102300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d940d1e40 0x7f0d940d2270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d94162140 tx=0x7f0d8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04613e2b0715890 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.318+0000 7f0d9930d640 1 -- 172.21.15.22:0/2327102300 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c031870 con 0x7f0d940d1e40 2023-11-24T06:12:01.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.318+0000 7f0d9930d640 1 -- 172.21.15.22:0/2327102300 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c0319d0 con 0x7f0d940d1e40 2023-11-24T06:12:01.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.318+0000 7f0d9930d640 1 -- 172.21.15.22:0/2327102300 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c031d60 con 0x7f0d940d1e40 2023-11-24T06:12:01.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.318+0000 7f0d9c573640 1 -- 172.21.15.22:0/2327102300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d940d1e40 msgr2=0x7f0d940d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.318+0000 7f0d9c573640 1 --2- 172.21.15.22:0/2327102300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d940d1e40 0x7f0d940d2270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d94162140 tx=0x7f0d8c02b910 comp rx=0 tx=0).stop 2023-11-24T06:12:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.319+0000 7f0d9c573640 1 -- 172.21.15.22:0/2327102300 shutdown_connections 2023-11-24T06:12:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.319+0000 7f0d9c573640 1 --2- 172.21.15.22:0/2327102300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d940d1e40 0x7f0d940d2270 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.319+0000 7f0d9c573640 1 --2- 172.21.15.22:0/2327102300 >> v2:172.21.15.31:3300/0 conn(0x7f0d940ce040 0x7f0d940ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.319+0000 7f0d9c573640 1 -- 172.21.15.22:0/2327102300 >> 172.21.15.22:0/2327102300 conn(0x7f0d9406b420 msgr2=0x7f0d9406b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.319+0000 7f0d9c573640 1 -- 172.21.15.22:0/2327102300 shutdown_connections 2023-11-24T06:12:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.319+0000 7f0d9c573640 1 -- 172.21.15.22:0/2327102300 wait complete. 2023-11-24T06:12:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.320+0000 7f0d9c573640 1 Processor -- start 2023-11-24T06:12:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.321+0000 7f0d9c573640 1 -- start start 2023-11-24T06:12:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.321+0000 7f0d9c573640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d940ce040 0x7f0d9415e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.321+0000 7f0d9c573640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d940d1e40 0x7f0d9415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.321+0000 7f0d9c573640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d9415d480 0x7f0d941f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9c573640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d940ca3d0 con 0x7f0d9415d480 2023-11-24T06:12:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9c573640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9415ede0 con 0x7f0d940d1e40 2023-11-24T06:12:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9c573640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9415f0c0 con 0x7f0d940ce040 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9ab10640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d9415d480 0x7f0d941f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9ab10640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d9415d480 0x7f0d941f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45970/0 (socket says 172.21.15.22:45970) 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9ab10640 1 -- 172.21.15.22:0/4043852633 learned_addr learned my addr 172.21.15.22:0/4043852633 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d99b0e640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d940d1e40 0x7f0d9415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9a30f640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d940ce040 0x7f0d9415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9ab10640 1 -- 172.21.15.22:0/4043852633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d940ce040 msgr2=0x7f0d9415e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9ab10640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d940ce040 0x7f0d9415e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9ab10640 1 -- 172.21.15.22:0/4043852633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d940d1e40 msgr2=0x7f0d9415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.322+0000 7f0d9ab10640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d940d1e40 0x7f0d9415e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.323+0000 7f0d9ab10640 1 -- 172.21.15.22:0/4043852633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0094d0 con 0x7f0d9415d480 2023-11-24T06:12:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.323+0000 7f0d9ab10640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d9415d480 0x7f0d941f6340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0090b0 tx=0x7f0d8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.323+0000 7f0d92ffd640 1 -- 172.21.15.22:0/4043852633 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c03ac60 con 0x7f0d9415d480 2023-11-24T06:12:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.323+0000 7f0d92ffd640 1 -- 172.21.15.22:0/4043852633 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c03adc0 con 0x7f0d9415d480 2023-11-24T06:12:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.323+0000 7f0d92ffd640 1 -- 172.21.15.22:0/4043852633 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c044610 con 0x7f0d9415d480 2023-11-24T06:12:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.323+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9415f3a0 con 0x7f0d9415d480 2023-11-24T06:12:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.323+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d941f3bb0 con 0x7f0d9415d480 2023-11-24T06:12:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.325+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d940ca540 con 0x7f0d9415d480 2023-11-24T06:12:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.326+0000 7f0d92ffd640 1 -- 172.21.15.22:0/4043852633 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d8c04d450 con 0x7f0d9415d480 2023-11-24T06:12:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.326+0000 7f0d92ffd640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d8006ae40 0x7f0d8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.327+0000 7f0d92ffd640 1 -- 172.21.15.22:0/4043852633 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d8c02d040 con 0x7f0d9415d480 2023-11-24T06:12:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.327+0000 7f0d9a30f640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d8006ae40 0x7f0d8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.327+0000 7f0d9a30f640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d8006ae40 0x7f0d8006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009f20 tx=0x7f0d840094d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.331+0000 7f0d92ffd640 1 -- 172.21.15.22:0/4043852633 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d940ca540 con 0x7f0d9415d480 2023-11-24T06:12:01.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.528+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d940ca540 con 0x7f0d9415d480 2023-11-24T06:12:01.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.531+0000 7f0d92ffd640 1 -- 172.21.15.22:0/4043852633 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f0d940ca540 con 0x7f0d9415d480 2023-11-24T06:12:01.534 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:01.535 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:01.374181+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:01.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d8006ae40 msgr2=0x7f0d8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d8006ae40 0x7f0d8006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009f20 tx=0x7f0d840094d0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d9415d480 msgr2=0x7f0d941f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d9415d480 0x7f0d941f6340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0090b0 tx=0x7f0d8c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 shutdown_connections 2023-11-24T06:12:01.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d8006ae40 0x7f0d8006d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d9415d480 0x7f0d941f6340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d940d1e40 0x7f0d9415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 --2- 172.21.15.22:0/4043852633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d940ce040 0x7f0d9415e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 >> 172.21.15.22:0/4043852633 conn(0x7f0d9406b420 msgr2=0x7f0d9406b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:01.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 shutdown_connections 2023-11-24T06:12:01.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.534+0000 7f0d9c573640 1 -- 172.21.15.22:0/4043852633 wait complete. 2023-11-24T06:12:01.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:12:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.777+0000 7f1f296ea640 1 Processor -- start 2023-11-24T06:12:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.777+0000 7f1f296ea640 1 -- start start 2023-11-24T06:12:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.778+0000 7f1f296ea640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1f24144770 0x7f1f2415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.778+0000 7f1f296ea640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f240b35a0 0x7f1f2415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.778+0000 7f1f296ea640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2415f930 con 0x7f1f2406c9d0 2023-11-24T06:12:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.778+0000 7f1f296ea640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f240b43b0 con 0x7f1f240b35a0 2023-11-24T06:12:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.778+0000 7f1f296ea640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f240b3b10 con 0x7f1f24144770 2023-11-24T06:12:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.779+0000 7f1f237fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f240b35a0 0x7f1f2415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.779+0000 7f1f28ee9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1f2406c9d0 0x7f1f2406ce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56600/0 (socket says 172.21.15.22:56600) 2023-11-24T06:12:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.779+0000 7f1f28ee9640 1 -- 172.21.15.22:0/3955413862 learned_addr learned my addr 172.21.15.22:0/3955413862 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.779+0000 7f1f23fff640 1 --2- 172.21.15.22:0/3955413862 >> v2:172.21.15.31:3300/0 conn(0x7f1f24144770 0x7f1f2415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.779+0000 7f1f237fe640 1 -- 172.21.15.22:0/3955413862 >> v2:172.21.15.31:3300/0 conn(0x7f1f24144770 msgr2=0x7f1f2415eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.779+0000 7f1f22ffd640 1 -- 172.21.15.22:0/3955413862 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060722740 0 0) 0x7f1f2415f930 con 0x7f1f2406c9d0 2023-11-24T06:12:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.779+0000 7f1f237fe640 1 --2- 172.21.15.22:0/3955413862 >> v2:172.21.15.31:3300/0 conn(0x7f1f24144770 0x7f1f2415eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.779+0000 7f1f237fe640 1 -- 172.21.15.22:0/3955413862 >> v1:172.21.15.22:6789/0 conn(0x7f1f2406c9d0 legacy=0x7f1f2406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.779+0000 7f1f237fe640 1 -- 172.21.15.22:0/3955413862 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f240b3df0 con 0x7f1f240b35a0 2023-11-24T06:12:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.780+0000 7f1f237fe640 1 --2- 172.21.15.22:0/3955413862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 0x7f1f2415f0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f2406df90 tx=0x7f1f0c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf07552758ee479 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.781+0000 7f1f22ffd640 1 -- 172.21.15.22:0/3955413862 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c031830 con 0x7f1f240b35a0 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.781+0000 7f1f22ffd640 1 -- 172.21.15.22:0/3955413862 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c031990 con 0x7f1f240b35a0 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.781+0000 7f1f22ffd640 1 -- 172.21.15.22:0/3955413862 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c031d20 con 0x7f1f240b35a0 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.781+0000 7f1f296ea640 1 -- 172.21.15.22:0/3955413862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 msgr2=0x7f1f2415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.781+0000 7f1f296ea640 1 --2- 172.21.15.22:0/3955413862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 0x7f1f2415f0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f2406df90 tx=0x7f1f0c02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.782+0000 7f1f296ea640 1 -- 172.21.15.22:0/3955413862 shutdown_connections 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.782+0000 7f1f296ea640 1 --2- 172.21.15.22:0/3955413862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 0x7f1f2415f0a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.782+0000 7f1f296ea640 1 --2- 172.21.15.22:0/3955413862 >> v2:172.21.15.31:3300/0 conn(0x7f1f24144770 0x7f1f2415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.782+0000 7f1f296ea640 1 -- 172.21.15.22:0/3955413862 >> 172.21.15.22:0/3955413862 conn(0x7f1f240cec10 msgr2=0x7f1f240cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.782+0000 7f1f296ea640 1 -- 172.21.15.22:0/3955413862 shutdown_connections 2023-11-24T06:12:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.782+0000 7f1f296ea640 1 -- 172.21.15.22:0/3955413862 wait complete. 2023-11-24T06:12:01.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.783+0000 7f1f296ea640 1 Processor -- start 2023-11-24T06:12:01.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.784+0000 7f1f296ea640 1 -- start start 2023-11-24T06:12:01.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f296ea640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f2406c9d0 0x7f1f24141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f296ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 0x7f1f2413fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f296ea640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f24144770 0x7f1f2415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f296ea640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f241384e0 con 0x7f1f240b35a0 2023-11-24T06:12:01.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f296ea640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f24137440 con 0x7f1f24144770 2023-11-24T06:12:01.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f296ea640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f24137720 con 0x7f1f2406c9d0 2023-11-24T06:12:01.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 0x7f1f2413fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 0x7f1f2413fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45982/0 (socket says 172.21.15.22:45982) 2023-11-24T06:12:01.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f237fe640 1 -- 172.21.15.22:0/1264415622 learned_addr learned my addr 172.21.15.22:0/1264415622 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:01.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f237fe640 1 -- 172.21.15.22:0/1264415622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f2406c9d0 msgr2=0x7f1f24141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f237fe640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f2406c9d0 0x7f1f24141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f237fe640 1 -- 172.21.15.22:0/1264415622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f24144770 msgr2=0x7f1f2415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:01.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f237fe640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f24144770 0x7f1f2415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:01.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.785+0000 7f1f237fe640 1 -- 172.21.15.22:0/1264415622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c009400 con 0x7f1f240b35a0 2023-11-24T06:12:01.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.786+0000 7f1f237fe640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 0x7f1f2413fbd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009890 tx=0x7f1f0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:01.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.786+0000 7f1f20ff9640 1 -- 172.21.15.22:0/1264415622 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c03ba70 con 0x7f1f240b35a0 2023-11-24T06:12:01.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.786+0000 7f1f20ff9640 1 -- 172.21.15.22:0/1264415622 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c03bbf0 con 0x7f1f240b35a0 2023-11-24T06:12:01.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.786+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f24137a00 con 0x7f1f240b35a0 2023-11-24T06:12:01.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.786+0000 7f1f20ff9640 1 -- 172.21.15.22:0/1264415622 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c045400 con 0x7f1f240b35a0 2023-11-24T06:12:01.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.786+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f24137fc0 con 0x7f1f240b35a0 2023-11-24T06:12:01.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.787+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f241381b0 con 0x7f1f240b35a0 2023-11-24T06:12:01.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.788+0000 7f1f20ff9640 1 -- 172.21.15.22:0/1264415622 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f0c04e440 con 0x7f1f240b35a0 2023-11-24T06:12:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.789+0000 7f1f20ff9640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f0406ae40 0x7f1f0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.789+0000 7f1f20ff9640 1 -- 172.21.15.22:0/1264415622 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f0c0ab900 con 0x7f1f240b35a0 2023-11-24T06:12:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.789+0000 7f1f23fff640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f0406ae40 0x7f1f0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.790+0000 7f1f23fff640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f0406ae40 0x7f1f0406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f14007dc0 tx=0x7f1f140072f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:01.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:01.793+0000 7f1f20ff9640 1 -- 172.21.15.22:0/1264415622 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f0c076a20 con 0x7f1f240b35a0 2023-11-24T06:12:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.025+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1f2404e840 con 0x7f1f240b35a0 2023-11-24T06:12:02.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.655+0000 7f1f20ff9640 1 -- 172.21.15.22:0/1264415622 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1f0c07a040 con 0x7f1f240b35a0 2023-11-24T06:12:02.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.658+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f0406ae40 msgr2=0x7f1f0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:02.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.658+0000 7f1f296ea640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f0406ae40 0x7f1f0406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f14007dc0 tx=0x7f1f140072f0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 msgr2=0x7f1f2413fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:02.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 0x7f1f2413fbd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009890 tx=0x7f1f0c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 shutdown_connections 2023-11-24T06:12:02.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f0406ae40 0x7f1f0406d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f24144770 0x7f1f2415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f240b35a0 0x7f1f2413fbd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 --2- 172.21.15.22:0/1264415622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f2406c9d0 0x7f1f24141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 >> 172.21.15.22:0/1264415622 conn(0x7f1f240cec10 msgr2=0x7f1f2413e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:02.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 shutdown_connections 2023-11-24T06:12:02.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.659+0000 7f1f296ea640 1 -- 172.21.15.22:0/1264415622 wait complete. 2023-11-24T06:12:02.683 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:12:02.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:12:02.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.906+0000 7f9f7b251640 1 Processor -- start 2023-11-24T06:12:02.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.906+0000 7f9f7b251640 1 -- start start 2023-11-24T06:12:02.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.908+0000 7f9f7b251640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f740ae270 0x7f9f740abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:02.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.908+0000 7f9f7b251640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7415b730 con 0x7f9f7415b350 2023-11-24T06:12:02.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.908+0000 7f9f7b251640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f740ac740 con 0x7f9f7409cb30 2023-11-24T06:12:02.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.908+0000 7f9f7b251640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740ac460 con 0x7f9f740ae270 2023-11-24T06:12:02.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.908+0000 7f9f78fed640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9f7415b350 0x7f9f740b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56610/0 (socket says 172.21.15.22:56610) 2023-11-24T06:12:02.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.908+0000 7f9f78fed640 1 -- 172.21.15.22:0/2970758101 learned_addr learned my addr 172.21.15.22:0/2970758101 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:02.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f797ee640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f740ae270 0x7f9f740abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:02.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472623374 0 0) 0x7f9f68001110 con 0x7f9f7415b350 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f64003520 con 0x7f9f7415b350 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3022545074 0 0) 0x7f9f64003520 con 0x7f9f7415b350 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f740ae270 msgr2=0x7f9f740abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f740ae270 0x7f9f740abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 >> v1:172.21.15.31:6789/0 conn(0x7f9f7409cb30 legacy=0x7f9f740adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740b2a50 con 0x7f9f7415b350 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f9f68001800 con 0x7f9f7415b350 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 >> v1:172.21.15.22:6789/0 conn(0x7f9f7415b350 legacy=0x7f9f740b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f640039a0 0x7f9f64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640047c0 0x7f9f64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:02.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f740ae270 0x7f9f64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740ac460 con 0x7f9f640039a0 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6400ba60 con 0x7f9f640047c0 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.909+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6400bc20 con 0x7f9f740ae270 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f78fed640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f640039a0 0x7f9f64003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f73fff640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640047c0 0x7f9f64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f797ee640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f740ae270 0x7f9f64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f78fed640 1 -- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f740ae270 msgr2=0x7f9f64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f78fed640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f740ae270 0x7f9f64005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f78fed640 1 -- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640047c0 msgr2=0x7f9f64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f78fed640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640047c0 0x7f9f64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f78fed640 1 -- 172.21.15.22:0/2970758101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f64003520 con 0x7f9f640039a0 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f73fff640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640047c0 0x7f9f64004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:02.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.910+0000 7f9f797ee640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f740ae270 0x7f9f64005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:02.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.911+0000 7f9f78fed640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f640039a0 0x7f9f64003dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9f68001eb0 tx=0x7f9f640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d626903ba307b7c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f68005ad0 con 0x7f9f640039a0 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f68005c50 con 0x7f9f640039a0 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f737fe640 1 -- 172.21.15.22:0/2970758101 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6802c790 con 0x7f9f640039a0 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f7b251640 1 -- 172.21.15.22:0/2970758101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f640039a0 msgr2=0x7f9f64003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f7b251640 1 --2- 172.21.15.22:0/2970758101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f640039a0 0x7f9f64003dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9f68001eb0 tx=0x7f9f640057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f797ee640 1 -- 172.21.15.22:0/2970758101 reap_dead start 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f7b251640 1 -- 172.21.15.22:0/2970758101 shutdown_connections 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f7b251640 1 -- 172.21.15.22:0/2970758101 >> 172.21.15.22:0/2970758101 conn(0x7f9f740b0ba0 msgr2=0x7f9f740b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f7b251640 1 -- 172.21.15.22:0/2970758101 shutdown_connections 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.912+0000 7f9f7b251640 1 -- 172.21.15.22:0/2970758101 wait complete. 2023-11-24T06:12:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.914+0000 7f9f7b251640 1 Processor -- start 2023-11-24T06:12:02.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.914+0000 7f9f7b251640 1 -- start start 2023-11-24T06:12:02.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.915+0000 7f9f7b251640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640039a0 0x7f9f74144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:02.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.915+0000 7f9f7b251640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7414ef90 0x7f9f74152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.915+0000 7f9f7b251640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f74155020 0x7f9f741554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.915+0000 7f9f7b251640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7415d7b0 con 0x7f9f7414ef90 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.915+0000 7f9f7b251640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f741559f0 con 0x7f9f640039a0 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.915+0000 7f9f7b251640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7415d1c0 con 0x7f9f74155020 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.915+0000 7f9f73fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7414ef90 0x7f9f74152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.915+0000 7f9f73fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7414ef90 0x7f9f74152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46004/0 (socket says 172.21.15.22:46004) 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f73fff640 1 -- 172.21.15.22:0/4251856370 learned_addr learned my addr 172.21.15.22:0/4251856370 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f78fed640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640039a0 0x7f9f74144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f797ee640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f74155020 0x7f9f741554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:02.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f73fff640 1 -- 172.21.15.22:0/4251856370 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f74155020 msgr2=0x7f9f741554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f73fff640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f74155020 0x7f9f741554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f73fff640 1 -- 172.21.15.22:0/4251856370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640039a0 msgr2=0x7f9f74144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f73fff640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640039a0 0x7f9f74144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f73fff640 1 -- 172.21.15.22:0/4251856370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7414fa70 con 0x7f9f7414ef90 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f73fff640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7414ef90 0x7f9f74152570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000d7a0 tx=0x7f9f6000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.916+0000 7f9f717fa640 1 -- 172.21.15.22:0/4251856370 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60017070 con 0x7f9f7414ef90 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.917+0000 7f9f717fa640 1 -- 172.21.15.22:0/4251856370 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60005070 con 0x7f9f7414ef90 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.917+0000 7f9f717fa640 1 -- 172.21.15.22:0/4251856370 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60005420 con 0x7f9f7414ef90 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.917+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7414fd50 con 0x7f9f7414ef90 2023-11-24T06:12:02.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.917+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f74152ab0 con 0x7f9f7414ef90 2023-11-24T06:12:02.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.918+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7415d8f0 con 0x7f9f7414ef90 2023-11-24T06:12:02.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.919+0000 7f9f717fa640 1 -- 172.21.15.22:0/4251856370 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f60007030 con 0x7f9f7414ef90 2023-11-24T06:12:02.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.920+0000 7f9f717fa640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f5806ae40 0x7f9f5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:02.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.920+0000 7f9f717fa640 1 -- 172.21.15.22:0/4251856370 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f60088d70 con 0x7f9f7414ef90 2023-11-24T06:12:02.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.920+0000 7f9f78fed640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f5806ae40 0x7f9f5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:02.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.921+0000 7f9f78fed640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f5806ae40 0x7f9f5806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f68034000 tx=0x7f9f68009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:02.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:02.924+0000 7f9f717fa640 1 -- 172.21.15.22:0/4251856370 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f7415d8f0 con 0x7f9f7414ef90 2023-11-24T06:12:03.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.155+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9f740ac740 con 0x7f9f7414ef90 2023-11-24T06:12:03.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.665+0000 7f9f717fa640 1 -- 172.21.15.22:0/4251856370 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9f740ac740 con 0x7f9f7414ef90 2023-11-24T06:12:03.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f5806ae40 msgr2=0x7f9f5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f5806ae40 0x7f9f5806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f68034000 tx=0x7f9f68009030 comp rx=0 tx=0).stop 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7414ef90 msgr2=0x7f9f74152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7414ef90 0x7f9f74152570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000d7a0 tx=0x7f9f6000dc60 comp rx=0 tx=0).stop 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 shutdown_connections 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f5806ae40 0x7f9f5806d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f74155020 0x7f9f741554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7414ef90 0x7f9f74152570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 --2- 172.21.15.22:0/4251856370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f640039a0 0x7f9f74144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.669+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 >> 172.21.15.22:0/4251856370 conn(0x7f9f740b0ba0 msgr2=0x7f9f7415a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.670+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 shutdown_connections 2023-11-24T06:12:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.670+0000 7f9f7b251640 1 -- 172.21.15.22:0/4251856370 wait complete. 2023-11-24T06:12:03.693 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:12:03.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:12:03.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.924+0000 7eff4f59e640 1 Processor -- start 2023-11-24T06:12:03.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.925+0000 7eff4f59e640 1 -- start start 2023-11-24T06:12:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.926+0000 7eff4f59e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff500cf500 0x7eff500cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.926+0000 7eff4f59e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff50140900 con 0x7eff5013dfd0 2023-11-24T06:12:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.927+0000 7eff4f59e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5015fa70 con 0x7eff500cf050 2023-11-24T06:12:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.927+0000 7eff4f59e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5015c580 con 0x7eff500cf500 2023-11-24T06:12:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.927+0000 7eff4e59c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7eff5013dfd0 0x7eff5015be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56618/0 (socket says 172.21.15.22:56618) 2023-11-24T06:12:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.927+0000 7eff4e59c640 1 -- 172.21.15.22:0/2013708827 learned_addr learned my addr 172.21.15.22:0/2013708827 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.927+0000 7eff4ed9d640 1 --2- 172.21.15.22:0/2013708827 >> v2:172.21.15.31:3300/0 conn(0x7eff500cf500 0x7eff500cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:03.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.927+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123996893 0 0) 0x7eff50140900 con 0x7eff5013dfd0 2023-11-24T06:12:03.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.927+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff3c003520 con 0x7eff5013dfd0 2023-11-24T06:12:03.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 726170198 0 0) 0x7eff3c003520 con 0x7eff5013dfd0 2023-11-24T06:12:03.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 >> v2:172.21.15.31:3300/0 conn(0x7eff500cf500 msgr2=0x7eff500cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:03.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 --2- 172.21.15.22:0/2013708827 >> v2:172.21.15.31:3300/0 conn(0x7eff500cf500 0x7eff500cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 >> v1:172.21.15.31:6789/0 conn(0x7eff500cf050 legacy=0x7eff500cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:03.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5015ee60 con 0x7eff5013dfd0 2023-11-24T06:12:03.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7eff40001670 con 0x7eff5013dfd0 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 >> v1:172.21.15.22:6789/0 conn(0x7eff5013dfd0 legacy=0x7eff5015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff3c0039e0 0x7eff3c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3c005180 0x7eff3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5015c580 con 0x7eff3c0047c0 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c00c0b0 con 0x7eff3c005180 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c00c270 con 0x7eff3c0039e0 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff47fff640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.928+0000 7eff4ed9d640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3c005180 0x7eff3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.929+0000 7eff4e59c640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff3c0039e0 0x7eff3c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.929+0000 7eff47fff640 1 -- 172.21.15.22:0/2013708827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff3c0039e0 msgr2=0x7eff3c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.929+0000 7eff47fff640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff3c0039e0 0x7eff3c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.929+0000 7eff47fff640 1 -- 172.21.15.22:0/2013708827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3c005180 msgr2=0x7eff3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:03.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.929+0000 7eff47fff640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3c005180 0x7eff3c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.929+0000 7eff47fff640 1 -- 172.21.15.22:0/2013708827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c003520 con 0x7eff3c0047c0 2023-11-24T06:12:03.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.929+0000 7eff4ed9d640 1 -- 172.21.15.22:0/2013708827 reap_dead start 2023-11-24T06:12:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.930+0000 7eff47fff640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff3c004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff38001750 tx=0x7eff3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32182f3ddb2b189b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.930+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380052d0 con 0x7eff3c0047c0 2023-11-24T06:12:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.930+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3802e050 con 0x7eff3c0047c0 2023-11-24T06:12:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.930+0000 7eff4dd9b640 1 -- 172.21.15.22:0/2013708827 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38003830 con 0x7eff3c0047c0 2023-11-24T06:12:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.931+0000 7eff4f59e640 1 -- 172.21.15.22:0/2013708827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 msgr2=0x7eff3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.931+0000 7eff4f59e640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff3c004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff38001750 tx=0x7eff3c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.931+0000 7eff4f59e640 1 -- 172.21.15.22:0/2013708827 shutdown_connections 2023-11-24T06:12:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.931+0000 7eff4f59e640 1 --2- 172.21.15.22:0/2013708827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff3c004c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.931+0000 7eff4f59e640 1 -- 172.21.15.22:0/2013708827 >> 172.21.15.22:0/2013708827 conn(0x7eff5006a860 msgr2=0x7eff5006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:03.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.931+0000 7eff4f59e640 1 -- 172.21.15.22:0/2013708827 shutdown_connections 2023-11-24T06:12:03.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.931+0000 7eff4f59e640 1 -- 172.21.15.22:0/2013708827 wait complete. 2023-11-24T06:12:03.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.933+0000 7eff4f59e640 1 Processor -- start 2023-11-24T06:12:03.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.933+0000 7eff4f59e640 1 -- start start 2023-11-24T06:12:03.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.934+0000 7eff4f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff50133570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:03.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.934+0000 7eff4f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff500ad280 0x7eff500b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:03.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.934+0000 7eff4f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff5013b6c0 0x7eff500b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:03.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.934+0000 7eff4f59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500ad840 con 0x7eff3c0047c0 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.934+0000 7eff4f59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500adb20 con 0x7eff500ad280 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.934+0000 7eff4f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff500ade00 con 0x7eff5013b6c0 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.934+0000 7eff4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff50133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.934+0000 7eff4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff50133570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46018/0 (socket says 172.21.15.22:46018) 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.934+0000 7eff4e59c640 1 -- 172.21.15.22:0/1499453818 learned_addr learned my addr 172.21.15.22:0/1499453818 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff47fff640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff500ad280 0x7eff500b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff4ed9d640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff5013b6c0 0x7eff500b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff4e59c640 1 -- 172.21.15.22:0/1499453818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff5013b6c0 msgr2=0x7eff500b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff4e59c640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff5013b6c0 0x7eff500b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff4e59c640 1 -- 172.21.15.22:0/1499453818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff500ad280 msgr2=0x7eff500b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff4e59c640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff500ad280 0x7eff500b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff4e59c640 1 -- 172.21.15.22:0/1499453818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50070170 con 0x7eff3c0047c0 2023-11-24T06:12:03.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff47fff640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff500ad280 0x7eff500b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:03.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff4e59c640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff50133570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff4000e730 tx=0x7eff4000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:03.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff46ffd640 1 -- 172.21.15.22:0/1499453818 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000c6c0 con 0x7eff3c0047c0 2023-11-24T06:12:03.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff46ffd640 1 -- 172.21.15.22:0/1499453818 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4000c840 con 0x7eff3c0047c0 2023-11-24T06:12:03.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.935+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff50070450 con 0x7eff3c0047c0 2023-11-24T06:12:03.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.936+0000 7eff46ffd640 1 -- 172.21.15.22:0/1499453818 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000cbf0 con 0x7eff3c0047c0 2023-11-24T06:12:03.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.936+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5013f8f0 con 0x7eff3c0047c0 2023-11-24T06:12:03.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.937+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5004e840 con 0x7eff3c0047c0 2023-11-24T06:12:03.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.938+0000 7eff46ffd640 1 -- 172.21.15.22:0/1499453818 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff4000cd50 con 0x7eff3c0047c0 2023-11-24T06:12:03.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.939+0000 7eff46ffd640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7eff3006ae70 0x7eff3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:03.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.939+0000 7eff46ffd640 1 -- 172.21.15.22:0/1499453818 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff400894c0 con 0x7eff3c0047c0 2023-11-24T06:12:03.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.939+0000 7eff47fff640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7eff3006ae70 0x7eff3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:03.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.940+0000 7eff47fff640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7eff3006ae70 0x7eff3006d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff38033000 tx=0x7eff38009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:03.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:03.944+0000 7eff46ffd640 1 -- 172.21.15.22:0/1499453818 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff400544d0 con 0x7eff3c0047c0 2023-11-24T06:12:04.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.178+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff500ce9a0 con 0x7eff3c0047c0 2023-11-24T06:12:04.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.179+0000 7eff46ffd640 1 -- 172.21.15.22:0/1499453818 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7eff40057af0 con 0x7eff3c0047c0 2023-11-24T06:12:04.182 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:04.182 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2596011389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2596011389},{"type":"v1","addr":"172.21.15.22:6837","nonce":2596011389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1715395658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1715395658},{"type":"v1","addr":"172.21.15.31:6834","nonce":1715395658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2020783180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2020783180},{"type":"v1","addr":"172.21.15.31:6835","nonce":2020783180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:12:00.092195+0000","modified":"2023-11-24T06:12:03.157366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/4189980327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":4189980327},{"type":"v1","addr":"172.21.15.22:6835","nonce":4189980327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:12:04.182 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-11-24T06:12:04.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7eff3006ae70 msgr2=0x7eff3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7eff3006ae70 0x7eff3006d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff38033000 tx=0x7eff38009030 comp rx=0 tx=0).stop 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 msgr2=0x7eff50133570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff50133570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff4000e730 tx=0x7eff4000ebf0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 shutdown_connections 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7eff3006ae70 0x7eff3006d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff5013b6c0 0x7eff500b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff500ad280 0x7eff500b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 --2- 172.21.15.22:0/1499453818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff3c0047c0 0x7eff50133570 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.181+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 >> 172.21.15.22:0/1499453818 conn(0x7eff5006a860 msgr2=0x7eff500b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.182+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 shutdown_connections 2023-11-24T06:12:04.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.182+0000 7eff4f59e640 1 -- 172.21.15.22:0/1499453818 wait complete. 2023-11-24T06:12:04.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:04.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.430+0000 7fd212dc9640 1 Processor -- start 2023-11-24T06:12:04.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.430+0000 7fd212dc9640 1 -- start start 2023-11-24T06:12:04.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.432+0000 7fd212dc9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 0x7fd20c162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.432+0000 7fd212dc9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd20c0cf760 0x7fd20c1655e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.432+0000 7fd212dc9640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c162bb0 con 0x7fd20c1651a0 2023-11-24T06:12:04.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.432+0000 7fd212dc9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c165ca0 con 0x7fd20c0cf760 2023-11-24T06:12:04.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.432+0000 7fd212dc9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c165f80 con 0x7fd20c14b1c0 2023-11-24T06:12:04.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.432+0000 7fd2115c6640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd20c1651a0 0x7fd20c0cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56620/0 (socket says 172.21.15.22:56620) 2023-11-24T06:12:04.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.432+0000 7fd2115c6640 1 -- 172.21.15.22:0/1084438359 learned_addr learned my addr 172.21.15.22:0/1084438359 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:04.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.432+0000 7fd2125c8640 1 --2- 172.21.15.22:0/1084438359 >> v2:172.21.15.22:3300/0 conn(0x7fd20c0cf760 0x7fd20c1655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.432+0000 7fd211dc7640 1 --2- 172.21.15.22:0/1084438359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 0x7fd20c162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.433+0000 7fd210dc5640 1 -- 172.21.15.22:0/1084438359 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459672394 0 0) 0x7fd20c162bb0 con 0x7fd20c1651a0 2023-11-24T06:12:04.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.433+0000 7fd210dc5640 1 -- 172.21.15.22:0/1084438359 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f8003520 con 0x7fd20c1651a0 2023-11-24T06:12:04.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.433+0000 7fd2125c8640 1 -- 172.21.15.22:0/1084438359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 msgr2=0x7fd20c162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:04.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.433+0000 7fd2125c8640 1 --2- 172.21.15.22:0/1084438359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 0x7fd20c162670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.433+0000 7fd2125c8640 1 -- 172.21.15.22:0/1084438359 >> v1:172.21.15.22:6789/0 conn(0x7fd20c1651a0 legacy=0x7fd20c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.433+0000 7fd2125c8640 1 -- 172.21.15.22:0/1084438359 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c161e70 con 0x7fd20c0cf760 2023-11-24T06:12:04.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.434+0000 7fd2125c8640 1 --2- 172.21.15.22:0/1084438359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c0cf760 0x7fd20c1655e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd204009d90 tx=0x7fd20402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92d37b42a974968 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:04.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.434+0000 7fd210dc5640 1 -- 172.21.15.22:0/1084438359 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20402cbc0 con 0x7fd20c0cf760 2023-11-24T06:12:04.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.434+0000 7fd210dc5640 1 -- 172.21.15.22:0/1084438359 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20402cd20 con 0x7fd20c0cf760 2023-11-24T06:12:04.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.434+0000 7fd210dc5640 1 -- 172.21.15.22:0/1084438359 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204034660 con 0x7fd20c0cf760 2023-11-24T06:12:04.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.435+0000 7fd212dc9640 1 -- 172.21.15.22:0/1084438359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c0cf760 msgr2=0x7fd20c1655e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.435+0000 7fd212dc9640 1 --2- 172.21.15.22:0/1084438359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c0cf760 0x7fd20c1655e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd204009d90 tx=0x7fd20402be10 comp rx=0 tx=0).stop 2023-11-24T06:12:04.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.435+0000 7fd212dc9640 1 -- 172.21.15.22:0/1084438359 shutdown_connections 2023-11-24T06:12:04.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.435+0000 7fd212dc9640 1 --2- 172.21.15.22:0/1084438359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c0cf760 0x7fd20c1655e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.435+0000 7fd212dc9640 1 --2- 172.21.15.22:0/1084438359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 0x7fd20c162670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.435+0000 7fd212dc9640 1 -- 172.21.15.22:0/1084438359 >> 172.21.15.22:0/1084438359 conn(0x7fd20c06a860 msgr2=0x7fd20c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.435+0000 7fd212dc9640 1 -- 172.21.15.22:0/1084438359 shutdown_connections 2023-11-24T06:12:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.435+0000 7fd212dc9640 1 -- 172.21.15.22:0/1084438359 wait complete. 2023-11-24T06:12:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.437+0000 7fd212dc9640 1 Processor -- start 2023-11-24T06:12:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.437+0000 7fd212dc9640 1 -- start start 2023-11-24T06:12:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.438+0000 7fd212dc9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd20c0cf760 0x7fd20c0cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.438+0000 7fd212dc9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 0x7fd20c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.438+0000 7fd212dc9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c1651a0 0x7fd20c0c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.438+0000 7fd212dc9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c135a30 con 0x7fd20c1651a0 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.438+0000 7fd212dc9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c134e20 con 0x7fd20c0cf760 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.438+0000 7fd212dc9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c135100 con 0x7fd20c14b1c0 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.438+0000 7fd2125c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c1651a0 0x7fd20c0c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd2125c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c1651a0 0x7fd20c0c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46028/0 (socket says 172.21.15.22:46028) 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd2125c8640 1 -- 172.21.15.22:0/1453218583 learned_addr learned my addr 172.21.15.22:0/1453218583 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd2115c6640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 0x7fd20c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd211dc7640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd20c0cf760 0x7fd20c0cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd2125c8640 1 -- 172.21.15.22:0/1453218583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 msgr2=0x7fd20c15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd2125c8640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 0x7fd20c15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd2125c8640 1 -- 172.21.15.22:0/1453218583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd20c0cf760 msgr2=0x7fd20c0cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd2125c8640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd20c0cf760 0x7fd20c0cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd2125c8640 1 -- 172.21.15.22:0/1453218583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204009a70 con 0x7fd20c1651a0 2023-11-24T06:12:04.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.439+0000 7fd2125c8640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c1651a0 0x7fd20c0c3e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd204009d90 tx=0x7fd204004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:04.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.440+0000 7fd2027fc640 1 -- 172.21.15.22:0/1453218583 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204040650 con 0x7fd20c1651a0 2023-11-24T06:12:04.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.440+0000 7fd2027fc640 1 -- 172.21.15.22:0/1453218583 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20402ce90 con 0x7fd20c1651a0 2023-11-24T06:12:04.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.440+0000 7fd2027fc640 1 -- 172.21.15.22:0/1453218583 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040409f0 con 0x7fd20c1651a0 2023-11-24T06:12:04.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.440+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c1353e0 con 0x7fd20c1651a0 2023-11-24T06:12:04.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.440+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c15e930 con 0x7fd20c1651a0 2023-11-24T06:12:04.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.441+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c135ba0 con 0x7fd20c1651a0 2023-11-24T06:12:04.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.442+0000 7fd2027fc640 1 -- 172.21.15.22:0/1453218583 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd204040b50 con 0x7fd20c1651a0 2023-11-24T06:12:04.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.443+0000 7fd2027fc640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd1f006ae40 0x7fd1f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.443+0000 7fd2027fc640 1 -- 172.21.15.22:0/1453218583 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2040ac1e0 con 0x7fd20c1651a0 2023-11-24T06:12:04.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.444+0000 7fd211dc7640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd1f006ae40 0x7fd1f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.444+0000 7fd211dc7640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd1f006ae40 0x7fd1f006d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ad0 tx=0x7fd208008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.448+0000 7fd2027fc640 1 -- 172.21.15.22:0/1453218583 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd204077290 con 0x7fd20c1651a0 2023-11-24T06:12:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.642+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd20c06c5c0 con 0x7fd20c1651a0 2023-11-24T06:12:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.644+0000 7fd2027fc640 1 -- 172.21.15.22:0/1453218583 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fd204009450 con 0x7fd20c1651a0 2023-11-24T06:12:04.647 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:04.647 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:01.374181+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd1f006ae40 msgr2=0x7fd1f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd1f006ae40 0x7fd1f006d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ad0 tx=0x7fd208008040 comp rx=0 tx=0).stop 2023-11-24T06:12:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c1651a0 msgr2=0x7fd20c0c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c1651a0 0x7fd20c0c3e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd204009d90 tx=0x7fd204004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 shutdown_connections 2023-11-24T06:12:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd1f006ae40 0x7fd1f006d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20c1651a0 0x7fd20c0c3e50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd20c14b1c0 0x7fd20c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 --2- 172.21.15.22:0/1453218583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd20c0cf760 0x7fd20c0cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 >> 172.21.15.22:0/1453218583 conn(0x7fd20c06a860 msgr2=0x7fd20c071bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.647+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 shutdown_connections 2023-11-24T06:12:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.648+0000 7fd212dc9640 1 -- 172.21.15.22:0/1453218583 wait complete. 2023-11-24T06:12:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:12:04.669 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:12:04.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.890+0000 7fe318eea640 1 Processor -- start 2023-11-24T06:12:04.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.890+0000 7fe318eea640 1 -- start start 2023-11-24T06:12:04.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.891+0000 7fe318eea640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe31415d5b0 0x7fe3140d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.891+0000 7fe318eea640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140d14a0 0x7fe3140d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.892+0000 7fe318eea640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3140cf0c0 con 0x7fe3140cf7a0 2023-11-24T06:12:04.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.892+0000 7fe318eea640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3140b01b0 con 0x7fe31415d5b0 2023-11-24T06:12:04.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.892+0000 7fe318eea640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31415d990 con 0x7fe3140d14a0 2023-11-24T06:12:04.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.892+0000 7fe3137fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe31415d5b0 0x7fe3140d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.892+0000 7fe3137fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe31415d5b0 0x7fe3140d3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46036/0 (socket says 172.21.15.22:46036) 2023-11-24T06:12:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.892+0000 7fe3137fe640 1 -- 172.21.15.22:0/376359799 learned_addr learned my addr 172.21.15.22:0/376359799 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.892+0000 7fe3137fe640 1 -- 172.21.15.22:0/376359799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140d14a0 msgr2=0x7fe3140d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.892+0000 7fe312ffd640 1 --2- 172.21.15.22:0/376359799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140d14a0 0x7fe3140d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.893+0000 7fe3137fe640 1 --2- 172.21.15.22:0/376359799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140d14a0 0x7fe3140d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.893+0000 7fe3137fe640 1 -- 172.21.15.22:0/376359799 >> v1:172.21.15.31:6789/0 conn(0x7fe3140cf7a0 legacy=0x7fe3140cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.893+0000 7fe3137fe640 1 -- 172.21.15.22:0/376359799 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140d1e40 con 0x7fe31415d5b0 2023-11-24T06:12:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.893+0000 7fe312ffd640 1 --2- 172.21.15.22:0/376359799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140d14a0 0x7fe3140d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:04.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.894+0000 7fe3137fe640 1 --2- 172.21.15.22:0/376359799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 0x7fe3140d3990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe304009870 tx=0x7fe30402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f24dafe3cb9a5cb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:04.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.894+0000 7fe3127fc640 1 -- 172.21.15.22:0/376359799 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304031640 con 0x7fe31415d5b0 2023-11-24T06:12:04.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.894+0000 7fe3127fc640 1 -- 172.21.15.22:0/376359799 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3040317a0 con 0x7fe31415d5b0 2023-11-24T06:12:04.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.894+0000 7fe3127fc640 1 -- 172.21.15.22:0/376359799 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304031b30 con 0x7fe31415d5b0 2023-11-24T06:12:04.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.895+0000 7fe318eea640 1 -- 172.21.15.22:0/376359799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 msgr2=0x7fe3140d3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.895+0000 7fe318eea640 1 --2- 172.21.15.22:0/376359799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 0x7fe3140d3990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe304009870 tx=0x7fe30402b8f0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.895+0000 7fe318eea640 1 -- 172.21.15.22:0/376359799 shutdown_connections 2023-11-24T06:12:04.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.895+0000 7fe318eea640 1 --2- 172.21.15.22:0/376359799 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140d14a0 0x7fe3140d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.895+0000 7fe318eea640 1 --2- 172.21.15.22:0/376359799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 0x7fe3140d3990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.895+0000 7fe318eea640 1 -- 172.21.15.22:0/376359799 >> 172.21.15.22:0/376359799 conn(0x7fe31409c3b0 msgr2=0x7fe3140d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:04.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.895+0000 7fe318eea640 1 -- 172.21.15.22:0/376359799 shutdown_connections 2023-11-24T06:12:04.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.895+0000 7fe318eea640 1 -- 172.21.15.22:0/376359799 wait complete. 2023-11-24T06:12:04.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.897+0000 7fe318eea640 1 Processor -- start 2023-11-24T06:12:04.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.897+0000 7fe318eea640 1 -- start start 2023-11-24T06:12:04.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe318eea640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140cf7a0 0x7fe3140cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe318eea640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3140d14a0 0x7fe3140b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe318eea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 0x7fe31415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe318eea640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3141f73a0 con 0x7fe31415d5b0 2023-11-24T06:12:04.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe318eea640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140c8360 con 0x7fe3140d14a0 2023-11-24T06:12:04.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe318eea640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140c8640 con 0x7fe3140cf7a0 2023-11-24T06:12:04.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe313fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 0x7fe31415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe313fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 0x7fe31415a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46048/0 (socket says 172.21.15.22:46048) 2023-11-24T06:12:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe313fff640 1 -- 172.21.15.22:0/3980279447 learned_addr learned my addr 172.21.15.22:0/3980279447 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe3137fe640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140cf7a0 0x7fe3140cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe312ffd640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3140d14a0 0x7fe3140b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe313fff640 1 -- 172.21.15.22:0/3980279447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140cf7a0 msgr2=0x7fe3140cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe313fff640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140cf7a0 0x7fe3140cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe313fff640 1 -- 172.21.15.22:0/3980279447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3140d14a0 msgr2=0x7fe3140b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe313fff640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3140d14a0 0x7fe3140b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.898+0000 7fe313fff640 1 -- 172.21.15.22:0/3980279447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040094d0 con 0x7fe31415d5b0 2023-11-24T06:12:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.899+0000 7fe313fff640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 0x7fe31415a3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00b970 tx=0x7fe30c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.899+0000 7fe2fbfff640 1 -- 172.21.15.22:0/3980279447 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00cb40 con 0x7fe31415d5b0 2023-11-24T06:12:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.899+0000 7fe2fbfff640 1 -- 172.21.15.22:0/3980279447 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c00cca0 con 0x7fe31415d5b0 2023-11-24T06:12:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.899+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3140c8920 con 0x7fe31415d5b0 2023-11-24T06:12:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.899+0000 7fe2fbfff640 1 -- 172.21.15.22:0/3980279447 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c014680 con 0x7fe31415d5b0 2023-11-24T06:12:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.899+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3140cc490 con 0x7fe31415d5b0 2023-11-24T06:12:04.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.900+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3140c8e40 con 0x7fe31415d5b0 2023-11-24T06:12:04.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.901+0000 7fe2fbfff640 1 -- 172.21.15.22:0/3980279447 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe30c01d3b0 con 0x7fe31415d5b0 2023-11-24T06:12:04.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.902+0000 7fe2fbfff640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe30006ae40 0x7fe30006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:04.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.902+0000 7fe2fbfff640 1 -- 172.21.15.22:0/3980279447 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe30c0894a0 con 0x7fe31415d5b0 2023-11-24T06:12:04.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.903+0000 7fe3137fe640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe30006ae40 0x7fe30006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:04.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.903+0000 7fe3137fe640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe30006ae40 0x7fe30006d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe304036000 tx=0x7fe30403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:04.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:04.907+0000 7fe2fbfff640 1 -- 172.21.15.22:0/3980279447 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3140c8e40 con 0x7fe31415d5b0 2023-11-24T06:12:05.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.099+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3140afe40 con 0x7fe30006ae40 2023-11-24T06:12:05.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.123+0000 7fe2fbfff640 1 -- 172.21.15.22:0/3980279447 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263507 (secure 0 0 0) 0x7fe304031a10 con 0x7fe30006ae40 2023-11-24T06:12:05.129 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:05.131 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:12:05.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe30006ae40 msgr2=0x7fe30006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe30006ae40 0x7fe30006d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe304036000 tx=0x7fe30403c040 comp rx=0 tx=0).stop 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 msgr2=0x7fe31415a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 0x7fe31415a3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00b970 tx=0x7fe30c00be30 comp rx=0 tx=0).stop 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 shutdown_connections 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe30006ae40 0x7fe30006d300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe31415d5b0 0x7fe31415a3a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3140d14a0 0x7fe3140b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 --2- 172.21.15.22:0/3980279447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3140cf7a0 0x7fe3140cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 >> 172.21.15.22:0/3980279447 conn(0x7fe31409c3b0 msgr2=0x7fe314160490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 shutdown_connections 2023-11-24T06:12:05.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.129+0000 7fe318eea640 1 -- 172.21.15.22:0/3980279447 wait complete. 2023-11-24T06:12:05.153 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T06:12:04.647691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235740,"kb_used_data":2912,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738980,"statfs":{"total":773094113280,"available":772852715520,"internally_reserved":0,"allocated":2981888,"data_stored":1773892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001552"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386950+0000","last_change":"2023-11-24T06:12:00.409989+0000","last_active":"2023-11-24T06:12:01.386950+0000","last_peered":"2023-11-24T06:12:01.386950+0000","last_clean":"2023-11-24T06:12:01.386950+0000","last_became_active":"2023-11-24T06:12:00.409672+0000","last_became_peered":"2023-11-24T06:12:00.409672+0000","last_unstale":"2023-11-24T06:12:01.386950+0000","last_undegraded":"2023-11-24T06:12:01.386950+0000","last_fullsized":"2023-11-24T06:12:01.386950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386025+0000","last_change":"2023-11-24T06:12:00.416425+0000","last_active":"2023-11-24T06:12:01.386025+0000","last_peered":"2023-11-24T06:12:01.386025+0000","last_clean":"2023-11-24T06:12:01.386025+0000","last_became_active":"2023-11-24T06:12:00.415783+0000","last_became_peered":"2023-11-24T06:12:00.415783+0000","last_unstale":"2023-11-24T06:12:01.386025+0000","last_undegraded":"2023-11-24T06:12:01.386025+0000","last_fullsized":"2023-11-24T06:12:01.386025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:38:17.759240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811686+0000","last_change":"2023-11-24T06:12:00.408399+0000","last_active":"2023-11-24T06:12:01.811686+0000","last_peered":"2023-11-24T06:12:01.811686+0000","last_clean":"2023-11-24T06:12:01.811686+0000","last_became_active":"2023-11-24T06:12:00.408067+0000","last_became_peered":"2023-11-24T06:12:00.408067+0000","last_unstale":"2023-11-24T06:12:01.811686+0000","last_undegraded":"2023-11-24T06:12:01.811686+0000","last_fullsized":"2023-11-24T06:12:01.811686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.639601+0000","last_change":"2023-11-24T06:11:59.639601+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.639601+0000","last_undegraded":"2023-11-24T06:11:59.639601+0000","last_fullsized":"2023-11-24T06:11:59.639601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:12:00.400306+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:12:00.399964+0000","last_became_peered":"2023-11-24T06:12:00.399964+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.641902+0000","last_change":"2023-11-24T06:11:59.641902+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.641902+0000","last_undegraded":"2023-11-24T06:11:59.641902+0000","last_fullsized":"2023-11-24T06:11:59.641902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385528+0000","last_change":"2023-11-24T06:12:00.408860+0000","last_active":"2023-11-24T06:12:01.385528+0000","last_peered":"2023-11-24T06:12:01.385528+0000","last_clean":"2023-11-24T06:12:01.385528+0000","last_became_active":"2023-11-24T06:12:00.408549+0000","last_became_peered":"2023-11-24T06:12:00.408549+0000","last_unstale":"2023-11-24T06:12:01.385528+0000","last_undegraded":"2023-11-24T06:12:01.385528+0000","last_fullsized":"2023-11-24T06:12:01.385528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383026+0000","last_change":"2023-11-24T06:12:00.413017+0000","last_active":"2023-11-24T06:12:01.383026+0000","last_peered":"2023-11-24T06:12:01.383026+0000","last_clean":"2023-11-24T06:12:01.383026+0000","last_became_active":"2023-11-24T06:12:00.411843+0000","last_became_peered":"2023-11-24T06:12:00.411843+0000","last_unstale":"2023-11-24T06:12:01.383026+0000","last_undegraded":"2023-11-24T06:12:01.383026+0000","last_fullsized":"2023-11-24T06:12:01.383026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387045+0000","last_change":"2023-11-24T06:12:00.418547+0000","last_active":"2023-11-24T06:12:01.387045+0000","last_peered":"2023-11-24T06:12:01.387045+0000","last_clean":"2023-11-24T06:12:01.387045+0000","last_became_active":"2023-11-24T06:12:00.418264+0000","last_became_peered":"2023-11-24T06:12:00.418264+0000","last_unstale":"2023-11-24T06:12:01.387045+0000","last_undegraded":"2023-11-24T06:12:01.387045+0000","last_fullsized":"2023-11-24T06:12:01.387045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792917+0000","last_change":"2023-11-24T06:12:00.413548+0000","last_active":"2023-11-24T06:12:01.792917+0000","last_peered":"2023-11-24T06:12:01.792917+0000","last_clean":"2023-11-24T06:12:01.792917+0000","last_became_active":"2023-11-24T06:12:00.413225+0000","last_became_peered":"2023-11-24T06:12:00.413225+0000","last_unstale":"2023-11-24T06:12:01.792917+0000","last_undegraded":"2023-11-24T06:12:01.792917+0000","last_fullsized":"2023-11-24T06:12:01.792917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792746+0000","last_change":"2023-11-24T06:12:00.415528+0000","last_active":"2023-11-24T06:12:01.792746+0000","last_peered":"2023-11-24T06:12:01.792746+0000","last_clean":"2023-11-24T06:12:01.792746+0000","last_became_active":"2023-11-24T06:12:00.414074+0000","last_became_peered":"2023-11-24T06:12:00.414074+0000","last_unstale":"2023-11-24T06:12:01.792746+0000","last_undegraded":"2023-11-24T06:12:01.792746+0000","last_fullsized":"2023-11-24T06:12:01.792746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814560+0000","last_change":"2023-11-24T06:12:00.412466+0000","last_active":"2023-11-24T06:12:01.814560+0000","last_peered":"2023-11-24T06:12:01.814560+0000","last_clean":"2023-11-24T06:12:01.814560+0000","last_became_active":"2023-11-24T06:12:00.412189+0000","last_became_peered":"2023-11-24T06:12:00.412189+0000","last_unstale":"2023-11-24T06:12:01.814560+0000","last_undegraded":"2023-11-24T06:12:01.814560+0000","last_fullsized":"2023-11-24T06:12:01.814560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:33.179248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384061+0000","last_change":"2023-11-24T06:12:00.410091+0000","last_active":"2023-11-24T06:12:01.384061+0000","last_peered":"2023-11-24T06:12:01.384061+0000","last_clean":"2023-11-24T06:12:01.384061+0000","last_became_active":"2023-11-24T06:12:00.409724+0000","last_became_peered":"2023-11-24T06:12:00.409724+0000","last_unstale":"2023-11-24T06:12:01.384061+0000","last_undegraded":"2023-11-24T06:12:01.384061+0000","last_fullsized":"2023-11-24T06:12:01.384061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811279+0000","last_change":"2023-11-24T06:12:00.413928+0000","last_active":"2023-11-24T06:12:01.811279+0000","last_peered":"2023-11-24T06:12:01.811279+0000","last_clean":"2023-11-24T06:12:01.811279+0000","last_became_active":"2023-11-24T06:12:00.408524+0000","last_became_peered":"2023-11-24T06:12:00.408524+0000","last_unstale":"2023-11-24T06:12:01.811279+0000","last_undegraded":"2023-11-24T06:12:01.811279+0000","last_fullsized":"2023-11-24T06:12:01.811279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:21.383018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385301+0000","last_change":"2023-11-24T06:12:00.414487+0000","last_active":"2023-11-24T06:12:01.385301+0000","last_peered":"2023-11-24T06:12:01.385301+0000","last_clean":"2023-11-24T06:12:01.385301+0000","last_became_active":"2023-11-24T06:12:00.412548+0000","last_became_peered":"2023-11-24T06:12:00.412548+0000","last_unstale":"2023-11-24T06:12:01.385301+0000","last_undegraded":"2023-11-24T06:12:01.385301+0000","last_fullsized":"2023-11-24T06:12:01.385301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:04.491629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.641036+0000","last_change":"2023-11-24T06:11:59.641036+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.641036+0000","last_undegraded":"2023-11-24T06:11:59.641036+0000","last_fullsized":"2023-11-24T06:11:59.641036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.635690+0000","last_change":"2023-11-24T06:11:59.635690+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.635690+0000","last_undegraded":"2023-11-24T06:11:59.635690+0000","last_fullsized":"2023-11-24T06:11:59.635690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812634+0000","last_change":"2023-11-24T06:12:00.415065+0000","last_active":"2023-11-24T06:12:01.812634+0000","last_peered":"2023-11-24T06:12:01.812634+0000","last_clean":"2023-11-24T06:12:01.812634+0000","last_became_active":"2023-11-24T06:12:00.414686+0000","last_became_peered":"2023-11-24T06:12:00.414686+0000","last_unstale":"2023-11-24T06:12:01.812634+0000","last_undegraded":"2023-11-24T06:12:01.812634+0000","last_fullsized":"2023-11-24T06:12:01.812634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.404241+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.403972+0000","last_became_peered":"2023-11-24T06:12:00.403972+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792421+0000","last_change":"2023-11-24T06:12:00.422094+0000","last_active":"2023-11-24T06:12:01.792421+0000","last_peered":"2023-11-24T06:12:01.792421+0000","last_clean":"2023-11-24T06:12:01.792421+0000","last_became_active":"2023-11-24T06:12:00.421724+0000","last_became_peered":"2023-11-24T06:12:00.421724+0000","last_unstale":"2023-11-24T06:12:01.792421+0000","last_undegraded":"2023-11-24T06:12:01.792421+0000","last_fullsized":"2023-11-24T06:12:01.792421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811370+0000","last_change":"2023-11-24T06:12:00.411570+0000","last_active":"2023-11-24T06:12:01.811370+0000","last_peered":"2023-11-24T06:12:01.811370+0000","last_clean":"2023-11-24T06:12:01.811370+0000","last_became_active":"2023-11-24T06:12:00.411118+0000","last_became_peered":"2023-11-24T06:12:00.411118+0000","last_unstale":"2023-11-24T06:12:01.811370+0000","last_undegraded":"2023-11-24T06:12:01.811370+0000","last_fullsized":"2023-11-24T06:12:01.811370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:15.863418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.634866+0000","last_change":"2023-11-24T06:11:59.634866+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.634866+0000","last_undegraded":"2023-11-24T06:11:59.634866+0000","last_fullsized":"2023-11-24T06:11:59.634866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383318+0000","last_change":"2023-11-24T06:12:00.410431+0000","last_active":"2023-11-24T06:12:01.383318+0000","last_peered":"2023-11-24T06:12:01.383318+0000","last_clean":"2023-11-24T06:12:01.383318+0000","last_became_active":"2023-11-24T06:12:00.410132+0000","last_became_peered":"2023-11-24T06:12:00.410132+0000","last_unstale":"2023-11-24T06:12:01.383318+0000","last_undegraded":"2023-11-24T06:12:01.383318+0000","last_fullsized":"2023-11-24T06:12:01.383318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.636236+0000","last_change":"2023-11-24T06:11:59.636236+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.636236+0000","last_undegraded":"2023-11-24T06:11:59.636236+0000","last_fullsized":"2023-11-24T06:11:59.636236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384663+0000","last_change":"2023-11-24T06:12:00.419798+0000","last_active":"2023-11-24T06:12:01.384663+0000","last_peered":"2023-11-24T06:12:01.384663+0000","last_clean":"2023-11-24T06:12:01.384663+0000","last_became_active":"2023-11-24T06:12:00.419568+0000","last_became_peered":"2023-11-24T06:12:00.419568+0000","last_unstale":"2023-11-24T06:12:01.384663+0000","last_undegraded":"2023-11-24T06:12:01.384663+0000","last_fullsized":"2023-11-24T06:12:01.384663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.793026+0000","last_change":"2023-11-24T06:12:00.412430+0000","last_active":"2023-11-24T06:12:01.793026+0000","last_peered":"2023-11-24T06:12:01.793026+0000","last_clean":"2023-11-24T06:12:01.793026+0000","last_became_active":"2023-11-24T06:12:00.411971+0000","last_became_peered":"2023-11-24T06:12:00.411971+0000","last_unstale":"2023-11-24T06:12:01.793026+0000","last_undegraded":"2023-11-24T06:12:01.793026+0000","last_fullsized":"2023-11-24T06:12:01.793026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385763+0000","last_change":"2023-11-24T06:12:00.414558+0000","last_active":"2023-11-24T06:12:01.385763+0000","last_peered":"2023-11-24T06:12:01.385763+0000","last_clean":"2023-11-24T06:12:01.385763+0000","last_became_active":"2023-11-24T06:12:00.414279+0000","last_became_peered":"2023-11-24T06:12:00.414279+0000","last_unstale":"2023-11-24T06:12:01.385763+0000","last_undegraded":"2023-11-24T06:12:01.385763+0000","last_fullsized":"2023-11-24T06:12:01.385763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:00.298898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384237+0000","last_change":"2023-11-24T06:12:00.423044+0000","last_active":"2023-11-24T06:12:01.384237+0000","last_peered":"2023-11-24T06:12:01.384237+0000","last_clean":"2023-11-24T06:12:01.384237+0000","last_became_active":"2023-11-24T06:12:00.422684+0000","last_became_peered":"2023-11-24T06:12:00.422684+0000","last_unstale":"2023-11-24T06:12:01.384237+0000","last_undegraded":"2023-11-24T06:12:01.384237+0000","last_fullsized":"2023-11-24T06:12:01.384237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811420+0000","last_change":"2023-11-24T06:12:00.406540+0000","last_active":"2023-11-24T06:12:01.811420+0000","last_peered":"2023-11-24T06:12:01.811420+0000","last_clean":"2023-11-24T06:12:01.811420+0000","last_became_active":"2023-11-24T06:12:00.406115+0000","last_became_peered":"2023-11-24T06:12:00.406115+0000","last_unstale":"2023-11-24T06:12:01.811420+0000","last_undegraded":"2023-11-24T06:12:01.811420+0000","last_fullsized":"2023-11-24T06:12:01.811420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.632627+0000","last_change":"2023-11-24T06:11:59.632627+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.632627+0000","last_undegraded":"2023-11-24T06:11:59.632627+0000","last_fullsized":"2023-11-24T06:11:59.632627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812046+0000","last_change":"2023-11-24T06:12:00.413545+0000","last_active":"2023-11-24T06:12:01.812046+0000","last_peered":"2023-11-24T06:12:01.812046+0000","last_clean":"2023-11-24T06:12:01.812046+0000","last_became_active":"2023-11-24T06:12:00.411644+0000","last_became_peered":"2023-11-24T06:12:00.411644+0000","last_unstale":"2023-11-24T06:12:01.812046+0000","last_undegraded":"2023-11-24T06:12:01.812046+0000","last_fullsized":"2023-11-24T06:12:01.812046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792092+0000","last_change":"2023-11-24T06:12:00.411309+0000","last_active":"2023-11-24T06:12:01.792092+0000","last_peered":"2023-11-24T06:12:01.792092+0000","last_clean":"2023-11-24T06:12:01.792092+0000","last_became_active":"2023-11-24T06:12:00.409967+0000","last_became_peered":"2023-11-24T06:12:00.409967+0000","last_unstale":"2023-11-24T06:12:01.792092+0000","last_undegraded":"2023-11-24T06:12:01.792092+0000","last_fullsized":"2023-11-24T06:12:01.792092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814781+0000","last_change":"2023-11-24T06:12:00.417149+0000","last_active":"2023-11-24T06:12:01.814781+0000","last_peered":"2023-11-24T06:12:01.814781+0000","last_clean":"2023-11-24T06:12:01.814781+0000","last_became_active":"2023-11-24T06:12:00.410529+0000","last_became_peered":"2023-11-24T06:12:00.410529+0000","last_unstale":"2023-11-24T06:12:01.814781+0000","last_undegraded":"2023-11-24T06:12:01.814781+0000","last_fullsized":"2023-11-24T06:12:01.814781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654819+0000","last_change":"2023-11-24T06:11:59.645470+0000","last_active":"2023-11-24T06:12:00.654819+0000","last_peered":"2023-11-24T06:12:00.654819+0000","last_clean":"2023-11-24T06:12:00.654819+0000","last_became_active":"2023-11-24T06:11:59.644424+0000","last_became_peered":"2023-11-24T06:11:59.644424+0000","last_unstale":"2023-11-24T06:12:00.654819+0000","last_undegraded":"2023-11-24T06:12:00.654819+0000","last_fullsized":"2023-11-24T06:12:00.654819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811571+0000","last_change":"2023-11-24T06:12:00.421116+0000","last_active":"2023-11-24T06:12:01.811571+0000","last_peered":"2023-11-24T06:12:01.811571+0000","last_clean":"2023-11-24T06:12:01.811571+0000","last_became_active":"2023-11-24T06:12:00.420793+0000","last_became_peered":"2023-11-24T06:12:00.420793+0000","last_unstale":"2023-11-24T06:12:01.811571+0000","last_undegraded":"2023-11-24T06:12:01.811571+0000","last_fullsized":"2023-11-24T06:12:01.811571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654126+0000","last_change":"2023-11-24T06:11:59.657132+0000","last_active":"2023-11-24T06:12:00.654126+0000","last_peered":"2023-11-24T06:12:00.654126+0000","last_clean":"2023-11-24T06:12:00.654126+0000","last_became_active":"2023-11-24T06:11:59.656475+0000","last_became_peered":"2023-11-24T06:11:59.656475+0000","last_unstale":"2023-11-24T06:12:00.654126+0000","last_undegraded":"2023-11-24T06:12:00.654126+0000","last_fullsized":"2023-11-24T06:12:00.654126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.392519+0000","last_change":"2023-11-24T06:11:59.647264+0000","last_active":"2023-11-24T06:12:00.392519+0000","last_peered":"2023-11-24T06:12:00.392519+0000","last_clean":"2023-11-24T06:12:00.392519+0000","last_became_active":"2023-11-24T06:11:59.646951+0000","last_became_peered":"2023-11-24T06:11:59.646951+0000","last_unstale":"2023-11-24T06:12:00.392519+0000","last_undegraded":"2023-11-24T06:12:00.392519+0000","last_fullsized":"2023-11-24T06:12:00.392519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383246+0000","last_change":"2023-11-24T06:12:00.410276+0000","last_active":"2023-11-24T06:12:01.383246+0000","last_peered":"2023-11-24T06:12:01.383246+0000","last_clean":"2023-11-24T06:12:01.383246+0000","last_became_active":"2023-11-24T06:12:00.407839+0000","last_became_peered":"2023-11-24T06:12:00.407839+0000","last_unstale":"2023-11-24T06:12:01.383246+0000","last_undegraded":"2023-11-24T06:12:01.383246+0000","last_fullsized":"2023-11-24T06:12:01.383246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.661328+0000","last_change":"2023-11-24T06:11:59.656673+0000","last_active":"2023-11-24T06:11:59.661328+0000","last_peered":"2023-11-24T06:11:59.661328+0000","last_clean":"2023-11-24T06:11:59.661328+0000","last_became_active":"2023-11-24T06:11:59.656322+0000","last_became_peered":"2023-11-24T06:11:59.656322+0000","last_unstale":"2023-11-24T06:11:59.661328+0000","last_undegraded":"2023-11-24T06:11:59.661328+0000","last_fullsized":"2023-11-24T06:11:59.661328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:33:03.536712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385041+0000","last_change":"2023-11-24T06:12:00.411377+0000","last_active":"2023-11-24T06:12:01.385041+0000","last_peered":"2023-11-24T06:12:01.385041+0000","last_clean":"2023-11-24T06:12:01.385041+0000","last_became_active":"2023-11-24T06:12:00.411117+0000","last_became_peered":"2023-11-24T06:12:00.411117+0000","last_unstale":"2023-11-24T06:12:01.385041+0000","last_undegraded":"2023-11-24T06:12:01.385041+0000","last_fullsized":"2023-11-24T06:12:01.385041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:55.958831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.404314+0000","last_change":"2023-11-24T06:11:59.652584+0000","last_active":"2023-11-24T06:12:00.404314+0000","last_peered":"2023-11-24T06:12:00.404314+0000","last_clean":"2023-11-24T06:12:00.404314+0000","last_became_active":"2023-11-24T06:11:59.652269+0000","last_became_peered":"2023-11-24T06:11:59.652269+0000","last_unstale":"2023-11-24T06:12:00.404314+0000","last_undegraded":"2023-11-24T06:12:00.404314+0000","last_fullsized":"2023-11-24T06:12:00.404314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.631645+0000","last_change":"2023-11-24T06:11:59.631645+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.631645+0000","last_undegraded":"2023-11-24T06:11:59.631645+0000","last_fullsized":"2023-11-24T06:11:59.631645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.655388+0000","last_change":"2023-11-24T06:11:59.649342+0000","last_active":"2023-11-24T06:11:59.655388+0000","last_peered":"2023-11-24T06:11:59.655388+0000","last_clean":"2023-11-24T06:11:59.655388+0000","last_became_active":"2023-11-24T06:11:59.649022+0000","last_became_peered":"2023-11-24T06:11:59.649022+0000","last_unstale":"2023-11-24T06:11:59.655388+0000","last_undegraded":"2023-11-24T06:11:59.655388+0000","last_fullsized":"2023-11-24T06:11:59.655388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:12:45.266944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812025+0000","last_change":"2023-11-24T06:12:00.418160+0000","last_active":"2023-11-24T06:12:01.812025+0000","last_peered":"2023-11-24T06:12:01.812025+0000","last_clean":"2023-11-24T06:12:01.812025+0000","last_became_active":"2023-11-24T06:12:00.417836+0000","last_became_peered":"2023-11-24T06:12:00.417836+0000","last_unstale":"2023-11-24T06:12:01.812025+0000","last_undegraded":"2023-11-24T06:12:01.812025+0000","last_fullsized":"2023-11-24T06:12:01.812025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385956+0000","last_change":"2023-11-24T06:11:59.644472+0000","last_active":"2023-11-24T06:12:01.385956+0000","last_peered":"2023-11-24T06:12:01.385956+0000","last_clean":"2023-11-24T06:12:01.385956+0000","last_became_active":"2023-11-24T06:11:59.644152+0000","last_became_peered":"2023-11-24T06:11:59.644152+0000","last_unstale":"2023-11-24T06:12:01.385956+0000","last_undegraded":"2023-11-24T06:12:01.385956+0000","last_fullsized":"2023-11-24T06:12:01.385956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:50.982166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814768+0000","last_change":"2023-11-24T06:12:00.411893+0000","last_active":"2023-11-24T06:12:01.814768+0000","last_peered":"2023-11-24T06:12:01.814768+0000","last_clean":"2023-11-24T06:12:01.814768+0000","last_became_active":"2023-11-24T06:12:00.411029+0000","last_became_peered":"2023-11-24T06:12:00.411029+0000","last_unstale":"2023-11-24T06:12:01.814768+0000","last_undegraded":"2023-11-24T06:12:01.814768+0000","last_fullsized":"2023-11-24T06:12:01.814768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:01.536292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.658392+0000","last_change":"2023-11-24T06:11:59.648134+0000","last_active":"2023-11-24T06:12:00.658392+0000","last_peered":"2023-11-24T06:12:00.658392+0000","last_clean":"2023-11-24T06:12:00.658392+0000","last_became_active":"2023-11-24T06:11:59.647824+0000","last_became_peered":"2023-11-24T06:11:59.647824+0000","last_unstale":"2023-11-24T06:12:00.658392+0000","last_undegraded":"2023-11-24T06:12:00.658392+0000","last_fullsized":"2023-11-24T06:12:00.658392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385778+0000","last_change":"2023-11-24T06:12:00.417420+0000","last_active":"2023-11-24T06:12:01.385778+0000","last_peered":"2023-11-24T06:12:01.385778+0000","last_clean":"2023-11-24T06:12:01.385778+0000","last_became_active":"2023-11-24T06:12:00.416624+0000","last_became_peered":"2023-11-24T06:12:00.416624+0000","last_unstale":"2023-11-24T06:12:01.385778+0000","last_undegraded":"2023-11-24T06:12:01.385778+0000","last_fullsized":"2023-11-24T06:12:01.385778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656684+0000","last_change":"2023-11-24T06:11:59.650532+0000","last_active":"2023-11-24T06:12:00.656684+0000","last_peered":"2023-11-24T06:12:00.656684+0000","last_clean":"2023-11-24T06:12:00.656684+0000","last_became_active":"2023-11-24T06:11:59.650193+0000","last_became_peered":"2023-11-24T06:11:59.650193+0000","last_unstale":"2023-11-24T06:12:00.656684+0000","last_undegraded":"2023-11-24T06:12:00.656684+0000","last_fullsized":"2023-11-24T06:12:00.656684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811425+0000","last_change":"2023-11-24T06:12:00.411372+0000","last_active":"2023-11-24T06:12:01.811425+0000","last_peered":"2023-11-24T06:12:01.811425+0000","last_clean":"2023-11-24T06:12:01.811425+0000","last_became_active":"2023-11-24T06:12:00.410699+0000","last_became_peered":"2023-11-24T06:12:00.410699+0000","last_unstale":"2023-11-24T06:12:01.811425+0000","last_undegraded":"2023-11-24T06:12:01.811425+0000","last_fullsized":"2023-11-24T06:12:01.811425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.655458+0000","last_change":"2023-11-24T06:11:59.650677+0000","last_active":"2023-11-24T06:11:59.655458+0000","last_peered":"2023-11-24T06:11:59.655458+0000","last_clean":"2023-11-24T06:11:59.655458+0000","last_became_active":"2023-11-24T06:11:59.650368+0000","last_became_peered":"2023-11-24T06:11:59.650368+0000","last_unstale":"2023-11-24T06:11:59.655458+0000","last_undegraded":"2023-11-24T06:11:59.655458+0000","last_fullsized":"2023-11-24T06:11:59.655458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386237+0000","last_change":"2023-11-24T06:12:00.409066+0000","last_active":"2023-11-24T06:12:01.386237+0000","last_peered":"2023-11-24T06:12:01.386237+0000","last_clean":"2023-11-24T06:12:01.386237+0000","last_became_active":"2023-11-24T06:12:00.408722+0000","last_became_peered":"2023-11-24T06:12:00.408722+0000","last_unstale":"2023-11-24T06:12:01.386237+0000","last_undegraded":"2023-11-24T06:12:01.386237+0000","last_fullsized":"2023-11-24T06:12:01.386237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.399698+0000","last_change":"2023-11-24T06:11:59.653443+0000","last_active":"2023-11-24T06:12:00.399698+0000","last_peered":"2023-11-24T06:12:00.399698+0000","last_clean":"2023-11-24T06:12:00.399698+0000","last_became_active":"2023-11-24T06:11:59.653091+0000","last_became_peered":"2023-11-24T06:11:59.653091+0000","last_unstale":"2023-11-24T06:12:00.399698+0000","last_undegraded":"2023-11-24T06:12:00.399698+0000","last_fullsized":"2023-11-24T06:12:00.399698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792087+0000","last_change":"2023-11-24T06:12:00.415948+0000","last_active":"2023-11-24T06:12:01.792087+0000","last_peered":"2023-11-24T06:12:01.792087+0000","last_clean":"2023-11-24T06:12:01.792087+0000","last_became_active":"2023-11-24T06:12:00.415597+0000","last_became_peered":"2023-11-24T06:12:00.415597+0000","last_unstale":"2023-11-24T06:12:01.792087+0000","last_undegraded":"2023-11-24T06:12:01.792087+0000","last_fullsized":"2023-11-24T06:12:01.792087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648785+0000","last_change":"2023-11-24T06:11:59.620020+0000","last_active":"2023-11-24T06:12:00.648785+0000","last_peered":"2023-11-24T06:12:00.648785+0000","last_clean":"2023-11-24T06:12:00.648785+0000","last_became_active":"2023-11-24T06:11:59.619675+0000","last_became_peered":"2023-11-24T06:11:59.619675+0000","last_unstale":"2023-11-24T06:12:00.648785+0000","last_undegraded":"2023-11-24T06:12:00.648785+0000","last_fullsized":"2023-11-24T06:12:00.648785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385713+0000","last_change":"2023-11-24T06:12:00.412328+0000","last_active":"2023-11-24T06:12:01.385713+0000","last_peered":"2023-11-24T06:12:01.385713+0000","last_clean":"2023-11-24T06:12:01.385713+0000","last_became_active":"2023-11-24T06:12:00.412057+0000","last_became_peered":"2023-11-24T06:12:00.412057+0000","last_unstale":"2023-11-24T06:12:01.385713+0000","last_undegraded":"2023-11-24T06:12:01.385713+0000","last_fullsized":"2023-11-24T06:12:01.385713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.650279+0000","last_change":"2023-11-24T06:11:59.650120+0000","last_active":"2023-11-24T06:12:00.650279+0000","last_peered":"2023-11-24T06:12:00.650279+0000","last_clean":"2023-11-24T06:12:00.650279+0000","last_became_active":"2023-11-24T06:11:59.647975+0000","last_became_peered":"2023-11-24T06:11:59.647975+0000","last_unstale":"2023-11-24T06:12:00.650279+0000","last_undegraded":"2023-11-24T06:12:00.650279+0000","last_fullsized":"2023-11-24T06:12:00.650279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.407351+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.406978+0000","last_became_peered":"2023-11-24T06:12:00.406978+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648323+0000","last_change":"2023-11-24T06:11:59.628459+0000","last_active":"2023-11-24T06:12:00.648323+0000","last_peered":"2023-11-24T06:12:00.648323+0000","last_clean":"2023-11-24T06:12:00.648323+0000","last_became_active":"2023-11-24T06:11:59.628147+0000","last_became_peered":"2023-11-24T06:11:59.628147+0000","last_unstale":"2023-11-24T06:12:00.648323+0000","last_undegraded":"2023-11-24T06:12:00.648323+0000","last_fullsized":"2023-11-24T06:12:00.648323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387133+0000","last_change":"2023-11-24T06:12:00.424920+0000","last_active":"2023-11-24T06:12:01.387133+0000","last_peered":"2023-11-24T06:12:01.387133+0000","last_clean":"2023-11-24T06:12:01.387133+0000","last_became_active":"2023-11-24T06:12:00.423927+0000","last_became_peered":"2023-11-24T06:12:00.423927+0000","last_unstale":"2023-11-24T06:12:01.387133+0000","last_undegraded":"2023-11-24T06:12:01.387133+0000","last_fullsized":"2023-11-24T06:12:01.387133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:54:14.921315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:11:59.643977+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:11:59.643552+0000","last_became_peered":"2023-11-24T06:11:59.643552+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:02.323910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.636264+0000","last_change":"2023-11-24T06:11:59.636264+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.636264+0000","last_undegraded":"2023-11-24T06:11:59.636264+0000","last_fullsized":"2023-11-24T06:11:59.636264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379381+0000","last_change":"2023-11-24T06:11:59.643121+0000","last_active":"2023-11-24T06:12:00.379381+0000","last_peered":"2023-11-24T06:12:00.379381+0000","last_clean":"2023-11-24T06:12:00.379381+0000","last_became_active":"2023-11-24T06:11:59.642797+0000","last_became_peered":"2023-11-24T06:11:59.642797+0000","last_unstale":"2023-11-24T06:12:00.379381+0000","last_undegraded":"2023-11-24T06:12:00.379381+0000","last_fullsized":"2023-11-24T06:12:00.379381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386156+0000","last_change":"2023-11-24T06:12:00.417716+0000","last_active":"2023-11-24T06:12:01.386156+0000","last_peered":"2023-11-24T06:12:01.386156+0000","last_clean":"2023-11-24T06:12:01.386156+0000","last_became_active":"2023-11-24T06:12:00.417088+0000","last_became_peered":"2023-11-24T06:12:00.417088+0000","last_unstale":"2023-11-24T06:12:01.386156+0000","last_undegraded":"2023-11-24T06:12:01.386156+0000","last_fullsized":"2023-11-24T06:12:01.386156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383162+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:12:00.383162+0000","last_peered":"2023-11-24T06:12:00.383162+0000","last_clean":"2023-11-24T06:12:00.383162+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:12:00.383162+0000","last_undegraded":"2023-11-24T06:12:00.383162+0000","last_fullsized":"2023-11-24T06:12:00.383162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.655438+0000","last_change":"2023-11-24T06:11:59.649393+0000","last_active":"2023-11-24T06:11:59.655438+0000","last_peered":"2023-11-24T06:11:59.655438+0000","last_clean":"2023-11-24T06:11:59.655438+0000","last_became_active":"2023-11-24T06:11:59.649045+0000","last_became_peered":"2023-11-24T06:11:59.649045+0000","last_unstale":"2023-11-24T06:11:59.655438+0000","last_undegraded":"2023-11-24T06:11:59.655438+0000","last_fullsized":"2023-11-24T06:11:59.655438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383623+0000","last_change":"2023-11-24T06:12:00.417107+0000","last_active":"2023-11-24T06:12:01.383623+0000","last_peered":"2023-11-24T06:12:01.383623+0000","last_clean":"2023-11-24T06:12:01.383623+0000","last_became_active":"2023-11-24T06:12:00.416181+0000","last_became_peered":"2023-11-24T06:12:00.416181+0000","last_unstale":"2023-11-24T06:12:01.383623+0000","last_undegraded":"2023-11-24T06:12:01.383623+0000","last_fullsized":"2023-11-24T06:12:01.383623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383049+0000","last_change":"2023-11-24T06:11:59.641692+0000","last_active":"2023-11-24T06:12:00.383049+0000","last_peered":"2023-11-24T06:12:00.383049+0000","last_clean":"2023-11-24T06:12:00.383049+0000","last_became_active":"2023-11-24T06:11:59.641199+0000","last_became_peered":"2023-11-24T06:11:59.641199+0000","last_unstale":"2023-11-24T06:12:00.383049+0000","last_undegraded":"2023-11-24T06:12:00.383049+0000","last_fullsized":"2023-11-24T06:12:00.383049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811125+0000","last_change":"2023-11-24T06:12:00.421725+0000","last_active":"2023-11-24T06:12:01.811125+0000","last_peered":"2023-11-24T06:12:01.811125+0000","last_clean":"2023-11-24T06:12:01.811125+0000","last_became_active":"2023-11-24T06:12:00.421402+0000","last_became_peered":"2023-11-24T06:12:00.421402+0000","last_unstale":"2023-11-24T06:12:01.811125+0000","last_undegraded":"2023-11-24T06:12:01.811125+0000","last_fullsized":"2023-11-24T06:12:01.811125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:16.430001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379330+0000","last_change":"2023-11-24T06:11:59.628457+0000","last_active":"2023-11-24T06:12:00.379330+0000","last_peered":"2023-11-24T06:12:00.379330+0000","last_clean":"2023-11-24T06:12:00.379330+0000","last_became_active":"2023-11-24T06:11:59.628109+0000","last_became_peered":"2023-11-24T06:11:59.628109+0000","last_unstale":"2023-11-24T06:12:00.379330+0000","last_undegraded":"2023-11-24T06:12:00.379330+0000","last_fullsized":"2023-11-24T06:12:00.379330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385318+0000","last_change":"2023-11-24T06:12:00.406591+0000","last_active":"2023-11-24T06:12:01.385318+0000","last_peered":"2023-11-24T06:12:01.385318+0000","last_clean":"2023-11-24T06:12:01.385318+0000","last_became_active":"2023-11-24T06:12:00.406217+0000","last_became_peered":"2023-11-24T06:12:00.406217+0000","last_unstale":"2023-11-24T06:12:01.385318+0000","last_undegraded":"2023-11-24T06:12:01.385318+0000","last_fullsized":"2023-11-24T06:12:01.385318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:49.548969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.652345+0000","last_change":"2023-11-24T06:11:59.645058+0000","last_active":"2023-11-24T06:11:59.652345+0000","last_peered":"2023-11-24T06:11:59.652345+0000","last_clean":"2023-11-24T06:11:59.652345+0000","last_became_active":"2023-11-24T06:11:59.642696+0000","last_became_peered":"2023-11-24T06:11:59.642696+0000","last_unstale":"2023-11-24T06:11:59.652345+0000","last_undegraded":"2023-11-24T06:11:59.652345+0000","last_fullsized":"2023-11-24T06:11:59.652345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:43.070876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.815366+0000","last_change":"2023-11-24T06:12:00.415699+0000","last_active":"2023-11-24T06:12:01.815366+0000","last_peered":"2023-11-24T06:12:01.815366+0000","last_clean":"2023-11-24T06:12:01.815366+0000","last_became_active":"2023-11-24T06:12:00.412274+0000","last_became_peered":"2023-11-24T06:12:00.412274+0000","last_unstale":"2023-11-24T06:12:01.815366+0000","last_undegraded":"2023-11-24T06:12:01.815366+0000","last_fullsized":"2023-11-24T06:12:01.815366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385632+0000","last_change":"2023-11-24T06:11:59.633842+0000","last_active":"2023-11-24T06:12:01.385632+0000","last_peered":"2023-11-24T06:12:01.385632+0000","last_clean":"2023-11-24T06:12:01.385632+0000","last_became_active":"2023-11-24T06:11:59.632890+0000","last_became_peered":"2023-11-24T06:11:59.632890+0000","last_unstale":"2023-11-24T06:12:01.385632+0000","last_undegraded":"2023-11-24T06:12:01.385632+0000","last_fullsized":"2023-11-24T06:12:01.385632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:00.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.637570+0000","last_change":"2023-11-24T06:11:59.637570+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.637570+0000","last_undegraded":"2023-11-24T06:11:59.637570+0000","last_fullsized":"2023-11-24T06:11:59.637570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.389114+0000","last_change":"2023-11-24T06:11:59.644082+0000","last_active":"2023-11-24T06:12:00.389114+0000","last_peered":"2023-11-24T06:12:00.389114+0000","last_clean":"2023-11-24T06:12:00.389114+0000","last_became_active":"2023-11-24T06:11:59.640160+0000","last_became_peered":"2023-11-24T06:11:59.640160+0000","last_unstale":"2023-11-24T06:12:00.389114+0000","last_undegraded":"2023-11-24T06:12:00.389114+0000","last_fullsized":"2023-11-24T06:12:00.389114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385733+0000","last_change":"2023-11-24T06:12:00.406268+0000","last_active":"2023-11-24T06:12:01.385733+0000","last_peered":"2023-11-24T06:12:01.385733+0000","last_clean":"2023-11-24T06:12:01.385733+0000","last_became_active":"2023-11-24T06:12:00.405965+0000","last_became_peered":"2023-11-24T06:12:00.405965+0000","last_unstale":"2023-11-24T06:12:01.385733+0000","last_undegraded":"2023-11-24T06:12:01.385733+0000","last_fullsized":"2023-11-24T06:12:01.385733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:42.193371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386128+0000","last_change":"2023-11-24T06:11:59.645602+0000","last_active":"2023-11-24T06:12:01.386128+0000","last_peered":"2023-11-24T06:12:01.386128+0000","last_clean":"2023-11-24T06:12:01.386128+0000","last_became_active":"2023-11-24T06:11:59.645312+0000","last_became_peered":"2023-11-24T06:11:59.645312+0000","last_unstale":"2023-11-24T06:12:01.386128+0000","last_undegraded":"2023-11-24T06:12:01.386128+0000","last_fullsized":"2023-11-24T06:12:01.386128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:43.860695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384670+0000","last_change":"2023-11-24T06:12:00.417986+0000","last_active":"2023-11-24T06:12:01.384670+0000","last_peered":"2023-11-24T06:12:01.384670+0000","last_clean":"2023-11-24T06:12:01.384670+0000","last_became_active":"2023-11-24T06:12:00.417578+0000","last_became_peered":"2023-11-24T06:12:00.417578+0000","last_unstale":"2023-11-24T06:12:01.384670+0000","last_undegraded":"2023-11-24T06:12:01.384670+0000","last_fullsized":"2023-11-24T06:12:01.384670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656198+0000","last_change":"2023-11-24T06:11:59.648128+0000","last_active":"2023-11-24T06:12:00.656198+0000","last_peered":"2023-11-24T06:12:00.656198+0000","last_clean":"2023-11-24T06:12:00.656198+0000","last_became_active":"2023-11-24T06:11:59.647817+0000","last_became_peered":"2023-11-24T06:11:59.647817+0000","last_unstale":"2023-11-24T06:12:00.656198+0000","last_undegraded":"2023-11-24T06:12:00.656198+0000","last_fullsized":"2023-11-24T06:12:00.656198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812611+0000","last_change":"2023-11-24T06:12:00.407315+0000","last_active":"2023-11-24T06:12:01.812611+0000","last_peered":"2023-11-24T06:12:01.812611+0000","last_clean":"2023-11-24T06:12:01.812611+0000","last_became_active":"2023-11-24T06:12:00.406966+0000","last_became_peered":"2023-11-24T06:12:00.406966+0000","last_unstale":"2023-11-24T06:12:01.812611+0000","last_undegraded":"2023-11-24T06:12:01.812611+0000","last_fullsized":"2023-11-24T06:12:01.812611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.382934+0000","last_change":"2023-11-24T06:11:59.641473+0000","last_active":"2023-11-24T06:12:00.382934+0000","last_peered":"2023-11-24T06:12:00.382934+0000","last_clean":"2023-11-24T06:12:00.382934+0000","last_became_active":"2023-11-24T06:11:59.640882+0000","last_became_peered":"2023-11-24T06:11:59.640882+0000","last_unstale":"2023-11-24T06:12:00.382934+0000","last_undegraded":"2023-11-24T06:12:00.382934+0000","last_fullsized":"2023-11-24T06:12:00.382934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:15.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814297+0000","last_change":"2023-11-24T06:12:00.420629+0000","last_active":"2023-11-24T06:12:01.814297+0000","last_peered":"2023-11-24T06:12:01.814297+0000","last_clean":"2023-11-24T06:12:01.814297+0000","last_became_active":"2023-11-24T06:12:00.420121+0000","last_became_peered":"2023-11-24T06:12:00.420121+0000","last_unstale":"2023-11-24T06:12:01.814297+0000","last_undegraded":"2023-11-24T06:12:01.814297+0000","last_fullsized":"2023-11-24T06:12:01.814297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:16.361272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385138+0000","last_change":"2023-11-24T06:11:59.642028+0000","last_active":"2023-11-24T06:12:01.385138+0000","last_peered":"2023-11-24T06:12:01.385138+0000","last_clean":"2023-11-24T06:12:01.385138+0000","last_became_active":"2023-11-24T06:11:59.641734+0000","last_became_peered":"2023-11-24T06:11:59.641734+0000","last_unstale":"2023-11-24T06:12:01.385138+0000","last_undegraded":"2023-11-24T06:12:01.385138+0000","last_fullsized":"2023-11-24T06:12:01.385138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:44.578653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384138+0000","last_change":"2023-11-24T06:12:00.410266+0000","last_active":"2023-11-24T06:12:01.384138+0000","last_peered":"2023-11-24T06:12:01.384138+0000","last_clean":"2023-11-24T06:12:01.384138+0000","last_became_active":"2023-11-24T06:12:00.409968+0000","last_became_peered":"2023-11-24T06:12:00.409968+0000","last_unstale":"2023-11-24T06:12:01.384138+0000","last_undegraded":"2023-11-24T06:12:01.384138+0000","last_fullsized":"2023-11-24T06:12:01.384138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385736+0000","last_change":"2023-11-24T06:11:59.630765+0000","last_active":"2023-11-24T06:12:01.385736+0000","last_peered":"2023-11-24T06:12:01.385736+0000","last_clean":"2023-11-24T06:12:01.385736+0000","last_became_active":"2023-11-24T06:11:59.629875+0000","last_became_peered":"2023-11-24T06:11:59.629875+0000","last_unstale":"2023-11-24T06:12:01.385736+0000","last_undegraded":"2023-11-24T06:12:01.385736+0000","last_fullsized":"2023-11-24T06:12:01.385736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:19.421623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384213+0000","last_change":"2023-11-24T06:12:00.408041+0000","last_active":"2023-11-24T06:12:01.384213+0000","last_peered":"2023-11-24T06:12:01.384213+0000","last_clean":"2023-11-24T06:12:01.384213+0000","last_became_active":"2023-11-24T06:12:00.407616+0000","last_became_peered":"2023-11-24T06:12:00.407616+0000","last_unstale":"2023-11-24T06:12:01.384213+0000","last_undegraded":"2023-11-24T06:12:01.384213+0000","last_fullsized":"2023-11-24T06:12:01.384213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656982+0000","last_change":"2023-11-24T06:11:59.652850+0000","last_active":"2023-11-24T06:12:00.656982+0000","last_peered":"2023-11-24T06:12:00.656982+0000","last_clean":"2023-11-24T06:12:00.656982+0000","last_became_active":"2023-11-24T06:11:59.652583+0000","last_became_peered":"2023-11-24T06:11:59.652583+0000","last_unstale":"2023-11-24T06:12:00.656982+0000","last_undegraded":"2023-11-24T06:12:00.656982+0000","last_fullsized":"2023-11-24T06:12:00.656982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792109+0000","last_change":"2023-11-24T06:12:00.408854+0000","last_active":"2023-11-24T06:12:01.792109+0000","last_peered":"2023-11-24T06:12:01.792109+0000","last_clean":"2023-11-24T06:12:01.792109+0000","last_became_active":"2023-11-24T06:12:00.408541+0000","last_became_peered":"2023-11-24T06:12:00.408541+0000","last_unstale":"2023-11-24T06:12:01.792109+0000","last_undegraded":"2023-11-24T06:12:01.792109+0000","last_fullsized":"2023-11-24T06:12:01.792109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.638814+0000","last_change":"2023-11-24T06:11:59.638814+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.638814+0000","last_undegraded":"2023-11-24T06:11:59.638814+0000","last_fullsized":"2023-11-24T06:11:59.638814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.655824+0000","last_change":"2023-11-24T06:11:59.649445+0000","last_active":"2023-11-24T06:12:00.655824+0000","last_peered":"2023-11-24T06:12:00.655824+0000","last_clean":"2023-11-24T06:12:00.655824+0000","last_became_active":"2023-11-24T06:11:59.649024+0000","last_became_peered":"2023-11-24T06:11:59.649024+0000","last_unstale":"2023-11-24T06:12:00.655824+0000","last_undegraded":"2023-11-24T06:12:00.655824+0000","last_fullsized":"2023-11-24T06:12:00.655824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.639094+0000","last_change":"2023-11-24T06:11:59.639094+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.639094+0000","last_undegraded":"2023-11-24T06:11:59.639094+0000","last_fullsized":"2023-11-24T06:11:59.639094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656014+0000","last_change":"2023-11-24T06:11:59.648255+0000","last_active":"2023-11-24T06:12:00.656014+0000","last_peered":"2023-11-24T06:12:00.656014+0000","last_clean":"2023-11-24T06:12:00.656014+0000","last_became_active":"2023-11-24T06:11:59.647961+0000","last_became_peered":"2023-11-24T06:11:59.647961+0000","last_unstale":"2023-11-24T06:12:00.656014+0000","last_undegraded":"2023-11-24T06:12:00.656014+0000","last_fullsized":"2023-11-24T06:12:00.656014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811821+0000","last_change":"2023-11-24T06:12:00.415607+0000","last_active":"2023-11-24T06:12:01.811821+0000","last_peered":"2023-11-24T06:12:01.811821+0000","last_clean":"2023-11-24T06:12:01.811821+0000","last_became_active":"2023-11-24T06:12:00.415309+0000","last_became_peered":"2023-11-24T06:12:00.415309+0000","last_unstale":"2023-11-24T06:12:01.811821+0000","last_undegraded":"2023-11-24T06:12:01.811821+0000","last_fullsized":"2023-11-24T06:12:01.811821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.646459+0000","last_change":"2023-11-24T06:11:59.634657+0000","last_active":"2023-11-24T06:12:00.646459+0000","last_peered":"2023-11-24T06:12:00.646459+0000","last_clean":"2023-11-24T06:12:00.646459+0000","last_became_active":"2023-11-24T06:11:59.634335+0000","last_became_peered":"2023-11-24T06:11:59.634335+0000","last_unstale":"2023-11-24T06:12:00.646459+0000","last_undegraded":"2023-11-24T06:12:00.646459+0000","last_fullsized":"2023-11-24T06:12:00.646459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384001+0000","last_change":"2023-11-24T06:12:00.415376+0000","last_active":"2023-11-24T06:12:01.384001+0000","last_peered":"2023-11-24T06:12:01.384001+0000","last_clean":"2023-11-24T06:12:01.384001+0000","last_became_active":"2023-11-24T06:12:00.415114+0000","last_became_peered":"2023-11-24T06:12:00.415114+0000","last_unstale":"2023-11-24T06:12:01.384001+0000","last_undegraded":"2023-11-24T06:12:01.384001+0000","last_fullsized":"2023-11-24T06:12:01.384001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654742+0000","last_change":"2023-11-24T06:11:59.645253+0000","last_active":"2023-11-24T06:12:00.654742+0000","last_peered":"2023-11-24T06:12:00.654742+0000","last_clean":"2023-11-24T06:12:00.654742+0000","last_became_active":"2023-11-24T06:11:59.644979+0000","last_became_peered":"2023-11-24T06:11:59.644979+0000","last_unstale":"2023-11-24T06:12:00.654742+0000","last_undegraded":"2023-11-24T06:12:00.654742+0000","last_fullsized":"2023-11-24T06:12:00.654742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:36:07.535502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":56622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.258}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0059999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":666978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:12:05.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:12:05.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.423+0000 7f7c41859640 1 Processor -- start 2023-11-24T06:12:05.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.423+0000 7f7c41859640 1 -- start start 2023-11-24T06:12:05.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.425+0000 7f7c41859640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c3c13dfd0 0x7f7c3c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.425+0000 7f7c41859640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.425+0000 7f7c41859640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c0ce7c0 con 0x7f7c3c0cf050 2023-11-24T06:12:05.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.425+0000 7f7c41859640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c140900 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.425+0000 7f7c41859640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c15fa70 con 0x7f7c3c0cf500 2023-11-24T06:12:05.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.425+0000 7f7c41058640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.425+0000 7f7c40857640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c3c13dfd0 0x7f7c3c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.425+0000 7f7c41058640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c06c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:47254/0 (socket says 172.21.15.22:47254) 2023-11-24T06:12:05.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.425+0000 7f7c41058640 1 -- 172.21.15.22:0/429305639 learned_addr learned my addr 172.21.15.22:0/429305639 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:05.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.426+0000 7f7c41058640 1 -- 172.21.15.22:0/429305639 >> v2:172.21.15.31:3300/0 conn(0x7f7c3c13dfd0 msgr2=0x7f7c3c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:05.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.426+0000 7f7c41058640 1 --2- 172.21.15.22:0/429305639 >> v2:172.21.15.31:3300/0 conn(0x7f7c3c13dfd0 0x7f7c3c15be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.426+0000 7f7c41058640 1 -- 172.21.15.22:0/429305639 >> v1:172.21.15.31:6789/0 conn(0x7f7c3c0cf050 legacy=0x7f7c3c06c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.426+0000 7f7c41058640 1 -- 172.21.15.22:0/429305639 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0cf950 con 0x7f7c3c0cf500 2023-11-24T06:12:05.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.426+0000 7f7c40857640 1 --2- 172.21.15.22:0/429305639 >> v2:172.21.15.31:3300/0 conn(0x7f7c3c13dfd0 0x7f7c3c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:12:05.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.428+0000 7f7c41058640 1 --2- 172.21.15.22:0/429305639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c06c840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009870 tx=0x7f7c3402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c356a87fcf5c87e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:05.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.428+0000 7f7c337fe640 1 -- 172.21.15.22:0/429305639 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34030840 con 0x7f7c3c0cf500 2023-11-24T06:12:05.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.428+0000 7f7c337fe640 1 -- 172.21.15.22:0/429305639 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c340309a0 con 0x7f7c3c0cf500 2023-11-24T06:12:05.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.428+0000 7f7c337fe640 1 -- 172.21.15.22:0/429305639 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34030d30 con 0x7f7c3c0cf500 2023-11-24T06:12:05.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.429+0000 7f7c41859640 1 -- 172.21.15.22:0/429305639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 msgr2=0x7f7c3c06c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.429+0000 7f7c41859640 1 --2- 172.21.15.22:0/429305639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c06c840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009870 tx=0x7f7c3402b980 comp rx=0 tx=0).stop 2023-11-24T06:12:05.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.430+0000 7f7c41859640 1 -- 172.21.15.22:0/429305639 shutdown_connections 2023-11-24T06:12:05.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.430+0000 7f7c41859640 1 --2- 172.21.15.22:0/429305639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c06c840 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.430+0000 7f7c41859640 1 --2- 172.21.15.22:0/429305639 >> v2:172.21.15.31:3300/0 conn(0x7f7c3c13dfd0 0x7f7c3c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.430+0000 7f7c41859640 1 -- 172.21.15.22:0/429305639 >> 172.21.15.22:0/429305639 conn(0x7f7c3c06a860 msgr2=0x7f7c3c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:05.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.430+0000 7f7c41859640 1 -- 172.21.15.22:0/429305639 shutdown_connections 2023-11-24T06:12:05.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.430+0000 7f7c41859640 1 -- 172.21.15.22:0/429305639 wait complete. 2023-11-24T06:12:05.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.432+0000 7f7c41859640 1 Processor -- start 2023-11-24T06:12:05.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.432+0000 7f7c41859640 1 -- start start 2023-11-24T06:12:05.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.433+0000 7f7c41859640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c3c0cf050 0x7f7c3c154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.433+0000 7f7c41859640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c13a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.433+0000 7f7c41859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c3c13dfd0 0x7f7c3c134520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.433+0000 7f7c41859640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c135d50 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.433+0000 7f7c41859640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0b2340 con 0x7f7c3c0cf050 2023-11-24T06:12:05.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.433+0000 7f7c41859640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0b2620 con 0x7f7c3c0cf500 2023-11-24T06:12:05.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c41058640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c3c13dfd0 0x7f7c3c134520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c41058640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c3c13dfd0 0x7f7c3c134520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46058/0 (socket says 172.21.15.22:46058) 2023-11-24T06:12:05.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c41058640 1 -- 172.21.15.22:0/2454805084 learned_addr learned my addr 172.21.15.22:0/2454805084 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:05.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c40857640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c3c0cf050 0x7f7c3c154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c33fff640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c13a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c41058640 1 -- 172.21.15.22:0/2454805084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 msgr2=0x7f7c3c13a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c41058640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c13a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c41058640 1 -- 172.21.15.22:0/2454805084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c3c0cf050 msgr2=0x7f7c3c154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c41058640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c3c0cf050 0x7f7c3c154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c41058640 1 -- 172.21.15.22:0/2454805084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c38009a70 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.434+0000 7f7c41058640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c3c13dfd0 0x7f7c3c134520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009870 tx=0x7f7c34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:05.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.435+0000 7f7c317fa640 1 -- 172.21.15.22:0/2454805084 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34039a90 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.435+0000 7f7c317fa640 1 -- 172.21.15.22:0/2454805084 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34039c10 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.435+0000 7f7c317fa640 1 -- 172.21.15.22:0/2454805084 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34043410 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.435+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340094d0 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.435+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c0b2be0 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.436+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c04e840 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.437+0000 7f7c317fa640 1 -- 172.21.15.22:0/2454805084 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c3402f390 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.438+0000 7f7c317fa640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c2806ae40 0x7f7c2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.438+0000 7f7c317fa640 1 -- 172.21.15.22:0/2454805084 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c340ab690 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.438+0000 7f7c40857640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c2806ae40 0x7f7c2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.439+0000 7f7c40857640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c2806ae40 0x7f7c2806d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009fd0 tx=0x7f7c3800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:05.442 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-11-24T06:12:05.439+0000 7f7265709640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:12:05.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.443+0000 7f7c317fa640 1 -- 172.21.15.22:0/2454805084 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c340767e0 con 0x7f7c3c13dfd0 2023-11-24T06:12:05.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.637+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c3c15f420 con 0x7f7c2806ae40 2023-11-24T06:12:05.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.645+0000 7f7c317fa640 1 -- 172.21.15.22:0/2454805084 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263507 (secure 0 0 0) 0x7f7c3800f040 con 0x7f7c2806ae40 2023-11-24T06:12:05.652 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:05.653 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:12:05.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c2806ae40 msgr2=0x7f7c2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c2806ae40 0x7f7c2806d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009fd0 tx=0x7f7c3800b040 comp rx=0 tx=0).stop 2023-11-24T06:12:05.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c3c13dfd0 msgr2=0x7f7c3c134520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c3c13dfd0 0x7f7c3c134520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009870 tx=0x7f7c34004730 comp rx=0 tx=0).stop 2023-11-24T06:12:05.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 shutdown_connections 2023-11-24T06:12:05.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c2806ae40 0x7f7c2806d300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c3c13dfd0 0x7f7c3c134520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c3c0cf500 0x7f7c3c13a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 --2- 172.21.15.22:0/2454805084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c3c0cf050 0x7f7c3c154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 >> 172.21.15.22:0/2454805084 conn(0x7f7c3c06a860 msgr2=0x7f7c3c06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:05.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 shutdown_connections 2023-11-24T06:12:05.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.651+0000 7f7c41859640 1 -- 172.21.15.22:0/2454805084 wait complete. 2023-11-24T06:12:05.673 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T06:12:04.647691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235740,"kb_used_data":2912,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738980,"statfs":{"total":773094113280,"available":772852715520,"internally_reserved":0,"allocated":2981888,"data_stored":1773892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001552"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386950+0000","last_change":"2023-11-24T06:12:00.409989+0000","last_active":"2023-11-24T06:12:01.386950+0000","last_peered":"2023-11-24T06:12:01.386950+0000","last_clean":"2023-11-24T06:12:01.386950+0000","last_became_active":"2023-11-24T06:12:00.409672+0000","last_became_peered":"2023-11-24T06:12:00.409672+0000","last_unstale":"2023-11-24T06:12:01.386950+0000","last_undegraded":"2023-11-24T06:12:01.386950+0000","last_fullsized":"2023-11-24T06:12:01.386950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386025+0000","last_change":"2023-11-24T06:12:00.416425+0000","last_active":"2023-11-24T06:12:01.386025+0000","last_peered":"2023-11-24T06:12:01.386025+0000","last_clean":"2023-11-24T06:12:01.386025+0000","last_became_active":"2023-11-24T06:12:00.415783+0000","last_became_peered":"2023-11-24T06:12:00.415783+0000","last_unstale":"2023-11-24T06:12:01.386025+0000","last_undegraded":"2023-11-24T06:12:01.386025+0000","last_fullsized":"2023-11-24T06:12:01.386025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:38:17.759240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811686+0000","last_change":"2023-11-24T06:12:00.408399+0000","last_active":"2023-11-24T06:12:01.811686+0000","last_peered":"2023-11-24T06:12:01.811686+0000","last_clean":"2023-11-24T06:12:01.811686+0000","last_became_active":"2023-11-24T06:12:00.408067+0000","last_became_peered":"2023-11-24T06:12:00.408067+0000","last_unstale":"2023-11-24T06:12:01.811686+0000","last_undegraded":"2023-11-24T06:12:01.811686+0000","last_fullsized":"2023-11-24T06:12:01.811686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.639601+0000","last_change":"2023-11-24T06:11:59.639601+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.639601+0000","last_undegraded":"2023-11-24T06:11:59.639601+0000","last_fullsized":"2023-11-24T06:11:59.639601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:12:00.400306+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:12:00.399964+0000","last_became_peered":"2023-11-24T06:12:00.399964+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.641902+0000","last_change":"2023-11-24T06:11:59.641902+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.641902+0000","last_undegraded":"2023-11-24T06:11:59.641902+0000","last_fullsized":"2023-11-24T06:11:59.641902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385528+0000","last_change":"2023-11-24T06:12:00.408860+0000","last_active":"2023-11-24T06:12:01.385528+0000","last_peered":"2023-11-24T06:12:01.385528+0000","last_clean":"2023-11-24T06:12:01.385528+0000","last_became_active":"2023-11-24T06:12:00.408549+0000","last_became_peered":"2023-11-24T06:12:00.408549+0000","last_unstale":"2023-11-24T06:12:01.385528+0000","last_undegraded":"2023-11-24T06:12:01.385528+0000","last_fullsized":"2023-11-24T06:12:01.385528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383026+0000","last_change":"2023-11-24T06:12:00.413017+0000","last_active":"2023-11-24T06:12:01.383026+0000","last_peered":"2023-11-24T06:12:01.383026+0000","last_clean":"2023-11-24T06:12:01.383026+0000","last_became_active":"2023-11-24T06:12:00.411843+0000","last_became_peered":"2023-11-24T06:12:00.411843+0000","last_unstale":"2023-11-24T06:12:01.383026+0000","last_undegraded":"2023-11-24T06:12:01.383026+0000","last_fullsized":"2023-11-24T06:12:01.383026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387045+0000","last_change":"2023-11-24T06:12:00.418547+0000","last_active":"2023-11-24T06:12:01.387045+0000","last_peered":"2023-11-24T06:12:01.387045+0000","last_clean":"2023-11-24T06:12:01.387045+0000","last_became_active":"2023-11-24T06:12:00.418264+0000","last_became_peered":"2023-11-24T06:12:00.418264+0000","last_unstale":"2023-11-24T06:12:01.387045+0000","last_undegraded":"2023-11-24T06:12:01.387045+0000","last_fullsized":"2023-11-24T06:12:01.387045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792917+0000","last_change":"2023-11-24T06:12:00.413548+0000","last_active":"2023-11-24T06:12:01.792917+0000","last_peered":"2023-11-24T06:12:01.792917+0000","last_clean":"2023-11-24T06:12:01.792917+0000","last_became_active":"2023-11-24T06:12:00.413225+0000","last_became_peered":"2023-11-24T06:12:00.413225+0000","last_unstale":"2023-11-24T06:12:01.792917+0000","last_undegraded":"2023-11-24T06:12:01.792917+0000","last_fullsized":"2023-11-24T06:12:01.792917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792746+0000","last_change":"2023-11-24T06:12:00.415528+0000","last_active":"2023-11-24T06:12:01.792746+0000","last_peered":"2023-11-24T06:12:01.792746+0000","last_clean":"2023-11-24T06:12:01.792746+0000","last_became_active":"2023-11-24T06:12:00.414074+0000","last_became_peered":"2023-11-24T06:12:00.414074+0000","last_unstale":"2023-11-24T06:12:01.792746+0000","last_undegraded":"2023-11-24T06:12:01.792746+0000","last_fullsized":"2023-11-24T06:12:01.792746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814560+0000","last_change":"2023-11-24T06:12:00.412466+0000","last_active":"2023-11-24T06:12:01.814560+0000","last_peered":"2023-11-24T06:12:01.814560+0000","last_clean":"2023-11-24T06:12:01.814560+0000","last_became_active":"2023-11-24T06:12:00.412189+0000","last_became_peered":"2023-11-24T06:12:00.412189+0000","last_unstale":"2023-11-24T06:12:01.814560+0000","last_undegraded":"2023-11-24T06:12:01.814560+0000","last_fullsized":"2023-11-24T06:12:01.814560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:33.179248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384061+0000","last_change":"2023-11-24T06:12:00.410091+0000","last_active":"2023-11-24T06:12:01.384061+0000","last_peered":"2023-11-24T06:12:01.384061+0000","last_clean":"2023-11-24T06:12:01.384061+0000","last_became_active":"2023-11-24T06:12:00.409724+0000","last_became_peered":"2023-11-24T06:12:00.409724+0000","last_unstale":"2023-11-24T06:12:01.384061+0000","last_undegraded":"2023-11-24T06:12:01.384061+0000","last_fullsized":"2023-11-24T06:12:01.384061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811279+0000","last_change":"2023-11-24T06:12:00.413928+0000","last_active":"2023-11-24T06:12:01.811279+0000","last_peered":"2023-11-24T06:12:01.811279+0000","last_clean":"2023-11-24T06:12:01.811279+0000","last_became_active":"2023-11-24T06:12:00.408524+0000","last_became_peered":"2023-11-24T06:12:00.408524+0000","last_unstale":"2023-11-24T06:12:01.811279+0000","last_undegraded":"2023-11-24T06:12:01.811279+0000","last_fullsized":"2023-11-24T06:12:01.811279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:21.383018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385301+0000","last_change":"2023-11-24T06:12:00.414487+0000","last_active":"2023-11-24T06:12:01.385301+0000","last_peered":"2023-11-24T06:12:01.385301+0000","last_clean":"2023-11-24T06:12:01.385301+0000","last_became_active":"2023-11-24T06:12:00.412548+0000","last_became_peered":"2023-11-24T06:12:00.412548+0000","last_unstale":"2023-11-24T06:12:01.385301+0000","last_undegraded":"2023-11-24T06:12:01.385301+0000","last_fullsized":"2023-11-24T06:12:01.385301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:04.491629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.641036+0000","last_change":"2023-11-24T06:11:59.641036+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.641036+0000","last_undegraded":"2023-11-24T06:11:59.641036+0000","last_fullsized":"2023-11-24T06:11:59.641036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.635690+0000","last_change":"2023-11-24T06:11:59.635690+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.635690+0000","last_undegraded":"2023-11-24T06:11:59.635690+0000","last_fullsized":"2023-11-24T06:11:59.635690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812634+0000","last_change":"2023-11-24T06:12:00.415065+0000","last_active":"2023-11-24T06:12:01.812634+0000","last_peered":"2023-11-24T06:12:01.812634+0000","last_clean":"2023-11-24T06:12:01.812634+0000","last_became_active":"2023-11-24T06:12:00.414686+0000","last_became_peered":"2023-11-24T06:12:00.414686+0000","last_unstale":"2023-11-24T06:12:01.812634+0000","last_undegraded":"2023-11-24T06:12:01.812634+0000","last_fullsized":"2023-11-24T06:12:01.812634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.404241+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.403972+0000","last_became_peered":"2023-11-24T06:12:00.403972+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792421+0000","last_change":"2023-11-24T06:12:00.422094+0000","last_active":"2023-11-24T06:12:01.792421+0000","last_peered":"2023-11-24T06:12:01.792421+0000","last_clean":"2023-11-24T06:12:01.792421+0000","last_became_active":"2023-11-24T06:12:00.421724+0000","last_became_peered":"2023-11-24T06:12:00.421724+0000","last_unstale":"2023-11-24T06:12:01.792421+0000","last_undegraded":"2023-11-24T06:12:01.792421+0000","last_fullsized":"2023-11-24T06:12:01.792421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811370+0000","last_change":"2023-11-24T06:12:00.411570+0000","last_active":"2023-11-24T06:12:01.811370+0000","last_peered":"2023-11-24T06:12:01.811370+0000","last_clean":"2023-11-24T06:12:01.811370+0000","last_became_active":"2023-11-24T06:12:00.411118+0000","last_became_peered":"2023-11-24T06:12:00.411118+0000","last_unstale":"2023-11-24T06:12:01.811370+0000","last_undegraded":"2023-11-24T06:12:01.811370+0000","last_fullsized":"2023-11-24T06:12:01.811370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:15.863418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.634866+0000","last_change":"2023-11-24T06:11:59.634866+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.634866+0000","last_undegraded":"2023-11-24T06:11:59.634866+0000","last_fullsized":"2023-11-24T06:11:59.634866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383318+0000","last_change":"2023-11-24T06:12:00.410431+0000","last_active":"2023-11-24T06:12:01.383318+0000","last_peered":"2023-11-24T06:12:01.383318+0000","last_clean":"2023-11-24T06:12:01.383318+0000","last_became_active":"2023-11-24T06:12:00.410132+0000","last_became_peered":"2023-11-24T06:12:00.410132+0000","last_unstale":"2023-11-24T06:12:01.383318+0000","last_undegraded":"2023-11-24T06:12:01.383318+0000","last_fullsized":"2023-11-24T06:12:01.383318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.636236+0000","last_change":"2023-11-24T06:11:59.636236+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.636236+0000","last_undegraded":"2023-11-24T06:11:59.636236+0000","last_fullsized":"2023-11-24T06:11:59.636236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384663+0000","last_change":"2023-11-24T06:12:00.419798+0000","last_active":"2023-11-24T06:12:01.384663+0000","last_peered":"2023-11-24T06:12:01.384663+0000","last_clean":"2023-11-24T06:12:01.384663+0000","last_became_active":"2023-11-24T06:12:00.419568+0000","last_became_peered":"2023-11-24T06:12:00.419568+0000","last_unstale":"2023-11-24T06:12:01.384663+0000","last_undegraded":"2023-11-24T06:12:01.384663+0000","last_fullsized":"2023-11-24T06:12:01.384663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.793026+0000","last_change":"2023-11-24T06:12:00.412430+0000","last_active":"2023-11-24T06:12:01.793026+0000","last_peered":"2023-11-24T06:12:01.793026+0000","last_clean":"2023-11-24T06:12:01.793026+0000","last_became_active":"2023-11-24T06:12:00.411971+0000","last_became_peered":"2023-11-24T06:12:00.411971+0000","last_unstale":"2023-11-24T06:12:01.793026+0000","last_undegraded":"2023-11-24T06:12:01.793026+0000","last_fullsized":"2023-11-24T06:12:01.793026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385763+0000","last_change":"2023-11-24T06:12:00.414558+0000","last_active":"2023-11-24T06:12:01.385763+0000","last_peered":"2023-11-24T06:12:01.385763+0000","last_clean":"2023-11-24T06:12:01.385763+0000","last_became_active":"2023-11-24T06:12:00.414279+0000","last_became_peered":"2023-11-24T06:12:00.414279+0000","last_unstale":"2023-11-24T06:12:01.385763+0000","last_undegraded":"2023-11-24T06:12:01.385763+0000","last_fullsized":"2023-11-24T06:12:01.385763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:00.298898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384237+0000","last_change":"2023-11-24T06:12:00.423044+0000","last_active":"2023-11-24T06:12:01.384237+0000","last_peered":"2023-11-24T06:12:01.384237+0000","last_clean":"2023-11-24T06:12:01.384237+0000","last_became_active":"2023-11-24T06:12:00.422684+0000","last_became_peered":"2023-11-24T06:12:00.422684+0000","last_unstale":"2023-11-24T06:12:01.384237+0000","last_undegraded":"2023-11-24T06:12:01.384237+0000","last_fullsized":"2023-11-24T06:12:01.384237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811420+0000","last_change":"2023-11-24T06:12:00.406540+0000","last_active":"2023-11-24T06:12:01.811420+0000","last_peered":"2023-11-24T06:12:01.811420+0000","last_clean":"2023-11-24T06:12:01.811420+0000","last_became_active":"2023-11-24T06:12:00.406115+0000","last_became_peered":"2023-11-24T06:12:00.406115+0000","last_unstale":"2023-11-24T06:12:01.811420+0000","last_undegraded":"2023-11-24T06:12:01.811420+0000","last_fullsized":"2023-11-24T06:12:01.811420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.632627+0000","last_change":"2023-11-24T06:11:59.632627+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.632627+0000","last_undegraded":"2023-11-24T06:11:59.632627+0000","last_fullsized":"2023-11-24T06:11:59.632627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812046+0000","last_change":"2023-11-24T06:12:00.413545+0000","last_active":"2023-11-24T06:12:01.812046+0000","last_peered":"2023-11-24T06:12:01.812046+0000","last_clean":"2023-11-24T06:12:01.812046+0000","last_became_active":"2023-11-24T06:12:00.411644+0000","last_became_peered":"2023-11-24T06:12:00.411644+0000","last_unstale":"2023-11-24T06:12:01.812046+0000","last_undegraded":"2023-11-24T06:12:01.812046+0000","last_fullsized":"2023-11-24T06:12:01.812046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792092+0000","last_change":"2023-11-24T06:12:00.411309+0000","last_active":"2023-11-24T06:12:01.792092+0000","last_peered":"2023-11-24T06:12:01.792092+0000","last_clean":"2023-11-24T06:12:01.792092+0000","last_became_active":"2023-11-24T06:12:00.409967+0000","last_became_peered":"2023-11-24T06:12:00.409967+0000","last_unstale":"2023-11-24T06:12:01.792092+0000","last_undegraded":"2023-11-24T06:12:01.792092+0000","last_fullsized":"2023-11-24T06:12:01.792092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814781+0000","last_change":"2023-11-24T06:12:00.417149+0000","last_active":"2023-11-24T06:12:01.814781+0000","last_peered":"2023-11-24T06:12:01.814781+0000","last_clean":"2023-11-24T06:12:01.814781+0000","last_became_active":"2023-11-24T06:12:00.410529+0000","last_became_peered":"2023-11-24T06:12:00.410529+0000","last_unstale":"2023-11-24T06:12:01.814781+0000","last_undegraded":"2023-11-24T06:12:01.814781+0000","last_fullsized":"2023-11-24T06:12:01.814781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654819+0000","last_change":"2023-11-24T06:11:59.645470+0000","last_active":"2023-11-24T06:12:00.654819+0000","last_peered":"2023-11-24T06:12:00.654819+0000","last_clean":"2023-11-24T06:12:00.654819+0000","last_became_active":"2023-11-24T06:11:59.644424+0000","last_became_peered":"2023-11-24T06:11:59.644424+0000","last_unstale":"2023-11-24T06:12:00.654819+0000","last_undegraded":"2023-11-24T06:12:00.654819+0000","last_fullsized":"2023-11-24T06:12:00.654819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811571+0000","last_change":"2023-11-24T06:12:00.421116+0000","last_active":"2023-11-24T06:12:01.811571+0000","last_peered":"2023-11-24T06:12:01.811571+0000","last_clean":"2023-11-24T06:12:01.811571+0000","last_became_active":"2023-11-24T06:12:00.420793+0000","last_became_peered":"2023-11-24T06:12:00.420793+0000","last_unstale":"2023-11-24T06:12:01.811571+0000","last_undegraded":"2023-11-24T06:12:01.811571+0000","last_fullsized":"2023-11-24T06:12:01.811571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654126+0000","last_change":"2023-11-24T06:11:59.657132+0000","last_active":"2023-11-24T06:12:00.654126+0000","last_peered":"2023-11-24T06:12:00.654126+0000","last_clean":"2023-11-24T06:12:00.654126+0000","last_became_active":"2023-11-24T06:11:59.656475+0000","last_became_peered":"2023-11-24T06:11:59.656475+0000","last_unstale":"2023-11-24T06:12:00.654126+0000","last_undegraded":"2023-11-24T06:12:00.654126+0000","last_fullsized":"2023-11-24T06:12:00.654126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.392519+0000","last_change":"2023-11-24T06:11:59.647264+0000","last_active":"2023-11-24T06:12:00.392519+0000","last_peered":"2023-11-24T06:12:00.392519+0000","last_clean":"2023-11-24T06:12:00.392519+0000","last_became_active":"2023-11-24T06:11:59.646951+0000","last_became_peered":"2023-11-24T06:11:59.646951+0000","last_unstale":"2023-11-24T06:12:00.392519+0000","last_undegraded":"2023-11-24T06:12:00.392519+0000","last_fullsized":"2023-11-24T06:12:00.392519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383246+0000","last_change":"2023-11-24T06:12:00.410276+0000","last_active":"2023-11-24T06:12:01.383246+0000","last_peered":"2023-11-24T06:12:01.383246+0000","last_clean":"2023-11-24T06:12:01.383246+0000","last_became_active":"2023-11-24T06:12:00.407839+0000","last_became_peered":"2023-11-24T06:12:00.407839+0000","last_unstale":"2023-11-24T06:12:01.383246+0000","last_undegraded":"2023-11-24T06:12:01.383246+0000","last_fullsized":"2023-11-24T06:12:01.383246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.661328+0000","last_change":"2023-11-24T06:11:59.656673+0000","last_active":"2023-11-24T06:11:59.661328+0000","last_peered":"2023-11-24T06:11:59.661328+0000","last_clean":"2023-11-24T06:11:59.661328+0000","last_became_active":"2023-11-24T06:11:59.656322+0000","last_became_peered":"2023-11-24T06:11:59.656322+0000","last_unstale":"2023-11-24T06:11:59.661328+0000","last_undegraded":"2023-11-24T06:11:59.661328+0000","last_fullsized":"2023-11-24T06:11:59.661328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:33:03.536712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385041+0000","last_change":"2023-11-24T06:12:00.411377+0000","last_active":"2023-11-24T06:12:01.385041+0000","last_peered":"2023-11-24T06:12:01.385041+0000","last_clean":"2023-11-24T06:12:01.385041+0000","last_became_active":"2023-11-24T06:12:00.411117+0000","last_became_peered":"2023-11-24T06:12:00.411117+0000","last_unstale":"2023-11-24T06:12:01.385041+0000","last_undegraded":"2023-11-24T06:12:01.385041+0000","last_fullsized":"2023-11-24T06:12:01.385041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:55.958831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.404314+0000","last_change":"2023-11-24T06:11:59.652584+0000","last_active":"2023-11-24T06:12:00.404314+0000","last_peered":"2023-11-24T06:12:00.404314+0000","last_clean":"2023-11-24T06:12:00.404314+0000","last_became_active":"2023-11-24T06:11:59.652269+0000","last_became_peered":"2023-11-24T06:11:59.652269+0000","last_unstale":"2023-11-24T06:12:00.404314+0000","last_undegraded":"2023-11-24T06:12:00.404314+0000","last_fullsized":"2023-11-24T06:12:00.404314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.631645+0000","last_change":"2023-11-24T06:11:59.631645+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.631645+0000","last_undegraded":"2023-11-24T06:11:59.631645+0000","last_fullsized":"2023-11-24T06:11:59.631645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.655388+0000","last_change":"2023-11-24T06:11:59.649342+0000","last_active":"2023-11-24T06:11:59.655388+0000","last_peered":"2023-11-24T06:11:59.655388+0000","last_clean":"2023-11-24T06:11:59.655388+0000","last_became_active":"2023-11-24T06:11:59.649022+0000","last_became_peered":"2023-11-24T06:11:59.649022+0000","last_unstale":"2023-11-24T06:11:59.655388+0000","last_undegraded":"2023-11-24T06:11:59.655388+0000","last_fullsized":"2023-11-24T06:11:59.655388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:12:45.266944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812025+0000","last_change":"2023-11-24T06:12:00.418160+0000","last_active":"2023-11-24T06:12:01.812025+0000","last_peered":"2023-11-24T06:12:01.812025+0000","last_clean":"2023-11-24T06:12:01.812025+0000","last_became_active":"2023-11-24T06:12:00.417836+0000","last_became_peered":"2023-11-24T06:12:00.417836+0000","last_unstale":"2023-11-24T06:12:01.812025+0000","last_undegraded":"2023-11-24T06:12:01.812025+0000","last_fullsized":"2023-11-24T06:12:01.812025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385956+0000","last_change":"2023-11-24T06:11:59.644472+0000","last_active":"2023-11-24T06:12:01.385956+0000","last_peered":"2023-11-24T06:12:01.385956+0000","last_clean":"2023-11-24T06:12:01.385956+0000","last_became_active":"2023-11-24T06:11:59.644152+0000","last_became_peered":"2023-11-24T06:11:59.644152+0000","last_unstale":"2023-11-24T06:12:01.385956+0000","last_undegraded":"2023-11-24T06:12:01.385956+0000","last_fullsized":"2023-11-24T06:12:01.385956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:50.982166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814768+0000","last_change":"2023-11-24T06:12:00.411893+0000","last_active":"2023-11-24T06:12:01.814768+0000","last_peered":"2023-11-24T06:12:01.814768+0000","last_clean":"2023-11-24T06:12:01.814768+0000","last_became_active":"2023-11-24T06:12:00.411029+0000","last_became_peered":"2023-11-24T06:12:00.411029+0000","last_unstale":"2023-11-24T06:12:01.814768+0000","last_undegraded":"2023-11-24T06:12:01.814768+0000","last_fullsized":"2023-11-24T06:12:01.814768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:01.536292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.658392+0000","last_change":"2023-11-24T06:11:59.648134+0000","last_active":"2023-11-24T06:12:00.658392+0000","last_peered":"2023-11-24T06:12:00.658392+0000","last_clean":"2023-11-24T06:12:00.658392+0000","last_became_active":"2023-11-24T06:11:59.647824+0000","last_became_peered":"2023-11-24T06:11:59.647824+0000","last_unstale":"2023-11-24T06:12:00.658392+0000","last_undegraded":"2023-11-24T06:12:00.658392+0000","last_fullsized":"2023-11-24T06:12:00.658392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385778+0000","last_change":"2023-11-24T06:12:00.417420+0000","last_active":"2023-11-24T06:12:01.385778+0000","last_peered":"2023-11-24T06:12:01.385778+0000","last_clean":"2023-11-24T06:12:01.385778+0000","last_became_active":"2023-11-24T06:12:00.416624+0000","last_became_peered":"2023-11-24T06:12:00.416624+0000","last_unstale":"2023-11-24T06:12:01.385778+0000","last_undegraded":"2023-11-24T06:12:01.385778+0000","last_fullsized":"2023-11-24T06:12:01.385778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656684+0000","last_change":"2023-11-24T06:11:59.650532+0000","last_active":"2023-11-24T06:12:00.656684+0000","last_peered":"2023-11-24T06:12:00.656684+0000","last_clean":"2023-11-24T06:12:00.656684+0000","last_became_active":"2023-11-24T06:11:59.650193+0000","last_became_peered":"2023-11-24T06:11:59.650193+0000","last_unstale":"2023-11-24T06:12:00.656684+0000","last_undegraded":"2023-11-24T06:12:00.656684+0000","last_fullsized":"2023-11-24T06:12:00.656684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811425+0000","last_change":"2023-11-24T06:12:00.411372+0000","last_active":"2023-11-24T06:12:01.811425+0000","last_peered":"2023-11-24T06:12:01.811425+0000","last_clean":"2023-11-24T06:12:01.811425+0000","last_became_active":"2023-11-24T06:12:00.410699+0000","last_became_peered":"2023-11-24T06:12:00.410699+0000","last_unstale":"2023-11-24T06:12:01.811425+0000","last_undegraded":"2023-11-24T06:12:01.811425+0000","last_fullsized":"2023-11-24T06:12:01.811425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.655458+0000","last_change":"2023-11-24T06:11:59.650677+0000","last_active":"2023-11-24T06:11:59.655458+0000","last_peered":"2023-11-24T06:11:59.655458+0000","last_clean":"2023-11-24T06:11:59.655458+0000","last_became_active":"2023-11-24T06:11:59.650368+0000","last_became_peered":"2023-11-24T06:11:59.650368+0000","last_unstale":"2023-11-24T06:11:59.655458+0000","last_undegraded":"2023-11-24T06:11:59.655458+0000","last_fullsized":"2023-11-24T06:11:59.655458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386237+0000","last_change":"2023-11-24T06:12:00.409066+0000","last_active":"2023-11-24T06:12:01.386237+0000","last_peered":"2023-11-24T06:12:01.386237+0000","last_clean":"2023-11-24T06:12:01.386237+0000","last_became_active":"2023-11-24T06:12:00.408722+0000","last_became_peered":"2023-11-24T06:12:00.408722+0000","last_unstale":"2023-11-24T06:12:01.386237+0000","last_undegraded":"2023-11-24T06:12:01.386237+0000","last_fullsized":"2023-11-24T06:12:01.386237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.399698+0000","last_change":"2023-11-24T06:11:59.653443+0000","last_active":"2023-11-24T06:12:00.399698+0000","last_peered":"2023-11-24T06:12:00.399698+0000","last_clean":"2023-11-24T06:12:00.399698+0000","last_became_active":"2023-11-24T06:11:59.653091+0000","last_became_peered":"2023-11-24T06:11:59.653091+0000","last_unstale":"2023-11-24T06:12:00.399698+0000","last_undegraded":"2023-11-24T06:12:00.399698+0000","last_fullsized":"2023-11-24T06:12:00.399698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792087+0000","last_change":"2023-11-24T06:12:00.415948+0000","last_active":"2023-11-24T06:12:01.792087+0000","last_peered":"2023-11-24T06:12:01.792087+0000","last_clean":"2023-11-24T06:12:01.792087+0000","last_became_active":"2023-11-24T06:12:00.415597+0000","last_became_peered":"2023-11-24T06:12:00.415597+0000","last_unstale":"2023-11-24T06:12:01.792087+0000","last_undegraded":"2023-11-24T06:12:01.792087+0000","last_fullsized":"2023-11-24T06:12:01.792087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648785+0000","last_change":"2023-11-24T06:11:59.620020+0000","last_active":"2023-11-24T06:12:00.648785+0000","last_peered":"2023-11-24T06:12:00.648785+0000","last_clean":"2023-11-24T06:12:00.648785+0000","last_became_active":"2023-11-24T06:11:59.619675+0000","last_became_peered":"2023-11-24T06:11:59.619675+0000","last_unstale":"2023-11-24T06:12:00.648785+0000","last_undegraded":"2023-11-24T06:12:00.648785+0000","last_fullsized":"2023-11-24T06:12:00.648785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385713+0000","last_change":"2023-11-24T06:12:00.412328+0000","last_active":"2023-11-24T06:12:01.385713+0000","last_peered":"2023-11-24T06:12:01.385713+0000","last_clean":"2023-11-24T06:12:01.385713+0000","last_became_active":"2023-11-24T06:12:00.412057+0000","last_became_peered":"2023-11-24T06:12:00.412057+0000","last_unstale":"2023-11-24T06:12:01.385713+0000","last_undegraded":"2023-11-24T06:12:01.385713+0000","last_fullsized":"2023-11-24T06:12:01.385713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.650279+0000","last_change":"2023-11-24T06:11:59.650120+0000","last_active":"2023-11-24T06:12:00.650279+0000","last_peered":"2023-11-24T06:12:00.650279+0000","last_clean":"2023-11-24T06:12:00.650279+0000","last_became_active":"2023-11-24T06:11:59.647975+0000","last_became_peered":"2023-11-24T06:11:59.647975+0000","last_unstale":"2023-11-24T06:12:00.650279+0000","last_undegraded":"2023-11-24T06:12:00.650279+0000","last_fullsized":"2023-11-24T06:12:00.650279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.407351+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.406978+0000","last_became_peered":"2023-11-24T06:12:00.406978+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648323+0000","last_change":"2023-11-24T06:11:59.628459+0000","last_active":"2023-11-24T06:12:00.648323+0000","last_peered":"2023-11-24T06:12:00.648323+0000","last_clean":"2023-11-24T06:12:00.648323+0000","last_became_active":"2023-11-24T06:11:59.628147+0000","last_became_peered":"2023-11-24T06:11:59.628147+0000","last_unstale":"2023-11-24T06:12:00.648323+0000","last_undegraded":"2023-11-24T06:12:00.648323+0000","last_fullsized":"2023-11-24T06:12:00.648323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387133+0000","last_change":"2023-11-24T06:12:00.424920+0000","last_active":"2023-11-24T06:12:01.387133+0000","last_peered":"2023-11-24T06:12:01.387133+0000","last_clean":"2023-11-24T06:12:01.387133+0000","last_became_active":"2023-11-24T06:12:00.423927+0000","last_became_peered":"2023-11-24T06:12:00.423927+0000","last_unstale":"2023-11-24T06:12:01.387133+0000","last_undegraded":"2023-11-24T06:12:01.387133+0000","last_fullsized":"2023-11-24T06:12:01.387133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:54:14.921315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:11:59.643977+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:11:59.643552+0000","last_became_peered":"2023-11-24T06:11:59.643552+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:02.323910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.636264+0000","last_change":"2023-11-24T06:11:59.636264+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.636264+0000","last_undegraded":"2023-11-24T06:11:59.636264+0000","last_fullsized":"2023-11-24T06:11:59.636264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379381+0000","last_change":"2023-11-24T06:11:59.643121+0000","last_active":"2023-11-24T06:12:00.379381+0000","last_peered":"2023-11-24T06:12:00.379381+0000","last_clean":"2023-11-24T06:12:00.379381+0000","last_became_active":"2023-11-24T06:11:59.642797+0000","last_became_peered":"2023-11-24T06:11:59.642797+0000","last_unstale":"2023-11-24T06:12:00.379381+0000","last_undegraded":"2023-11-24T06:12:00.379381+0000","last_fullsized":"2023-11-24T06:12:00.379381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386156+0000","last_change":"2023-11-24T06:12:00.417716+0000","last_active":"2023-11-24T06:12:01.386156+0000","last_peered":"2023-11-24T06:12:01.386156+0000","last_clean":"2023-11-24T06:12:01.386156+0000","last_became_active":"2023-11-24T06:12:00.417088+0000","last_became_peered":"2023-11-24T06:12:00.417088+0000","last_unstale":"2023-11-24T06:12:01.386156+0000","last_undegraded":"2023-11-24T06:12:01.386156+0000","last_fullsized":"2023-11-24T06:12:01.386156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383162+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:12:00.383162+0000","last_peered":"2023-11-24T06:12:00.383162+0000","last_clean":"2023-11-24T06:12:00.383162+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:12:00.383162+0000","last_undegraded":"2023-11-24T06:12:00.383162+0000","last_fullsized":"2023-11-24T06:12:00.383162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.655438+0000","last_change":"2023-11-24T06:11:59.649393+0000","last_active":"2023-11-24T06:11:59.655438+0000","last_peered":"2023-11-24T06:11:59.655438+0000","last_clean":"2023-11-24T06:11:59.655438+0000","last_became_active":"2023-11-24T06:11:59.649045+0000","last_became_peered":"2023-11-24T06:11:59.649045+0000","last_unstale":"2023-11-24T06:11:59.655438+0000","last_undegraded":"2023-11-24T06:11:59.655438+0000","last_fullsized":"2023-11-24T06:11:59.655438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383623+0000","last_change":"2023-11-24T06:12:00.417107+0000","last_active":"2023-11-24T06:12:01.383623+0000","last_peered":"2023-11-24T06:12:01.383623+0000","last_clean":"2023-11-24T06:12:01.383623+0000","last_became_active":"2023-11-24T06:12:00.416181+0000","last_became_peered":"2023-11-24T06:12:00.416181+0000","last_unstale":"2023-11-24T06:12:01.383623+0000","last_undegraded":"2023-11-24T06:12:01.383623+0000","last_fullsized":"2023-11-24T06:12:01.383623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383049+0000","last_change":"2023-11-24T06:11:59.641692+0000","last_active":"2023-11-24T06:12:00.383049+0000","last_peered":"2023-11-24T06:12:00.383049+0000","last_clean":"2023-11-24T06:12:00.383049+0000","last_became_active":"2023-11-24T06:11:59.641199+0000","last_became_peered":"2023-11-24T06:11:59.641199+0000","last_unstale":"2023-11-24T06:12:00.383049+0000","last_undegraded":"2023-11-24T06:12:00.383049+0000","last_fullsized":"2023-11-24T06:12:00.383049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811125+0000","last_change":"2023-11-24T06:12:00.421725+0000","last_active":"2023-11-24T06:12:01.811125+0000","last_peered":"2023-11-24T06:12:01.811125+0000","last_clean":"2023-11-24T06:12:01.811125+0000","last_became_active":"2023-11-24T06:12:00.421402+0000","last_became_peered":"2023-11-24T06:12:00.421402+0000","last_unstale":"2023-11-24T06:12:01.811125+0000","last_undegraded":"2023-11-24T06:12:01.811125+0000","last_fullsized":"2023-11-24T06:12:01.811125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:16.430001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379330+0000","last_change":"2023-11-24T06:11:59.628457+0000","last_active":"2023-11-24T06:12:00.379330+0000","last_peered":"2023-11-24T06:12:00.379330+0000","last_clean":"2023-11-24T06:12:00.379330+0000","last_became_active":"2023-11-24T06:11:59.628109+0000","last_became_peered":"2023-11-24T06:11:59.628109+0000","last_unstale":"2023-11-24T06:12:00.379330+0000","last_undegraded":"2023-11-24T06:12:00.379330+0000","last_fullsized":"2023-11-24T06:12:00.379330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385318+0000","last_change":"2023-11-24T06:12:00.406591+0000","last_active":"2023-11-24T06:12:01.385318+0000","last_peered":"2023-11-24T06:12:01.385318+0000","last_clean":"2023-11-24T06:12:01.385318+0000","last_became_active":"2023-11-24T06:12:00.406217+0000","last_became_peered":"2023-11-24T06:12:00.406217+0000","last_unstale":"2023-11-24T06:12:01.385318+0000","last_undegraded":"2023-11-24T06:12:01.385318+0000","last_fullsized":"2023-11-24T06:12:01.385318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:49.548969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.652345+0000","last_change":"2023-11-24T06:11:59.645058+0000","last_active":"2023-11-24T06:11:59.652345+0000","last_peered":"2023-11-24T06:11:59.652345+0000","last_clean":"2023-11-24T06:11:59.652345+0000","last_became_active":"2023-11-24T06:11:59.642696+0000","last_became_peered":"2023-11-24T06:11:59.642696+0000","last_unstale":"2023-11-24T06:11:59.652345+0000","last_undegraded":"2023-11-24T06:11:59.652345+0000","last_fullsized":"2023-11-24T06:11:59.652345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:43.070876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.815366+0000","last_change":"2023-11-24T06:12:00.415699+0000","last_active":"2023-11-24T06:12:01.815366+0000","last_peered":"2023-11-24T06:12:01.815366+0000","last_clean":"2023-11-24T06:12:01.815366+0000","last_became_active":"2023-11-24T06:12:00.412274+0000","last_became_peered":"2023-11-24T06:12:00.412274+0000","last_unstale":"2023-11-24T06:12:01.815366+0000","last_undegraded":"2023-11-24T06:12:01.815366+0000","last_fullsized":"2023-11-24T06:12:01.815366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385632+0000","last_change":"2023-11-24T06:11:59.633842+0000","last_active":"2023-11-24T06:12:01.385632+0000","last_peered":"2023-11-24T06:12:01.385632+0000","last_clean":"2023-11-24T06:12:01.385632+0000","last_became_active":"2023-11-24T06:11:59.632890+0000","last_became_peered":"2023-11-24T06:11:59.632890+0000","last_unstale":"2023-11-24T06:12:01.385632+0000","last_undegraded":"2023-11-24T06:12:01.385632+0000","last_fullsized":"2023-11-24T06:12:01.385632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:00.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.637570+0000","last_change":"2023-11-24T06:11:59.637570+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.637570+0000","last_undegraded":"2023-11-24T06:11:59.637570+0000","last_fullsized":"2023-11-24T06:11:59.637570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.389114+0000","last_change":"2023-11-24T06:11:59.644082+0000","last_active":"2023-11-24T06:12:00.389114+0000","last_peered":"2023-11-24T06:12:00.389114+0000","last_clean":"2023-11-24T06:12:00.389114+0000","last_became_active":"2023-11-24T06:11:59.640160+0000","last_became_peered":"2023-11-24T06:11:59.640160+0000","last_unstale":"2023-11-24T06:12:00.389114+0000","last_undegraded":"2023-11-24T06:12:00.389114+0000","last_fullsized":"2023-11-24T06:12:00.389114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385733+0000","last_change":"2023-11-24T06:12:00.406268+0000","last_active":"2023-11-24T06:12:01.385733+0000","last_peered":"2023-11-24T06:12:01.385733+0000","last_clean":"2023-11-24T06:12:01.385733+0000","last_became_active":"2023-11-24T06:12:00.405965+0000","last_became_peered":"2023-11-24T06:12:00.405965+0000","last_unstale":"2023-11-24T06:12:01.385733+0000","last_undegraded":"2023-11-24T06:12:01.385733+0000","last_fullsized":"2023-11-24T06:12:01.385733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:42.193371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386128+0000","last_change":"2023-11-24T06:11:59.645602+0000","last_active":"2023-11-24T06:12:01.386128+0000","last_peered":"2023-11-24T06:12:01.386128+0000","last_clean":"2023-11-24T06:12:01.386128+0000","last_became_active":"2023-11-24T06:11:59.645312+0000","last_became_peered":"2023-11-24T06:11:59.645312+0000","last_unstale":"2023-11-24T06:12:01.386128+0000","last_undegraded":"2023-11-24T06:12:01.386128+0000","last_fullsized":"2023-11-24T06:12:01.386128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:43.860695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384670+0000","last_change":"2023-11-24T06:12:00.417986+0000","last_active":"2023-11-24T06:12:01.384670+0000","last_peered":"2023-11-24T06:12:01.384670+0000","last_clean":"2023-11-24T06:12:01.384670+0000","last_became_active":"2023-11-24T06:12:00.417578+0000","last_became_peered":"2023-11-24T06:12:00.417578+0000","last_unstale":"2023-11-24T06:12:01.384670+0000","last_undegraded":"2023-11-24T06:12:01.384670+0000","last_fullsized":"2023-11-24T06:12:01.384670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656198+0000","last_change":"2023-11-24T06:11:59.648128+0000","last_active":"2023-11-24T06:12:00.656198+0000","last_peered":"2023-11-24T06:12:00.656198+0000","last_clean":"2023-11-24T06:12:00.656198+0000","last_became_active":"2023-11-24T06:11:59.647817+0000","last_became_peered":"2023-11-24T06:11:59.647817+0000","last_unstale":"2023-11-24T06:12:00.656198+0000","last_undegraded":"2023-11-24T06:12:00.656198+0000","last_fullsized":"2023-11-24T06:12:00.656198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812611+0000","last_change":"2023-11-24T06:12:00.407315+0000","last_active":"2023-11-24T06:12:01.812611+0000","last_peered":"2023-11-24T06:12:01.812611+0000","last_clean":"2023-11-24T06:12:01.812611+0000","last_became_active":"2023-11-24T06:12:00.406966+0000","last_became_peered":"2023-11-24T06:12:00.406966+0000","last_unstale":"2023-11-24T06:12:01.812611+0000","last_undegraded":"2023-11-24T06:12:01.812611+0000","last_fullsized":"2023-11-24T06:12:01.812611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.382934+0000","last_change":"2023-11-24T06:11:59.641473+0000","last_active":"2023-11-24T06:12:00.382934+0000","last_peered":"2023-11-24T06:12:00.382934+0000","last_clean":"2023-11-24T06:12:00.382934+0000","last_became_active":"2023-11-24T06:11:59.640882+0000","last_became_peered":"2023-11-24T06:11:59.640882+0000","last_unstale":"2023-11-24T06:12:00.382934+0000","last_undegraded":"2023-11-24T06:12:00.382934+0000","last_fullsized":"2023-11-24T06:12:00.382934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:15.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814297+0000","last_change":"2023-11-24T06:12:00.420629+0000","last_active":"2023-11-24T06:12:01.814297+0000","last_peered":"2023-11-24T06:12:01.814297+0000","last_clean":"2023-11-24T06:12:01.814297+0000","last_became_active":"2023-11-24T06:12:00.420121+0000","last_became_peered":"2023-11-24T06:12:00.420121+0000","last_unstale":"2023-11-24T06:12:01.814297+0000","last_undegraded":"2023-11-24T06:12:01.814297+0000","last_fullsized":"2023-11-24T06:12:01.814297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:16.361272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385138+0000","last_change":"2023-11-24T06:11:59.642028+0000","last_active":"2023-11-24T06:12:01.385138+0000","last_peered":"2023-11-24T06:12:01.385138+0000","last_clean":"2023-11-24T06:12:01.385138+0000","last_became_active":"2023-11-24T06:11:59.641734+0000","last_became_peered":"2023-11-24T06:11:59.641734+0000","last_unstale":"2023-11-24T06:12:01.385138+0000","last_undegraded":"2023-11-24T06:12:01.385138+0000","last_fullsized":"2023-11-24T06:12:01.385138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:44.578653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384138+0000","last_change":"2023-11-24T06:12:00.410266+0000","last_active":"2023-11-24T06:12:01.384138+0000","last_peered":"2023-11-24T06:12:01.384138+0000","last_clean":"2023-11-24T06:12:01.384138+0000","last_became_active":"2023-11-24T06:12:00.409968+0000","last_became_peered":"2023-11-24T06:12:00.409968+0000","last_unstale":"2023-11-24T06:12:01.384138+0000","last_undegraded":"2023-11-24T06:12:01.384138+0000","last_fullsized":"2023-11-24T06:12:01.384138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385736+0000","last_change":"2023-11-24T06:11:59.630765+0000","last_active":"2023-11-24T06:12:01.385736+0000","last_peered":"2023-11-24T06:12:01.385736+0000","last_clean":"2023-11-24T06:12:01.385736+0000","last_became_active":"2023-11-24T06:11:59.629875+0000","last_became_peered":"2023-11-24T06:11:59.629875+0000","last_unstale":"2023-11-24T06:12:01.385736+0000","last_undegraded":"2023-11-24T06:12:01.385736+0000","last_fullsized":"2023-11-24T06:12:01.385736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:19.421623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384213+0000","last_change":"2023-11-24T06:12:00.408041+0000","last_active":"2023-11-24T06:12:01.384213+0000","last_peered":"2023-11-24T06:12:01.384213+0000","last_clean":"2023-11-24T06:12:01.384213+0000","last_became_active":"2023-11-24T06:12:00.407616+0000","last_became_peered":"2023-11-24T06:12:00.407616+0000","last_unstale":"2023-11-24T06:12:01.384213+0000","last_undegraded":"2023-11-24T06:12:01.384213+0000","last_fullsized":"2023-11-24T06:12:01.384213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656982+0000","last_change":"2023-11-24T06:11:59.652850+0000","last_active":"2023-11-24T06:12:00.656982+0000","last_peered":"2023-11-24T06:12:00.656982+0000","last_clean":"2023-11-24T06:12:00.656982+0000","last_became_active":"2023-11-24T06:11:59.652583+0000","last_became_peered":"2023-11-24T06:11:59.652583+0000","last_unstale":"2023-11-24T06:12:00.656982+0000","last_undegraded":"2023-11-24T06:12:00.656982+0000","last_fullsized":"2023-11-24T06:12:00.656982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792109+0000","last_change":"2023-11-24T06:12:00.408854+0000","last_active":"2023-11-24T06:12:01.792109+0000","last_peered":"2023-11-24T06:12:01.792109+0000","last_clean":"2023-11-24T06:12:01.792109+0000","last_became_active":"2023-11-24T06:12:00.408541+0000","last_became_peered":"2023-11-24T06:12:00.408541+0000","last_unstale":"2023-11-24T06:12:01.792109+0000","last_undegraded":"2023-11-24T06:12:01.792109+0000","last_fullsized":"2023-11-24T06:12:01.792109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.638814+0000","last_change":"2023-11-24T06:11:59.638814+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.638814+0000","last_undegraded":"2023-11-24T06:11:59.638814+0000","last_fullsized":"2023-11-24T06:11:59.638814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.655824+0000","last_change":"2023-11-24T06:11:59.649445+0000","last_active":"2023-11-24T06:12:00.655824+0000","last_peered":"2023-11-24T06:12:00.655824+0000","last_clean":"2023-11-24T06:12:00.655824+0000","last_became_active":"2023-11-24T06:11:59.649024+0000","last_became_peered":"2023-11-24T06:11:59.649024+0000","last_unstale":"2023-11-24T06:12:00.655824+0000","last_undegraded":"2023-11-24T06:12:00.655824+0000","last_fullsized":"2023-11-24T06:12:00.655824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.639094+0000","last_change":"2023-11-24T06:11:59.639094+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.639094+0000","last_undegraded":"2023-11-24T06:11:59.639094+0000","last_fullsized":"2023-11-24T06:11:59.639094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656014+0000","last_change":"2023-11-24T06:11:59.648255+0000","last_active":"2023-11-24T06:12:00.656014+0000","last_peered":"2023-11-24T06:12:00.656014+0000","last_clean":"2023-11-24T06:12:00.656014+0000","last_became_active":"2023-11-24T06:11:59.647961+0000","last_became_peered":"2023-11-24T06:11:59.647961+0000","last_unstale":"2023-11-24T06:12:00.656014+0000","last_undegraded":"2023-11-24T06:12:00.656014+0000","last_fullsized":"2023-11-24T06:12:00.656014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811821+0000","last_change":"2023-11-24T06:12:00.415607+0000","last_active":"2023-11-24T06:12:01.811821+0000","last_peered":"2023-11-24T06:12:01.811821+0000","last_clean":"2023-11-24T06:12:01.811821+0000","last_became_active":"2023-11-24T06:12:00.415309+0000","last_became_peered":"2023-11-24T06:12:00.415309+0000","last_unstale":"2023-11-24T06:12:01.811821+0000","last_undegraded":"2023-11-24T06:12:01.811821+0000","last_fullsized":"2023-11-24T06:12:01.811821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.646459+0000","last_change":"2023-11-24T06:11:59.634657+0000","last_active":"2023-11-24T06:12:00.646459+0000","last_peered":"2023-11-24T06:12:00.646459+0000","last_clean":"2023-11-24T06:12:00.646459+0000","last_became_active":"2023-11-24T06:11:59.634335+0000","last_became_peered":"2023-11-24T06:11:59.634335+0000","last_unstale":"2023-11-24T06:12:00.646459+0000","last_undegraded":"2023-11-24T06:12:00.646459+0000","last_fullsized":"2023-11-24T06:12:00.646459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384001+0000","last_change":"2023-11-24T06:12:00.415376+0000","last_active":"2023-11-24T06:12:01.384001+0000","last_peered":"2023-11-24T06:12:01.384001+0000","last_clean":"2023-11-24T06:12:01.384001+0000","last_became_active":"2023-11-24T06:12:00.415114+0000","last_became_peered":"2023-11-24T06:12:00.415114+0000","last_unstale":"2023-11-24T06:12:01.384001+0000","last_undegraded":"2023-11-24T06:12:01.384001+0000","last_fullsized":"2023-11-24T06:12:01.384001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654742+0000","last_change":"2023-11-24T06:11:59.645253+0000","last_active":"2023-11-24T06:12:00.654742+0000","last_peered":"2023-11-24T06:12:00.654742+0000","last_clean":"2023-11-24T06:12:00.654742+0000","last_became_active":"2023-11-24T06:11:59.644979+0000","last_became_peered":"2023-11-24T06:11:59.644979+0000","last_unstale":"2023-11-24T06:12:00.654742+0000","last_undegraded":"2023-11-24T06:12:00.654742+0000","last_fullsized":"2023-11-24T06:12:00.654742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:36:07.535502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":56622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.258}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0059999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":666978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:12:05.676 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:12:05.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.943+0000 7f61c6953640 1 Processor -- start 2023-11-24T06:12:05.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.943+0000 7f61c6953640 1 -- start start 2023-11-24T06:12:05.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.944+0000 7f61c6953640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61c006d520 0x7f61c006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.944+0000 7f61c6953640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c015f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61c6953640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c015c360 con 0x7f61c00ad720 2023-11-24T06:12:05.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61c6953640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c00b41a0 con 0x7f61c006d520 2023-11-24T06:12:05.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61c6953640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c006de40 con 0x7f61c00abff0 2023-11-24T06:12:05.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61bffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61c006d520 0x7f61c006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61bf7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f61c00ad720 0x7f61c015ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56634/0 (socket says 172.21.15.22:56634) 2023-11-24T06:12:05.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61bf7fe640 1 -- 172.21.15.22:0/3429078104 learned_addr learned my addr 172.21.15.22:0/3429078104 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61c4ef0640 1 --2- 172.21.15.22:0/3429078104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c015f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61bffff640 1 -- 172.21.15.22:0/3429078104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 msgr2=0x7f61c015f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61bffff640 1 --2- 172.21.15.22:0/3429078104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c015f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61bffff640 1 -- 172.21.15.22:0/3429078104 >> v1:172.21.15.22:6789/0 conn(0x7f61c00ad720 legacy=0x7f61c015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61bffff640 1 -- 172.21.15.22:0/3429078104 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c015ba30 con 0x7f61c006d520 2023-11-24T06:12:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61beffd640 1 -- 172.21.15.22:0/3429078104 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695775925 0 0) 0x7f61c015c360 con 0x7f61c00ad720 2023-11-24T06:12:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.945+0000 7f61c4ef0640 1 --2- 172.21.15.22:0/3429078104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c015f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.947+0000 7f61bffff640 1 --2- 172.21.15.22:0/3429078104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 0x7f61c006d900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009d90 tx=0x7f61b002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e073e64c305c697 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.947+0000 7f61beffd640 1 -- 172.21.15.22:0/3429078104 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b002cc50 con 0x7f61c006d520 2023-11-24T06:12:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.947+0000 7f61beffd640 1 -- 172.21.15.22:0/3429078104 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b002cdb0 con 0x7f61c006d520 2023-11-24T06:12:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.947+0000 7f61beffd640 1 -- 172.21.15.22:0/3429078104 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0034660 con 0x7f61c006d520 2023-11-24T06:12:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.947+0000 7f61c6953640 1 -- 172.21.15.22:0/3429078104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 msgr2=0x7f61c006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.947+0000 7f61c6953640 1 --2- 172.21.15.22:0/3429078104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 0x7f61c006d900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009d90 tx=0x7f61b002bea0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.948+0000 7f61c6953640 1 -- 172.21.15.22:0/3429078104 shutdown_connections 2023-11-24T06:12:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.948+0000 7f61c6953640 1 --2- 172.21.15.22:0/3429078104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c015f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.948+0000 7f61c6953640 1 --2- 172.21.15.22:0/3429078104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 0x7f61c006d900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.948+0000 7f61c6953640 1 -- 172.21.15.22:0/3429078104 >> 172.21.15.22:0/3429078104 conn(0x7f61c00b0d80 msgr2=0x7f61c00b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.948+0000 7f61c6953640 1 -- 172.21.15.22:0/3429078104 shutdown_connections 2023-11-24T06:12:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.948+0000 7f61c6953640 1 -- 172.21.15.22:0/3429078104 wait complete. 2023-11-24T06:12:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.949+0000 7f61c6953640 1 Processor -- start 2023-11-24T06:12:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.950+0000 7f61c6953640 1 -- start start 2023-11-24T06:12:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.950+0000 7f61c6953640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 0x7f61c014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.950+0000 7f61c6953640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c00cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.950+0000 7f61c6953640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00ad720 0x7f61c0071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.950+0000 7f61c6953640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c014cba0 con 0x7f61c006d520 2023-11-24T06:12:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.950+0000 7f61c6953640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c014c020 con 0x7f61c00ad720 2023-11-24T06:12:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.950+0000 7f61c6953640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c014c300 con 0x7f61c00abff0 2023-11-24T06:12:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 0x7f61c014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 0x7f61c014b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46070/0 (socket says 172.21.15.22:46070) 2023-11-24T06:12:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bffff640 1 -- 172.21.15.22:0/2825264718 learned_addr learned my addr 172.21.15.22:0/2825264718 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bf7fe640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c00cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61c4ef0640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00ad720 0x7f61c0071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bffff640 1 -- 172.21.15.22:0/2825264718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 msgr2=0x7f61c00cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bffff640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c00cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bffff640 1 -- 172.21.15.22:0/2825264718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00ad720 msgr2=0x7f61c0071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bffff640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00ad720 0x7f61c0071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bffff640 1 -- 172.21.15.22:0/2825264718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b0009a70 con 0x7f61c006d520 2023-11-24T06:12:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.951+0000 7f61bf7fe640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c00cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.952+0000 7f61bffff640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 0x7f61c014b610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61b0037040 tx=0x7f61b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.952+0000 7f61bcff9640 1 -- 172.21.15.22:0/2825264718 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0040650 con 0x7f61c006d520 2023-11-24T06:12:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.952+0000 7f61bcff9640 1 -- 172.21.15.22:0/2825264718 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b00407b0 con 0x7f61c006d520 2023-11-24T06:12:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.952+0000 7f61bcff9640 1 -- 172.21.15.22:0/2825264718 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0040ba0 con 0x7f61c006d520 2023-11-24T06:12:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.952+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c014c5e0 con 0x7f61c006d520 2023-11-24T06:12:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.952+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c014bb50 con 0x7f61c006d520 2023-11-24T06:12:05.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.953+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c00ae700 con 0x7f61c006d520 2023-11-24T06:12:05.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.955+0000 7f61bcff9640 1 -- 172.21.15.22:0/2825264718 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61b0040d00 con 0x7f61c006d520 2023-11-24T06:12:05.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.955+0000 7f61bcff9640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a006ae90 0x7f61a006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:05.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.955+0000 7f61bcff9640 1 -- 172.21.15.22:0/2825264718 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61b00ac3f0 con 0x7f61c006d520 2023-11-24T06:12:05.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.956+0000 7f61bf7fe640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a006ae90 0x7f61a006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:05.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.956+0000 7f61bf7fe640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a006ae90 0x7f61a006d350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f61c015db70 tx=0x7f61a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:05.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:05.960+0000 7f61bcff9640 1 -- 172.21.15.22:0/2825264718 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61b0077580 con 0x7f61c006d520 2023-11-24T06:12:06.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.155+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61c015b6e0 con 0x7f61a006ae90 2023-11-24T06:12:06.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.175+0000 7f61bcff9640 1 -- 172.21.15.22:0/2825264718 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263507 (secure 0 0 0) 0x7f61a8001c90 con 0x7f61a006ae90 2023-11-24T06:12:06.180 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:06.183 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:12:06.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a006ae90 msgr2=0x7f61a006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:06.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a006ae90 0x7f61a006d350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f61c015db70 tx=0x7f61a8009040 comp rx=0 tx=0).stop 2023-11-24T06:12:06.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 msgr2=0x7f61c014b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:06.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 0x7f61c014b610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61b0037040 tx=0x7f61b0004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:06.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 shutdown_connections 2023-11-24T06:12:06.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a006ae90 0x7f61a006d350 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00ad720 0x7f61c0071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c00abff0 0x7f61c00cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 --2- 172.21.15.22:0/2825264718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006d520 0x7f61c014b610 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 >> 172.21.15.22:0/2825264718 conn(0x7f61c00b0d80 msgr2=0x7f61c015ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:06.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 shutdown_connections 2023-11-24T06:12:06.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.182+0000 7f61c6953640 1 -- 172.21.15.22:0/2825264718 wait complete. 2023-11-24T06:12:06.204 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T06:12:04.647691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235740,"kb_used_data":2912,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738980,"statfs":{"total":773094113280,"available":772852715520,"internally_reserved":0,"allocated":2981888,"data_stored":1773892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001552"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386950+0000","last_change":"2023-11-24T06:12:00.409989+0000","last_active":"2023-11-24T06:12:01.386950+0000","last_peered":"2023-11-24T06:12:01.386950+0000","last_clean":"2023-11-24T06:12:01.386950+0000","last_became_active":"2023-11-24T06:12:00.409672+0000","last_became_peered":"2023-11-24T06:12:00.409672+0000","last_unstale":"2023-11-24T06:12:01.386950+0000","last_undegraded":"2023-11-24T06:12:01.386950+0000","last_fullsized":"2023-11-24T06:12:01.386950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386025+0000","last_change":"2023-11-24T06:12:00.416425+0000","last_active":"2023-11-24T06:12:01.386025+0000","last_peered":"2023-11-24T06:12:01.386025+0000","last_clean":"2023-11-24T06:12:01.386025+0000","last_became_active":"2023-11-24T06:12:00.415783+0000","last_became_peered":"2023-11-24T06:12:00.415783+0000","last_unstale":"2023-11-24T06:12:01.386025+0000","last_undegraded":"2023-11-24T06:12:01.386025+0000","last_fullsized":"2023-11-24T06:12:01.386025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:38:17.759240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811686+0000","last_change":"2023-11-24T06:12:00.408399+0000","last_active":"2023-11-24T06:12:01.811686+0000","last_peered":"2023-11-24T06:12:01.811686+0000","last_clean":"2023-11-24T06:12:01.811686+0000","last_became_active":"2023-11-24T06:12:00.408067+0000","last_became_peered":"2023-11-24T06:12:00.408067+0000","last_unstale":"2023-11-24T06:12:01.811686+0000","last_undegraded":"2023-11-24T06:12:01.811686+0000","last_fullsized":"2023-11-24T06:12:01.811686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.639601+0000","last_change":"2023-11-24T06:11:59.639601+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.639601+0000","last_undegraded":"2023-11-24T06:11:59.639601+0000","last_fullsized":"2023-11-24T06:11:59.639601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:12:00.400306+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:12:00.399964+0000","last_became_peered":"2023-11-24T06:12:00.399964+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.641902+0000","last_change":"2023-11-24T06:11:59.641902+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.641902+0000","last_undegraded":"2023-11-24T06:11:59.641902+0000","last_fullsized":"2023-11-24T06:11:59.641902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385528+0000","last_change":"2023-11-24T06:12:00.408860+0000","last_active":"2023-11-24T06:12:01.385528+0000","last_peered":"2023-11-24T06:12:01.385528+0000","last_clean":"2023-11-24T06:12:01.385528+0000","last_became_active":"2023-11-24T06:12:00.408549+0000","last_became_peered":"2023-11-24T06:12:00.408549+0000","last_unstale":"2023-11-24T06:12:01.385528+0000","last_undegraded":"2023-11-24T06:12:01.385528+0000","last_fullsized":"2023-11-24T06:12:01.385528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383026+0000","last_change":"2023-11-24T06:12:00.413017+0000","last_active":"2023-11-24T06:12:01.383026+0000","last_peered":"2023-11-24T06:12:01.383026+0000","last_clean":"2023-11-24T06:12:01.383026+0000","last_became_active":"2023-11-24T06:12:00.411843+0000","last_became_peered":"2023-11-24T06:12:00.411843+0000","last_unstale":"2023-11-24T06:12:01.383026+0000","last_undegraded":"2023-11-24T06:12:01.383026+0000","last_fullsized":"2023-11-24T06:12:01.383026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387045+0000","last_change":"2023-11-24T06:12:00.418547+0000","last_active":"2023-11-24T06:12:01.387045+0000","last_peered":"2023-11-24T06:12:01.387045+0000","last_clean":"2023-11-24T06:12:01.387045+0000","last_became_active":"2023-11-24T06:12:00.418264+0000","last_became_peered":"2023-11-24T06:12:00.418264+0000","last_unstale":"2023-11-24T06:12:01.387045+0000","last_undegraded":"2023-11-24T06:12:01.387045+0000","last_fullsized":"2023-11-24T06:12:01.387045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792917+0000","last_change":"2023-11-24T06:12:00.413548+0000","last_active":"2023-11-24T06:12:01.792917+0000","last_peered":"2023-11-24T06:12:01.792917+0000","last_clean":"2023-11-24T06:12:01.792917+0000","last_became_active":"2023-11-24T06:12:00.413225+0000","last_became_peered":"2023-11-24T06:12:00.413225+0000","last_unstale":"2023-11-24T06:12:01.792917+0000","last_undegraded":"2023-11-24T06:12:01.792917+0000","last_fullsized":"2023-11-24T06:12:01.792917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792746+0000","last_change":"2023-11-24T06:12:00.415528+0000","last_active":"2023-11-24T06:12:01.792746+0000","last_peered":"2023-11-24T06:12:01.792746+0000","last_clean":"2023-11-24T06:12:01.792746+0000","last_became_active":"2023-11-24T06:12:00.414074+0000","last_became_peered":"2023-11-24T06:12:00.414074+0000","last_unstale":"2023-11-24T06:12:01.792746+0000","last_undegraded":"2023-11-24T06:12:01.792746+0000","last_fullsized":"2023-11-24T06:12:01.792746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814560+0000","last_change":"2023-11-24T06:12:00.412466+0000","last_active":"2023-11-24T06:12:01.814560+0000","last_peered":"2023-11-24T06:12:01.814560+0000","last_clean":"2023-11-24T06:12:01.814560+0000","last_became_active":"2023-11-24T06:12:00.412189+0000","last_became_peered":"2023-11-24T06:12:00.412189+0000","last_unstale":"2023-11-24T06:12:01.814560+0000","last_undegraded":"2023-11-24T06:12:01.814560+0000","last_fullsized":"2023-11-24T06:12:01.814560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:33.179248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384061+0000","last_change":"2023-11-24T06:12:00.410091+0000","last_active":"2023-11-24T06:12:01.384061+0000","last_peered":"2023-11-24T06:12:01.384061+0000","last_clean":"2023-11-24T06:12:01.384061+0000","last_became_active":"2023-11-24T06:12:00.409724+0000","last_became_peered":"2023-11-24T06:12:00.409724+0000","last_unstale":"2023-11-24T06:12:01.384061+0000","last_undegraded":"2023-11-24T06:12:01.384061+0000","last_fullsized":"2023-11-24T06:12:01.384061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811279+0000","last_change":"2023-11-24T06:12:00.413928+0000","last_active":"2023-11-24T06:12:01.811279+0000","last_peered":"2023-11-24T06:12:01.811279+0000","last_clean":"2023-11-24T06:12:01.811279+0000","last_became_active":"2023-11-24T06:12:00.408524+0000","last_became_peered":"2023-11-24T06:12:00.408524+0000","last_unstale":"2023-11-24T06:12:01.811279+0000","last_undegraded":"2023-11-24T06:12:01.811279+0000","last_fullsized":"2023-11-24T06:12:01.811279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:21.383018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385301+0000","last_change":"2023-11-24T06:12:00.414487+0000","last_active":"2023-11-24T06:12:01.385301+0000","last_peered":"2023-11-24T06:12:01.385301+0000","last_clean":"2023-11-24T06:12:01.385301+0000","last_became_active":"2023-11-24T06:12:00.412548+0000","last_became_peered":"2023-11-24T06:12:00.412548+0000","last_unstale":"2023-11-24T06:12:01.385301+0000","last_undegraded":"2023-11-24T06:12:01.385301+0000","last_fullsized":"2023-11-24T06:12:01.385301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:04.491629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.641036+0000","last_change":"2023-11-24T06:11:59.641036+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.641036+0000","last_undegraded":"2023-11-24T06:11:59.641036+0000","last_fullsized":"2023-11-24T06:11:59.641036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.635690+0000","last_change":"2023-11-24T06:11:59.635690+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.635690+0000","last_undegraded":"2023-11-24T06:11:59.635690+0000","last_fullsized":"2023-11-24T06:11:59.635690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812634+0000","last_change":"2023-11-24T06:12:00.415065+0000","last_active":"2023-11-24T06:12:01.812634+0000","last_peered":"2023-11-24T06:12:01.812634+0000","last_clean":"2023-11-24T06:12:01.812634+0000","last_became_active":"2023-11-24T06:12:00.414686+0000","last_became_peered":"2023-11-24T06:12:00.414686+0000","last_unstale":"2023-11-24T06:12:01.812634+0000","last_undegraded":"2023-11-24T06:12:01.812634+0000","last_fullsized":"2023-11-24T06:12:01.812634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.404241+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.403972+0000","last_became_peered":"2023-11-24T06:12:00.403972+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792421+0000","last_change":"2023-11-24T06:12:00.422094+0000","last_active":"2023-11-24T06:12:01.792421+0000","last_peered":"2023-11-24T06:12:01.792421+0000","last_clean":"2023-11-24T06:12:01.792421+0000","last_became_active":"2023-11-24T06:12:00.421724+0000","last_became_peered":"2023-11-24T06:12:00.421724+0000","last_unstale":"2023-11-24T06:12:01.792421+0000","last_undegraded":"2023-11-24T06:12:01.792421+0000","last_fullsized":"2023-11-24T06:12:01.792421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811370+0000","last_change":"2023-11-24T06:12:00.411570+0000","last_active":"2023-11-24T06:12:01.811370+0000","last_peered":"2023-11-24T06:12:01.811370+0000","last_clean":"2023-11-24T06:12:01.811370+0000","last_became_active":"2023-11-24T06:12:00.411118+0000","last_became_peered":"2023-11-24T06:12:00.411118+0000","last_unstale":"2023-11-24T06:12:01.811370+0000","last_undegraded":"2023-11-24T06:12:01.811370+0000","last_fullsized":"2023-11-24T06:12:01.811370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:15.863418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.634866+0000","last_change":"2023-11-24T06:11:59.634866+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.634866+0000","last_undegraded":"2023-11-24T06:11:59.634866+0000","last_fullsized":"2023-11-24T06:11:59.634866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383318+0000","last_change":"2023-11-24T06:12:00.410431+0000","last_active":"2023-11-24T06:12:01.383318+0000","last_peered":"2023-11-24T06:12:01.383318+0000","last_clean":"2023-11-24T06:12:01.383318+0000","last_became_active":"2023-11-24T06:12:00.410132+0000","last_became_peered":"2023-11-24T06:12:00.410132+0000","last_unstale":"2023-11-24T06:12:01.383318+0000","last_undegraded":"2023-11-24T06:12:01.383318+0000","last_fullsized":"2023-11-24T06:12:01.383318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.636236+0000","last_change":"2023-11-24T06:11:59.636236+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.636236+0000","last_undegraded":"2023-11-24T06:11:59.636236+0000","last_fullsized":"2023-11-24T06:11:59.636236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384663+0000","last_change":"2023-11-24T06:12:00.419798+0000","last_active":"2023-11-24T06:12:01.384663+0000","last_peered":"2023-11-24T06:12:01.384663+0000","last_clean":"2023-11-24T06:12:01.384663+0000","last_became_active":"2023-11-24T06:12:00.419568+0000","last_became_peered":"2023-11-24T06:12:00.419568+0000","last_unstale":"2023-11-24T06:12:01.384663+0000","last_undegraded":"2023-11-24T06:12:01.384663+0000","last_fullsized":"2023-11-24T06:12:01.384663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.793026+0000","last_change":"2023-11-24T06:12:00.412430+0000","last_active":"2023-11-24T06:12:01.793026+0000","last_peered":"2023-11-24T06:12:01.793026+0000","last_clean":"2023-11-24T06:12:01.793026+0000","last_became_active":"2023-11-24T06:12:00.411971+0000","last_became_peered":"2023-11-24T06:12:00.411971+0000","last_unstale":"2023-11-24T06:12:01.793026+0000","last_undegraded":"2023-11-24T06:12:01.793026+0000","last_fullsized":"2023-11-24T06:12:01.793026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385763+0000","last_change":"2023-11-24T06:12:00.414558+0000","last_active":"2023-11-24T06:12:01.385763+0000","last_peered":"2023-11-24T06:12:01.385763+0000","last_clean":"2023-11-24T06:12:01.385763+0000","last_became_active":"2023-11-24T06:12:00.414279+0000","last_became_peered":"2023-11-24T06:12:00.414279+0000","last_unstale":"2023-11-24T06:12:01.385763+0000","last_undegraded":"2023-11-24T06:12:01.385763+0000","last_fullsized":"2023-11-24T06:12:01.385763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:00.298898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384237+0000","last_change":"2023-11-24T06:12:00.423044+0000","last_active":"2023-11-24T06:12:01.384237+0000","last_peered":"2023-11-24T06:12:01.384237+0000","last_clean":"2023-11-24T06:12:01.384237+0000","last_became_active":"2023-11-24T06:12:00.422684+0000","last_became_peered":"2023-11-24T06:12:00.422684+0000","last_unstale":"2023-11-24T06:12:01.384237+0000","last_undegraded":"2023-11-24T06:12:01.384237+0000","last_fullsized":"2023-11-24T06:12:01.384237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811420+0000","last_change":"2023-11-24T06:12:00.406540+0000","last_active":"2023-11-24T06:12:01.811420+0000","last_peered":"2023-11-24T06:12:01.811420+0000","last_clean":"2023-11-24T06:12:01.811420+0000","last_became_active":"2023-11-24T06:12:00.406115+0000","last_became_peered":"2023-11-24T06:12:00.406115+0000","last_unstale":"2023-11-24T06:12:01.811420+0000","last_undegraded":"2023-11-24T06:12:01.811420+0000","last_fullsized":"2023-11-24T06:12:01.811420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.632627+0000","last_change":"2023-11-24T06:11:59.632627+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.632627+0000","last_undegraded":"2023-11-24T06:11:59.632627+0000","last_fullsized":"2023-11-24T06:11:59.632627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812046+0000","last_change":"2023-11-24T06:12:00.413545+0000","last_active":"2023-11-24T06:12:01.812046+0000","last_peered":"2023-11-24T06:12:01.812046+0000","last_clean":"2023-11-24T06:12:01.812046+0000","last_became_active":"2023-11-24T06:12:00.411644+0000","last_became_peered":"2023-11-24T06:12:00.411644+0000","last_unstale":"2023-11-24T06:12:01.812046+0000","last_undegraded":"2023-11-24T06:12:01.812046+0000","last_fullsized":"2023-11-24T06:12:01.812046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792092+0000","last_change":"2023-11-24T06:12:00.411309+0000","last_active":"2023-11-24T06:12:01.792092+0000","last_peered":"2023-11-24T06:12:01.792092+0000","last_clean":"2023-11-24T06:12:01.792092+0000","last_became_active":"2023-11-24T06:12:00.409967+0000","last_became_peered":"2023-11-24T06:12:00.409967+0000","last_unstale":"2023-11-24T06:12:01.792092+0000","last_undegraded":"2023-11-24T06:12:01.792092+0000","last_fullsized":"2023-11-24T06:12:01.792092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814781+0000","last_change":"2023-11-24T06:12:00.417149+0000","last_active":"2023-11-24T06:12:01.814781+0000","last_peered":"2023-11-24T06:12:01.814781+0000","last_clean":"2023-11-24T06:12:01.814781+0000","last_became_active":"2023-11-24T06:12:00.410529+0000","last_became_peered":"2023-11-24T06:12:00.410529+0000","last_unstale":"2023-11-24T06:12:01.814781+0000","last_undegraded":"2023-11-24T06:12:01.814781+0000","last_fullsized":"2023-11-24T06:12:01.814781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654819+0000","last_change":"2023-11-24T06:11:59.645470+0000","last_active":"2023-11-24T06:12:00.654819+0000","last_peered":"2023-11-24T06:12:00.654819+0000","last_clean":"2023-11-24T06:12:00.654819+0000","last_became_active":"2023-11-24T06:11:59.644424+0000","last_became_peered":"2023-11-24T06:11:59.644424+0000","last_unstale":"2023-11-24T06:12:00.654819+0000","last_undegraded":"2023-11-24T06:12:00.654819+0000","last_fullsized":"2023-11-24T06:12:00.654819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811571+0000","last_change":"2023-11-24T06:12:00.421116+0000","last_active":"2023-11-24T06:12:01.811571+0000","last_peered":"2023-11-24T06:12:01.811571+0000","last_clean":"2023-11-24T06:12:01.811571+0000","last_became_active":"2023-11-24T06:12:00.420793+0000","last_became_peered":"2023-11-24T06:12:00.420793+0000","last_unstale":"2023-11-24T06:12:01.811571+0000","last_undegraded":"2023-11-24T06:12:01.811571+0000","last_fullsized":"2023-11-24T06:12:01.811571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654126+0000","last_change":"2023-11-24T06:11:59.657132+0000","last_active":"2023-11-24T06:12:00.654126+0000","last_peered":"2023-11-24T06:12:00.654126+0000","last_clean":"2023-11-24T06:12:00.654126+0000","last_became_active":"2023-11-24T06:11:59.656475+0000","last_became_peered":"2023-11-24T06:11:59.656475+0000","last_unstale":"2023-11-24T06:12:00.654126+0000","last_undegraded":"2023-11-24T06:12:00.654126+0000","last_fullsized":"2023-11-24T06:12:00.654126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.392519+0000","last_change":"2023-11-24T06:11:59.647264+0000","last_active":"2023-11-24T06:12:00.392519+0000","last_peered":"2023-11-24T06:12:00.392519+0000","last_clean":"2023-11-24T06:12:00.392519+0000","last_became_active":"2023-11-24T06:11:59.646951+0000","last_became_peered":"2023-11-24T06:11:59.646951+0000","last_unstale":"2023-11-24T06:12:00.392519+0000","last_undegraded":"2023-11-24T06:12:00.392519+0000","last_fullsized":"2023-11-24T06:12:00.392519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383246+0000","last_change":"2023-11-24T06:12:00.410276+0000","last_active":"2023-11-24T06:12:01.383246+0000","last_peered":"2023-11-24T06:12:01.383246+0000","last_clean":"2023-11-24T06:12:01.383246+0000","last_became_active":"2023-11-24T06:12:00.407839+0000","last_became_peered":"2023-11-24T06:12:00.407839+0000","last_unstale":"2023-11-24T06:12:01.383246+0000","last_undegraded":"2023-11-24T06:12:01.383246+0000","last_fullsized":"2023-11-24T06:12:01.383246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.661328+0000","last_change":"2023-11-24T06:11:59.656673+0000","last_active":"2023-11-24T06:11:59.661328+0000","last_peered":"2023-11-24T06:11:59.661328+0000","last_clean":"2023-11-24T06:11:59.661328+0000","last_became_active":"2023-11-24T06:11:59.656322+0000","last_became_peered":"2023-11-24T06:11:59.656322+0000","last_unstale":"2023-11-24T06:11:59.661328+0000","last_undegraded":"2023-11-24T06:11:59.661328+0000","last_fullsized":"2023-11-24T06:11:59.661328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:33:03.536712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385041+0000","last_change":"2023-11-24T06:12:00.411377+0000","last_active":"2023-11-24T06:12:01.385041+0000","last_peered":"2023-11-24T06:12:01.385041+0000","last_clean":"2023-11-24T06:12:01.385041+0000","last_became_active":"2023-11-24T06:12:00.411117+0000","last_became_peered":"2023-11-24T06:12:00.411117+0000","last_unstale":"2023-11-24T06:12:01.385041+0000","last_undegraded":"2023-11-24T06:12:01.385041+0000","last_fullsized":"2023-11-24T06:12:01.385041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:55.958831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.404314+0000","last_change":"2023-11-24T06:11:59.652584+0000","last_active":"2023-11-24T06:12:00.404314+0000","last_peered":"2023-11-24T06:12:00.404314+0000","last_clean":"2023-11-24T06:12:00.404314+0000","last_became_active":"2023-11-24T06:11:59.652269+0000","last_became_peered":"2023-11-24T06:11:59.652269+0000","last_unstale":"2023-11-24T06:12:00.404314+0000","last_undegraded":"2023-11-24T06:12:00.404314+0000","last_fullsized":"2023-11-24T06:12:00.404314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.631645+0000","last_change":"2023-11-24T06:11:59.631645+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.631645+0000","last_undegraded":"2023-11-24T06:11:59.631645+0000","last_fullsized":"2023-11-24T06:11:59.631645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.655388+0000","last_change":"2023-11-24T06:11:59.649342+0000","last_active":"2023-11-24T06:11:59.655388+0000","last_peered":"2023-11-24T06:11:59.655388+0000","last_clean":"2023-11-24T06:11:59.655388+0000","last_became_active":"2023-11-24T06:11:59.649022+0000","last_became_peered":"2023-11-24T06:11:59.649022+0000","last_unstale":"2023-11-24T06:11:59.655388+0000","last_undegraded":"2023-11-24T06:11:59.655388+0000","last_fullsized":"2023-11-24T06:11:59.655388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:12:45.266944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812025+0000","last_change":"2023-11-24T06:12:00.418160+0000","last_active":"2023-11-24T06:12:01.812025+0000","last_peered":"2023-11-24T06:12:01.812025+0000","last_clean":"2023-11-24T06:12:01.812025+0000","last_became_active":"2023-11-24T06:12:00.417836+0000","last_became_peered":"2023-11-24T06:12:00.417836+0000","last_unstale":"2023-11-24T06:12:01.812025+0000","last_undegraded":"2023-11-24T06:12:01.812025+0000","last_fullsized":"2023-11-24T06:12:01.812025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385956+0000","last_change":"2023-11-24T06:11:59.644472+0000","last_active":"2023-11-24T06:12:01.385956+0000","last_peered":"2023-11-24T06:12:01.385956+0000","last_clean":"2023-11-24T06:12:01.385956+0000","last_became_active":"2023-11-24T06:11:59.644152+0000","last_became_peered":"2023-11-24T06:11:59.644152+0000","last_unstale":"2023-11-24T06:12:01.385956+0000","last_undegraded":"2023-11-24T06:12:01.385956+0000","last_fullsized":"2023-11-24T06:12:01.385956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:50.982166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814768+0000","last_change":"2023-11-24T06:12:00.411893+0000","last_active":"2023-11-24T06:12:01.814768+0000","last_peered":"2023-11-24T06:12:01.814768+0000","last_clean":"2023-11-24T06:12:01.814768+0000","last_became_active":"2023-11-24T06:12:00.411029+0000","last_became_peered":"2023-11-24T06:12:00.411029+0000","last_unstale":"2023-11-24T06:12:01.814768+0000","last_undegraded":"2023-11-24T06:12:01.814768+0000","last_fullsized":"2023-11-24T06:12:01.814768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:01.536292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.658392+0000","last_change":"2023-11-24T06:11:59.648134+0000","last_active":"2023-11-24T06:12:00.658392+0000","last_peered":"2023-11-24T06:12:00.658392+0000","last_clean":"2023-11-24T06:12:00.658392+0000","last_became_active":"2023-11-24T06:11:59.647824+0000","last_became_peered":"2023-11-24T06:11:59.647824+0000","last_unstale":"2023-11-24T06:12:00.658392+0000","last_undegraded":"2023-11-24T06:12:00.658392+0000","last_fullsized":"2023-11-24T06:12:00.658392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385778+0000","last_change":"2023-11-24T06:12:00.417420+0000","last_active":"2023-11-24T06:12:01.385778+0000","last_peered":"2023-11-24T06:12:01.385778+0000","last_clean":"2023-11-24T06:12:01.385778+0000","last_became_active":"2023-11-24T06:12:00.416624+0000","last_became_peered":"2023-11-24T06:12:00.416624+0000","last_unstale":"2023-11-24T06:12:01.385778+0000","last_undegraded":"2023-11-24T06:12:01.385778+0000","last_fullsized":"2023-11-24T06:12:01.385778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656684+0000","last_change":"2023-11-24T06:11:59.650532+0000","last_active":"2023-11-24T06:12:00.656684+0000","last_peered":"2023-11-24T06:12:00.656684+0000","last_clean":"2023-11-24T06:12:00.656684+0000","last_became_active":"2023-11-24T06:11:59.650193+0000","last_became_peered":"2023-11-24T06:11:59.650193+0000","last_unstale":"2023-11-24T06:12:00.656684+0000","last_undegraded":"2023-11-24T06:12:00.656684+0000","last_fullsized":"2023-11-24T06:12:00.656684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811425+0000","last_change":"2023-11-24T06:12:00.411372+0000","last_active":"2023-11-24T06:12:01.811425+0000","last_peered":"2023-11-24T06:12:01.811425+0000","last_clean":"2023-11-24T06:12:01.811425+0000","last_became_active":"2023-11-24T06:12:00.410699+0000","last_became_peered":"2023-11-24T06:12:00.410699+0000","last_unstale":"2023-11-24T06:12:01.811425+0000","last_undegraded":"2023-11-24T06:12:01.811425+0000","last_fullsized":"2023-11-24T06:12:01.811425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.655458+0000","last_change":"2023-11-24T06:11:59.650677+0000","last_active":"2023-11-24T06:11:59.655458+0000","last_peered":"2023-11-24T06:11:59.655458+0000","last_clean":"2023-11-24T06:11:59.655458+0000","last_became_active":"2023-11-24T06:11:59.650368+0000","last_became_peered":"2023-11-24T06:11:59.650368+0000","last_unstale":"2023-11-24T06:11:59.655458+0000","last_undegraded":"2023-11-24T06:11:59.655458+0000","last_fullsized":"2023-11-24T06:11:59.655458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386237+0000","last_change":"2023-11-24T06:12:00.409066+0000","last_active":"2023-11-24T06:12:01.386237+0000","last_peered":"2023-11-24T06:12:01.386237+0000","last_clean":"2023-11-24T06:12:01.386237+0000","last_became_active":"2023-11-24T06:12:00.408722+0000","last_became_peered":"2023-11-24T06:12:00.408722+0000","last_unstale":"2023-11-24T06:12:01.386237+0000","last_undegraded":"2023-11-24T06:12:01.386237+0000","last_fullsized":"2023-11-24T06:12:01.386237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.399698+0000","last_change":"2023-11-24T06:11:59.653443+0000","last_active":"2023-11-24T06:12:00.399698+0000","last_peered":"2023-11-24T06:12:00.399698+0000","last_clean":"2023-11-24T06:12:00.399698+0000","last_became_active":"2023-11-24T06:11:59.653091+0000","last_became_peered":"2023-11-24T06:11:59.653091+0000","last_unstale":"2023-11-24T06:12:00.399698+0000","last_undegraded":"2023-11-24T06:12:00.399698+0000","last_fullsized":"2023-11-24T06:12:00.399698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792087+0000","last_change":"2023-11-24T06:12:00.415948+0000","last_active":"2023-11-24T06:12:01.792087+0000","last_peered":"2023-11-24T06:12:01.792087+0000","last_clean":"2023-11-24T06:12:01.792087+0000","last_became_active":"2023-11-24T06:12:00.415597+0000","last_became_peered":"2023-11-24T06:12:00.415597+0000","last_unstale":"2023-11-24T06:12:01.792087+0000","last_undegraded":"2023-11-24T06:12:01.792087+0000","last_fullsized":"2023-11-24T06:12:01.792087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648785+0000","last_change":"2023-11-24T06:11:59.620020+0000","last_active":"2023-11-24T06:12:00.648785+0000","last_peered":"2023-11-24T06:12:00.648785+0000","last_clean":"2023-11-24T06:12:00.648785+0000","last_became_active":"2023-11-24T06:11:59.619675+0000","last_became_peered":"2023-11-24T06:11:59.619675+0000","last_unstale":"2023-11-24T06:12:00.648785+0000","last_undegraded":"2023-11-24T06:12:00.648785+0000","last_fullsized":"2023-11-24T06:12:00.648785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385713+0000","last_change":"2023-11-24T06:12:00.412328+0000","last_active":"2023-11-24T06:12:01.385713+0000","last_peered":"2023-11-24T06:12:01.385713+0000","last_clean":"2023-11-24T06:12:01.385713+0000","last_became_active":"2023-11-24T06:12:00.412057+0000","last_became_peered":"2023-11-24T06:12:00.412057+0000","last_unstale":"2023-11-24T06:12:01.385713+0000","last_undegraded":"2023-11-24T06:12:01.385713+0000","last_fullsized":"2023-11-24T06:12:01.385713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.650279+0000","last_change":"2023-11-24T06:11:59.650120+0000","last_active":"2023-11-24T06:12:00.650279+0000","last_peered":"2023-11-24T06:12:00.650279+0000","last_clean":"2023-11-24T06:12:00.650279+0000","last_became_active":"2023-11-24T06:11:59.647975+0000","last_became_peered":"2023-11-24T06:11:59.647975+0000","last_unstale":"2023-11-24T06:12:00.650279+0000","last_undegraded":"2023-11-24T06:12:00.650279+0000","last_fullsized":"2023-11-24T06:12:00.650279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.407351+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.406978+0000","last_became_peered":"2023-11-24T06:12:00.406978+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648323+0000","last_change":"2023-11-24T06:11:59.628459+0000","last_active":"2023-11-24T06:12:00.648323+0000","last_peered":"2023-11-24T06:12:00.648323+0000","last_clean":"2023-11-24T06:12:00.648323+0000","last_became_active":"2023-11-24T06:11:59.628147+0000","last_became_peered":"2023-11-24T06:11:59.628147+0000","last_unstale":"2023-11-24T06:12:00.648323+0000","last_undegraded":"2023-11-24T06:12:00.648323+0000","last_fullsized":"2023-11-24T06:12:00.648323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387133+0000","last_change":"2023-11-24T06:12:00.424920+0000","last_active":"2023-11-24T06:12:01.387133+0000","last_peered":"2023-11-24T06:12:01.387133+0000","last_clean":"2023-11-24T06:12:01.387133+0000","last_became_active":"2023-11-24T06:12:00.423927+0000","last_became_peered":"2023-11-24T06:12:00.423927+0000","last_unstale":"2023-11-24T06:12:01.387133+0000","last_undegraded":"2023-11-24T06:12:01.387133+0000","last_fullsized":"2023-11-24T06:12:01.387133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:54:14.921315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:11:59.643977+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:11:59.643552+0000","last_became_peered":"2023-11-24T06:11:59.643552+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:02.323910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.636264+0000","last_change":"2023-11-24T06:11:59.636264+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.636264+0000","last_undegraded":"2023-11-24T06:11:59.636264+0000","last_fullsized":"2023-11-24T06:11:59.636264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379381+0000","last_change":"2023-11-24T06:11:59.643121+0000","last_active":"2023-11-24T06:12:00.379381+0000","last_peered":"2023-11-24T06:12:00.379381+0000","last_clean":"2023-11-24T06:12:00.379381+0000","last_became_active":"2023-11-24T06:11:59.642797+0000","last_became_peered":"2023-11-24T06:11:59.642797+0000","last_unstale":"2023-11-24T06:12:00.379381+0000","last_undegraded":"2023-11-24T06:12:00.379381+0000","last_fullsized":"2023-11-24T06:12:00.379381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386156+0000","last_change":"2023-11-24T06:12:00.417716+0000","last_active":"2023-11-24T06:12:01.386156+0000","last_peered":"2023-11-24T06:12:01.386156+0000","last_clean":"2023-11-24T06:12:01.386156+0000","last_became_active":"2023-11-24T06:12:00.417088+0000","last_became_peered":"2023-11-24T06:12:00.417088+0000","last_unstale":"2023-11-24T06:12:01.386156+0000","last_undegraded":"2023-11-24T06:12:01.386156+0000","last_fullsized":"2023-11-24T06:12:01.386156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383162+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:12:00.383162+0000","last_peered":"2023-11-24T06:12:00.383162+0000","last_clean":"2023-11-24T06:12:00.383162+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:12:00.383162+0000","last_undegraded":"2023-11-24T06:12:00.383162+0000","last_fullsized":"2023-11-24T06:12:00.383162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.655438+0000","last_change":"2023-11-24T06:11:59.649393+0000","last_active":"2023-11-24T06:11:59.655438+0000","last_peered":"2023-11-24T06:11:59.655438+0000","last_clean":"2023-11-24T06:11:59.655438+0000","last_became_active":"2023-11-24T06:11:59.649045+0000","last_became_peered":"2023-11-24T06:11:59.649045+0000","last_unstale":"2023-11-24T06:11:59.655438+0000","last_undegraded":"2023-11-24T06:11:59.655438+0000","last_fullsized":"2023-11-24T06:11:59.655438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383623+0000","last_change":"2023-11-24T06:12:00.417107+0000","last_active":"2023-11-24T06:12:01.383623+0000","last_peered":"2023-11-24T06:12:01.383623+0000","last_clean":"2023-11-24T06:12:01.383623+0000","last_became_active":"2023-11-24T06:12:00.416181+0000","last_became_peered":"2023-11-24T06:12:00.416181+0000","last_unstale":"2023-11-24T06:12:01.383623+0000","last_undegraded":"2023-11-24T06:12:01.383623+0000","last_fullsized":"2023-11-24T06:12:01.383623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383049+0000","last_change":"2023-11-24T06:11:59.641692+0000","last_active":"2023-11-24T06:12:00.383049+0000","last_peered":"2023-11-24T06:12:00.383049+0000","last_clean":"2023-11-24T06:12:00.383049+0000","last_became_active":"2023-11-24T06:11:59.641199+0000","last_became_peered":"2023-11-24T06:11:59.641199+0000","last_unstale":"2023-11-24T06:12:00.383049+0000","last_undegraded":"2023-11-24T06:12:00.383049+0000","last_fullsized":"2023-11-24T06:12:00.383049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811125+0000","last_change":"2023-11-24T06:12:00.421725+0000","last_active":"2023-11-24T06:12:01.811125+0000","last_peered":"2023-11-24T06:12:01.811125+0000","last_clean":"2023-11-24T06:12:01.811125+0000","last_became_active":"2023-11-24T06:12:00.421402+0000","last_became_peered":"2023-11-24T06:12:00.421402+0000","last_unstale":"2023-11-24T06:12:01.811125+0000","last_undegraded":"2023-11-24T06:12:01.811125+0000","last_fullsized":"2023-11-24T06:12:01.811125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:16.430001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379330+0000","last_change":"2023-11-24T06:11:59.628457+0000","last_active":"2023-11-24T06:12:00.379330+0000","last_peered":"2023-11-24T06:12:00.379330+0000","last_clean":"2023-11-24T06:12:00.379330+0000","last_became_active":"2023-11-24T06:11:59.628109+0000","last_became_peered":"2023-11-24T06:11:59.628109+0000","last_unstale":"2023-11-24T06:12:00.379330+0000","last_undegraded":"2023-11-24T06:12:00.379330+0000","last_fullsized":"2023-11-24T06:12:00.379330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385318+0000","last_change":"2023-11-24T06:12:00.406591+0000","last_active":"2023-11-24T06:12:01.385318+0000","last_peered":"2023-11-24T06:12:01.385318+0000","last_clean":"2023-11-24T06:12:01.385318+0000","last_became_active":"2023-11-24T06:12:00.406217+0000","last_became_peered":"2023-11-24T06:12:00.406217+0000","last_unstale":"2023-11-24T06:12:01.385318+0000","last_undegraded":"2023-11-24T06:12:01.385318+0000","last_fullsized":"2023-11-24T06:12:01.385318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:49.548969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:11:59.652345+0000","last_change":"2023-11-24T06:11:59.645058+0000","last_active":"2023-11-24T06:11:59.652345+0000","last_peered":"2023-11-24T06:11:59.652345+0000","last_clean":"2023-11-24T06:11:59.652345+0000","last_became_active":"2023-11-24T06:11:59.642696+0000","last_became_peered":"2023-11-24T06:11:59.642696+0000","last_unstale":"2023-11-24T06:11:59.652345+0000","last_undegraded":"2023-11-24T06:11:59.652345+0000","last_fullsized":"2023-11-24T06:11:59.652345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:43.070876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.815366+0000","last_change":"2023-11-24T06:12:00.415699+0000","last_active":"2023-11-24T06:12:01.815366+0000","last_peered":"2023-11-24T06:12:01.815366+0000","last_clean":"2023-11-24T06:12:01.815366+0000","last_became_active":"2023-11-24T06:12:00.412274+0000","last_became_peered":"2023-11-24T06:12:00.412274+0000","last_unstale":"2023-11-24T06:12:01.815366+0000","last_undegraded":"2023-11-24T06:12:01.815366+0000","last_fullsized":"2023-11-24T06:12:01.815366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385632+0000","last_change":"2023-11-24T06:11:59.633842+0000","last_active":"2023-11-24T06:12:01.385632+0000","last_peered":"2023-11-24T06:12:01.385632+0000","last_clean":"2023-11-24T06:12:01.385632+0000","last_became_active":"2023-11-24T06:11:59.632890+0000","last_became_peered":"2023-11-24T06:11:59.632890+0000","last_unstale":"2023-11-24T06:12:01.385632+0000","last_undegraded":"2023-11-24T06:12:01.385632+0000","last_fullsized":"2023-11-24T06:12:01.385632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:00.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.637570+0000","last_change":"2023-11-24T06:11:59.637570+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.637570+0000","last_undegraded":"2023-11-24T06:11:59.637570+0000","last_fullsized":"2023-11-24T06:11:59.637570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.389114+0000","last_change":"2023-11-24T06:11:59.644082+0000","last_active":"2023-11-24T06:12:00.389114+0000","last_peered":"2023-11-24T06:12:00.389114+0000","last_clean":"2023-11-24T06:12:00.389114+0000","last_became_active":"2023-11-24T06:11:59.640160+0000","last_became_peered":"2023-11-24T06:11:59.640160+0000","last_unstale":"2023-11-24T06:12:00.389114+0000","last_undegraded":"2023-11-24T06:12:00.389114+0000","last_fullsized":"2023-11-24T06:12:00.389114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385733+0000","last_change":"2023-11-24T06:12:00.406268+0000","last_active":"2023-11-24T06:12:01.385733+0000","last_peered":"2023-11-24T06:12:01.385733+0000","last_clean":"2023-11-24T06:12:01.385733+0000","last_became_active":"2023-11-24T06:12:00.405965+0000","last_became_peered":"2023-11-24T06:12:00.405965+0000","last_unstale":"2023-11-24T06:12:01.385733+0000","last_undegraded":"2023-11-24T06:12:01.385733+0000","last_fullsized":"2023-11-24T06:12:01.385733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:42.193371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386128+0000","last_change":"2023-11-24T06:11:59.645602+0000","last_active":"2023-11-24T06:12:01.386128+0000","last_peered":"2023-11-24T06:12:01.386128+0000","last_clean":"2023-11-24T06:12:01.386128+0000","last_became_active":"2023-11-24T06:11:59.645312+0000","last_became_peered":"2023-11-24T06:11:59.645312+0000","last_unstale":"2023-11-24T06:12:01.386128+0000","last_undegraded":"2023-11-24T06:12:01.386128+0000","last_fullsized":"2023-11-24T06:12:01.386128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:43.860695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384670+0000","last_change":"2023-11-24T06:12:00.417986+0000","last_active":"2023-11-24T06:12:01.384670+0000","last_peered":"2023-11-24T06:12:01.384670+0000","last_clean":"2023-11-24T06:12:01.384670+0000","last_became_active":"2023-11-24T06:12:00.417578+0000","last_became_peered":"2023-11-24T06:12:00.417578+0000","last_unstale":"2023-11-24T06:12:01.384670+0000","last_undegraded":"2023-11-24T06:12:01.384670+0000","last_fullsized":"2023-11-24T06:12:01.384670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656198+0000","last_change":"2023-11-24T06:11:59.648128+0000","last_active":"2023-11-24T06:12:00.656198+0000","last_peered":"2023-11-24T06:12:00.656198+0000","last_clean":"2023-11-24T06:12:00.656198+0000","last_became_active":"2023-11-24T06:11:59.647817+0000","last_became_peered":"2023-11-24T06:11:59.647817+0000","last_unstale":"2023-11-24T06:12:00.656198+0000","last_undegraded":"2023-11-24T06:12:00.656198+0000","last_fullsized":"2023-11-24T06:12:00.656198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812611+0000","last_change":"2023-11-24T06:12:00.407315+0000","last_active":"2023-11-24T06:12:01.812611+0000","last_peered":"2023-11-24T06:12:01.812611+0000","last_clean":"2023-11-24T06:12:01.812611+0000","last_became_active":"2023-11-24T06:12:00.406966+0000","last_became_peered":"2023-11-24T06:12:00.406966+0000","last_unstale":"2023-11-24T06:12:01.812611+0000","last_undegraded":"2023-11-24T06:12:01.812611+0000","last_fullsized":"2023-11-24T06:12:01.812611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.382934+0000","last_change":"2023-11-24T06:11:59.641473+0000","last_active":"2023-11-24T06:12:00.382934+0000","last_peered":"2023-11-24T06:12:00.382934+0000","last_clean":"2023-11-24T06:12:00.382934+0000","last_became_active":"2023-11-24T06:11:59.640882+0000","last_became_peered":"2023-11-24T06:11:59.640882+0000","last_unstale":"2023-11-24T06:12:00.382934+0000","last_undegraded":"2023-11-24T06:12:00.382934+0000","last_fullsized":"2023-11-24T06:12:00.382934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:15.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814297+0000","last_change":"2023-11-24T06:12:00.420629+0000","last_active":"2023-11-24T06:12:01.814297+0000","last_peered":"2023-11-24T06:12:01.814297+0000","last_clean":"2023-11-24T06:12:01.814297+0000","last_became_active":"2023-11-24T06:12:00.420121+0000","last_became_peered":"2023-11-24T06:12:00.420121+0000","last_unstale":"2023-11-24T06:12:01.814297+0000","last_undegraded":"2023-11-24T06:12:01.814297+0000","last_fullsized":"2023-11-24T06:12:01.814297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:16.361272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385138+0000","last_change":"2023-11-24T06:11:59.642028+0000","last_active":"2023-11-24T06:12:01.385138+0000","last_peered":"2023-11-24T06:12:01.385138+0000","last_clean":"2023-11-24T06:12:01.385138+0000","last_became_active":"2023-11-24T06:11:59.641734+0000","last_became_peered":"2023-11-24T06:11:59.641734+0000","last_unstale":"2023-11-24T06:12:01.385138+0000","last_undegraded":"2023-11-24T06:12:01.385138+0000","last_fullsized":"2023-11-24T06:12:01.385138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:44.578653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384138+0000","last_change":"2023-11-24T06:12:00.410266+0000","last_active":"2023-11-24T06:12:01.384138+0000","last_peered":"2023-11-24T06:12:01.384138+0000","last_clean":"2023-11-24T06:12:01.384138+0000","last_became_active":"2023-11-24T06:12:00.409968+0000","last_became_peered":"2023-11-24T06:12:00.409968+0000","last_unstale":"2023-11-24T06:12:01.384138+0000","last_undegraded":"2023-11-24T06:12:01.384138+0000","last_fullsized":"2023-11-24T06:12:01.384138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385736+0000","last_change":"2023-11-24T06:11:59.630765+0000","last_active":"2023-11-24T06:12:01.385736+0000","last_peered":"2023-11-24T06:12:01.385736+0000","last_clean":"2023-11-24T06:12:01.385736+0000","last_became_active":"2023-11-24T06:11:59.629875+0000","last_became_peered":"2023-11-24T06:11:59.629875+0000","last_unstale":"2023-11-24T06:12:01.385736+0000","last_undegraded":"2023-11-24T06:12:01.385736+0000","last_fullsized":"2023-11-24T06:12:01.385736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:19.421623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384213+0000","last_change":"2023-11-24T06:12:00.408041+0000","last_active":"2023-11-24T06:12:01.384213+0000","last_peered":"2023-11-24T06:12:01.384213+0000","last_clean":"2023-11-24T06:12:01.384213+0000","last_became_active":"2023-11-24T06:12:00.407616+0000","last_became_peered":"2023-11-24T06:12:00.407616+0000","last_unstale":"2023-11-24T06:12:01.384213+0000","last_undegraded":"2023-11-24T06:12:01.384213+0000","last_fullsized":"2023-11-24T06:12:01.384213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656982+0000","last_change":"2023-11-24T06:11:59.652850+0000","last_active":"2023-11-24T06:12:00.656982+0000","last_peered":"2023-11-24T06:12:00.656982+0000","last_clean":"2023-11-24T06:12:00.656982+0000","last_became_active":"2023-11-24T06:11:59.652583+0000","last_became_peered":"2023-11-24T06:11:59.652583+0000","last_unstale":"2023-11-24T06:12:00.656982+0000","last_undegraded":"2023-11-24T06:12:00.656982+0000","last_fullsized":"2023-11-24T06:12:00.656982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792109+0000","last_change":"2023-11-24T06:12:00.408854+0000","last_active":"2023-11-24T06:12:01.792109+0000","last_peered":"2023-11-24T06:12:01.792109+0000","last_clean":"2023-11-24T06:12:01.792109+0000","last_became_active":"2023-11-24T06:12:00.408541+0000","last_became_peered":"2023-11-24T06:12:00.408541+0000","last_unstale":"2023-11-24T06:12:01.792109+0000","last_undegraded":"2023-11-24T06:12:01.792109+0000","last_fullsized":"2023-11-24T06:12:01.792109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.638814+0000","last_change":"2023-11-24T06:11:59.638814+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.638814+0000","last_undegraded":"2023-11-24T06:11:59.638814+0000","last_fullsized":"2023-11-24T06:11:59.638814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.655824+0000","last_change":"2023-11-24T06:11:59.649445+0000","last_active":"2023-11-24T06:12:00.655824+0000","last_peered":"2023-11-24T06:12:00.655824+0000","last_clean":"2023-11-24T06:12:00.655824+0000","last_became_active":"2023-11-24T06:11:59.649024+0000","last_became_peered":"2023-11-24T06:11:59.649024+0000","last_unstale":"2023-11-24T06:12:00.655824+0000","last_undegraded":"2023-11-24T06:12:00.655824+0000","last_fullsized":"2023-11-24T06:12:00.655824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2023-11-24T06:11:59.639094+0000","last_change":"2023-11-24T06:11:59.639094+0000","last_active":"2023-11-24T06:11:59.598693+0000","last_peered":"2023-11-24T06:11:59.598693+0000","last_clean":"2023-11-24T06:11:59.598693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:11:59.639094+0000","last_undegraded":"2023-11-24T06:11:59.639094+0000","last_fullsized":"2023-11-24T06:11:59.639094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656014+0000","last_change":"2023-11-24T06:11:59.648255+0000","last_active":"2023-11-24T06:12:00.656014+0000","last_peered":"2023-11-24T06:12:00.656014+0000","last_clean":"2023-11-24T06:12:00.656014+0000","last_became_active":"2023-11-24T06:11:59.647961+0000","last_became_peered":"2023-11-24T06:11:59.647961+0000","last_unstale":"2023-11-24T06:12:00.656014+0000","last_undegraded":"2023-11-24T06:12:00.656014+0000","last_fullsized":"2023-11-24T06:12:00.656014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811821+0000","last_change":"2023-11-24T06:12:00.415607+0000","last_active":"2023-11-24T06:12:01.811821+0000","last_peered":"2023-11-24T06:12:01.811821+0000","last_clean":"2023-11-24T06:12:01.811821+0000","last_became_active":"2023-11-24T06:12:00.415309+0000","last_became_peered":"2023-11-24T06:12:00.415309+0000","last_unstale":"2023-11-24T06:12:01.811821+0000","last_undegraded":"2023-11-24T06:12:01.811821+0000","last_fullsized":"2023-11-24T06:12:01.811821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.646459+0000","last_change":"2023-11-24T06:11:59.634657+0000","last_active":"2023-11-24T06:12:00.646459+0000","last_peered":"2023-11-24T06:12:00.646459+0000","last_clean":"2023-11-24T06:12:00.646459+0000","last_became_active":"2023-11-24T06:11:59.634335+0000","last_became_peered":"2023-11-24T06:11:59.634335+0000","last_unstale":"2023-11-24T06:12:00.646459+0000","last_undegraded":"2023-11-24T06:12:00.646459+0000","last_fullsized":"2023-11-24T06:12:00.646459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384001+0000","last_change":"2023-11-24T06:12:00.415376+0000","last_active":"2023-11-24T06:12:01.384001+0000","last_peered":"2023-11-24T06:12:01.384001+0000","last_clean":"2023-11-24T06:12:01.384001+0000","last_became_active":"2023-11-24T06:12:00.415114+0000","last_became_peered":"2023-11-24T06:12:00.415114+0000","last_unstale":"2023-11-24T06:12:01.384001+0000","last_undegraded":"2023-11-24T06:12:01.384001+0000","last_fullsized":"2023-11-24T06:12:01.384001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654742+0000","last_change":"2023-11-24T06:11:59.645253+0000","last_active":"2023-11-24T06:12:00.654742+0000","last_peered":"2023-11-24T06:12:00.654742+0000","last_clean":"2023-11-24T06:12:00.654742+0000","last_became_active":"2023-11-24T06:11:59.644979+0000","last_became_peered":"2023-11-24T06:11:59.644979+0000","last_unstale":"2023-11-24T06:12:00.654742+0000","last_undegraded":"2023-11-24T06:12:00.654742+0000","last_fullsized":"2023-11-24T06:12:00.654742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:36:07.535502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":56622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.258}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0059999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":666978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:12:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-11-24T06:12:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.639601+0000', 'last_change': '2023-11-24T06:11:59.639601+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.639601+0000', 'last_undegraded': '2023-11-24T06:11:59.639601+0000', 'last_fullsized': '2023-11-24T06:11:59.639601+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-11-24T06:12:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.641902+0000', 'last_change': '2023-11-24T06:11:59.641902+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.641902+0000', 'last_undegraded': '2023-11-24T06:11:59.641902+0000', 'last_fullsized': '2023-11-24T06:11:59.641902+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-11-24T06:12:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.641036+0000', 'last_change': '2023-11-24T06:11:59.641036+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.641036+0000', 'last_undegraded': '2023-11-24T06:11:59.641036+0000', 'last_fullsized': '2023-11-24T06:11:59.641036+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-11-24T06:12:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.635690+0000', 'last_change': '2023-11-24T06:11:59.635690+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.635690+0000', 'last_undegraded': '2023-11-24T06:11:59.635690+0000', 'last_fullsized': '2023-11-24T06:11:59.635690+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-11-24T06:12:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.634866+0000', 'last_change': '2023-11-24T06:11:59.634866+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.634866+0000', 'last_undegraded': '2023-11-24T06:11:59.634866+0000', 'last_fullsized': '2023-11-24T06:11:59.634866+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.636236+0000', 'last_change': '2023-11-24T06:11:59.636236+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.636236+0000', 'last_undegraded': '2023-11-24T06:11:59.636236+0000', 'last_fullsized': '2023-11-24T06:11:59.636236+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.632627+0000', 'last_change': '2023-11-24T06:11:59.632627+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.632627+0000', 'last_undegraded': '2023-11-24T06:11:59.632627+0000', 'last_fullsized': '2023-11-24T06:11:59.632627+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.631645+0000', 'last_change': '2023-11-24T06:11:59.631645+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.631645+0000', 'last_undegraded': '2023-11-24T06:11:59.631645+0000', 'last_fullsized': '2023-11-24T06:11:59.631645+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.636264+0000', 'last_change': '2023-11-24T06:11:59.636264+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.636264+0000', 'last_undegraded': '2023-11-24T06:11:59.636264+0000', 'last_fullsized': '2023-11-24T06:11:59.636264+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-11-24T06:12:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.637570+0000', 'last_change': '2023-11-24T06:11:59.637570+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.637570+0000', 'last_undegraded': '2023-11-24T06:11:59.637570+0000', 'last_fullsized': '2023-11-24T06:11:59.637570+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-11-24T06:12:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.638814+0000', 'last_change': '2023-11-24T06:11:59.638814+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.638814+0000', 'last_undegraded': '2023-11-24T06:11:59.638814+0000', 'last_fullsized': '2023-11-24T06:11:59.638814+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-11-24T06:12:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:11:59.639094+0000', 'last_change': '2023-11-24T06:11:59.639094+0000', 'last_active': '2023-11-24T06:11:59.598693+0000', 'last_peered': '2023-11-24T06:11:59.598693+0000', 'last_clean': '2023-11-24T06:11:59.598693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:11:59.639094+0000', 'last_undegraded': '2023-11-24T06:11:59.639094+0000', 'last_fullsized': '2023-11-24T06:11:59.639094+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'last_clean_scrub_stamp': '2023-11-24T06:11:59.598693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:12:06.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-24T06:12:06.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.474+0000 7efc33fff640 1 Processor -- start 2023-11-24T06:12:06.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.474+0000 7efc33fff640 1 -- start start 2023-11-24T06:12:06.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.476+0000 7efc33fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc34144ac0 0x7efc340712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:06.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.476+0000 7efc33fff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc340cbd10 con 0x7efc3406ab50 2023-11-24T06:12:06.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.476+0000 7efc33fff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc340cc660 con 0x7efc3406f540 2023-11-24T06:12:06.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.476+0000 7efc33fff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3406f9d0 con 0x7efc34144ac0 2023-11-24T06:12:06.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.476+0000 7efc337fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efc3406ab50 0x7efc34164bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56646/0 (socket says 172.21.15.22:56646) 2023-11-24T06:12:06.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.476+0000 7efc337fe640 1 -- 172.21.15.22:0/748865815 learned_addr learned my addr 172.21.15.22:0/748865815 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:06.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.476+0000 7efc32ffd640 1 --2- 172.21.15.22:0/748865815 >> v2:172.21.15.22:3300/0 conn(0x7efc34144ac0 0x7efc340712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:06.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.477+0000 7efc32ffd640 1 -- 172.21.15.22:0/748865815 >> v1:172.21.15.31:6789/0 conn(0x7efc3406f540 legacy=0x7efc3406a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.477+0000 7efc32ffd640 1 -- 172.21.15.22:0/748865815 >> v1:172.21.15.22:6789/0 conn(0x7efc3406ab50 legacy=0x7efc34164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.477+0000 7efc31ffb640 1 -- 172.21.15.22:0/748865815 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471461543 0 0) 0x7efc340cbd10 con 0x7efc3406ab50 2023-11-24T06:12:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.477+0000 7efc32ffd640 1 -- 172.21.15.22:0/748865815 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34071920 con 0x7efc34144ac0 2023-11-24T06:12:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.478+0000 7efc32ffd640 1 --2- 172.21.15.22:0/748865815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 0x7efc340712b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0097a0 tx=0x7efc1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d978172f53d60e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.478+0000 7efc31ffb640 1 -- 172.21.15.22:0/748865815 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c031830 con 0x7efc34144ac0 2023-11-24T06:12:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.478+0000 7efc31ffb640 1 -- 172.21.15.22:0/748865815 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c031990 con 0x7efc34144ac0 2023-11-24T06:12:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.478+0000 7efc31ffb640 1 -- 172.21.15.22:0/748865815 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c031d20 con 0x7efc34144ac0 2023-11-24T06:12:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.479+0000 7efc33fff640 1 -- 172.21.15.22:0/748865815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 msgr2=0x7efc340712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:06.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.479+0000 7efc33fff640 1 --2- 172.21.15.22:0/748865815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 0x7efc340712b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0097a0 tx=0x7efc1c02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.479+0000 7efc33fff640 1 -- 172.21.15.22:0/748865815 shutdown_connections 2023-11-24T06:12:06.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.479+0000 7efc33fff640 1 --2- 172.21.15.22:0/748865815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 0x7efc340712b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.479+0000 7efc33fff640 1 -- 172.21.15.22:0/748865815 >> 172.21.15.22:0/748865815 conn(0x7efc340cfdc0 msgr2=0x7efc340d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:06.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.479+0000 7efc33fff640 1 -- 172.21.15.22:0/748865815 shutdown_connections 2023-11-24T06:12:06.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.479+0000 7efc33fff640 1 -- 172.21.15.22:0/748865815 wait complete. 2023-11-24T06:12:06.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.481+0000 7efc33fff640 1 Processor -- start 2023-11-24T06:12:06.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.481+0000 7efc33fff640 1 -- start start 2023-11-24T06:12:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc33fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3406ab50 0x7efc34142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc33fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3406f540 0x7efc340c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 0x7efc340c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc33fff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34143330 con 0x7efc34144ac0 2023-11-24T06:12:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc33fff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3413ba50 con 0x7efc3406f540 2023-11-24T06:12:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc33fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3413bd30 con 0x7efc3406ab50 2023-11-24T06:12:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 0x7efc340c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 0x7efc340c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46084/0 (socket says 172.21.15.22:46084) 2023-11-24T06:12:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc337fe640 1 -- 172.21.15.22:0/4059365190 learned_addr learned my addr 172.21.15.22:0/4059365190 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc32ffd640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3406ab50 0x7efc34142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc327fc640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3406f540 0x7efc340c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc337fe640 1 -- 172.21.15.22:0/4059365190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3406ab50 msgr2=0x7efc34142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc337fe640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3406ab50 0x7efc34142df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc337fe640 1 -- 172.21.15.22:0/4059365190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3406f540 msgr2=0x7efc340c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc337fe640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3406f540 0x7efc340c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc337fe640 1 -- 172.21.15.22:0/4059365190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c009400 con 0x7efc34144ac0 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.482+0000 7efc32ffd640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3406ab50 0x7efc34142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.483+0000 7efc337fe640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 0x7efc340c9c30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00c7e0 tx=0x7efc2c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.483+0000 7efc2b7fe640 1 -- 172.21.15.22:0/4059365190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00a640 con 0x7efc34144ac0 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.483+0000 7efc2b7fe640 1 -- 172.21.15.22:0/4059365190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c00a7c0 con 0x7efc34144ac0 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.483+0000 7efc2b7fe640 1 -- 172.21.15.22:0/4059365190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00ab70 con 0x7efc34144ac0 2023-11-24T06:12:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.483+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3413c010 con 0x7efc34144ac0 2023-11-24T06:12:06.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.483+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc34140c40 con 0x7efc34144ac0 2023-11-24T06:12:06.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.484+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3404e840 con 0x7efc34144ac0 2023-11-24T06:12:06.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.485+0000 7efc2b7fe640 1 -- 172.21.15.22:0/4059365190 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc2c00acd0 con 0x7efc34144ac0 2023-11-24T06:12:06.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.486+0000 7efc2b7fe640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efc1406ae40 0x7efc1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:06.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.486+0000 7efc2b7fe640 1 -- 172.21.15.22:0/4059365190 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc2c088ba0 con 0x7efc34144ac0 2023-11-24T06:12:06.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.486+0000 7efc32ffd640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efc1406ae40 0x7efc1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.487+0000 7efc32ffd640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efc1406ae40 0x7efc1406d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc1c036000 tx=0x7efc1c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:06.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.491+0000 7efc2b7fe640 1 -- 172.21.15.22:0/4059365190 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc2c053ce0 con 0x7efc34144ac0 2023-11-24T06:12:06.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.756+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7efc3415e8f0 con 0x7efc34144ac0 2023-11-24T06:12:06.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.757+0000 7efc2b7fe640 1 -- 172.21.15.22:0/4059365190 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7efc2c018020 con 0x7efc34144ac0 2023-11-24T06:12:06.760 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:06.760 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":31,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1700806309,"num_in_osds":8,"osd_in_since":1700806299,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":241438720,"bytes_avail":772852674560,"bytes_total":773094113280,"write_bytes_sec":2036,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4269}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-24T06:11:35.608070+0000","services":{}},"progress_events":{}} 2023-11-24T06:12:06.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efc1406ae40 msgr2=0x7efc1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:06.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efc1406ae40 0x7efc1406d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc1c036000 tx=0x7efc1c03c040 comp rx=0 tx=0).stop 2023-11-24T06:12:06.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 msgr2=0x7efc340c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:06.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 0x7efc340c9c30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00c7e0 tx=0x7efc2c00cca0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 shutdown_connections 2023-11-24T06:12:06.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efc1406ae40 0x7efc1406d300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc34144ac0 0x7efc340c9c30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3406f540 0x7efc340c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 --2- 172.21.15.22:0/4059365190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3406ab50 0x7efc34142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:06.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.759+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 >> 172.21.15.22:0/4059365190 conn(0x7efc340cfdc0 msgr2=0x7efc340b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:06.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.760+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 shutdown_connections 2023-11-24T06:12:06.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:06.760+0000 7efc33fff640 1 -- 172.21.15.22:0/4059365190 wait complete. 2023-11-24T06:12:06.781 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-24T06:12:06.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:12:07.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.003+0000 7fe3fb59e640 1 Processor -- start 2023-11-24T06:12:07.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.003+0000 7fe3fb59e640 1 -- start start 2023-11-24T06:12:07.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.005+0000 7fe3fb59e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe3fc157770 0x7fe3fc06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:07.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.005+0000 7fe3fb59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc06d080 0x7fe3fc15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:07.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.005+0000 7fe3fb59e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc161670 con 0x7fe3fc15ddb0 2023-11-24T06:12:07.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.005+0000 7fe3fb59e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc06d500 con 0x7fe3fc157770 2023-11-24T06:12:07.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.005+0000 7fe3fb59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc071730 con 0x7fe3fc06d080 2023-11-24T06:12:07.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.006+0000 7fe3fa59c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe3fc157770 0x7fe3fc06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:07.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.006+0000 7fe3fa59c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe3fc157770 0x7fe3fc06cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46090/0 (socket says 172.21.15.22:46090) 2023-11-24T06:12:07.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.006+0000 7fe3fa59c640 1 -- 172.21.15.22:0/2915330030 learned_addr learned my addr 172.21.15.22:0/2915330030 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:07.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.006+0000 7fe3f9d9b640 1 --2- 172.21.15.22:0/2915330030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc06d080 0x7fe3fc15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:07.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.006+0000 7fe3fa59c640 1 -- 172.21.15.22:0/2915330030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc06d080 msgr2=0x7fe3fc15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:07.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.006+0000 7fe3fa59c640 1 --2- 172.21.15.22:0/2915330030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc06d080 0x7fe3fc15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.006+0000 7fe3fa59c640 1 -- 172.21.15.22:0/2915330030 >> v1:172.21.15.31:6789/0 conn(0x7fe3fc15ddb0 legacy=0x7fe3fc0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:07.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.006+0000 7fe3fa59c640 1 -- 172.21.15.22:0/2915330030 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc15e610 con 0x7fe3fc157770 2023-11-24T06:12:07.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.007+0000 7fe3fa59c640 1 --2- 172.21.15.22:0/2915330030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc157770 0x7fe3fc06cb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009870 tx=0x7fe3ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c557c62ef7b808 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:07.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.007+0000 7fe3f959a640 1 -- 172.21.15.22:0/2915330030 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec031640 con 0x7fe3fc157770 2023-11-24T06:12:07.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3f959a640 1 -- 172.21.15.22:0/2915330030 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec0317a0 con 0x7fe3fc157770 2023-11-24T06:12:07.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3f959a640 1 -- 172.21.15.22:0/2915330030 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec031b30 con 0x7fe3fc157770 2023-11-24T06:12:07.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2915330030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc157770 msgr2=0x7fe3fc06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:07.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3fb59e640 1 --2- 172.21.15.22:0/2915330030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc157770 0x7fe3fc06cb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009870 tx=0x7fe3ec02b8f0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2915330030 shutdown_connections 2023-11-24T06:12:07.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3fb59e640 1 --2- 172.21.15.22:0/2915330030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc06d080 0x7fe3fc15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3fb59e640 1 --2- 172.21.15.22:0/2915330030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc157770 0x7fe3fc06cb40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2915330030 >> 172.21.15.22:0/2915330030 conn(0x7fe3fc06a860 msgr2=0x7fe3fc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:07.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2915330030 shutdown_connections 2023-11-24T06:12:07.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.008+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2915330030 wait complete. 2023-11-24T06:12:07.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.010+0000 7fe3fb59e640 1 Processor -- start 2023-11-24T06:12:07.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.010+0000 7fe3fb59e640 1 -- start start 2023-11-24T06:12:07.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.011+0000 7fe3fb59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc06d080 0x7fe3fc154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:07.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.011+0000 7fe3fb59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc157770 0x7fe3fc148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:07.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.011+0000 7fe3fb59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc15ddb0 0x7fe3fc0af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:07.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.011+0000 7fe3fb59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cb1e0 con 0x7fe3fc06d080 2023-11-24T06:12:07.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.011+0000 7fe3fb59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cb4c0 con 0x7fe3fc157770 2023-11-24T06:12:07.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.011+0000 7fe3fb59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cb7a0 con 0x7fe3fc15ddb0 2023-11-24T06:12:07.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.011+0000 7fe3fa59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc06d080 0x7fe3fc154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:07.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.011+0000 7fe3fa59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc06d080 0x7fe3fc154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46096/0 (socket says 172.21.15.22:46096) 2023-11-24T06:12:07.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.011+0000 7fe3fa59c640 1 -- 172.21.15.22:0/2339412759 learned_addr learned my addr 172.21.15.22:0/2339412759 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:07.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3fa59c640 1 -- 172.21.15.22:0/2339412759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc15ddb0 msgr2=0x7fe3fc0af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:07.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3fad9d640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc15ddb0 0x7fe3fc0af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:07.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3f9d9b640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc157770 0x7fe3fc148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:07.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3fa59c640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc15ddb0 0x7fe3fc0af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3fa59c640 1 -- 172.21.15.22:0/2339412759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc157770 msgr2=0x7fe3fc148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:07.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3fa59c640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc157770 0x7fe3fc148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3fa59c640 1 -- 172.21.15.22:0/2339412759 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec0094d0 con 0x7fe3fc06d080 2023-11-24T06:12:07.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3fa59c640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc06d080 0x7fe3fc154f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c00 tx=0x7fe3ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:07.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3f2ffd640 1 -- 172.21.15.22:0/2339412759 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec03ac60 con 0x7fe3fc06d080 2023-11-24T06:12:07.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3f2ffd640 1 -- 172.21.15.22:0/2339412759 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec03adc0 con 0x7fe3fc06d080 2023-11-24T06:12:07.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3f2ffd640 1 -- 172.21.15.22:0/2339412759 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec044630 con 0x7fe3fc06d080 2023-11-24T06:12:07.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.012+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc0cba80 con 0x7fe3fc06d080 2023-11-24T06:12:07.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.013+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc1526c0 con 0x7fe3fc06d080 2023-11-24T06:12:07.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.014+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc04e840 con 0x7fe3fc06d080 2023-11-24T06:12:07.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.015+0000 7fe3f2ffd640 1 -- 172.21.15.22:0/2339412759 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3ec02f050 con 0x7fe3fc06d080 2023-11-24T06:12:07.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.016+0000 7fe3f2ffd640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe3dc06ae40 0x7fe3dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:07.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.016+0000 7fe3f2ffd640 1 -- 172.21.15.22:0/2339412759 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3ec0ab520 con 0x7fe3fc06d080 2023-11-24T06:12:07.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.017+0000 7fe3f9d9b640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe3dc06ae40 0x7fe3dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:07.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.017+0000 7fe3f9d9b640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe3dc06ae40 0x7fe3dc06d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc1524b0 tx=0x7fe3e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:07.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.021+0000 7fe3f2ffd640 1 -- 172.21.15.22:0/2339412759 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3ec076530 con 0x7fe3fc06d080 2023-11-24T06:12:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.210+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3fc0cb630 con 0x7fe3dc06ae40 2023-11-24T06:12:07.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.221+0000 7fe3f2ffd640 1 -- 172.21.15.22:0/2339412759 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264498 (secure 0 0 0) 0x7fe3fc0cb630 con 0x7fe3dc06ae40 2023-11-24T06:12:07.227 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:07.229 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:12:07.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.228+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe3dc06ae40 msgr2=0x7fe3dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:07.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.228+0000 7fe3fb59e640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe3dc06ae40 0x7fe3dc06d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc1524b0 tx=0x7fe3e4008040 comp rx=0 tx=0).stop 2023-11-24T06:12:07.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.228+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc06d080 msgr2=0x7fe3fc154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:07.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.228+0000 7fe3fb59e640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc06d080 0x7fe3fc154f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c00 tx=0x7fe3ec0046c0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.229+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 shutdown_connections 2023-11-24T06:12:07.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.229+0000 7fe3fb59e640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe3dc06ae40 0x7fe3dc06d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.229+0000 7fe3fb59e640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe3fc15ddb0 0x7fe3fc0af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.229+0000 7fe3fb59e640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3fc157770 0x7fe3fc148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.229+0000 7fe3fb59e640 1 --2- 172.21.15.22:0/2339412759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3fc06d080 0x7fe3fc154f50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:07.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.229+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 >> 172.21.15.22:0/2339412759 conn(0x7fe3fc06a860 msgr2=0x7fe3fc1555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:07.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.229+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 shutdown_connections 2023-11-24T06:12:07.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:07.229+0000 7fe3fb59e640 1 -- 172.21.15.22:0/2339412759 wait complete. 2023-11-24T06:12:07.249 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-24T06:12:06.648247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235780,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738940,"statfs":{"total":773094113280,"available":772852674560,"internally_reserved":0,"allocated":3022848,"data_stored":1793332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.041043"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386950+0000","last_change":"2023-11-24T06:12:00.409989+0000","last_active":"2023-11-24T06:12:01.386950+0000","last_peered":"2023-11-24T06:12:01.386950+0000","last_clean":"2023-11-24T06:12:01.386950+0000","last_became_active":"2023-11-24T06:12:00.409672+0000","last_became_peered":"2023-11-24T06:12:00.409672+0000","last_unstale":"2023-11-24T06:12:01.386950+0000","last_undegraded":"2023-11-24T06:12:01.386950+0000","last_fullsized":"2023-11-24T06:12:01.386950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386025+0000","last_change":"2023-11-24T06:12:00.416425+0000","last_active":"2023-11-24T06:12:01.386025+0000","last_peered":"2023-11-24T06:12:01.386025+0000","last_clean":"2023-11-24T06:12:01.386025+0000","last_became_active":"2023-11-24T06:12:00.415783+0000","last_became_peered":"2023-11-24T06:12:00.415783+0000","last_unstale":"2023-11-24T06:12:01.386025+0000","last_undegraded":"2023-11-24T06:12:01.386025+0000","last_fullsized":"2023-11-24T06:12:01.386025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:38:17.759240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811686+0000","last_change":"2023-11-24T06:12:00.408399+0000","last_active":"2023-11-24T06:12:01.811686+0000","last_peered":"2023-11-24T06:12:01.811686+0000","last_clean":"2023-11-24T06:12:01.811686+0000","last_became_active":"2023-11-24T06:12:00.408067+0000","last_became_peered":"2023-11-24T06:12:00.408067+0000","last_unstale":"2023-11-24T06:12:01.811686+0000","last_undegraded":"2023-11-24T06:12:01.811686+0000","last_fullsized":"2023-11-24T06:12:01.811686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813152+0000","last_change":"2023-11-24T06:12:00.423704+0000","last_active":"2023-11-24T06:12:01.813152+0000","last_peered":"2023-11-24T06:12:01.813152+0000","last_clean":"2023-11-24T06:12:01.813152+0000","last_became_active":"2023-11-24T06:12:00.423106+0000","last_became_peered":"2023-11-24T06:12:00.423106+0000","last_unstale":"2023-11-24T06:12:01.813152+0000","last_undegraded":"2023-11-24T06:12:01.813152+0000","last_fullsized":"2023-11-24T06:12:01.813152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:12:00.400306+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:12:00.399964+0000","last_became_peered":"2023-11-24T06:12:00.399964+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812946+0000","last_change":"2023-11-24T06:12:00.418713+0000","last_active":"2023-11-24T06:12:01.812946+0000","last_peered":"2023-11-24T06:12:01.812946+0000","last_clean":"2023-11-24T06:12:01.812946+0000","last_became_active":"2023-11-24T06:12:00.417992+0000","last_became_peered":"2023-11-24T06:12:00.417992+0000","last_unstale":"2023-11-24T06:12:01.812946+0000","last_undegraded":"2023-11-24T06:12:01.812946+0000","last_fullsized":"2023-11-24T06:12:01.812946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385528+0000","last_change":"2023-11-24T06:12:00.408860+0000","last_active":"2023-11-24T06:12:01.385528+0000","last_peered":"2023-11-24T06:12:01.385528+0000","last_clean":"2023-11-24T06:12:01.385528+0000","last_became_active":"2023-11-24T06:12:00.408549+0000","last_became_peered":"2023-11-24T06:12:00.408549+0000","last_unstale":"2023-11-24T06:12:01.385528+0000","last_undegraded":"2023-11-24T06:12:01.385528+0000","last_fullsized":"2023-11-24T06:12:01.385528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383026+0000","last_change":"2023-11-24T06:12:00.413017+0000","last_active":"2023-11-24T06:12:01.383026+0000","last_peered":"2023-11-24T06:12:01.383026+0000","last_clean":"2023-11-24T06:12:01.383026+0000","last_became_active":"2023-11-24T06:12:00.411843+0000","last_became_peered":"2023-11-24T06:12:00.411843+0000","last_unstale":"2023-11-24T06:12:01.383026+0000","last_undegraded":"2023-11-24T06:12:01.383026+0000","last_fullsized":"2023-11-24T06:12:01.383026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387045+0000","last_change":"2023-11-24T06:12:00.418547+0000","last_active":"2023-11-24T06:12:01.387045+0000","last_peered":"2023-11-24T06:12:01.387045+0000","last_clean":"2023-11-24T06:12:01.387045+0000","last_became_active":"2023-11-24T06:12:00.418264+0000","last_became_peered":"2023-11-24T06:12:00.418264+0000","last_unstale":"2023-11-24T06:12:01.387045+0000","last_undegraded":"2023-11-24T06:12:01.387045+0000","last_fullsized":"2023-11-24T06:12:01.387045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792917+0000","last_change":"2023-11-24T06:12:00.413548+0000","last_active":"2023-11-24T06:12:01.792917+0000","last_peered":"2023-11-24T06:12:01.792917+0000","last_clean":"2023-11-24T06:12:01.792917+0000","last_became_active":"2023-11-24T06:12:00.413225+0000","last_became_peered":"2023-11-24T06:12:00.413225+0000","last_unstale":"2023-11-24T06:12:01.792917+0000","last_undegraded":"2023-11-24T06:12:01.792917+0000","last_fullsized":"2023-11-24T06:12:01.792917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792746+0000","last_change":"2023-11-24T06:12:00.415528+0000","last_active":"2023-11-24T06:12:01.792746+0000","last_peered":"2023-11-24T06:12:01.792746+0000","last_clean":"2023-11-24T06:12:01.792746+0000","last_became_active":"2023-11-24T06:12:00.414074+0000","last_became_peered":"2023-11-24T06:12:00.414074+0000","last_unstale":"2023-11-24T06:12:01.792746+0000","last_undegraded":"2023-11-24T06:12:01.792746+0000","last_fullsized":"2023-11-24T06:12:01.792746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814560+0000","last_change":"2023-11-24T06:12:00.412466+0000","last_active":"2023-11-24T06:12:01.814560+0000","last_peered":"2023-11-24T06:12:01.814560+0000","last_clean":"2023-11-24T06:12:01.814560+0000","last_became_active":"2023-11-24T06:12:00.412189+0000","last_became_peered":"2023-11-24T06:12:00.412189+0000","last_unstale":"2023-11-24T06:12:01.814560+0000","last_undegraded":"2023-11-24T06:12:01.814560+0000","last_fullsized":"2023-11-24T06:12:01.814560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:33.179248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384061+0000","last_change":"2023-11-24T06:12:00.410091+0000","last_active":"2023-11-24T06:12:01.384061+0000","last_peered":"2023-11-24T06:12:01.384061+0000","last_clean":"2023-11-24T06:12:01.384061+0000","last_became_active":"2023-11-24T06:12:00.409724+0000","last_became_peered":"2023-11-24T06:12:00.409724+0000","last_unstale":"2023-11-24T06:12:01.384061+0000","last_undegraded":"2023-11-24T06:12:01.384061+0000","last_fullsized":"2023-11-24T06:12:01.384061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811279+0000","last_change":"2023-11-24T06:12:00.413928+0000","last_active":"2023-11-24T06:12:01.811279+0000","last_peered":"2023-11-24T06:12:01.811279+0000","last_clean":"2023-11-24T06:12:01.811279+0000","last_became_active":"2023-11-24T06:12:00.408524+0000","last_became_peered":"2023-11-24T06:12:00.408524+0000","last_unstale":"2023-11-24T06:12:01.811279+0000","last_undegraded":"2023-11-24T06:12:01.811279+0000","last_fullsized":"2023-11-24T06:12:01.811279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:21.383018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385301+0000","last_change":"2023-11-24T06:12:00.414487+0000","last_active":"2023-11-24T06:12:01.385301+0000","last_peered":"2023-11-24T06:12:01.385301+0000","last_clean":"2023-11-24T06:12:01.385301+0000","last_became_active":"2023-11-24T06:12:00.412548+0000","last_became_peered":"2023-11-24T06:12:00.412548+0000","last_unstale":"2023-11-24T06:12:01.385301+0000","last_undegraded":"2023-11-24T06:12:01.385301+0000","last_fullsized":"2023-11-24T06:12:01.385301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:04.491629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812440+0000","last_change":"2023-11-24T06:12:00.418298+0000","last_active":"2023-11-24T06:12:01.812440+0000","last_peered":"2023-11-24T06:12:01.812440+0000","last_clean":"2023-11-24T06:12:01.812440+0000","last_became_active":"2023-11-24T06:12:00.417933+0000","last_became_peered":"2023-11-24T06:12:00.417933+0000","last_unstale":"2023-11-24T06:12:01.812440+0000","last_undegraded":"2023-11-24T06:12:01.812440+0000","last_fullsized":"2023-11-24T06:12:01.812440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814235+0000","last_change":"2023-11-24T06:12:00.424325+0000","last_active":"2023-11-24T06:12:01.814235+0000","last_peered":"2023-11-24T06:12:01.814235+0000","last_clean":"2023-11-24T06:12:01.814235+0000","last_became_active":"2023-11-24T06:12:00.419795+0000","last_became_peered":"2023-11-24T06:12:00.419795+0000","last_unstale":"2023-11-24T06:12:01.814235+0000","last_undegraded":"2023-11-24T06:12:01.814235+0000","last_fullsized":"2023-11-24T06:12:01.814235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812634+0000","last_change":"2023-11-24T06:12:00.415065+0000","last_active":"2023-11-24T06:12:01.812634+0000","last_peered":"2023-11-24T06:12:01.812634+0000","last_clean":"2023-11-24T06:12:01.812634+0000","last_became_active":"2023-11-24T06:12:00.414686+0000","last_became_peered":"2023-11-24T06:12:00.414686+0000","last_unstale":"2023-11-24T06:12:01.812634+0000","last_undegraded":"2023-11-24T06:12:01.812634+0000","last_fullsized":"2023-11-24T06:12:01.812634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.404241+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.403972+0000","last_became_peered":"2023-11-24T06:12:00.403972+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792421+0000","last_change":"2023-11-24T06:12:00.422094+0000","last_active":"2023-11-24T06:12:01.792421+0000","last_peered":"2023-11-24T06:12:01.792421+0000","last_clean":"2023-11-24T06:12:01.792421+0000","last_became_active":"2023-11-24T06:12:00.421724+0000","last_became_peered":"2023-11-24T06:12:00.421724+0000","last_unstale":"2023-11-24T06:12:01.792421+0000","last_undegraded":"2023-11-24T06:12:01.792421+0000","last_fullsized":"2023-11-24T06:12:01.792421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811370+0000","last_change":"2023-11-24T06:12:00.411570+0000","last_active":"2023-11-24T06:12:01.811370+0000","last_peered":"2023-11-24T06:12:01.811370+0000","last_clean":"2023-11-24T06:12:01.811370+0000","last_became_active":"2023-11-24T06:12:00.411118+0000","last_became_peered":"2023-11-24T06:12:00.411118+0000","last_unstale":"2023-11-24T06:12:01.811370+0000","last_undegraded":"2023-11-24T06:12:01.811370+0000","last_fullsized":"2023-11-24T06:12:01.811370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:15.863418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814833+0000","last_change":"2023-11-24T06:12:00.417371+0000","last_active":"2023-11-24T06:12:01.814833+0000","last_peered":"2023-11-24T06:12:01.814833+0000","last_clean":"2023-11-24T06:12:01.814833+0000","last_became_active":"2023-11-24T06:12:00.417046+0000","last_became_peered":"2023-11-24T06:12:00.417046+0000","last_unstale":"2023-11-24T06:12:01.814833+0000","last_undegraded":"2023-11-24T06:12:01.814833+0000","last_fullsized":"2023-11-24T06:12:01.814833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383318+0000","last_change":"2023-11-24T06:12:00.410431+0000","last_active":"2023-11-24T06:12:01.383318+0000","last_peered":"2023-11-24T06:12:01.383318+0000","last_clean":"2023-11-24T06:12:01.383318+0000","last_became_active":"2023-11-24T06:12:00.410132+0000","last_became_peered":"2023-11-24T06:12:00.410132+0000","last_unstale":"2023-11-24T06:12:01.383318+0000","last_undegraded":"2023-11-24T06:12:01.383318+0000","last_fullsized":"2023-11-24T06:12:01.383318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812700+0000","last_change":"2023-11-24T06:12:00.417335+0000","last_active":"2023-11-24T06:12:01.812700+0000","last_peered":"2023-11-24T06:12:01.812700+0000","last_clean":"2023-11-24T06:12:01.812700+0000","last_became_active":"2023-11-24T06:12:00.416822+0000","last_became_peered":"2023-11-24T06:12:00.416822+0000","last_unstale":"2023-11-24T06:12:01.812700+0000","last_undegraded":"2023-11-24T06:12:01.812700+0000","last_fullsized":"2023-11-24T06:12:01.812700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384663+0000","last_change":"2023-11-24T06:12:00.419798+0000","last_active":"2023-11-24T06:12:01.384663+0000","last_peered":"2023-11-24T06:12:01.384663+0000","last_clean":"2023-11-24T06:12:01.384663+0000","last_became_active":"2023-11-24T06:12:00.419568+0000","last_became_peered":"2023-11-24T06:12:00.419568+0000","last_unstale":"2023-11-24T06:12:01.384663+0000","last_undegraded":"2023-11-24T06:12:01.384663+0000","last_fullsized":"2023-11-24T06:12:01.384663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.793026+0000","last_change":"2023-11-24T06:12:00.412430+0000","last_active":"2023-11-24T06:12:01.793026+0000","last_peered":"2023-11-24T06:12:01.793026+0000","last_clean":"2023-11-24T06:12:01.793026+0000","last_became_active":"2023-11-24T06:12:00.411971+0000","last_became_peered":"2023-11-24T06:12:00.411971+0000","last_unstale":"2023-11-24T06:12:01.793026+0000","last_undegraded":"2023-11-24T06:12:01.793026+0000","last_fullsized":"2023-11-24T06:12:01.793026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385763+0000","last_change":"2023-11-24T06:12:00.414558+0000","last_active":"2023-11-24T06:12:01.385763+0000","last_peered":"2023-11-24T06:12:01.385763+0000","last_clean":"2023-11-24T06:12:01.385763+0000","last_became_active":"2023-11-24T06:12:00.414279+0000","last_became_peered":"2023-11-24T06:12:00.414279+0000","last_unstale":"2023-11-24T06:12:01.385763+0000","last_undegraded":"2023-11-24T06:12:01.385763+0000","last_fullsized":"2023-11-24T06:12:01.385763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:00.298898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384237+0000","last_change":"2023-11-24T06:12:00.423044+0000","last_active":"2023-11-24T06:12:01.384237+0000","last_peered":"2023-11-24T06:12:01.384237+0000","last_clean":"2023-11-24T06:12:01.384237+0000","last_became_active":"2023-11-24T06:12:00.422684+0000","last_became_peered":"2023-11-24T06:12:00.422684+0000","last_unstale":"2023-11-24T06:12:01.384237+0000","last_undegraded":"2023-11-24T06:12:01.384237+0000","last_fullsized":"2023-11-24T06:12:01.384237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811420+0000","last_change":"2023-11-24T06:12:00.406540+0000","last_active":"2023-11-24T06:12:01.811420+0000","last_peered":"2023-11-24T06:12:01.811420+0000","last_clean":"2023-11-24T06:12:01.811420+0000","last_became_active":"2023-11-24T06:12:00.406115+0000","last_became_peered":"2023-11-24T06:12:00.406115+0000","last_unstale":"2023-11-24T06:12:01.811420+0000","last_undegraded":"2023-11-24T06:12:01.811420+0000","last_fullsized":"2023-11-24T06:12:01.811420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813334+0000","last_change":"2023-11-24T06:12:00.421363+0000","last_active":"2023-11-24T06:12:01.813334+0000","last_peered":"2023-11-24T06:12:01.813334+0000","last_clean":"2023-11-24T06:12:01.813334+0000","last_became_active":"2023-11-24T06:12:00.420976+0000","last_became_peered":"2023-11-24T06:12:00.420976+0000","last_unstale":"2023-11-24T06:12:01.813334+0000","last_undegraded":"2023-11-24T06:12:01.813334+0000","last_fullsized":"2023-11-24T06:12:01.813334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812046+0000","last_change":"2023-11-24T06:12:00.413545+0000","last_active":"2023-11-24T06:12:01.812046+0000","last_peered":"2023-11-24T06:12:01.812046+0000","last_clean":"2023-11-24T06:12:01.812046+0000","last_became_active":"2023-11-24T06:12:00.411644+0000","last_became_peered":"2023-11-24T06:12:00.411644+0000","last_unstale":"2023-11-24T06:12:01.812046+0000","last_undegraded":"2023-11-24T06:12:01.812046+0000","last_fullsized":"2023-11-24T06:12:01.812046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792092+0000","last_change":"2023-11-24T06:12:00.411309+0000","last_active":"2023-11-24T06:12:01.792092+0000","last_peered":"2023-11-24T06:12:01.792092+0000","last_clean":"2023-11-24T06:12:01.792092+0000","last_became_active":"2023-11-24T06:12:00.409967+0000","last_became_peered":"2023-11-24T06:12:00.409967+0000","last_unstale":"2023-11-24T06:12:01.792092+0000","last_undegraded":"2023-11-24T06:12:01.792092+0000","last_fullsized":"2023-11-24T06:12:01.792092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814781+0000","last_change":"2023-11-24T06:12:00.417149+0000","last_active":"2023-11-24T06:12:01.814781+0000","last_peered":"2023-11-24T06:12:01.814781+0000","last_clean":"2023-11-24T06:12:01.814781+0000","last_became_active":"2023-11-24T06:12:00.410529+0000","last_became_peered":"2023-11-24T06:12:00.410529+0000","last_unstale":"2023-11-24T06:12:01.814781+0000","last_undegraded":"2023-11-24T06:12:01.814781+0000","last_fullsized":"2023-11-24T06:12:01.814781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654819+0000","last_change":"2023-11-24T06:11:59.645470+0000","last_active":"2023-11-24T06:12:00.654819+0000","last_peered":"2023-11-24T06:12:00.654819+0000","last_clean":"2023-11-24T06:12:00.654819+0000","last_became_active":"2023-11-24T06:11:59.644424+0000","last_became_peered":"2023-11-24T06:11:59.644424+0000","last_unstale":"2023-11-24T06:12:00.654819+0000","last_undegraded":"2023-11-24T06:12:00.654819+0000","last_fullsized":"2023-11-24T06:12:00.654819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811571+0000","last_change":"2023-11-24T06:12:00.421116+0000","last_active":"2023-11-24T06:12:01.811571+0000","last_peered":"2023-11-24T06:12:01.811571+0000","last_clean":"2023-11-24T06:12:01.811571+0000","last_became_active":"2023-11-24T06:12:00.420793+0000","last_became_peered":"2023-11-24T06:12:00.420793+0000","last_unstale":"2023-11-24T06:12:01.811571+0000","last_undegraded":"2023-11-24T06:12:01.811571+0000","last_fullsized":"2023-11-24T06:12:01.811571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654126+0000","last_change":"2023-11-24T06:11:59.657132+0000","last_active":"2023-11-24T06:12:00.654126+0000","last_peered":"2023-11-24T06:12:00.654126+0000","last_clean":"2023-11-24T06:12:00.654126+0000","last_became_active":"2023-11-24T06:11:59.656475+0000","last_became_peered":"2023-11-24T06:11:59.656475+0000","last_unstale":"2023-11-24T06:12:00.654126+0000","last_undegraded":"2023-11-24T06:12:00.654126+0000","last_fullsized":"2023-11-24T06:12:00.654126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.392519+0000","last_change":"2023-11-24T06:11:59.647264+0000","last_active":"2023-11-24T06:12:00.392519+0000","last_peered":"2023-11-24T06:12:00.392519+0000","last_clean":"2023-11-24T06:12:00.392519+0000","last_became_active":"2023-11-24T06:11:59.646951+0000","last_became_peered":"2023-11-24T06:11:59.646951+0000","last_unstale":"2023-11-24T06:12:00.392519+0000","last_undegraded":"2023-11-24T06:12:00.392519+0000","last_fullsized":"2023-11-24T06:12:00.392519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383246+0000","last_change":"2023-11-24T06:12:00.410276+0000","last_active":"2023-11-24T06:12:01.383246+0000","last_peered":"2023-11-24T06:12:01.383246+0000","last_clean":"2023-11-24T06:12:01.383246+0000","last_became_active":"2023-11-24T06:12:00.407839+0000","last_became_peered":"2023-11-24T06:12:00.407839+0000","last_unstale":"2023-11-24T06:12:01.383246+0000","last_undegraded":"2023-11-24T06:12:01.383246+0000","last_fullsized":"2023-11-24T06:12:01.383246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.405489+0000","last_change":"2023-11-24T06:11:59.656673+0000","last_active":"2023-11-24T06:12:00.405489+0000","last_peered":"2023-11-24T06:12:00.405489+0000","last_clean":"2023-11-24T06:12:00.405489+0000","last_became_active":"2023-11-24T06:11:59.656322+0000","last_became_peered":"2023-11-24T06:11:59.656322+0000","last_unstale":"2023-11-24T06:12:00.405489+0000","last_undegraded":"2023-11-24T06:12:00.405489+0000","last_fullsized":"2023-11-24T06:12:00.405489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:18.929168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385041+0000","last_change":"2023-11-24T06:12:00.411377+0000","last_active":"2023-11-24T06:12:01.385041+0000","last_peered":"2023-11-24T06:12:01.385041+0000","last_clean":"2023-11-24T06:12:01.385041+0000","last_became_active":"2023-11-24T06:12:00.411117+0000","last_became_peered":"2023-11-24T06:12:00.411117+0000","last_unstale":"2023-11-24T06:12:01.385041+0000","last_undegraded":"2023-11-24T06:12:01.385041+0000","last_fullsized":"2023-11-24T06:12:01.385041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:55.958831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.404314+0000","last_change":"2023-11-24T06:11:59.652584+0000","last_active":"2023-11-24T06:12:00.404314+0000","last_peered":"2023-11-24T06:12:00.404314+0000","last_clean":"2023-11-24T06:12:00.404314+0000","last_became_active":"2023-11-24T06:11:59.652269+0000","last_became_peered":"2023-11-24T06:11:59.652269+0000","last_unstale":"2023-11-24T06:12:00.404314+0000","last_undegraded":"2023-11-24T06:12:00.404314+0000","last_fullsized":"2023-11-24T06:12:00.404314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814238+0000","last_change":"2023-11-24T06:12:00.422883+0000","last_active":"2023-11-24T06:12:01.814238+0000","last_peered":"2023-11-24T06:12:01.814238+0000","last_clean":"2023-11-24T06:12:01.814238+0000","last_became_active":"2023-11-24T06:12:00.422163+0000","last_became_peered":"2023-11-24T06:12:00.422163+0000","last_unstale":"2023-11-24T06:12:01.814238+0000","last_undegraded":"2023-11-24T06:12:01.814238+0000","last_fullsized":"2023-11-24T06:12:01.814238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406883+0000","last_change":"2023-11-24T06:11:59.649342+0000","last_active":"2023-11-24T06:12:00.406883+0000","last_peered":"2023-11-24T06:12:00.406883+0000","last_clean":"2023-11-24T06:12:00.406883+0000","last_became_active":"2023-11-24T06:11:59.649022+0000","last_became_peered":"2023-11-24T06:11:59.649022+0000","last_unstale":"2023-11-24T06:12:00.406883+0000","last_undegraded":"2023-11-24T06:12:00.406883+0000","last_fullsized":"2023-11-24T06:12:00.406883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:06.711959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812025+0000","last_change":"2023-11-24T06:12:00.418160+0000","last_active":"2023-11-24T06:12:01.812025+0000","last_peered":"2023-11-24T06:12:01.812025+0000","last_clean":"2023-11-24T06:12:01.812025+0000","last_became_active":"2023-11-24T06:12:00.417836+0000","last_became_peered":"2023-11-24T06:12:00.417836+0000","last_unstale":"2023-11-24T06:12:01.812025+0000","last_undegraded":"2023-11-24T06:12:01.812025+0000","last_fullsized":"2023-11-24T06:12:01.812025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385956+0000","last_change":"2023-11-24T06:11:59.644472+0000","last_active":"2023-11-24T06:12:01.385956+0000","last_peered":"2023-11-24T06:12:01.385956+0000","last_clean":"2023-11-24T06:12:01.385956+0000","last_became_active":"2023-11-24T06:11:59.644152+0000","last_became_peered":"2023-11-24T06:11:59.644152+0000","last_unstale":"2023-11-24T06:12:01.385956+0000","last_undegraded":"2023-11-24T06:12:01.385956+0000","last_fullsized":"2023-11-24T06:12:01.385956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:50.982166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814768+0000","last_change":"2023-11-24T06:12:00.411893+0000","last_active":"2023-11-24T06:12:01.814768+0000","last_peered":"2023-11-24T06:12:01.814768+0000","last_clean":"2023-11-24T06:12:01.814768+0000","last_became_active":"2023-11-24T06:12:00.411029+0000","last_became_peered":"2023-11-24T06:12:00.411029+0000","last_unstale":"2023-11-24T06:12:01.814768+0000","last_undegraded":"2023-11-24T06:12:01.814768+0000","last_fullsized":"2023-11-24T06:12:01.814768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:01.536292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.658392+0000","last_change":"2023-11-24T06:11:59.648134+0000","last_active":"2023-11-24T06:12:00.658392+0000","last_peered":"2023-11-24T06:12:00.658392+0000","last_clean":"2023-11-24T06:12:00.658392+0000","last_became_active":"2023-11-24T06:11:59.647824+0000","last_became_peered":"2023-11-24T06:11:59.647824+0000","last_unstale":"2023-11-24T06:12:00.658392+0000","last_undegraded":"2023-11-24T06:12:00.658392+0000","last_fullsized":"2023-11-24T06:12:00.658392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385778+0000","last_change":"2023-11-24T06:12:00.417420+0000","last_active":"2023-11-24T06:12:01.385778+0000","last_peered":"2023-11-24T06:12:01.385778+0000","last_clean":"2023-11-24T06:12:01.385778+0000","last_became_active":"2023-11-24T06:12:00.416624+0000","last_became_peered":"2023-11-24T06:12:00.416624+0000","last_unstale":"2023-11-24T06:12:01.385778+0000","last_undegraded":"2023-11-24T06:12:01.385778+0000","last_fullsized":"2023-11-24T06:12:01.385778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656684+0000","last_change":"2023-11-24T06:11:59.650532+0000","last_active":"2023-11-24T06:12:00.656684+0000","last_peered":"2023-11-24T06:12:00.656684+0000","last_clean":"2023-11-24T06:12:00.656684+0000","last_became_active":"2023-11-24T06:11:59.650193+0000","last_became_peered":"2023-11-24T06:11:59.650193+0000","last_unstale":"2023-11-24T06:12:00.656684+0000","last_undegraded":"2023-11-24T06:12:00.656684+0000","last_fullsized":"2023-11-24T06:12:00.656684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811425+0000","last_change":"2023-11-24T06:12:00.411372+0000","last_active":"2023-11-24T06:12:01.811425+0000","last_peered":"2023-11-24T06:12:01.811425+0000","last_clean":"2023-11-24T06:12:01.811425+0000","last_became_active":"2023-11-24T06:12:00.410699+0000","last_became_peered":"2023-11-24T06:12:00.410699+0000","last_unstale":"2023-11-24T06:12:01.811425+0000","last_undegraded":"2023-11-24T06:12:01.811425+0000","last_fullsized":"2023-11-24T06:12:01.811425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406094+0000","last_change":"2023-11-24T06:11:59.650677+0000","last_active":"2023-11-24T06:12:00.406094+0000","last_peered":"2023-11-24T06:12:00.406094+0000","last_clean":"2023-11-24T06:12:00.406094+0000","last_became_active":"2023-11-24T06:11:59.650368+0000","last_became_peered":"2023-11-24T06:11:59.650368+0000","last_unstale":"2023-11-24T06:12:00.406094+0000","last_undegraded":"2023-11-24T06:12:00.406094+0000","last_fullsized":"2023-11-24T06:12:00.406094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:29.182982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386237+0000","last_change":"2023-11-24T06:12:00.409066+0000","last_active":"2023-11-24T06:12:01.386237+0000","last_peered":"2023-11-24T06:12:01.386237+0000","last_clean":"2023-11-24T06:12:01.386237+0000","last_became_active":"2023-11-24T06:12:00.408722+0000","last_became_peered":"2023-11-24T06:12:00.408722+0000","last_unstale":"2023-11-24T06:12:01.386237+0000","last_undegraded":"2023-11-24T06:12:01.386237+0000","last_fullsized":"2023-11-24T06:12:01.386237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.399698+0000","last_change":"2023-11-24T06:11:59.653443+0000","last_active":"2023-11-24T06:12:00.399698+0000","last_peered":"2023-11-24T06:12:00.399698+0000","last_clean":"2023-11-24T06:12:00.399698+0000","last_became_active":"2023-11-24T06:11:59.653091+0000","last_became_peered":"2023-11-24T06:11:59.653091+0000","last_unstale":"2023-11-24T06:12:00.399698+0000","last_undegraded":"2023-11-24T06:12:00.399698+0000","last_fullsized":"2023-11-24T06:12:00.399698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792087+0000","last_change":"2023-11-24T06:12:00.415948+0000","last_active":"2023-11-24T06:12:01.792087+0000","last_peered":"2023-11-24T06:12:01.792087+0000","last_clean":"2023-11-24T06:12:01.792087+0000","last_became_active":"2023-11-24T06:12:00.415597+0000","last_became_peered":"2023-11-24T06:12:00.415597+0000","last_unstale":"2023-11-24T06:12:01.792087+0000","last_undegraded":"2023-11-24T06:12:01.792087+0000","last_fullsized":"2023-11-24T06:12:01.792087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648785+0000","last_change":"2023-11-24T06:11:59.620020+0000","last_active":"2023-11-24T06:12:00.648785+0000","last_peered":"2023-11-24T06:12:00.648785+0000","last_clean":"2023-11-24T06:12:00.648785+0000","last_became_active":"2023-11-24T06:11:59.619675+0000","last_became_peered":"2023-11-24T06:11:59.619675+0000","last_unstale":"2023-11-24T06:12:00.648785+0000","last_undegraded":"2023-11-24T06:12:00.648785+0000","last_fullsized":"2023-11-24T06:12:00.648785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385713+0000","last_change":"2023-11-24T06:12:00.412328+0000","last_active":"2023-11-24T06:12:01.385713+0000","last_peered":"2023-11-24T06:12:01.385713+0000","last_clean":"2023-11-24T06:12:01.385713+0000","last_became_active":"2023-11-24T06:12:00.412057+0000","last_became_peered":"2023-11-24T06:12:00.412057+0000","last_unstale":"2023-11-24T06:12:01.385713+0000","last_undegraded":"2023-11-24T06:12:01.385713+0000","last_fullsized":"2023-11-24T06:12:01.385713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.650279+0000","last_change":"2023-11-24T06:11:59.650120+0000","last_active":"2023-11-24T06:12:00.650279+0000","last_peered":"2023-11-24T06:12:00.650279+0000","last_clean":"2023-11-24T06:12:00.650279+0000","last_became_active":"2023-11-24T06:11:59.647975+0000","last_became_peered":"2023-11-24T06:11:59.647975+0000","last_unstale":"2023-11-24T06:12:00.650279+0000","last_undegraded":"2023-11-24T06:12:00.650279+0000","last_fullsized":"2023-11-24T06:12:00.650279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.407351+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.406978+0000","last_became_peered":"2023-11-24T06:12:00.406978+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648323+0000","last_change":"2023-11-24T06:11:59.628459+0000","last_active":"2023-11-24T06:12:00.648323+0000","last_peered":"2023-11-24T06:12:00.648323+0000","last_clean":"2023-11-24T06:12:00.648323+0000","last_became_active":"2023-11-24T06:11:59.628147+0000","last_became_peered":"2023-11-24T06:11:59.628147+0000","last_unstale":"2023-11-24T06:12:00.648323+0000","last_undegraded":"2023-11-24T06:12:00.648323+0000","last_fullsized":"2023-11-24T06:12:00.648323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387133+0000","last_change":"2023-11-24T06:12:00.424920+0000","last_active":"2023-11-24T06:12:01.387133+0000","last_peered":"2023-11-24T06:12:01.387133+0000","last_clean":"2023-11-24T06:12:01.387133+0000","last_became_active":"2023-11-24T06:12:00.423927+0000","last_became_peered":"2023-11-24T06:12:00.423927+0000","last_unstale":"2023-11-24T06:12:01.387133+0000","last_undegraded":"2023-11-24T06:12:01.387133+0000","last_fullsized":"2023-11-24T06:12:01.387133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:54:14.921315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:11:59.643977+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:11:59.643552+0000","last_became_peered":"2023-11-24T06:11:59.643552+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:02.323910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813574+0000","last_change":"2023-11-24T06:12:00.417408+0000","last_active":"2023-11-24T06:12:01.813574+0000","last_peered":"2023-11-24T06:12:01.813574+0000","last_clean":"2023-11-24T06:12:01.813574+0000","last_became_active":"2023-11-24T06:12:00.417026+0000","last_became_peered":"2023-11-24T06:12:00.417026+0000","last_unstale":"2023-11-24T06:12:01.813574+0000","last_undegraded":"2023-11-24T06:12:01.813574+0000","last_fullsized":"2023-11-24T06:12:01.813574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379381+0000","last_change":"2023-11-24T06:11:59.643121+0000","last_active":"2023-11-24T06:12:00.379381+0000","last_peered":"2023-11-24T06:12:00.379381+0000","last_clean":"2023-11-24T06:12:00.379381+0000","last_became_active":"2023-11-24T06:11:59.642797+0000","last_became_peered":"2023-11-24T06:11:59.642797+0000","last_unstale":"2023-11-24T06:12:00.379381+0000","last_undegraded":"2023-11-24T06:12:00.379381+0000","last_fullsized":"2023-11-24T06:12:00.379381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386156+0000","last_change":"2023-11-24T06:12:00.417716+0000","last_active":"2023-11-24T06:12:01.386156+0000","last_peered":"2023-11-24T06:12:01.386156+0000","last_clean":"2023-11-24T06:12:01.386156+0000","last_became_active":"2023-11-24T06:12:00.417088+0000","last_became_peered":"2023-11-24T06:12:00.417088+0000","last_unstale":"2023-11-24T06:12:01.386156+0000","last_undegraded":"2023-11-24T06:12:01.386156+0000","last_fullsized":"2023-11-24T06:12:01.386156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383162+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:12:00.383162+0000","last_peered":"2023-11-24T06:12:00.383162+0000","last_clean":"2023-11-24T06:12:00.383162+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:12:00.383162+0000","last_undegraded":"2023-11-24T06:12:00.383162+0000","last_fullsized":"2023-11-24T06:12:00.383162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.403650+0000","last_change":"2023-11-24T06:11:59.649393+0000","last_active":"2023-11-24T06:12:00.403650+0000","last_peered":"2023-11-24T06:12:00.403650+0000","last_clean":"2023-11-24T06:12:00.403650+0000","last_became_active":"2023-11-24T06:11:59.649045+0000","last_became_peered":"2023-11-24T06:11:59.649045+0000","last_unstale":"2023-11-24T06:12:00.403650+0000","last_undegraded":"2023-11-24T06:12:00.403650+0000","last_fullsized":"2023-11-24T06:12:00.403650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383623+0000","last_change":"2023-11-24T06:12:00.417107+0000","last_active":"2023-11-24T06:12:01.383623+0000","last_peered":"2023-11-24T06:12:01.383623+0000","last_clean":"2023-11-24T06:12:01.383623+0000","last_became_active":"2023-11-24T06:12:00.416181+0000","last_became_peered":"2023-11-24T06:12:00.416181+0000","last_unstale":"2023-11-24T06:12:01.383623+0000","last_undegraded":"2023-11-24T06:12:01.383623+0000","last_fullsized":"2023-11-24T06:12:01.383623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383049+0000","last_change":"2023-11-24T06:11:59.641692+0000","last_active":"2023-11-24T06:12:00.383049+0000","last_peered":"2023-11-24T06:12:00.383049+0000","last_clean":"2023-11-24T06:12:00.383049+0000","last_became_active":"2023-11-24T06:11:59.641199+0000","last_became_peered":"2023-11-24T06:11:59.641199+0000","last_unstale":"2023-11-24T06:12:00.383049+0000","last_undegraded":"2023-11-24T06:12:00.383049+0000","last_fullsized":"2023-11-24T06:12:00.383049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811125+0000","last_change":"2023-11-24T06:12:00.421725+0000","last_active":"2023-11-24T06:12:01.811125+0000","last_peered":"2023-11-24T06:12:01.811125+0000","last_clean":"2023-11-24T06:12:01.811125+0000","last_became_active":"2023-11-24T06:12:00.421402+0000","last_became_peered":"2023-11-24T06:12:00.421402+0000","last_unstale":"2023-11-24T06:12:01.811125+0000","last_undegraded":"2023-11-24T06:12:01.811125+0000","last_fullsized":"2023-11-24T06:12:01.811125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:16.430001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379330+0000","last_change":"2023-11-24T06:11:59.628457+0000","last_active":"2023-11-24T06:12:00.379330+0000","last_peered":"2023-11-24T06:12:00.379330+0000","last_clean":"2023-11-24T06:12:00.379330+0000","last_became_active":"2023-11-24T06:11:59.628109+0000","last_became_peered":"2023-11-24T06:11:59.628109+0000","last_unstale":"2023-11-24T06:12:00.379330+0000","last_undegraded":"2023-11-24T06:12:00.379330+0000","last_fullsized":"2023-11-24T06:12:00.379330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385318+0000","last_change":"2023-11-24T06:12:00.406591+0000","last_active":"2023-11-24T06:12:01.385318+0000","last_peered":"2023-11-24T06:12:01.385318+0000","last_clean":"2023-11-24T06:12:01.385318+0000","last_became_active":"2023-11-24T06:12:00.406217+0000","last_became_peered":"2023-11-24T06:12:00.406217+0000","last_unstale":"2023-11-24T06:12:01.385318+0000","last_undegraded":"2023-11-24T06:12:01.385318+0000","last_fullsized":"2023-11-24T06:12:01.385318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:49.548969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406285+0000","last_change":"2023-11-24T06:11:59.645058+0000","last_active":"2023-11-24T06:12:00.406285+0000","last_peered":"2023-11-24T06:12:00.406285+0000","last_clean":"2023-11-24T06:12:00.406285+0000","last_became_active":"2023-11-24T06:11:59.642696+0000","last_became_peered":"2023-11-24T06:11:59.642696+0000","last_unstale":"2023-11-24T06:12:00.406285+0000","last_undegraded":"2023-11-24T06:12:00.406285+0000","last_fullsized":"2023-11-24T06:12:00.406285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:17.577492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.815366+0000","last_change":"2023-11-24T06:12:00.415699+0000","last_active":"2023-11-24T06:12:01.815366+0000","last_peered":"2023-11-24T06:12:01.815366+0000","last_clean":"2023-11-24T06:12:01.815366+0000","last_became_active":"2023-11-24T06:12:00.412274+0000","last_became_peered":"2023-11-24T06:12:00.412274+0000","last_unstale":"2023-11-24T06:12:01.815366+0000","last_undegraded":"2023-11-24T06:12:01.815366+0000","last_fullsized":"2023-11-24T06:12:01.815366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385632+0000","last_change":"2023-11-24T06:11:59.633842+0000","last_active":"2023-11-24T06:12:01.385632+0000","last_peered":"2023-11-24T06:12:01.385632+0000","last_clean":"2023-11-24T06:12:01.385632+0000","last_became_active":"2023-11-24T06:11:59.632890+0000","last_became_peered":"2023-11-24T06:11:59.632890+0000","last_unstale":"2023-11-24T06:12:01.385632+0000","last_undegraded":"2023-11-24T06:12:01.385632+0000","last_fullsized":"2023-11-24T06:12:01.385632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:00.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813832+0000","last_change":"2023-11-24T06:12:00.424534+0000","last_active":"2023-11-24T06:12:01.813832+0000","last_peered":"2023-11-24T06:12:01.813832+0000","last_clean":"2023-11-24T06:12:01.813832+0000","last_became_active":"2023-11-24T06:12:00.419919+0000","last_became_peered":"2023-11-24T06:12:00.419919+0000","last_unstale":"2023-11-24T06:12:01.813832+0000","last_undegraded":"2023-11-24T06:12:01.813832+0000","last_fullsized":"2023-11-24T06:12:01.813832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.389114+0000","last_change":"2023-11-24T06:11:59.644082+0000","last_active":"2023-11-24T06:12:00.389114+0000","last_peered":"2023-11-24T06:12:00.389114+0000","last_clean":"2023-11-24T06:12:00.389114+0000","last_became_active":"2023-11-24T06:11:59.640160+0000","last_became_peered":"2023-11-24T06:11:59.640160+0000","last_unstale":"2023-11-24T06:12:00.389114+0000","last_undegraded":"2023-11-24T06:12:00.389114+0000","last_fullsized":"2023-11-24T06:12:00.389114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385733+0000","last_change":"2023-11-24T06:12:00.406268+0000","last_active":"2023-11-24T06:12:01.385733+0000","last_peered":"2023-11-24T06:12:01.385733+0000","last_clean":"2023-11-24T06:12:01.385733+0000","last_became_active":"2023-11-24T06:12:00.405965+0000","last_became_peered":"2023-11-24T06:12:00.405965+0000","last_unstale":"2023-11-24T06:12:01.385733+0000","last_undegraded":"2023-11-24T06:12:01.385733+0000","last_fullsized":"2023-11-24T06:12:01.385733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:42.193371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386128+0000","last_change":"2023-11-24T06:11:59.645602+0000","last_active":"2023-11-24T06:12:01.386128+0000","last_peered":"2023-11-24T06:12:01.386128+0000","last_clean":"2023-11-24T06:12:01.386128+0000","last_became_active":"2023-11-24T06:11:59.645312+0000","last_became_peered":"2023-11-24T06:11:59.645312+0000","last_unstale":"2023-11-24T06:12:01.386128+0000","last_undegraded":"2023-11-24T06:12:01.386128+0000","last_fullsized":"2023-11-24T06:12:01.386128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:43.860695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384670+0000","last_change":"2023-11-24T06:12:00.417986+0000","last_active":"2023-11-24T06:12:01.384670+0000","last_peered":"2023-11-24T06:12:01.384670+0000","last_clean":"2023-11-24T06:12:01.384670+0000","last_became_active":"2023-11-24T06:12:00.417578+0000","last_became_peered":"2023-11-24T06:12:00.417578+0000","last_unstale":"2023-11-24T06:12:01.384670+0000","last_undegraded":"2023-11-24T06:12:01.384670+0000","last_fullsized":"2023-11-24T06:12:01.384670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656198+0000","last_change":"2023-11-24T06:11:59.648128+0000","last_active":"2023-11-24T06:12:00.656198+0000","last_peered":"2023-11-24T06:12:00.656198+0000","last_clean":"2023-11-24T06:12:00.656198+0000","last_became_active":"2023-11-24T06:11:59.647817+0000","last_became_peered":"2023-11-24T06:11:59.647817+0000","last_unstale":"2023-11-24T06:12:00.656198+0000","last_undegraded":"2023-11-24T06:12:00.656198+0000","last_fullsized":"2023-11-24T06:12:00.656198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812611+0000","last_change":"2023-11-24T06:12:00.407315+0000","last_active":"2023-11-24T06:12:01.812611+0000","last_peered":"2023-11-24T06:12:01.812611+0000","last_clean":"2023-11-24T06:12:01.812611+0000","last_became_active":"2023-11-24T06:12:00.406966+0000","last_became_peered":"2023-11-24T06:12:00.406966+0000","last_unstale":"2023-11-24T06:12:01.812611+0000","last_undegraded":"2023-11-24T06:12:01.812611+0000","last_fullsized":"2023-11-24T06:12:01.812611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.382934+0000","last_change":"2023-11-24T06:11:59.641473+0000","last_active":"2023-11-24T06:12:00.382934+0000","last_peered":"2023-11-24T06:12:00.382934+0000","last_clean":"2023-11-24T06:12:00.382934+0000","last_became_active":"2023-11-24T06:11:59.640882+0000","last_became_peered":"2023-11-24T06:11:59.640882+0000","last_unstale":"2023-11-24T06:12:00.382934+0000","last_undegraded":"2023-11-24T06:12:00.382934+0000","last_fullsized":"2023-11-24T06:12:00.382934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:15.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814297+0000","last_change":"2023-11-24T06:12:00.420629+0000","last_active":"2023-11-24T06:12:01.814297+0000","last_peered":"2023-11-24T06:12:01.814297+0000","last_clean":"2023-11-24T06:12:01.814297+0000","last_became_active":"2023-11-24T06:12:00.420121+0000","last_became_peered":"2023-11-24T06:12:00.420121+0000","last_unstale":"2023-11-24T06:12:01.814297+0000","last_undegraded":"2023-11-24T06:12:01.814297+0000","last_fullsized":"2023-11-24T06:12:01.814297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:16.361272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385138+0000","last_change":"2023-11-24T06:11:59.642028+0000","last_active":"2023-11-24T06:12:01.385138+0000","last_peered":"2023-11-24T06:12:01.385138+0000","last_clean":"2023-11-24T06:12:01.385138+0000","last_became_active":"2023-11-24T06:11:59.641734+0000","last_became_peered":"2023-11-24T06:11:59.641734+0000","last_unstale":"2023-11-24T06:12:01.385138+0000","last_undegraded":"2023-11-24T06:12:01.385138+0000","last_fullsized":"2023-11-24T06:12:01.385138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:44.578653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384138+0000","last_change":"2023-11-24T06:12:00.410266+0000","last_active":"2023-11-24T06:12:01.384138+0000","last_peered":"2023-11-24T06:12:01.384138+0000","last_clean":"2023-11-24T06:12:01.384138+0000","last_became_active":"2023-11-24T06:12:00.409968+0000","last_became_peered":"2023-11-24T06:12:00.409968+0000","last_unstale":"2023-11-24T06:12:01.384138+0000","last_undegraded":"2023-11-24T06:12:01.384138+0000","last_fullsized":"2023-11-24T06:12:01.384138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385736+0000","last_change":"2023-11-24T06:11:59.630765+0000","last_active":"2023-11-24T06:12:01.385736+0000","last_peered":"2023-11-24T06:12:01.385736+0000","last_clean":"2023-11-24T06:12:01.385736+0000","last_became_active":"2023-11-24T06:11:59.629875+0000","last_became_peered":"2023-11-24T06:11:59.629875+0000","last_unstale":"2023-11-24T06:12:01.385736+0000","last_undegraded":"2023-11-24T06:12:01.385736+0000","last_fullsized":"2023-11-24T06:12:01.385736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:19.421623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384213+0000","last_change":"2023-11-24T06:12:00.408041+0000","last_active":"2023-11-24T06:12:01.384213+0000","last_peered":"2023-11-24T06:12:01.384213+0000","last_clean":"2023-11-24T06:12:01.384213+0000","last_became_active":"2023-11-24T06:12:00.407616+0000","last_became_peered":"2023-11-24T06:12:00.407616+0000","last_unstale":"2023-11-24T06:12:01.384213+0000","last_undegraded":"2023-11-24T06:12:01.384213+0000","last_fullsized":"2023-11-24T06:12:01.384213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656982+0000","last_change":"2023-11-24T06:11:59.652850+0000","last_active":"2023-11-24T06:12:00.656982+0000","last_peered":"2023-11-24T06:12:00.656982+0000","last_clean":"2023-11-24T06:12:00.656982+0000","last_became_active":"2023-11-24T06:11:59.652583+0000","last_became_peered":"2023-11-24T06:11:59.652583+0000","last_unstale":"2023-11-24T06:12:00.656982+0000","last_undegraded":"2023-11-24T06:12:00.656982+0000","last_fullsized":"2023-11-24T06:12:00.656982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792109+0000","last_change":"2023-11-24T06:12:00.408854+0000","last_active":"2023-11-24T06:12:01.792109+0000","last_peered":"2023-11-24T06:12:01.792109+0000","last_clean":"2023-11-24T06:12:01.792109+0000","last_became_active":"2023-11-24T06:12:00.408541+0000","last_became_peered":"2023-11-24T06:12:00.408541+0000","last_unstale":"2023-11-24T06:12:01.792109+0000","last_undegraded":"2023-11-24T06:12:01.792109+0000","last_fullsized":"2023-11-24T06:12:01.792109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813395+0000","last_change":"2023-11-24T06:12:00.425989+0000","last_active":"2023-11-24T06:12:01.813395+0000","last_peered":"2023-11-24T06:12:01.813395+0000","last_clean":"2023-11-24T06:12:01.813395+0000","last_became_active":"2023-11-24T06:12:00.425649+0000","last_became_peered":"2023-11-24T06:12:00.425649+0000","last_unstale":"2023-11-24T06:12:01.813395+0000","last_undegraded":"2023-11-24T06:12:01.813395+0000","last_fullsized":"2023-11-24T06:12:01.813395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.655824+0000","last_change":"2023-11-24T06:11:59.649445+0000","last_active":"2023-11-24T06:12:00.655824+0000","last_peered":"2023-11-24T06:12:00.655824+0000","last_clean":"2023-11-24T06:12:00.655824+0000","last_became_active":"2023-11-24T06:11:59.649024+0000","last_became_peered":"2023-11-24T06:11:59.649024+0000","last_unstale":"2023-11-24T06:12:00.655824+0000","last_undegraded":"2023-11-24T06:12:00.655824+0000","last_fullsized":"2023-11-24T06:12:00.655824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813376+0000","last_change":"2023-11-24T06:12:00.425911+0000","last_active":"2023-11-24T06:12:01.813376+0000","last_peered":"2023-11-24T06:12:01.813376+0000","last_clean":"2023-11-24T06:12:01.813376+0000","last_became_active":"2023-11-24T06:12:00.425590+0000","last_became_peered":"2023-11-24T06:12:00.425590+0000","last_unstale":"2023-11-24T06:12:01.813376+0000","last_undegraded":"2023-11-24T06:12:01.813376+0000","last_fullsized":"2023-11-24T06:12:01.813376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656014+0000","last_change":"2023-11-24T06:11:59.648255+0000","last_active":"2023-11-24T06:12:00.656014+0000","last_peered":"2023-11-24T06:12:00.656014+0000","last_clean":"2023-11-24T06:12:00.656014+0000","last_became_active":"2023-11-24T06:11:59.647961+0000","last_became_peered":"2023-11-24T06:11:59.647961+0000","last_unstale":"2023-11-24T06:12:00.656014+0000","last_undegraded":"2023-11-24T06:12:00.656014+0000","last_fullsized":"2023-11-24T06:12:00.656014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811821+0000","last_change":"2023-11-24T06:12:00.415607+0000","last_active":"2023-11-24T06:12:01.811821+0000","last_peered":"2023-11-24T06:12:01.811821+0000","last_clean":"2023-11-24T06:12:01.811821+0000","last_became_active":"2023-11-24T06:12:00.415309+0000","last_became_peered":"2023-11-24T06:12:00.415309+0000","last_unstale":"2023-11-24T06:12:01.811821+0000","last_undegraded":"2023-11-24T06:12:01.811821+0000","last_fullsized":"2023-11-24T06:12:01.811821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.646459+0000","last_change":"2023-11-24T06:11:59.634657+0000","last_active":"2023-11-24T06:12:00.646459+0000","last_peered":"2023-11-24T06:12:00.646459+0000","last_clean":"2023-11-24T06:12:00.646459+0000","last_became_active":"2023-11-24T06:11:59.634335+0000","last_became_peered":"2023-11-24T06:11:59.634335+0000","last_unstale":"2023-11-24T06:12:00.646459+0000","last_undegraded":"2023-11-24T06:12:00.646459+0000","last_fullsized":"2023-11-24T06:12:00.646459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384001+0000","last_change":"2023-11-24T06:12:00.415376+0000","last_active":"2023-11-24T06:12:01.384001+0000","last_peered":"2023-11-24T06:12:01.384001+0000","last_clean":"2023-11-24T06:12:01.384001+0000","last_became_active":"2023-11-24T06:12:00.415114+0000","last_became_peered":"2023-11-24T06:12:00.415114+0000","last_unstale":"2023-11-24T06:12:01.384001+0000","last_undegraded":"2023-11-24T06:12:01.384001+0000","last_fullsized":"2023-11-24T06:12:01.384001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654742+0000","last_change":"2023-11-24T06:11:59.645253+0000","last_active":"2023-11-24T06:12:00.654742+0000","last_peered":"2023-11-24T06:12:00.654742+0000","last_clean":"2023-11-24T06:12:00.654742+0000","last_became_active":"2023-11-24T06:11:59.644979+0000","last_became_peered":"2023-11-24T06:11:59.644979+0000","last_unstale":"2023-11-24T06:12:00.654742+0000","last_undegraded":"2023-11-24T06:12:00.654742+0000","last_fullsized":"2023-11-24T06:12:00.654742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:36:07.535502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9319999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2210000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4460000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.173}]}]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.258}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0059999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":666978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:12:10.255 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:12:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.488+0000 7f4f3759e640 1 Processor -- start 2023-11-24T06:12:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.488+0000 7f4f3759e640 1 -- start start 2023-11-24T06:12:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.490+0000 7f4f3759e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f38143570 0x7f4f380cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.490+0000 7f4f3759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f38143950 0x7f4f380cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.490+0000 7f4f3759e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f3815e6b0 0x7f4f3815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.490+0000 7f4f3759e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f38071700 con 0x7f4f3815e6b0 2023-11-24T06:12:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.490+0000 7f4f3759e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3815b410 con 0x7f4f38143570 2023-11-24T06:12:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.490+0000 7f4f3759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3815b130 con 0x7f4f38143950 2023-11-24T06:12:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f36d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f3815e6b0 0x7f4f3815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f36d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f3815e6b0 0x7f4f3815a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46112/0 (socket says 172.21.15.22:46112) 2023-11-24T06:12:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f36d9d640 1 -- 172.21.15.22:0/706652614 learned_addr learned my addr 172.21.15.22:0/706652614 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f3659c640 1 --2- 172.21.15.22:0/706652614 >> v2:172.21.15.31:3300/0 conn(0x7f4f38143570 0x7f4f380cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f2dd9b640 1 --2- 172.21.15.22:0/706652614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f38143950 0x7f4f380cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:10.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f36d9d640 1 -- 172.21.15.22:0/706652614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f38143950 msgr2=0x7f4f380cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:10.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f36d9d640 1 --2- 172.21.15.22:0/706652614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f38143950 0x7f4f380cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f36d9d640 1 -- 172.21.15.22:0/706652614 >> v2:172.21.15.31:3300/0 conn(0x7f4f38143570 msgr2=0x7f4f380cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:10.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f36d9d640 1 --2- 172.21.15.22:0/706652614 >> v2:172.21.15.31:3300/0 conn(0x7f4f38143570 0x7f4f380cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.491+0000 7f4f36d9d640 1 -- 172.21.15.22:0/706652614 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3815dbd0 con 0x7f4f3815e6b0 2023-11-24T06:12:10.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.492+0000 7f4f36d9d640 1 --2- 172.21.15.22:0/706652614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3815e6b0 0x7f4f3815a4b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f38070c70 tx=0x7f4f3002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727ed95d01e72992 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:10.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.493+0000 7f4f35d9b640 1 -- 172.21.15.22:0/706652614 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3002c9f0 con 0x7f4f3815e6b0 2023-11-24T06:12:10.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.493+0000 7f4f35d9b640 1 -- 172.21.15.22:0/706652614 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3002cb50 con 0x7f4f3815e6b0 2023-11-24T06:12:10.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.493+0000 7f4f35d9b640 1 -- 172.21.15.22:0/706652614 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300343f0 con 0x7f4f3815e6b0 2023-11-24T06:12:10.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.493+0000 7f4f3759e640 1 -- 172.21.15.22:0/706652614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3815e6b0 msgr2=0x7f4f3815a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:10.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.493+0000 7f4f3759e640 1 --2- 172.21.15.22:0/706652614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3815e6b0 0x7f4f3815a4b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f38070c70 tx=0x7f4f3002be50 comp rx=0 tx=0).stop 2023-11-24T06:12:10.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.494+0000 7f4f3759e640 1 -- 172.21.15.22:0/706652614 shutdown_connections 2023-11-24T06:12:10.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.494+0000 7f4f3759e640 1 --2- 172.21.15.22:0/706652614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3815e6b0 0x7f4f3815a4b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.494+0000 7f4f3759e640 1 --2- 172.21.15.22:0/706652614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f38143950 0x7f4f380cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.494+0000 7f4f3759e640 1 --2- 172.21.15.22:0/706652614 >> v2:172.21.15.31:3300/0 conn(0x7f4f38143570 0x7f4f380cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.494+0000 7f4f3759e640 1 -- 172.21.15.22:0/706652614 >> 172.21.15.22:0/706652614 conn(0x7f4f3806a860 msgr2=0x7f4f3806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:10.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.494+0000 7f4f3759e640 1 -- 172.21.15.22:0/706652614 shutdown_connections 2023-11-24T06:12:10.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.494+0000 7f4f3759e640 1 -- 172.21.15.22:0/706652614 wait complete. 2023-11-24T06:12:10.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.496+0000 7f4f3759e640 1 Processor -- start 2023-11-24T06:12:10.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.496+0000 7f4f3759e640 1 -- start start 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f3759e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f38143570 0x7f4f38137f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f3759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f38143950 0x7f4f38141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f3759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f3815e6b0 0x7f4f381415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f3759e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3813e890 con 0x7f4f38143950 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f3759e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3813f3d0 con 0x7f4f38143570 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f3759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f381384b0 con 0x7f4f3815e6b0 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f2dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f38143950 0x7f4f38141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f2dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f38143950 0x7f4f38141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46122/0 (socket says 172.21.15.22:46122) 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f2dd9b640 1 -- 172.21.15.22:0/3275726951 learned_addr learned my addr 172.21.15.22:0/3275726951 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.497+0000 7f4f2dd9b640 1 -- 172.21.15.22:0/3275726951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f3815e6b0 msgr2=0x7f4f381415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f36d9d640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f3815e6b0 0x7f4f381415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f3659c640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f38143570 0x7f4f38137f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f2dd9b640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f3815e6b0 0x7f4f381415b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f2dd9b640 1 -- 172.21.15.22:0/3275726951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f38143570 msgr2=0x7f4f38137f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f2dd9b640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f38143570 0x7f4f38137f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f2dd9b640 1 -- 172.21.15.22:0/3275726951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f30009b30 con 0x7f4f38143950 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f2dd9b640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f38143950 0x7f4f38141070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000d7d0 tx=0x7f4f2000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f2f7fe640 1 -- 172.21.15.22:0/3275726951 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000b6c0 con 0x7f4f38143950 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f2f7fe640 1 -- 172.21.15.22:0/3275726951 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000b820 con 0x7f4f38143950 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f2f7fe640 1 -- 172.21.15.22:0/3275726951 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000bbb0 con 0x7f4f38143950 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3813c8f0 con 0x7f4f38143950 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.498+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3813ed80 con 0x7f4f38143950 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.500+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3804e840 con 0x7f4f38143950 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.501+0000 7f4f2f7fe640 1 -- 172.21.15.22:0/3275726951 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f2000bd10 con 0x7f4f38143950 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.501+0000 7f4f2f7fe640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4f1806ae70 0x7f4f1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.502+0000 7f4f2f7fe640 1 -- 172.21.15.22:0/3275726951 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f20089ab0 con 0x7f4f38143950 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.502+0000 7f4f3659c640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4f1806ae70 0x7f4f1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.502+0000 7f4f3659c640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4f1806ae70 0x7f4f1806d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f28006fd0 tx=0x7f4f28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.506+0000 7f4f2f7fe640 1 -- 172.21.15.22:0/3275726951 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f20054b50 con 0x7f4f38143950 2023-11-24T06:12:10.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.697+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f3815e190 con 0x7f4f1806ae70 2023-11-24T06:12:10.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.705+0000 7f4f2f7fe640 1 -- 172.21.15.22:0/3275726951 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264395 (secure 0 0 0) 0x7f4f28009d60 con 0x7f4f1806ae70 2023-11-24T06:12:10.712 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:10.713 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:12:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4f1806ae70 msgr2=0x7f4f1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4f1806ae70 0x7f4f1806d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f28006fd0 tx=0x7f4f28008040 comp rx=0 tx=0).stop 2023-11-24T06:12:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f38143950 msgr2=0x7f4f38141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f38143950 0x7f4f38141070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000d7d0 tx=0x7f4f2000dc90 comp rx=0 tx=0).stop 2023-11-24T06:12:10.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 shutdown_connections 2023-11-24T06:12:10.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4f1806ae70 0x7f4f1806d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f3815e6b0 0x7f4f381415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f38143950 0x7f4f38141070 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 --2- 172.21.15.22:0/3275726951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f38143570 0x7f4f38137f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:10.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.712+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 >> 172.21.15.22:0/3275726951 conn(0x7f4f3806a860 msgr2=0x7f4f380ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:10.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.713+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 shutdown_connections 2023-11-24T06:12:10.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.713+0000 7f4f3759e640 1 -- 172.21.15.22:0/3275726951 wait complete. 2023-11-24T06:12:10.733 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-24T06:12:10.649787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235780,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738940,"statfs":{"total":773094113280,"available":772852674560,"internally_reserved":0,"allocated":3022848,"data_stored":1793332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003319"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386950+0000","last_change":"2023-11-24T06:12:00.409989+0000","last_active":"2023-11-24T06:12:01.386950+0000","last_peered":"2023-11-24T06:12:01.386950+0000","last_clean":"2023-11-24T06:12:01.386950+0000","last_became_active":"2023-11-24T06:12:00.409672+0000","last_became_peered":"2023-11-24T06:12:00.409672+0000","last_unstale":"2023-11-24T06:12:01.386950+0000","last_undegraded":"2023-11-24T06:12:01.386950+0000","last_fullsized":"2023-11-24T06:12:01.386950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386025+0000","last_change":"2023-11-24T06:12:00.416425+0000","last_active":"2023-11-24T06:12:01.386025+0000","last_peered":"2023-11-24T06:12:01.386025+0000","last_clean":"2023-11-24T06:12:01.386025+0000","last_became_active":"2023-11-24T06:12:00.415783+0000","last_became_peered":"2023-11-24T06:12:00.415783+0000","last_unstale":"2023-11-24T06:12:01.386025+0000","last_undegraded":"2023-11-24T06:12:01.386025+0000","last_fullsized":"2023-11-24T06:12:01.386025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:38:17.759240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811686+0000","last_change":"2023-11-24T06:12:00.408399+0000","last_active":"2023-11-24T06:12:01.811686+0000","last_peered":"2023-11-24T06:12:01.811686+0000","last_clean":"2023-11-24T06:12:01.811686+0000","last_became_active":"2023-11-24T06:12:00.408067+0000","last_became_peered":"2023-11-24T06:12:00.408067+0000","last_unstale":"2023-11-24T06:12:01.811686+0000","last_undegraded":"2023-11-24T06:12:01.811686+0000","last_fullsized":"2023-11-24T06:12:01.811686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813152+0000","last_change":"2023-11-24T06:12:00.423704+0000","last_active":"2023-11-24T06:12:01.813152+0000","last_peered":"2023-11-24T06:12:01.813152+0000","last_clean":"2023-11-24T06:12:01.813152+0000","last_became_active":"2023-11-24T06:12:00.423106+0000","last_became_peered":"2023-11-24T06:12:00.423106+0000","last_unstale":"2023-11-24T06:12:01.813152+0000","last_undegraded":"2023-11-24T06:12:01.813152+0000","last_fullsized":"2023-11-24T06:12:01.813152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:12:00.400306+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:12:00.399964+0000","last_became_peered":"2023-11-24T06:12:00.399964+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812946+0000","last_change":"2023-11-24T06:12:00.418713+0000","last_active":"2023-11-24T06:12:01.812946+0000","last_peered":"2023-11-24T06:12:01.812946+0000","last_clean":"2023-11-24T06:12:01.812946+0000","last_became_active":"2023-11-24T06:12:00.417992+0000","last_became_peered":"2023-11-24T06:12:00.417992+0000","last_unstale":"2023-11-24T06:12:01.812946+0000","last_undegraded":"2023-11-24T06:12:01.812946+0000","last_fullsized":"2023-11-24T06:12:01.812946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385528+0000","last_change":"2023-11-24T06:12:00.408860+0000","last_active":"2023-11-24T06:12:01.385528+0000","last_peered":"2023-11-24T06:12:01.385528+0000","last_clean":"2023-11-24T06:12:01.385528+0000","last_became_active":"2023-11-24T06:12:00.408549+0000","last_became_peered":"2023-11-24T06:12:00.408549+0000","last_unstale":"2023-11-24T06:12:01.385528+0000","last_undegraded":"2023-11-24T06:12:01.385528+0000","last_fullsized":"2023-11-24T06:12:01.385528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383026+0000","last_change":"2023-11-24T06:12:00.413017+0000","last_active":"2023-11-24T06:12:01.383026+0000","last_peered":"2023-11-24T06:12:01.383026+0000","last_clean":"2023-11-24T06:12:01.383026+0000","last_became_active":"2023-11-24T06:12:00.411843+0000","last_became_peered":"2023-11-24T06:12:00.411843+0000","last_unstale":"2023-11-24T06:12:01.383026+0000","last_undegraded":"2023-11-24T06:12:01.383026+0000","last_fullsized":"2023-11-24T06:12:01.383026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387045+0000","last_change":"2023-11-24T06:12:00.418547+0000","last_active":"2023-11-24T06:12:01.387045+0000","last_peered":"2023-11-24T06:12:01.387045+0000","last_clean":"2023-11-24T06:12:01.387045+0000","last_became_active":"2023-11-24T06:12:00.418264+0000","last_became_peered":"2023-11-24T06:12:00.418264+0000","last_unstale":"2023-11-24T06:12:01.387045+0000","last_undegraded":"2023-11-24T06:12:01.387045+0000","last_fullsized":"2023-11-24T06:12:01.387045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792917+0000","last_change":"2023-11-24T06:12:00.413548+0000","last_active":"2023-11-24T06:12:01.792917+0000","last_peered":"2023-11-24T06:12:01.792917+0000","last_clean":"2023-11-24T06:12:01.792917+0000","last_became_active":"2023-11-24T06:12:00.413225+0000","last_became_peered":"2023-11-24T06:12:00.413225+0000","last_unstale":"2023-11-24T06:12:01.792917+0000","last_undegraded":"2023-11-24T06:12:01.792917+0000","last_fullsized":"2023-11-24T06:12:01.792917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792746+0000","last_change":"2023-11-24T06:12:00.415528+0000","last_active":"2023-11-24T06:12:01.792746+0000","last_peered":"2023-11-24T06:12:01.792746+0000","last_clean":"2023-11-24T06:12:01.792746+0000","last_became_active":"2023-11-24T06:12:00.414074+0000","last_became_peered":"2023-11-24T06:12:00.414074+0000","last_unstale":"2023-11-24T06:12:01.792746+0000","last_undegraded":"2023-11-24T06:12:01.792746+0000","last_fullsized":"2023-11-24T06:12:01.792746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814560+0000","last_change":"2023-11-24T06:12:00.412466+0000","last_active":"2023-11-24T06:12:01.814560+0000","last_peered":"2023-11-24T06:12:01.814560+0000","last_clean":"2023-11-24T06:12:01.814560+0000","last_became_active":"2023-11-24T06:12:00.412189+0000","last_became_peered":"2023-11-24T06:12:00.412189+0000","last_unstale":"2023-11-24T06:12:01.814560+0000","last_undegraded":"2023-11-24T06:12:01.814560+0000","last_fullsized":"2023-11-24T06:12:01.814560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:33.179248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384061+0000","last_change":"2023-11-24T06:12:00.410091+0000","last_active":"2023-11-24T06:12:01.384061+0000","last_peered":"2023-11-24T06:12:01.384061+0000","last_clean":"2023-11-24T06:12:01.384061+0000","last_became_active":"2023-11-24T06:12:00.409724+0000","last_became_peered":"2023-11-24T06:12:00.409724+0000","last_unstale":"2023-11-24T06:12:01.384061+0000","last_undegraded":"2023-11-24T06:12:01.384061+0000","last_fullsized":"2023-11-24T06:12:01.384061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811279+0000","last_change":"2023-11-24T06:12:00.413928+0000","last_active":"2023-11-24T06:12:01.811279+0000","last_peered":"2023-11-24T06:12:01.811279+0000","last_clean":"2023-11-24T06:12:01.811279+0000","last_became_active":"2023-11-24T06:12:00.408524+0000","last_became_peered":"2023-11-24T06:12:00.408524+0000","last_unstale":"2023-11-24T06:12:01.811279+0000","last_undegraded":"2023-11-24T06:12:01.811279+0000","last_fullsized":"2023-11-24T06:12:01.811279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:21.383018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385301+0000","last_change":"2023-11-24T06:12:00.414487+0000","last_active":"2023-11-24T06:12:01.385301+0000","last_peered":"2023-11-24T06:12:01.385301+0000","last_clean":"2023-11-24T06:12:01.385301+0000","last_became_active":"2023-11-24T06:12:00.412548+0000","last_became_peered":"2023-11-24T06:12:00.412548+0000","last_unstale":"2023-11-24T06:12:01.385301+0000","last_undegraded":"2023-11-24T06:12:01.385301+0000","last_fullsized":"2023-11-24T06:12:01.385301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:04.491629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812440+0000","last_change":"2023-11-24T06:12:00.418298+0000","last_active":"2023-11-24T06:12:01.812440+0000","last_peered":"2023-11-24T06:12:01.812440+0000","last_clean":"2023-11-24T06:12:01.812440+0000","last_became_active":"2023-11-24T06:12:00.417933+0000","last_became_peered":"2023-11-24T06:12:00.417933+0000","last_unstale":"2023-11-24T06:12:01.812440+0000","last_undegraded":"2023-11-24T06:12:01.812440+0000","last_fullsized":"2023-11-24T06:12:01.812440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814235+0000","last_change":"2023-11-24T06:12:00.424325+0000","last_active":"2023-11-24T06:12:01.814235+0000","last_peered":"2023-11-24T06:12:01.814235+0000","last_clean":"2023-11-24T06:12:01.814235+0000","last_became_active":"2023-11-24T06:12:00.419795+0000","last_became_peered":"2023-11-24T06:12:00.419795+0000","last_unstale":"2023-11-24T06:12:01.814235+0000","last_undegraded":"2023-11-24T06:12:01.814235+0000","last_fullsized":"2023-11-24T06:12:01.814235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812634+0000","last_change":"2023-11-24T06:12:00.415065+0000","last_active":"2023-11-24T06:12:01.812634+0000","last_peered":"2023-11-24T06:12:01.812634+0000","last_clean":"2023-11-24T06:12:01.812634+0000","last_became_active":"2023-11-24T06:12:00.414686+0000","last_became_peered":"2023-11-24T06:12:00.414686+0000","last_unstale":"2023-11-24T06:12:01.812634+0000","last_undegraded":"2023-11-24T06:12:01.812634+0000","last_fullsized":"2023-11-24T06:12:01.812634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.404241+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.403972+0000","last_became_peered":"2023-11-24T06:12:00.403972+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792421+0000","last_change":"2023-11-24T06:12:00.422094+0000","last_active":"2023-11-24T06:12:01.792421+0000","last_peered":"2023-11-24T06:12:01.792421+0000","last_clean":"2023-11-24T06:12:01.792421+0000","last_became_active":"2023-11-24T06:12:00.421724+0000","last_became_peered":"2023-11-24T06:12:00.421724+0000","last_unstale":"2023-11-24T06:12:01.792421+0000","last_undegraded":"2023-11-24T06:12:01.792421+0000","last_fullsized":"2023-11-24T06:12:01.792421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811370+0000","last_change":"2023-11-24T06:12:00.411570+0000","last_active":"2023-11-24T06:12:01.811370+0000","last_peered":"2023-11-24T06:12:01.811370+0000","last_clean":"2023-11-24T06:12:01.811370+0000","last_became_active":"2023-11-24T06:12:00.411118+0000","last_became_peered":"2023-11-24T06:12:00.411118+0000","last_unstale":"2023-11-24T06:12:01.811370+0000","last_undegraded":"2023-11-24T06:12:01.811370+0000","last_fullsized":"2023-11-24T06:12:01.811370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:15.863418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814833+0000","last_change":"2023-11-24T06:12:00.417371+0000","last_active":"2023-11-24T06:12:01.814833+0000","last_peered":"2023-11-24T06:12:01.814833+0000","last_clean":"2023-11-24T06:12:01.814833+0000","last_became_active":"2023-11-24T06:12:00.417046+0000","last_became_peered":"2023-11-24T06:12:00.417046+0000","last_unstale":"2023-11-24T06:12:01.814833+0000","last_undegraded":"2023-11-24T06:12:01.814833+0000","last_fullsized":"2023-11-24T06:12:01.814833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383318+0000","last_change":"2023-11-24T06:12:00.410431+0000","last_active":"2023-11-24T06:12:01.383318+0000","last_peered":"2023-11-24T06:12:01.383318+0000","last_clean":"2023-11-24T06:12:01.383318+0000","last_became_active":"2023-11-24T06:12:00.410132+0000","last_became_peered":"2023-11-24T06:12:00.410132+0000","last_unstale":"2023-11-24T06:12:01.383318+0000","last_undegraded":"2023-11-24T06:12:01.383318+0000","last_fullsized":"2023-11-24T06:12:01.383318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812700+0000","last_change":"2023-11-24T06:12:00.417335+0000","last_active":"2023-11-24T06:12:01.812700+0000","last_peered":"2023-11-24T06:12:01.812700+0000","last_clean":"2023-11-24T06:12:01.812700+0000","last_became_active":"2023-11-24T06:12:00.416822+0000","last_became_peered":"2023-11-24T06:12:00.416822+0000","last_unstale":"2023-11-24T06:12:01.812700+0000","last_undegraded":"2023-11-24T06:12:01.812700+0000","last_fullsized":"2023-11-24T06:12:01.812700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384663+0000","last_change":"2023-11-24T06:12:00.419798+0000","last_active":"2023-11-24T06:12:01.384663+0000","last_peered":"2023-11-24T06:12:01.384663+0000","last_clean":"2023-11-24T06:12:01.384663+0000","last_became_active":"2023-11-24T06:12:00.419568+0000","last_became_peered":"2023-11-24T06:12:00.419568+0000","last_unstale":"2023-11-24T06:12:01.384663+0000","last_undegraded":"2023-11-24T06:12:01.384663+0000","last_fullsized":"2023-11-24T06:12:01.384663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.793026+0000","last_change":"2023-11-24T06:12:00.412430+0000","last_active":"2023-11-24T06:12:01.793026+0000","last_peered":"2023-11-24T06:12:01.793026+0000","last_clean":"2023-11-24T06:12:01.793026+0000","last_became_active":"2023-11-24T06:12:00.411971+0000","last_became_peered":"2023-11-24T06:12:00.411971+0000","last_unstale":"2023-11-24T06:12:01.793026+0000","last_undegraded":"2023-11-24T06:12:01.793026+0000","last_fullsized":"2023-11-24T06:12:01.793026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385763+0000","last_change":"2023-11-24T06:12:00.414558+0000","last_active":"2023-11-24T06:12:01.385763+0000","last_peered":"2023-11-24T06:12:01.385763+0000","last_clean":"2023-11-24T06:12:01.385763+0000","last_became_active":"2023-11-24T06:12:00.414279+0000","last_became_peered":"2023-11-24T06:12:00.414279+0000","last_unstale":"2023-11-24T06:12:01.385763+0000","last_undegraded":"2023-11-24T06:12:01.385763+0000","last_fullsized":"2023-11-24T06:12:01.385763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:00.298898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384237+0000","last_change":"2023-11-24T06:12:00.423044+0000","last_active":"2023-11-24T06:12:01.384237+0000","last_peered":"2023-11-24T06:12:01.384237+0000","last_clean":"2023-11-24T06:12:01.384237+0000","last_became_active":"2023-11-24T06:12:00.422684+0000","last_became_peered":"2023-11-24T06:12:00.422684+0000","last_unstale":"2023-11-24T06:12:01.384237+0000","last_undegraded":"2023-11-24T06:12:01.384237+0000","last_fullsized":"2023-11-24T06:12:01.384237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811420+0000","last_change":"2023-11-24T06:12:00.406540+0000","last_active":"2023-11-24T06:12:01.811420+0000","last_peered":"2023-11-24T06:12:01.811420+0000","last_clean":"2023-11-24T06:12:01.811420+0000","last_became_active":"2023-11-24T06:12:00.406115+0000","last_became_peered":"2023-11-24T06:12:00.406115+0000","last_unstale":"2023-11-24T06:12:01.811420+0000","last_undegraded":"2023-11-24T06:12:01.811420+0000","last_fullsized":"2023-11-24T06:12:01.811420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813334+0000","last_change":"2023-11-24T06:12:00.421363+0000","last_active":"2023-11-24T06:12:01.813334+0000","last_peered":"2023-11-24T06:12:01.813334+0000","last_clean":"2023-11-24T06:12:01.813334+0000","last_became_active":"2023-11-24T06:12:00.420976+0000","last_became_peered":"2023-11-24T06:12:00.420976+0000","last_unstale":"2023-11-24T06:12:01.813334+0000","last_undegraded":"2023-11-24T06:12:01.813334+0000","last_fullsized":"2023-11-24T06:12:01.813334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812046+0000","last_change":"2023-11-24T06:12:00.413545+0000","last_active":"2023-11-24T06:12:01.812046+0000","last_peered":"2023-11-24T06:12:01.812046+0000","last_clean":"2023-11-24T06:12:01.812046+0000","last_became_active":"2023-11-24T06:12:00.411644+0000","last_became_peered":"2023-11-24T06:12:00.411644+0000","last_unstale":"2023-11-24T06:12:01.812046+0000","last_undegraded":"2023-11-24T06:12:01.812046+0000","last_fullsized":"2023-11-24T06:12:01.812046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792092+0000","last_change":"2023-11-24T06:12:00.411309+0000","last_active":"2023-11-24T06:12:01.792092+0000","last_peered":"2023-11-24T06:12:01.792092+0000","last_clean":"2023-11-24T06:12:01.792092+0000","last_became_active":"2023-11-24T06:12:00.409967+0000","last_became_peered":"2023-11-24T06:12:00.409967+0000","last_unstale":"2023-11-24T06:12:01.792092+0000","last_undegraded":"2023-11-24T06:12:01.792092+0000","last_fullsized":"2023-11-24T06:12:01.792092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814781+0000","last_change":"2023-11-24T06:12:00.417149+0000","last_active":"2023-11-24T06:12:01.814781+0000","last_peered":"2023-11-24T06:12:01.814781+0000","last_clean":"2023-11-24T06:12:01.814781+0000","last_became_active":"2023-11-24T06:12:00.410529+0000","last_became_peered":"2023-11-24T06:12:00.410529+0000","last_unstale":"2023-11-24T06:12:01.814781+0000","last_undegraded":"2023-11-24T06:12:01.814781+0000","last_fullsized":"2023-11-24T06:12:01.814781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654819+0000","last_change":"2023-11-24T06:11:59.645470+0000","last_active":"2023-11-24T06:12:00.654819+0000","last_peered":"2023-11-24T06:12:00.654819+0000","last_clean":"2023-11-24T06:12:00.654819+0000","last_became_active":"2023-11-24T06:11:59.644424+0000","last_became_peered":"2023-11-24T06:11:59.644424+0000","last_unstale":"2023-11-24T06:12:00.654819+0000","last_undegraded":"2023-11-24T06:12:00.654819+0000","last_fullsized":"2023-11-24T06:12:00.654819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811571+0000","last_change":"2023-11-24T06:12:00.421116+0000","last_active":"2023-11-24T06:12:01.811571+0000","last_peered":"2023-11-24T06:12:01.811571+0000","last_clean":"2023-11-24T06:12:01.811571+0000","last_became_active":"2023-11-24T06:12:00.420793+0000","last_became_peered":"2023-11-24T06:12:00.420793+0000","last_unstale":"2023-11-24T06:12:01.811571+0000","last_undegraded":"2023-11-24T06:12:01.811571+0000","last_fullsized":"2023-11-24T06:12:01.811571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654126+0000","last_change":"2023-11-24T06:11:59.657132+0000","last_active":"2023-11-24T06:12:00.654126+0000","last_peered":"2023-11-24T06:12:00.654126+0000","last_clean":"2023-11-24T06:12:00.654126+0000","last_became_active":"2023-11-24T06:11:59.656475+0000","last_became_peered":"2023-11-24T06:11:59.656475+0000","last_unstale":"2023-11-24T06:12:00.654126+0000","last_undegraded":"2023-11-24T06:12:00.654126+0000","last_fullsized":"2023-11-24T06:12:00.654126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.392519+0000","last_change":"2023-11-24T06:11:59.647264+0000","last_active":"2023-11-24T06:12:00.392519+0000","last_peered":"2023-11-24T06:12:00.392519+0000","last_clean":"2023-11-24T06:12:00.392519+0000","last_became_active":"2023-11-24T06:11:59.646951+0000","last_became_peered":"2023-11-24T06:11:59.646951+0000","last_unstale":"2023-11-24T06:12:00.392519+0000","last_undegraded":"2023-11-24T06:12:00.392519+0000","last_fullsized":"2023-11-24T06:12:00.392519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383246+0000","last_change":"2023-11-24T06:12:00.410276+0000","last_active":"2023-11-24T06:12:01.383246+0000","last_peered":"2023-11-24T06:12:01.383246+0000","last_clean":"2023-11-24T06:12:01.383246+0000","last_became_active":"2023-11-24T06:12:00.407839+0000","last_became_peered":"2023-11-24T06:12:00.407839+0000","last_unstale":"2023-11-24T06:12:01.383246+0000","last_undegraded":"2023-11-24T06:12:01.383246+0000","last_fullsized":"2023-11-24T06:12:01.383246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.405489+0000","last_change":"2023-11-24T06:11:59.656673+0000","last_active":"2023-11-24T06:12:00.405489+0000","last_peered":"2023-11-24T06:12:00.405489+0000","last_clean":"2023-11-24T06:12:00.405489+0000","last_became_active":"2023-11-24T06:11:59.656322+0000","last_became_peered":"2023-11-24T06:11:59.656322+0000","last_unstale":"2023-11-24T06:12:00.405489+0000","last_undegraded":"2023-11-24T06:12:00.405489+0000","last_fullsized":"2023-11-24T06:12:00.405489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:18.929168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385041+0000","last_change":"2023-11-24T06:12:00.411377+0000","last_active":"2023-11-24T06:12:01.385041+0000","last_peered":"2023-11-24T06:12:01.385041+0000","last_clean":"2023-11-24T06:12:01.385041+0000","last_became_active":"2023-11-24T06:12:00.411117+0000","last_became_peered":"2023-11-24T06:12:00.411117+0000","last_unstale":"2023-11-24T06:12:01.385041+0000","last_undegraded":"2023-11-24T06:12:01.385041+0000","last_fullsized":"2023-11-24T06:12:01.385041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:55.958831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.404314+0000","last_change":"2023-11-24T06:11:59.652584+0000","last_active":"2023-11-24T06:12:00.404314+0000","last_peered":"2023-11-24T06:12:00.404314+0000","last_clean":"2023-11-24T06:12:00.404314+0000","last_became_active":"2023-11-24T06:11:59.652269+0000","last_became_peered":"2023-11-24T06:11:59.652269+0000","last_unstale":"2023-11-24T06:12:00.404314+0000","last_undegraded":"2023-11-24T06:12:00.404314+0000","last_fullsized":"2023-11-24T06:12:00.404314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814238+0000","last_change":"2023-11-24T06:12:00.422883+0000","last_active":"2023-11-24T06:12:01.814238+0000","last_peered":"2023-11-24T06:12:01.814238+0000","last_clean":"2023-11-24T06:12:01.814238+0000","last_became_active":"2023-11-24T06:12:00.422163+0000","last_became_peered":"2023-11-24T06:12:00.422163+0000","last_unstale":"2023-11-24T06:12:01.814238+0000","last_undegraded":"2023-11-24T06:12:01.814238+0000","last_fullsized":"2023-11-24T06:12:01.814238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406883+0000","last_change":"2023-11-24T06:11:59.649342+0000","last_active":"2023-11-24T06:12:00.406883+0000","last_peered":"2023-11-24T06:12:00.406883+0000","last_clean":"2023-11-24T06:12:00.406883+0000","last_became_active":"2023-11-24T06:11:59.649022+0000","last_became_peered":"2023-11-24T06:11:59.649022+0000","last_unstale":"2023-11-24T06:12:00.406883+0000","last_undegraded":"2023-11-24T06:12:00.406883+0000","last_fullsized":"2023-11-24T06:12:00.406883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:06.711959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812025+0000","last_change":"2023-11-24T06:12:00.418160+0000","last_active":"2023-11-24T06:12:01.812025+0000","last_peered":"2023-11-24T06:12:01.812025+0000","last_clean":"2023-11-24T06:12:01.812025+0000","last_became_active":"2023-11-24T06:12:00.417836+0000","last_became_peered":"2023-11-24T06:12:00.417836+0000","last_unstale":"2023-11-24T06:12:01.812025+0000","last_undegraded":"2023-11-24T06:12:01.812025+0000","last_fullsized":"2023-11-24T06:12:01.812025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385956+0000","last_change":"2023-11-24T06:11:59.644472+0000","last_active":"2023-11-24T06:12:01.385956+0000","last_peered":"2023-11-24T06:12:01.385956+0000","last_clean":"2023-11-24T06:12:01.385956+0000","last_became_active":"2023-11-24T06:11:59.644152+0000","last_became_peered":"2023-11-24T06:11:59.644152+0000","last_unstale":"2023-11-24T06:12:01.385956+0000","last_undegraded":"2023-11-24T06:12:01.385956+0000","last_fullsized":"2023-11-24T06:12:01.385956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:50.982166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814768+0000","last_change":"2023-11-24T06:12:00.411893+0000","last_active":"2023-11-24T06:12:01.814768+0000","last_peered":"2023-11-24T06:12:01.814768+0000","last_clean":"2023-11-24T06:12:01.814768+0000","last_became_active":"2023-11-24T06:12:00.411029+0000","last_became_peered":"2023-11-24T06:12:00.411029+0000","last_unstale":"2023-11-24T06:12:01.814768+0000","last_undegraded":"2023-11-24T06:12:01.814768+0000","last_fullsized":"2023-11-24T06:12:01.814768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:01.536292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.658392+0000","last_change":"2023-11-24T06:11:59.648134+0000","last_active":"2023-11-24T06:12:00.658392+0000","last_peered":"2023-11-24T06:12:00.658392+0000","last_clean":"2023-11-24T06:12:00.658392+0000","last_became_active":"2023-11-24T06:11:59.647824+0000","last_became_peered":"2023-11-24T06:11:59.647824+0000","last_unstale":"2023-11-24T06:12:00.658392+0000","last_undegraded":"2023-11-24T06:12:00.658392+0000","last_fullsized":"2023-11-24T06:12:00.658392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385778+0000","last_change":"2023-11-24T06:12:00.417420+0000","last_active":"2023-11-24T06:12:01.385778+0000","last_peered":"2023-11-24T06:12:01.385778+0000","last_clean":"2023-11-24T06:12:01.385778+0000","last_became_active":"2023-11-24T06:12:00.416624+0000","last_became_peered":"2023-11-24T06:12:00.416624+0000","last_unstale":"2023-11-24T06:12:01.385778+0000","last_undegraded":"2023-11-24T06:12:01.385778+0000","last_fullsized":"2023-11-24T06:12:01.385778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656684+0000","last_change":"2023-11-24T06:11:59.650532+0000","last_active":"2023-11-24T06:12:00.656684+0000","last_peered":"2023-11-24T06:12:00.656684+0000","last_clean":"2023-11-24T06:12:00.656684+0000","last_became_active":"2023-11-24T06:11:59.650193+0000","last_became_peered":"2023-11-24T06:11:59.650193+0000","last_unstale":"2023-11-24T06:12:00.656684+0000","last_undegraded":"2023-11-24T06:12:00.656684+0000","last_fullsized":"2023-11-24T06:12:00.656684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811425+0000","last_change":"2023-11-24T06:12:00.411372+0000","last_active":"2023-11-24T06:12:01.811425+0000","last_peered":"2023-11-24T06:12:01.811425+0000","last_clean":"2023-11-24T06:12:01.811425+0000","last_became_active":"2023-11-24T06:12:00.410699+0000","last_became_peered":"2023-11-24T06:12:00.410699+0000","last_unstale":"2023-11-24T06:12:01.811425+0000","last_undegraded":"2023-11-24T06:12:01.811425+0000","last_fullsized":"2023-11-24T06:12:01.811425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406094+0000","last_change":"2023-11-24T06:11:59.650677+0000","last_active":"2023-11-24T06:12:00.406094+0000","last_peered":"2023-11-24T06:12:00.406094+0000","last_clean":"2023-11-24T06:12:00.406094+0000","last_became_active":"2023-11-24T06:11:59.650368+0000","last_became_peered":"2023-11-24T06:11:59.650368+0000","last_unstale":"2023-11-24T06:12:00.406094+0000","last_undegraded":"2023-11-24T06:12:00.406094+0000","last_fullsized":"2023-11-24T06:12:00.406094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:29.182982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386237+0000","last_change":"2023-11-24T06:12:00.409066+0000","last_active":"2023-11-24T06:12:01.386237+0000","last_peered":"2023-11-24T06:12:01.386237+0000","last_clean":"2023-11-24T06:12:01.386237+0000","last_became_active":"2023-11-24T06:12:00.408722+0000","last_became_peered":"2023-11-24T06:12:00.408722+0000","last_unstale":"2023-11-24T06:12:01.386237+0000","last_undegraded":"2023-11-24T06:12:01.386237+0000","last_fullsized":"2023-11-24T06:12:01.386237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.399698+0000","last_change":"2023-11-24T06:11:59.653443+0000","last_active":"2023-11-24T06:12:00.399698+0000","last_peered":"2023-11-24T06:12:00.399698+0000","last_clean":"2023-11-24T06:12:00.399698+0000","last_became_active":"2023-11-24T06:11:59.653091+0000","last_became_peered":"2023-11-24T06:11:59.653091+0000","last_unstale":"2023-11-24T06:12:00.399698+0000","last_undegraded":"2023-11-24T06:12:00.399698+0000","last_fullsized":"2023-11-24T06:12:00.399698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792087+0000","last_change":"2023-11-24T06:12:00.415948+0000","last_active":"2023-11-24T06:12:01.792087+0000","last_peered":"2023-11-24T06:12:01.792087+0000","last_clean":"2023-11-24T06:12:01.792087+0000","last_became_active":"2023-11-24T06:12:00.415597+0000","last_became_peered":"2023-11-24T06:12:00.415597+0000","last_unstale":"2023-11-24T06:12:01.792087+0000","last_undegraded":"2023-11-24T06:12:01.792087+0000","last_fullsized":"2023-11-24T06:12:01.792087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648785+0000","last_change":"2023-11-24T06:11:59.620020+0000","last_active":"2023-11-24T06:12:00.648785+0000","last_peered":"2023-11-24T06:12:00.648785+0000","last_clean":"2023-11-24T06:12:00.648785+0000","last_became_active":"2023-11-24T06:11:59.619675+0000","last_became_peered":"2023-11-24T06:11:59.619675+0000","last_unstale":"2023-11-24T06:12:00.648785+0000","last_undegraded":"2023-11-24T06:12:00.648785+0000","last_fullsized":"2023-11-24T06:12:00.648785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385713+0000","last_change":"2023-11-24T06:12:00.412328+0000","last_active":"2023-11-24T06:12:01.385713+0000","last_peered":"2023-11-24T06:12:01.385713+0000","last_clean":"2023-11-24T06:12:01.385713+0000","last_became_active":"2023-11-24T06:12:00.412057+0000","last_became_peered":"2023-11-24T06:12:00.412057+0000","last_unstale":"2023-11-24T06:12:01.385713+0000","last_undegraded":"2023-11-24T06:12:01.385713+0000","last_fullsized":"2023-11-24T06:12:01.385713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.650279+0000","last_change":"2023-11-24T06:11:59.650120+0000","last_active":"2023-11-24T06:12:00.650279+0000","last_peered":"2023-11-24T06:12:00.650279+0000","last_clean":"2023-11-24T06:12:00.650279+0000","last_became_active":"2023-11-24T06:11:59.647975+0000","last_became_peered":"2023-11-24T06:11:59.647975+0000","last_unstale":"2023-11-24T06:12:00.650279+0000","last_undegraded":"2023-11-24T06:12:00.650279+0000","last_fullsized":"2023-11-24T06:12:00.650279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.407351+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.406978+0000","last_became_peered":"2023-11-24T06:12:00.406978+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648323+0000","last_change":"2023-11-24T06:11:59.628459+0000","last_active":"2023-11-24T06:12:00.648323+0000","last_peered":"2023-11-24T06:12:00.648323+0000","last_clean":"2023-11-24T06:12:00.648323+0000","last_became_active":"2023-11-24T06:11:59.628147+0000","last_became_peered":"2023-11-24T06:11:59.628147+0000","last_unstale":"2023-11-24T06:12:00.648323+0000","last_undegraded":"2023-11-24T06:12:00.648323+0000","last_fullsized":"2023-11-24T06:12:00.648323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387133+0000","last_change":"2023-11-24T06:12:00.424920+0000","last_active":"2023-11-24T06:12:01.387133+0000","last_peered":"2023-11-24T06:12:01.387133+0000","last_clean":"2023-11-24T06:12:01.387133+0000","last_became_active":"2023-11-24T06:12:00.423927+0000","last_became_peered":"2023-11-24T06:12:00.423927+0000","last_unstale":"2023-11-24T06:12:01.387133+0000","last_undegraded":"2023-11-24T06:12:01.387133+0000","last_fullsized":"2023-11-24T06:12:01.387133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:54:14.921315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:11:59.643977+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:11:59.643552+0000","last_became_peered":"2023-11-24T06:11:59.643552+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:02.323910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813574+0000","last_change":"2023-11-24T06:12:00.417408+0000","last_active":"2023-11-24T06:12:01.813574+0000","last_peered":"2023-11-24T06:12:01.813574+0000","last_clean":"2023-11-24T06:12:01.813574+0000","last_became_active":"2023-11-24T06:12:00.417026+0000","last_became_peered":"2023-11-24T06:12:00.417026+0000","last_unstale":"2023-11-24T06:12:01.813574+0000","last_undegraded":"2023-11-24T06:12:01.813574+0000","last_fullsized":"2023-11-24T06:12:01.813574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379381+0000","last_change":"2023-11-24T06:11:59.643121+0000","last_active":"2023-11-24T06:12:00.379381+0000","last_peered":"2023-11-24T06:12:00.379381+0000","last_clean":"2023-11-24T06:12:00.379381+0000","last_became_active":"2023-11-24T06:11:59.642797+0000","last_became_peered":"2023-11-24T06:11:59.642797+0000","last_unstale":"2023-11-24T06:12:00.379381+0000","last_undegraded":"2023-11-24T06:12:00.379381+0000","last_fullsized":"2023-11-24T06:12:00.379381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386156+0000","last_change":"2023-11-24T06:12:00.417716+0000","last_active":"2023-11-24T06:12:01.386156+0000","last_peered":"2023-11-24T06:12:01.386156+0000","last_clean":"2023-11-24T06:12:01.386156+0000","last_became_active":"2023-11-24T06:12:00.417088+0000","last_became_peered":"2023-11-24T06:12:00.417088+0000","last_unstale":"2023-11-24T06:12:01.386156+0000","last_undegraded":"2023-11-24T06:12:01.386156+0000","last_fullsized":"2023-11-24T06:12:01.386156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383162+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:12:00.383162+0000","last_peered":"2023-11-24T06:12:00.383162+0000","last_clean":"2023-11-24T06:12:00.383162+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:12:00.383162+0000","last_undegraded":"2023-11-24T06:12:00.383162+0000","last_fullsized":"2023-11-24T06:12:00.383162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.403650+0000","last_change":"2023-11-24T06:11:59.649393+0000","last_active":"2023-11-24T06:12:00.403650+0000","last_peered":"2023-11-24T06:12:00.403650+0000","last_clean":"2023-11-24T06:12:00.403650+0000","last_became_active":"2023-11-24T06:11:59.649045+0000","last_became_peered":"2023-11-24T06:11:59.649045+0000","last_unstale":"2023-11-24T06:12:00.403650+0000","last_undegraded":"2023-11-24T06:12:00.403650+0000","last_fullsized":"2023-11-24T06:12:00.403650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383623+0000","last_change":"2023-11-24T06:12:00.417107+0000","last_active":"2023-11-24T06:12:01.383623+0000","last_peered":"2023-11-24T06:12:01.383623+0000","last_clean":"2023-11-24T06:12:01.383623+0000","last_became_active":"2023-11-24T06:12:00.416181+0000","last_became_peered":"2023-11-24T06:12:00.416181+0000","last_unstale":"2023-11-24T06:12:01.383623+0000","last_undegraded":"2023-11-24T06:12:01.383623+0000","last_fullsized":"2023-11-24T06:12:01.383623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383049+0000","last_change":"2023-11-24T06:11:59.641692+0000","last_active":"2023-11-24T06:12:00.383049+0000","last_peered":"2023-11-24T06:12:00.383049+0000","last_clean":"2023-11-24T06:12:00.383049+0000","last_became_active":"2023-11-24T06:11:59.641199+0000","last_became_peered":"2023-11-24T06:11:59.641199+0000","last_unstale":"2023-11-24T06:12:00.383049+0000","last_undegraded":"2023-11-24T06:12:00.383049+0000","last_fullsized":"2023-11-24T06:12:00.383049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811125+0000","last_change":"2023-11-24T06:12:00.421725+0000","last_active":"2023-11-24T06:12:01.811125+0000","last_peered":"2023-11-24T06:12:01.811125+0000","last_clean":"2023-11-24T06:12:01.811125+0000","last_became_active":"2023-11-24T06:12:00.421402+0000","last_became_peered":"2023-11-24T06:12:00.421402+0000","last_unstale":"2023-11-24T06:12:01.811125+0000","last_undegraded":"2023-11-24T06:12:01.811125+0000","last_fullsized":"2023-11-24T06:12:01.811125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:16.430001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379330+0000","last_change":"2023-11-24T06:11:59.628457+0000","last_active":"2023-11-24T06:12:00.379330+0000","last_peered":"2023-11-24T06:12:00.379330+0000","last_clean":"2023-11-24T06:12:00.379330+0000","last_became_active":"2023-11-24T06:11:59.628109+0000","last_became_peered":"2023-11-24T06:11:59.628109+0000","last_unstale":"2023-11-24T06:12:00.379330+0000","last_undegraded":"2023-11-24T06:12:00.379330+0000","last_fullsized":"2023-11-24T06:12:00.379330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385318+0000","last_change":"2023-11-24T06:12:00.406591+0000","last_active":"2023-11-24T06:12:01.385318+0000","last_peered":"2023-11-24T06:12:01.385318+0000","last_clean":"2023-11-24T06:12:01.385318+0000","last_became_active":"2023-11-24T06:12:00.406217+0000","last_became_peered":"2023-11-24T06:12:00.406217+0000","last_unstale":"2023-11-24T06:12:01.385318+0000","last_undegraded":"2023-11-24T06:12:01.385318+0000","last_fullsized":"2023-11-24T06:12:01.385318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:49.548969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406285+0000","last_change":"2023-11-24T06:11:59.645058+0000","last_active":"2023-11-24T06:12:00.406285+0000","last_peered":"2023-11-24T06:12:00.406285+0000","last_clean":"2023-11-24T06:12:00.406285+0000","last_became_active":"2023-11-24T06:11:59.642696+0000","last_became_peered":"2023-11-24T06:11:59.642696+0000","last_unstale":"2023-11-24T06:12:00.406285+0000","last_undegraded":"2023-11-24T06:12:00.406285+0000","last_fullsized":"2023-11-24T06:12:00.406285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:17.577492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.815366+0000","last_change":"2023-11-24T06:12:00.415699+0000","last_active":"2023-11-24T06:12:01.815366+0000","last_peered":"2023-11-24T06:12:01.815366+0000","last_clean":"2023-11-24T06:12:01.815366+0000","last_became_active":"2023-11-24T06:12:00.412274+0000","last_became_peered":"2023-11-24T06:12:00.412274+0000","last_unstale":"2023-11-24T06:12:01.815366+0000","last_undegraded":"2023-11-24T06:12:01.815366+0000","last_fullsized":"2023-11-24T06:12:01.815366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385632+0000","last_change":"2023-11-24T06:11:59.633842+0000","last_active":"2023-11-24T06:12:01.385632+0000","last_peered":"2023-11-24T06:12:01.385632+0000","last_clean":"2023-11-24T06:12:01.385632+0000","last_became_active":"2023-11-24T06:11:59.632890+0000","last_became_peered":"2023-11-24T06:11:59.632890+0000","last_unstale":"2023-11-24T06:12:01.385632+0000","last_undegraded":"2023-11-24T06:12:01.385632+0000","last_fullsized":"2023-11-24T06:12:01.385632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:00.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813832+0000","last_change":"2023-11-24T06:12:00.424534+0000","last_active":"2023-11-24T06:12:01.813832+0000","last_peered":"2023-11-24T06:12:01.813832+0000","last_clean":"2023-11-24T06:12:01.813832+0000","last_became_active":"2023-11-24T06:12:00.419919+0000","last_became_peered":"2023-11-24T06:12:00.419919+0000","last_unstale":"2023-11-24T06:12:01.813832+0000","last_undegraded":"2023-11-24T06:12:01.813832+0000","last_fullsized":"2023-11-24T06:12:01.813832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.389114+0000","last_change":"2023-11-24T06:11:59.644082+0000","last_active":"2023-11-24T06:12:00.389114+0000","last_peered":"2023-11-24T06:12:00.389114+0000","last_clean":"2023-11-24T06:12:00.389114+0000","last_became_active":"2023-11-24T06:11:59.640160+0000","last_became_peered":"2023-11-24T06:11:59.640160+0000","last_unstale":"2023-11-24T06:12:00.389114+0000","last_undegraded":"2023-11-24T06:12:00.389114+0000","last_fullsized":"2023-11-24T06:12:00.389114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385733+0000","last_change":"2023-11-24T06:12:00.406268+0000","last_active":"2023-11-24T06:12:01.385733+0000","last_peered":"2023-11-24T06:12:01.385733+0000","last_clean":"2023-11-24T06:12:01.385733+0000","last_became_active":"2023-11-24T06:12:00.405965+0000","last_became_peered":"2023-11-24T06:12:00.405965+0000","last_unstale":"2023-11-24T06:12:01.385733+0000","last_undegraded":"2023-11-24T06:12:01.385733+0000","last_fullsized":"2023-11-24T06:12:01.385733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:42.193371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:02.714599+0000","last_change":"2023-11-24T06:11:59.645602+0000","last_active":"2023-11-24T06:12:02.714599+0000","last_peered":"2023-11-24T06:12:02.714599+0000","last_clean":"2023-11-24T06:12:02.714599+0000","last_became_active":"2023-11-24T06:11:59.645312+0000","last_became_peered":"2023-11-24T06:11:59.645312+0000","last_unstale":"2023-11-24T06:12:02.714599+0000","last_undegraded":"2023-11-24T06:12:02.714599+0000","last_fullsized":"2023-11-24T06:12:02.714599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:43.860695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384670+0000","last_change":"2023-11-24T06:12:00.417986+0000","last_active":"2023-11-24T06:12:01.384670+0000","last_peered":"2023-11-24T06:12:01.384670+0000","last_clean":"2023-11-24T06:12:01.384670+0000","last_became_active":"2023-11-24T06:12:00.417578+0000","last_became_peered":"2023-11-24T06:12:00.417578+0000","last_unstale":"2023-11-24T06:12:01.384670+0000","last_undegraded":"2023-11-24T06:12:01.384670+0000","last_fullsized":"2023-11-24T06:12:01.384670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656198+0000","last_change":"2023-11-24T06:11:59.648128+0000","last_active":"2023-11-24T06:12:00.656198+0000","last_peered":"2023-11-24T06:12:00.656198+0000","last_clean":"2023-11-24T06:12:00.656198+0000","last_became_active":"2023-11-24T06:11:59.647817+0000","last_became_peered":"2023-11-24T06:11:59.647817+0000","last_unstale":"2023-11-24T06:12:00.656198+0000","last_undegraded":"2023-11-24T06:12:00.656198+0000","last_fullsized":"2023-11-24T06:12:00.656198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812611+0000","last_change":"2023-11-24T06:12:00.407315+0000","last_active":"2023-11-24T06:12:01.812611+0000","last_peered":"2023-11-24T06:12:01.812611+0000","last_clean":"2023-11-24T06:12:01.812611+0000","last_became_active":"2023-11-24T06:12:00.406966+0000","last_became_peered":"2023-11-24T06:12:00.406966+0000","last_unstale":"2023-11-24T06:12:01.812611+0000","last_undegraded":"2023-11-24T06:12:01.812611+0000","last_fullsized":"2023-11-24T06:12:01.812611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.382934+0000","last_change":"2023-11-24T06:11:59.641473+0000","last_active":"2023-11-24T06:12:00.382934+0000","last_peered":"2023-11-24T06:12:00.382934+0000","last_clean":"2023-11-24T06:12:00.382934+0000","last_became_active":"2023-11-24T06:11:59.640882+0000","last_became_peered":"2023-11-24T06:11:59.640882+0000","last_unstale":"2023-11-24T06:12:00.382934+0000","last_undegraded":"2023-11-24T06:12:00.382934+0000","last_fullsized":"2023-11-24T06:12:00.382934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:15.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814297+0000","last_change":"2023-11-24T06:12:00.420629+0000","last_active":"2023-11-24T06:12:01.814297+0000","last_peered":"2023-11-24T06:12:01.814297+0000","last_clean":"2023-11-24T06:12:01.814297+0000","last_became_active":"2023-11-24T06:12:00.420121+0000","last_became_peered":"2023-11-24T06:12:00.420121+0000","last_unstale":"2023-11-24T06:12:01.814297+0000","last_undegraded":"2023-11-24T06:12:01.814297+0000","last_fullsized":"2023-11-24T06:12:01.814297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:16.361272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385138+0000","last_change":"2023-11-24T06:11:59.642028+0000","last_active":"2023-11-24T06:12:01.385138+0000","last_peered":"2023-11-24T06:12:01.385138+0000","last_clean":"2023-11-24T06:12:01.385138+0000","last_became_active":"2023-11-24T06:11:59.641734+0000","last_became_peered":"2023-11-24T06:11:59.641734+0000","last_unstale":"2023-11-24T06:12:01.385138+0000","last_undegraded":"2023-11-24T06:12:01.385138+0000","last_fullsized":"2023-11-24T06:12:01.385138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:44.578653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384138+0000","last_change":"2023-11-24T06:12:00.410266+0000","last_active":"2023-11-24T06:12:01.384138+0000","last_peered":"2023-11-24T06:12:01.384138+0000","last_clean":"2023-11-24T06:12:01.384138+0000","last_became_active":"2023-11-24T06:12:00.409968+0000","last_became_peered":"2023-11-24T06:12:00.409968+0000","last_unstale":"2023-11-24T06:12:01.384138+0000","last_undegraded":"2023-11-24T06:12:01.384138+0000","last_fullsized":"2023-11-24T06:12:01.384138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385736+0000","last_change":"2023-11-24T06:11:59.630765+0000","last_active":"2023-11-24T06:12:01.385736+0000","last_peered":"2023-11-24T06:12:01.385736+0000","last_clean":"2023-11-24T06:12:01.385736+0000","last_became_active":"2023-11-24T06:11:59.629875+0000","last_became_peered":"2023-11-24T06:11:59.629875+0000","last_unstale":"2023-11-24T06:12:01.385736+0000","last_undegraded":"2023-11-24T06:12:01.385736+0000","last_fullsized":"2023-11-24T06:12:01.385736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:19.421623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384213+0000","last_change":"2023-11-24T06:12:00.408041+0000","last_active":"2023-11-24T06:12:01.384213+0000","last_peered":"2023-11-24T06:12:01.384213+0000","last_clean":"2023-11-24T06:12:01.384213+0000","last_became_active":"2023-11-24T06:12:00.407616+0000","last_became_peered":"2023-11-24T06:12:00.407616+0000","last_unstale":"2023-11-24T06:12:01.384213+0000","last_undegraded":"2023-11-24T06:12:01.384213+0000","last_fullsized":"2023-11-24T06:12:01.384213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656982+0000","last_change":"2023-11-24T06:11:59.652850+0000","last_active":"2023-11-24T06:12:00.656982+0000","last_peered":"2023-11-24T06:12:00.656982+0000","last_clean":"2023-11-24T06:12:00.656982+0000","last_became_active":"2023-11-24T06:11:59.652583+0000","last_became_peered":"2023-11-24T06:11:59.652583+0000","last_unstale":"2023-11-24T06:12:00.656982+0000","last_undegraded":"2023-11-24T06:12:00.656982+0000","last_fullsized":"2023-11-24T06:12:00.656982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792109+0000","last_change":"2023-11-24T06:12:00.408854+0000","last_active":"2023-11-24T06:12:01.792109+0000","last_peered":"2023-11-24T06:12:01.792109+0000","last_clean":"2023-11-24T06:12:01.792109+0000","last_became_active":"2023-11-24T06:12:00.408541+0000","last_became_peered":"2023-11-24T06:12:00.408541+0000","last_unstale":"2023-11-24T06:12:01.792109+0000","last_undegraded":"2023-11-24T06:12:01.792109+0000","last_fullsized":"2023-11-24T06:12:01.792109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813395+0000","last_change":"2023-11-24T06:12:00.425989+0000","last_active":"2023-11-24T06:12:01.813395+0000","last_peered":"2023-11-24T06:12:01.813395+0000","last_clean":"2023-11-24T06:12:01.813395+0000","last_became_active":"2023-11-24T06:12:00.425649+0000","last_became_peered":"2023-11-24T06:12:00.425649+0000","last_unstale":"2023-11-24T06:12:01.813395+0000","last_undegraded":"2023-11-24T06:12:01.813395+0000","last_fullsized":"2023-11-24T06:12:01.813395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.655824+0000","last_change":"2023-11-24T06:11:59.649445+0000","last_active":"2023-11-24T06:12:00.655824+0000","last_peered":"2023-11-24T06:12:00.655824+0000","last_clean":"2023-11-24T06:12:00.655824+0000","last_became_active":"2023-11-24T06:11:59.649024+0000","last_became_peered":"2023-11-24T06:11:59.649024+0000","last_unstale":"2023-11-24T06:12:00.655824+0000","last_undegraded":"2023-11-24T06:12:00.655824+0000","last_fullsized":"2023-11-24T06:12:00.655824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813376+0000","last_change":"2023-11-24T06:12:00.425911+0000","last_active":"2023-11-24T06:12:01.813376+0000","last_peered":"2023-11-24T06:12:01.813376+0000","last_clean":"2023-11-24T06:12:01.813376+0000","last_became_active":"2023-11-24T06:12:00.425590+0000","last_became_peered":"2023-11-24T06:12:00.425590+0000","last_unstale":"2023-11-24T06:12:01.813376+0000","last_undegraded":"2023-11-24T06:12:01.813376+0000","last_fullsized":"2023-11-24T06:12:01.813376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656014+0000","last_change":"2023-11-24T06:11:59.648255+0000","last_active":"2023-11-24T06:12:00.656014+0000","last_peered":"2023-11-24T06:12:00.656014+0000","last_clean":"2023-11-24T06:12:00.656014+0000","last_became_active":"2023-11-24T06:11:59.647961+0000","last_became_peered":"2023-11-24T06:11:59.647961+0000","last_unstale":"2023-11-24T06:12:00.656014+0000","last_undegraded":"2023-11-24T06:12:00.656014+0000","last_fullsized":"2023-11-24T06:12:00.656014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811821+0000","last_change":"2023-11-24T06:12:00.415607+0000","last_active":"2023-11-24T06:12:01.811821+0000","last_peered":"2023-11-24T06:12:01.811821+0000","last_clean":"2023-11-24T06:12:01.811821+0000","last_became_active":"2023-11-24T06:12:00.415309+0000","last_became_peered":"2023-11-24T06:12:00.415309+0000","last_unstale":"2023-11-24T06:12:01.811821+0000","last_undegraded":"2023-11-24T06:12:01.811821+0000","last_fullsized":"2023-11-24T06:12:01.811821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.646459+0000","last_change":"2023-11-24T06:11:59.634657+0000","last_active":"2023-11-24T06:12:00.646459+0000","last_peered":"2023-11-24T06:12:00.646459+0000","last_clean":"2023-11-24T06:12:00.646459+0000","last_became_active":"2023-11-24T06:11:59.634335+0000","last_became_peered":"2023-11-24T06:11:59.634335+0000","last_unstale":"2023-11-24T06:12:00.646459+0000","last_undegraded":"2023-11-24T06:12:00.646459+0000","last_fullsized":"2023-11-24T06:12:00.646459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384001+0000","last_change":"2023-11-24T06:12:00.415376+0000","last_active":"2023-11-24T06:12:01.384001+0000","last_peered":"2023-11-24T06:12:01.384001+0000","last_clean":"2023-11-24T06:12:01.384001+0000","last_became_active":"2023-11-24T06:12:00.415114+0000","last_became_peered":"2023-11-24T06:12:00.415114+0000","last_unstale":"2023-11-24T06:12:01.384001+0000","last_undegraded":"2023-11-24T06:12:01.384001+0000","last_fullsized":"2023-11-24T06:12:01.384001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654742+0000","last_change":"2023-11-24T06:11:59.645253+0000","last_active":"2023-11-24T06:12:00.654742+0000","last_peered":"2023-11-24T06:12:00.654742+0000","last_clean":"2023-11-24T06:12:00.654742+0000","last_became_active":"2023-11-24T06:11:59.644979+0000","last_became_peered":"2023-11-24T06:11:59.644979+0000","last_unstale":"2023-11-24T06:12:00.654742+0000","last_undegraded":"2023-11-24T06:12:00.654742+0000","last_fullsized":"2023-11-24T06:12:00.654742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:36:07.535502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6459999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7949999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1619999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":666978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.784}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:12:10.737 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:12:10.737 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-24T06:12:10.738 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-24T06:12:10.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-24T06:12:10.738 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-24T06:12:11.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.998+0000 7fbf8622e640 1 Processor -- start 2023-11-24T06:12:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.998+0000 7fbf8622e640 1 -- start start 2023-11-24T06:12:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:10.999+0000 7fbf8622e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf800cf050 0x7fbf800cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.000+0000 7fbf8622e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf80140900 con 0x7fbf800cd7b0 2023-11-24T06:12:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.000+0000 7fbf8622e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8015fa70 con 0x7fbf8013dfd0 2023-11-24T06:12:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.000+0000 7fbf8622e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf800cfa40 con 0x7fbf800cf050 2023-11-24T06:12:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.000+0000 7fbf85a2d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbf800cd7b0 0x7fbf800cdbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53282/0 (socket says 172.21.15.22:53282) 2023-11-24T06:12:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.000+0000 7fbf85a2d640 1 -- 172.21.15.22:0/428607854 learned_addr learned my addr 172.21.15.22:0/428607854 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.000+0000 7fbf84a2b640 1 --2- 172.21.15.22:0/428607854 >> v2:172.21.15.31:3300/0 conn(0x7fbf800cf050 0x7fbf800cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.000+0000 7fbf77fff640 1 -- 172.21.15.22:0/428607854 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144018424 0 0) 0x7fbf80140900 con 0x7fbf800cd7b0 2023-11-24T06:12:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.001+0000 7fbf77fff640 1 -- 172.21.15.22:0/428607854 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf6c003520 con 0x7fbf800cd7b0 2023-11-24T06:12:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.001+0000 7fbf84a2b640 1 -- 172.21.15.22:0/428607854 >> v1:172.21.15.31:6789/0 conn(0x7fbf8013dfd0 legacy=0x7fbf8015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.001+0000 7fbf84a2b640 1 -- 172.21.15.22:0/428607854 >> v1:172.21.15.22:6789/0 conn(0x7fbf800cd7b0 legacy=0x7fbf800cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.001+0000 7fbf84a2b640 1 -- 172.21.15.22:0/428607854 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8015ee60 con 0x7fbf800cf050 2023-11-24T06:12:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.002+0000 7fbf84a2b640 1 --2- 172.21.15.22:0/428607854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf800cf050 0x7fbf800cf500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009d90 tx=0x7fbf7002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3575c98b3a2f5ef6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf77fff640 1 -- 172.21.15.22:0/428607854 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7002ccf0 con 0x7fbf800cf050 2023-11-24T06:12:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf77fff640 1 -- 172.21.15.22:0/428607854 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7002ce50 con 0x7fbf800cf050 2023-11-24T06:12:11.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf77fff640 1 -- 172.21.15.22:0/428607854 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70034640 con 0x7fbf800cf050 2023-11-24T06:12:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf8622e640 1 -- 172.21.15.22:0/428607854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf800cf050 msgr2=0x7fbf800cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf8622e640 1 --2- 172.21.15.22:0/428607854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf800cf050 0x7fbf800cf500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009d90 tx=0x7fbf7002bf40 comp rx=0 tx=0).stop 2023-11-24T06:12:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf8622e640 1 -- 172.21.15.22:0/428607854 shutdown_connections 2023-11-24T06:12:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf8622e640 1 --2- 172.21.15.22:0/428607854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf800cf050 0x7fbf800cf500 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf8622e640 1 -- 172.21.15.22:0/428607854 >> 172.21.15.22:0/428607854 conn(0x7fbf8006a860 msgr2=0x7fbf8006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf8622e640 1 -- 172.21.15.22:0/428607854 shutdown_connections 2023-11-24T06:12:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.003+0000 7fbf8622e640 1 -- 172.21.15.22:0/428607854 wait complete. 2023-11-24T06:12:11.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.005+0000 7fbf8622e640 1 Processor -- start 2023-11-24T06:12:11.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.005+0000 7fbf8622e640 1 -- start start 2023-11-24T06:12:11.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.006+0000 7fbf8622e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf800cd7b0 0x7fbf8013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.006+0000 7fbf8622e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf050 0x7fbf8014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.006+0000 7fbf8622e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf8013dfd0 0x7fbf8014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.006+0000 7fbf8622e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8014ef40 con 0x7fbf800cf050 2023-11-24T06:12:11.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.006+0000 7fbf8622e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8014f220 con 0x7fbf8013dfd0 2023-11-24T06:12:11.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.006+0000 7fbf8622e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8014f500 con 0x7fbf800cd7b0 2023-11-24T06:12:11.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf84a2b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf050 0x7fbf8014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf8522c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf800cd7b0 0x7fbf8013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf85a2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf8013dfd0 0x7fbf8014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf84a2b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf050 0x7fbf8014e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37584/0 (socket says 172.21.15.22:37584) 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf84a2b640 1 -- 172.21.15.22:0/3997296950 learned_addr learned my addr 172.21.15.22:0/3997296950 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf84a2b640 1 -- 172.21.15.22:0/3997296950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf800cd7b0 msgr2=0x7fbf8013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf84a2b640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf800cd7b0 0x7fbf8013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf84a2b640 1 -- 172.21.15.22:0/3997296950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf8013dfd0 msgr2=0x7fbf8014e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf84a2b640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf8013dfd0 0x7fbf8014e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.007+0000 7fbf84a2b640 1 -- 172.21.15.22:0/3997296950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70009a70 con 0x7fbf800cf050 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.008+0000 7fbf84a2b640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf050 0x7fbf8014e180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbf7002dfd0 tx=0x7fbf70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.008+0000 7fbf75ffb640 1 -- 172.21.15.22:0/3997296950 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70004390 con 0x7fbf800cf050 2023-11-24T06:12:11.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.008+0000 7fbf75ffb640 1 -- 172.21.15.22:0/3997296950 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf700044f0 con 0x7fbf800cf050 2023-11-24T06:12:11.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.008+0000 7fbf75ffb640 1 -- 172.21.15.22:0/3997296950 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70004880 con 0x7fbf800cf050 2023-11-24T06:12:11.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.008+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8014f7e0 con 0x7fbf800cf050 2023-11-24T06:12:11.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.008+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8014ec00 con 0x7fbf800cf050 2023-11-24T06:12:11.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.009+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8014fd00 con 0x7fbf800cf050 2023-11-24T06:12:11.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.011+0000 7fbf75ffb640 1 -- 172.21.15.22:0/3997296950 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf7003b070 con 0x7fbf800cf050 2023-11-24T06:12:11.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.012+0000 7fbf75ffb640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf6406ae40 0x7fbf6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.012+0000 7fbf75ffb640 1 -- 172.21.15.22:0/3997296950 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf700abf30 con 0x7fbf800cf050 2023-11-24T06:12:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.012+0000 7fbf8522c640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf6406ae40 0x7fbf6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.013+0000 7fbf8522c640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf6406ae40 0x7fbf6406d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c000f60 tx=0x7fbf7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:11.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.017+0000 7fbf75ffb640 1 -- 172.21.15.22:0/3997296950 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf8014fd00 con 0x7fbf800cf050 2023-11-24T06:12:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.262+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbf8014fd00 con 0x7fbf800cf050 2023-11-24T06:12:11.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.271+0000 7fbf75ffb640 1 -- 172.21.15.22:0/3997296950 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171027 (secure 0 0 0) 0x7fbf8014fd00 con 0x7fbf800cf050 2023-11-24T06:12:11.276 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.275+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf6406ae40 msgr2=0x7fbf6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.275+0000 7fbf8622e640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf6406ae40 0x7fbf6406d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c000f60 tx=0x7fbf7c009040 comp rx=0 tx=0).stop 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.275+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf050 msgr2=0x7fbf8014e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.275+0000 7fbf8622e640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf050 0x7fbf8014e180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbf7002dfd0 tx=0x7fbf70004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.275+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 shutdown_connections 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.276+0000 7fbf8622e640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf6406ae40 0x7fbf6406d300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.276+0000 7fbf8622e640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf8013dfd0 0x7fbf8014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.276+0000 7fbf8622e640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf050 0x7fbf8014e180 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.276+0000 7fbf8622e640 1 --2- 172.21.15.22:0/3997296950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf800cd7b0 0x7fbf8013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.276+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 >> 172.21.15.22:0/3997296950 conn(0x7fbf8006a860 msgr2=0x7fbf800cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.276+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 shutdown_connections 2023-11-24T06:12:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.276+0000 7fbf8622e640 1 -- 172.21.15.22:0/3997296950 wait complete. 2023-11-24T06:12:11.298 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":913263114},{"type":"v1","addr":"172.21.15.22:6833","nonce":913263114}]},"active_addr":"172.21.15.22:6833/913263114","active_change":"2023-11-24T06:11:40.623456+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":943474118}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1070367271}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":355559089}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":4235970855}]}]} 2023-11-24T06:12:11.302 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-24T06:12:11.302 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-24T06:12:11.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.523+0000 7f2891883640 1 Processor -- start 2023-11-24T06:12:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.523+0000 7f2891883640 1 -- start start 2023-11-24T06:12:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.525+0000 7f2891883640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c157770 0x7f288c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.525+0000 7f2891883640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f288c06d080 0x7f288c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.525+0000 7f2891883640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f288c15ddb0 0x7f288c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.525+0000 7f2891883640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c06d500 con 0x7f288c15ddb0 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.525+0000 7f2891883640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c161670 con 0x7f288c06d080 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.525+0000 7f2891883640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c15e610 con 0x7f288c157770 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.525+0000 7f2891082640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f288c15ddb0 0x7f288c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.526+0000 7f2891082640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f288c15ddb0 0x7f288c0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37586/0 (socket says 172.21.15.22:37586) 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.526+0000 7f2891082640 1 -- 172.21.15.22:0/2227963559 learned_addr learned my addr 172.21.15.22:0/2227963559 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.526+0000 7f2883fff640 1 --2- 172.21.15.22:0/2227963559 >> v2:172.21.15.31:3300/0 conn(0x7f288c06d080 0x7f288c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.526+0000 7f2890881640 1 --2- 172.21.15.22:0/2227963559 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c157770 0x7f288c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.526+0000 7f2891082640 1 -- 172.21.15.22:0/2227963559 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c157770 msgr2=0x7f288c06cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.526+0000 7f2891082640 1 --2- 172.21.15.22:0/2227963559 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c157770 0x7f288c06cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.526+0000 7f2891082640 1 -- 172.21.15.22:0/2227963559 >> v2:172.21.15.31:3300/0 conn(0x7f288c06d080 msgr2=0x7f288c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.526+0000 7f2891082640 1 --2- 172.21.15.22:0/2227963559 >> v2:172.21.15.31:3300/0 conn(0x7f288c06d080 0x7f288c15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.526+0000 7f2891082640 1 -- 172.21.15.22:0/2227963559 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c160d40 con 0x7f288c15ddb0 2023-11-24T06:12:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.527+0000 7f2891082640 1 --2- 172.21.15.22:0/2227963559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c15ddb0 0x7f288c0ac870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f288c0ae680 tx=0x7f288402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb38984a1469694 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.527+0000 7f28837fe640 1 -- 172.21.15.22:0/2227963559 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288402ca70 con 0x7f288c15ddb0 2023-11-24T06:12:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f28837fe640 1 -- 172.21.15.22:0/2227963559 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288402cbd0 con 0x7f288c15ddb0 2023-11-24T06:12:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f28837fe640 1 -- 172.21.15.22:0/2227963559 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840343f0 con 0x7f288c15ddb0 2023-11-24T06:12:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f2891883640 1 -- 172.21.15.22:0/2227963559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c15ddb0 msgr2=0x7f288c0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f2891883640 1 --2- 172.21.15.22:0/2227963559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c15ddb0 0x7f288c0ac870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f288c0ae680 tx=0x7f288402bed0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f2891883640 1 -- 172.21.15.22:0/2227963559 shutdown_connections 2023-11-24T06:12:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f2891883640 1 --2- 172.21.15.22:0/2227963559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c15ddb0 0x7f288c0ac870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f2891883640 1 --2- 172.21.15.22:0/2227963559 >> v2:172.21.15.31:3300/0 conn(0x7f288c06d080 0x7f288c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f2891883640 1 --2- 172.21.15.22:0/2227963559 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c157770 0x7f288c06cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f2891883640 1 -- 172.21.15.22:0/2227963559 >> 172.21.15.22:0/2227963559 conn(0x7f288c06a860 msgr2=0x7f288c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f2891883640 1 -- 172.21.15.22:0/2227963559 shutdown_connections 2023-11-24T06:12:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.528+0000 7f2891883640 1 -- 172.21.15.22:0/2227963559 wait complete. 2023-11-24T06:12:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.530+0000 7f2891883640 1 Processor -- start 2023-11-24T06:12:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.530+0000 7f2891883640 1 -- start start 2023-11-24T06:12:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.531+0000 7f2891883640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c06d080 0x7f288c14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.531+0000 7f2891883640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f288c157770 0x7f288c0cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.531+0000 7f2891883640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c15ddb0 0x7f288c0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.531+0000 7f2891883640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c14bcd0 con 0x7f288c06d080 2023-11-24T06:12:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.531+0000 7f2891883640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c15fdb0 con 0x7f288c157770 2023-11-24T06:12:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.531+0000 7f2891883640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c160090 con 0x7f288c15ddb0 2023-11-24T06:12:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.531+0000 7f2890881640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c06d080 0x7f288c14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2890881640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c06d080 0x7f288c14b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37594/0 (socket says 172.21.15.22:37594) 2023-11-24T06:12:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2890881640 1 -- 172.21.15.22:0/1224434954 learned_addr learned my addr 172.21.15.22:0/1224434954 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2883fff640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f288c157770 0x7f288c0cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2890881640 1 -- 172.21.15.22:0/1224434954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c15ddb0 msgr2=0x7f288c0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2891082640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c15ddb0 0x7f288c0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2890881640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c15ddb0 0x7f288c0ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2890881640 1 -- 172.21.15.22:0/1224434954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f288c157770 msgr2=0x7f288c0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2890881640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f288c157770 0x7f288c0cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2890881640 1 -- 172.21.15.22:0/1224434954 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2884009b30 con 0x7f288c06d080 2023-11-24T06:12:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2883fff640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f288c157770 0x7f288c0cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.532+0000 7f2890881640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c06d080 0x7f288c14b790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f288800d800 tx=0x7f288800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.533+0000 7f28817fa640 1 -- 172.21.15.22:0/1224434954 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800b6c0 con 0x7f288c06d080 2023-11-24T06:12:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.533+0000 7f28817fa640 1 -- 172.21.15.22:0/1224434954 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288800b820 con 0x7f288c06d080 2023-11-24T06:12:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.533+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c160370 con 0x7f288c06d080 2023-11-24T06:12:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.533+0000 7f28817fa640 1 -- 172.21.15.22:0/1224434954 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800bbb0 con 0x7f288c06d080 2023-11-24T06:12:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.533+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c160930 con 0x7f288c06d080 2023-11-24T06:12:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.534+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c0b4e60 con 0x7f288c06d080 2023-11-24T06:12:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.535+0000 7f28817fa640 1 -- 172.21.15.22:0/1224434954 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f288800bd10 con 0x7f288c06d080 2023-11-24T06:12:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.536+0000 7f28817fa640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f287806ae40 0x7f287806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.536+0000 7f28817fa640 1 -- 172.21.15.22:0/1224434954 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2888089b10 con 0x7f288c06d080 2023-11-24T06:12:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.536+0000 7f2883fff640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f287806ae40 0x7f287806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.537+0000 7f2883fff640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f287806ae40 0x7f287806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f288c0afef0 tx=0x7f287c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:11.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.540+0000 7f28817fa640 1 -- 172.21.15.22:0/1224434954 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2888054bb0 con 0x7f288c06d080 2023-11-24T06:12:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.737+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f288c04e840 con 0x7f288c06d080 2023-11-24T06:12:11.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.740+0000 7f28817fa640 1 -- 172.21.15.22:0/1224434954 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f28880581d0 con 0x7f288c06d080 2023-11-24T06:12:11.744 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:11.744 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:01.374181+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:11.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f287806ae40 msgr2=0x7f287806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f287806ae40 0x7f287806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f288c0afef0 tx=0x7f287c008040 comp rx=0 tx=0).stop 2023-11-24T06:12:11.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c06d080 msgr2=0x7f288c14b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c06d080 0x7f288c14b790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f288800d800 tx=0x7f288800dcc0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 shutdown_connections 2023-11-24T06:12:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f287806ae40 0x7f287806d300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f288c15ddb0 0x7f288c0ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f288c157770 0x7f288c0cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 --2- 172.21.15.22:0/1224434954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288c06d080 0x7f288c14b790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 >> 172.21.15.22:0/1224434954 conn(0x7f288c06a860 msgr2=0x7f288c0ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.743+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 shutdown_connections 2023-11-24T06:12:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.744+0000 7f2891883640 1 -- 172.21.15.22:0/1224434954 wait complete. 2023-11-24T06:12:11.765 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-24T06:12:11.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.992+0000 7fb57f59e640 1 Processor -- start 2023-11-24T06:12:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.992+0000 7fb57f59e640 1 -- start start 2023-11-24T06:12:11.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.993+0000 7fb57f59e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb58014b1c0 0x7fb580162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.993+0000 7fb57f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 0x7fb5801655f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.993+0000 7fb57f59e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb580162bb0 con 0x7fb5801651a0 2023-11-24T06:12:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.993+0000 7fb57f59e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb580165ca0 con 0x7fb58014b1c0 2023-11-24T06:12:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.993+0000 7fb57f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb580165f80 con 0x7fb5800cf760 2023-11-24T06:12:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.994+0000 7fb57e59c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb58014b1c0 0x7fb580162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.994+0000 7fb57e59c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb58014b1c0 0x7fb580162670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37602/0 (socket says 172.21.15.22:37602) 2023-11-24T06:12:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.994+0000 7fb57e59c640 1 -- 172.21.15.22:0/1129767364 learned_addr learned my addr 172.21.15.22:0/1129767364 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.994+0000 7fb57ed9d640 1 --2- 172.21.15.22:0/1129767364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 0x7fb5801655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.994+0000 7fb57e59c640 1 -- 172.21.15.22:0/1129767364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 msgr2=0x7fb5801655f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.994+0000 7fb57e59c640 1 --2- 172.21.15.22:0/1129767364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 0x7fb5801655f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.994+0000 7fb57e59c640 1 -- 172.21.15.22:0/1129767364 >> v1:172.21.15.31:6789/0 conn(0x7fb5801651a0 legacy=0x7fb5800cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.994+0000 7fb57e59c640 1 -- 172.21.15.22:0/1129767364 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580161e70 con 0x7fb58014b1c0 2023-11-24T06:12:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.995+0000 7fb57e59c640 1 --2- 172.21.15.22:0/1129767364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb58014b1c0 0x7fb580162670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb570009870 tx=0x7fb57002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb97f1e6dac0d8b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:11.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.996+0000 7fb57d59a640 1 -- 172.21.15.22:0/1129767364 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5700317c0 con 0x7fb58014b1c0 2023-11-24T06:12:11.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.996+0000 7fb57d59a640 1 -- 172.21.15.22:0/1129767364 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb570031920 con 0x7fb58014b1c0 2023-11-24T06:12:11.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.996+0000 7fb57d59a640 1 -- 172.21.15.22:0/1129767364 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570031cb0 con 0x7fb58014b1c0 2023-11-24T06:12:11.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.996+0000 7fb57f59e640 1 -- 172.21.15.22:0/1129767364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb58014b1c0 msgr2=0x7fb580162670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:11.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.996+0000 7fb57f59e640 1 --2- 172.21.15.22:0/1129767364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb58014b1c0 0x7fb580162670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb570009870 tx=0x7fb57002b860 comp rx=0 tx=0).stop 2023-11-24T06:12:12.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.996+0000 7fb57f59e640 1 -- 172.21.15.22:0/1129767364 shutdown_connections 2023-11-24T06:12:12.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.996+0000 7fb57f59e640 1 --2- 172.21.15.22:0/1129767364 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 0x7fb5801655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.996+0000 7fb57f59e640 1 --2- 172.21.15.22:0/1129767364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb58014b1c0 0x7fb580162670 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.996+0000 7fb57f59e640 1 -- 172.21.15.22:0/1129767364 >> 172.21.15.22:0/1129767364 conn(0x7fb58006a860 msgr2=0x7fb58006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.997+0000 7fb57f59e640 1 -- 172.21.15.22:0/1129767364 shutdown_connections 2023-11-24T06:12:12.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.997+0000 7fb57f59e640 1 -- 172.21.15.22:0/1129767364 wait complete. 2023-11-24T06:12:12.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.998+0000 7fb57f59e640 1 Processor -- start 2023-11-24T06:12:12.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.998+0000 7fb57f59e640 1 -- start start 2023-11-24T06:12:12.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.999+0000 7fb57f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 0x7fb5801f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.999+0000 7fb57f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb58014b1c0 0x7fb58015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.999+0000 7fb57f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5801651a0 0x7fb5800cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.999+0000 7fb57f59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58015e8c0 con 0x7fb5801651a0 2023-11-24T06:12:12.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.999+0000 7fb57f59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800cd790 con 0x7fb58014b1c0 2023-11-24T06:12:12.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:11.999+0000 7fb57f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800cd9d0 con 0x7fb5800cf760 2023-11-24T06:12:12.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5801651a0 0x7fb5800cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5801651a0 0x7fb5800cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37606/0 (socket says 172.21.15.22:37606) 2023-11-24T06:12:12.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57ed9d640 1 -- 172.21.15.22:0/1126570278 learned_addr learned my addr 172.21.15.22:0/1126570278 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57dd9b640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb58014b1c0 0x7fb58015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57e59c640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 0x7fb5801f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57ed9d640 1 -- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 msgr2=0x7fb5801f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57ed9d640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 0x7fb5801f82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57ed9d640 1 -- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb58014b1c0 msgr2=0x7fb58015e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57ed9d640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb58014b1c0 0x7fb58015e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57ed9d640 1 -- 172.21.15.22:0/1126570278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700094d0 con 0x7fb5801651a0 2023-11-24T06:12:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57dd9b640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb58014b1c0 0x7fb58015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57e59c640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 0x7fb5801f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.000+0000 7fb57ed9d640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5801651a0 0x7fb5800cd250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb57800cd70 tx=0x7fb57800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.001+0000 7fb56effd640 1 -- 172.21.15.22:0/1126570278 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578003b90 con 0x7fb5801651a0 2023-11-24T06:12:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.001+0000 7fb56effd640 1 -- 172.21.15.22:0/1126570278 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578003cf0 con 0x7fb5801651a0 2023-11-24T06:12:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.001+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5800cdcb0 con 0x7fb5801651a0 2023-11-24T06:12:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.001+0000 7fb56effd640 1 -- 172.21.15.22:0/1126570278 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578004240 con 0x7fb5801651a0 2023-11-24T06:12:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.001+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5800ce270 con 0x7fb5801651a0 2023-11-24T06:12:12.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.002+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb580162970 con 0x7fb5801651a0 2023-11-24T06:12:12.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.003+0000 7fb56effd640 1 -- 172.21.15.22:0/1126570278 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb5780043a0 con 0x7fb5801651a0 2023-11-24T06:12:12.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.004+0000 7fb56effd640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb56006ae40 0x7fb56006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.004+0000 7fb56effd640 1 -- 172.21.15.22:0/1126570278 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb578012070 con 0x7fb5801651a0 2023-11-24T06:12:12.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.004+0000 7fb57e59c640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb56006ae40 0x7fb56006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.005+0000 7fb57e59c640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb56006ae40 0x7fb56006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb570036000 tx=0x7fb57003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.008+0000 7fb56effd640 1 -- 172.21.15.22:0/1126570278 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb5780550f0 con 0x7fb5801651a0 2023-11-24T06:12:12.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.203+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb580162670 con 0x7fb5801651a0 2023-11-24T06:12:12.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.205+0000 7fb56effd640 1 -- 172.21.15.22:0/1126570278 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fb578058710 con 0x7fb5801651a0 2023-11-24T06:12:12.208 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:12.208 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:01.374181+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:12.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.207+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb56006ae40 msgr2=0x7fb56006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.207+0000 7fb57f59e640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb56006ae40 0x7fb56006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb570036000 tx=0x7fb57003d040 comp rx=0 tx=0).stop 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.207+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5801651a0 msgr2=0x7fb5800cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.207+0000 7fb57f59e640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5801651a0 0x7fb5800cd250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb57800cd70 tx=0x7fb57800a660 comp rx=0 tx=0).stop 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.208+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 shutdown_connections 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.208+0000 7fb57f59e640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb56006ae40 0x7fb56006d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.208+0000 7fb57f59e640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5801651a0 0x7fb5800cd250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.208+0000 7fb57f59e640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb58014b1c0 0x7fb58015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.208+0000 7fb57f59e640 1 --2- 172.21.15.22:0/1126570278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5800cf760 0x7fb5801f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.208+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 >> 172.21.15.22:0/1126570278 conn(0x7fb58006a860 msgr2=0x7fb5800b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.208+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 shutdown_connections 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.208+0000 7fb57f59e640 1 -- 172.21.15.22:0/1126570278 wait complete. 2023-11-24T06:12:12.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-24T06:12:12.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-24T06:12:12.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-24T06:12:12.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-24T06:12:12.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-24T06:12:12.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-24T06:12:12.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-24T06:12:12.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-24T06:12:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.553+0000 7f9818fd0640 1 Processor -- start 2023-11-24T06:12:12.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.554+0000 7f9818fd0640 1 -- start start 2023-11-24T06:12:12.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.555+0000 7f12f1278640 1 Processor -- start 2023-11-24T06:12:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.556+0000 7f9818fd0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f980c005eb0 0x7f980c0062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.556+0000 7f9818fd0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c006830 0x7f980c006cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.557+0000 7f9818fd0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c054300 con 0x7f980c0eacd0 2023-11-24T06:12:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.557+0000 7f9818fd0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0536f0 con 0x7f980c005eb0 2023-11-24T06:12:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.557+0000 7f9818fd0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0539d0 con 0x7f980c006830 2023-11-24T06:12:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.557+0000 7f9812ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f980c005eb0 0x7f980c0062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f98137fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f980c0eacd0 0x7f980c04fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53294/0 (socket says 172.21.15.22:53294) 2023-11-24T06:12:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f98137fe640 1 -- 172.21.15.22:0/93100324 learned_addr learned my addr 172.21.15.22:0/93100324 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.556+0000 7f12f1278640 1 -- start start 2023-11-24T06:12:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f12f1278640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 0x7f12e404fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f12f1278640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f12e404ffa0 0x7f12e4037ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f9813fff640 1 --2- 172.21.15.22:0/93100324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c006830 0x7f980c006cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f12eb7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f12e404ffa0 0x7f12e4037ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f12eb7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f12e404ffa0 0x7f12e4037ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37634/0 (socket says 172.21.15.22:37634) 2023-11-24T06:12:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f12ebfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 0x7f12e404fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f12ebfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 0x7f12e404fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:36296/0 (socket says 172.21.15.22:36296) 2023-11-24T06:12:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.558+0000 7f12eb7fe640 1 -- 172.21.15.22:0/3935706930 learned_addr learned my addr 172.21.15.22:0/3935706930 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.559+0000 7f12f1278640 1 -- 172.21.15.22:0/3935706930 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e4054300 con 0x7f12e40380e0 2023-11-24T06:12:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.559+0000 7f12f1278640 1 -- 172.21.15.22:0/3935706930 --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e40536f0 con 0x7f12e404ffa0 2023-11-24T06:12:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.559+0000 7f12f1278640 1 -- 172.21.15.22:0/3935706930 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e40539d0 con 0x7f12e40eacd0 2023-11-24T06:12:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.559+0000 7fbc72ee0640 1 Processor -- start 2023-11-24T06:12:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.559+0000 7f9812ffd640 1 -- 172.21.15.22:0/93100324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c006830 msgr2=0x7f980c006cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.559+0000 7f9812ffd640 1 --2- 172.21.15.22:0/93100324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c006830 0x7f980c006cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.559+0000 7f9812ffd640 1 -- 172.21.15.22:0/93100324 >> v1:172.21.15.22:6789/0 conn(0x7f980c0eacd0 legacy=0x7f980c04fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.559+0000 7f9812ffd640 1 -- 172.21.15.22:0/93100324 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c053cb0 con 0x7f980c005eb0 2023-11-24T06:12:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.560+0000 7f12eaffd640 1 -- 172.21.15.22:0/3935706930 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486076336 0 0) 0x7f12e4054300 con 0x7f12e40380e0 2023-11-24T06:12:12.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.560+0000 7f12eaffd640 1 -- 172.21.15.22:0/3935706930 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12dc003520 con 0x7f12e40380e0 2023-11-24T06:12:12.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.560+0000 7fbc72ee0640 1 -- start start 2023-11-24T06:12:12.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.560+0000 7f12ebfff640 1 -- 172.21.15.22:0/3935706930 >> v2:172.21.15.22:3300/0 conn(0x7f12e404ffa0 msgr2=0x7f12e4037ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.560+0000 7f12ebfff640 1 --2- 172.21.15.22:0/3935706930 >> v2:172.21.15.22:3300/0 conn(0x7f12e404ffa0 0x7f12e4037ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.560+0000 7f12ebfff640 1 -- 172.21.15.22:0/3935706930 >> v1:172.21.15.31:6789/0 conn(0x7f12e40380e0 legacy=0x7f12e4038570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.560+0000 7f12ebfff640 1 -- 172.21.15.22:0/3935706930 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e4053cb0 con 0x7f12e40eacd0 2023-11-24T06:12:12.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.562+0000 7f12ebfff640 1 --2- 172.21.15.22:0/3935706930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 0x7f12e404fa60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0681c0 tx=0x7f12ec0a5e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eb82f21615c87d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.562+0000 7f9812ffd640 1 --2- 172.21.15.22:0/93100324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c005eb0 0x7f980c0062f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98080097a0 tx=0x7f980802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3abd7123ec33de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.562+0000 7f12eaffd640 1 -- 172.21.15.22:0/3935706930 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0a6c90 con 0x7f12e40eacd0 2023-11-24T06:12:12.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.562+0000 7f12eaffd640 1 -- 172.21.15.22:0/3935706930 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec0a6df0 con 0x7f12e40eacd0 2023-11-24T06:12:12.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.562+0000 7f12eaffd640 1 -- 172.21.15.22:0/3935706930 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0ae660 con 0x7f12e40eacd0 2023-11-24T06:12:12.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7f98127fc640 1 -- 172.21.15.22:0/93100324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808031640 con 0x7f980c005eb0 2023-11-24T06:12:12.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7fbc72ee0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc6c06d520 0x7fbc6c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7f98127fc640 1 -- 172.21.15.22:0/93100324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98080317a0 con 0x7f980c005eb0 2023-11-24T06:12:12.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7f98127fc640 1 -- 172.21.15.22:0/93100324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808031b70 con 0x7f980c005eb0 2023-11-24T06:12:12.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7f12f1278640 1 -- 172.21.15.22:0/3935706930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 msgr2=0x7f12e404fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7f12f1278640 1 --2- 172.21.15.22:0/3935706930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 0x7f12e404fa60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0681c0 tx=0x7f12ec0a5e20 comp rx=0 tx=0).stop 2023-11-24T06:12:12.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7f12f1278640 1 -- 172.21.15.22:0/3935706930 shutdown_connections 2023-11-24T06:12:12.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7f12f1278640 1 --2- 172.21.15.22:0/3935706930 >> v2:172.21.15.22:3300/0 conn(0x7f12e404ffa0 0x7f12e4037ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7f12f1278640 1 --2- 172.21.15.22:0/3935706930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 0x7f12e404fa60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7f12f1278640 1 -- 172.21.15.22:0/3935706930 >> 172.21.15.22:0/3935706930 conn(0x7f12e4009f80 msgr2=0x7f12e400a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7f12f1278640 1 -- 172.21.15.22:0/3935706930 shutdown_connections 2023-11-24T06:12:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7fbc72ee0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c0b2080 0x7fbc6c0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7fbc72ee0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c070dc0 con 0x7fbc6c0acb50 2023-11-24T06:12:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7fbc72ee0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c0720e0 con 0x7fbc6c06d520 2023-11-24T06:12:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.563+0000 7fbc72ee0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c161d00 con 0x7fbc6c0b2080 2023-11-24T06:12:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7fbc70c7c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc6c06d520 0x7fbc6c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7fbc70c7c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc6c06d520 0x7fbc6c06d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37638/0 (socket says 172.21.15.22:37638) 2023-11-24T06:12:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7fbc70c7c640 1 -- 172.21.15.22:0/3223814022 learned_addr learned my addr 172.21.15.22:0/3223814022 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7f9818fd0640 1 -- 172.21.15.22:0/93100324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c005eb0 msgr2=0x7f980c0062f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7fbc7147d640 1 --2- 172.21.15.22:0/3223814022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c0b2080 0x7fbc6c0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7f12f1278640 1 -- 172.21.15.22:0/3935706930 wait complete. 2023-11-24T06:12:12.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.564+0000 7f9818fd0640 1 --2- 172.21.15.22:0/93100324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c005eb0 0x7f980c0062f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98080097a0 tx=0x7f980802b8f0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.565+0000 7f9818fd0640 1 -- 172.21.15.22:0/93100324 shutdown_connections 2023-11-24T06:12:12.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.565+0000 7f9818fd0640 1 --2- 172.21.15.22:0/93100324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c005eb0 0x7f980c0062f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.566+0000 7f9818fd0640 1 --2- 172.21.15.22:0/93100324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c006830 0x7f980c006cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.566+0000 7f9818fd0640 1 -- 172.21.15.22:0/93100324 >> 172.21.15.22:0/93100324 conn(0x7f980c009f80 msgr2=0x7f980c00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.565+0000 7fbc70c7c640 1 -- 172.21.15.22:0/3223814022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c0b2080 msgr2=0x7fbc6c0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.565+0000 7fbc70c7c640 1 --2- 172.21.15.22:0/3223814022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c0b2080 0x7fbc6c0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.565+0000 7fbc70c7c640 1 -- 172.21.15.22:0/3223814022 >> v1:172.21.15.31:6789/0 conn(0x7fbc6c0acb50 legacy=0x7fbc6c0719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.565+0000 7fbc70c7c640 1 -- 172.21.15.22:0/3223814022 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c06de40 con 0x7fbc6c06d520 2023-11-24T06:12:12.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.566+0000 7f9818fd0640 1 -- 172.21.15.22:0/93100324 shutdown_connections 2023-11-24T06:12:12.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.567+0000 7f9818fd0640 1 -- 172.21.15.22:0/93100324 wait complete. 2023-11-24T06:12:12.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.567+0000 7f12f1278640 1 Processor -- start 2023-11-24T06:12:12.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.568+0000 7f12f1278640 1 -- start start 2023-11-24T06:12:12.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.568+0000 7fbc70c7c640 1 --2- 172.21.15.22:0/3223814022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c06d520 0x7fbc6c06d900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009ad0 tx=0x7fbc5c02bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cbe3d5b687be84 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.568+0000 7f6cce72c640 1 Processor -- start 2023-11-24T06:12:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.568+0000 7f6cce72c640 1 -- start start 2023-11-24T06:12:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7fbc6b7fe640 1 -- 172.21.15.22:0/3223814022 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c02c710 con 0x7fbc6c06d520 2023-11-24T06:12:12.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7f12f1278640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e40380e0 0x7f12e4180d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7f9818fd0640 1 Processor -- start 2023-11-24T06:12:12.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7fbc6b7fe640 1 -- 172.21.15.22:0/3223814022 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c02c870 con 0x7fbc6c06d520 2023-11-24T06:12:12.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7fbc6b7fe640 1 -- 172.21.15.22:0/3223814022 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c02cc40 con 0x7fbc6c06d520 2023-11-24T06:12:12.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7f12f1278640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12e404ffa0 0x7f12e404e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7f9818fd0640 1 -- start start 2023-11-24T06:12:12.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7f6cce72c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d4e0 0x7f6cc8160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7f6cce72c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6cc8161350 0x7f6cc80b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.571+0000 7f12ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e40380e0 0x7f12e4180d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7f6cce72c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc80d3e50 con 0x7f6cc815d100 2023-11-24T06:12:12.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.570+0000 7f6cce72c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc81617e0 con 0x7f6cc8161350 2023-11-24T06:12:12.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.571+0000 7f6cce72c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80cef60 con 0x7f6cc815d4e0 2023-11-24T06:12:12.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.571+0000 7f12ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e40380e0 0x7f12e4180d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37640/0 (socket says 172.21.15.22:37640) 2023-11-24T06:12:12.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.571+0000 7f6ccd72a640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6cc815d100 0x7f6cc80d3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53298/0 (socket says 172.21.15.22:53298) 2023-11-24T06:12:12.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.571+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3223814022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c06d520 msgr2=0x7fbc6c06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.571+0000 7fbc72ee0640 1 --2- 172.21.15.22:0/3223814022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c06d520 0x7fbc6c06d900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009ad0 tx=0x7fbc5c02bb70 comp rx=0 tx=0).stop 2023-11-24T06:12:12.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.571+0000 7f6ccd72a640 1 -- 172.21.15.22:0/19524969 learned_addr learned my addr 172.21.15.22:0/19524969 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:12.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.571+0000 7f12ebfff640 1 -- 172.21.15.22:0/3427848931 learned_addr learned my addr 172.21.15.22:0/3427848931 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.571+0000 7f6cccf29640 1 --2- 172.21.15.22:0/19524969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d4e0 0x7f6cc8160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f6ccdf2b640 1 --2- 172.21.15.22:0/19524969 >> v2:172.21.15.31:3300/0 conn(0x7f6cc8161350 0x7f6cc80b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f12eb7fe640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12e404ffa0 0x7f12e404e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f6cbffff640 1 -- 172.21.15.22:0/19524969 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857746128 0 0) 0x7f6cc80d3e50 con 0x7f6cc815d100 2023-11-24T06:12:12.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f12f1278640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 0x7f12e4045460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f6cbffff640 1 -- 172.21.15.22:0/19524969 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb4003520 con 0x7f6cc815d100 2023-11-24T06:12:12.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f9818fd0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c005eb0 0x7f980c0dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f9818fd0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f980c006830 0x7f980c0455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f9818fd0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c0eacd0 0x7f980c04f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f9818fd0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0451a0 con 0x7f980c005eb0 2023-11-24T06:12:12.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f9818fd0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0dd4f0 con 0x7f980c006830 2023-11-24T06:12:12.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f9818fd0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c044800 con 0x7f980c0eacd0 2023-11-24T06:12:12.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f6cccf29640 1 -- 172.21.15.22:0/19524969 >> v2:172.21.15.31:3300/0 conn(0x7f6cc8161350 msgr2=0x7f6cc80b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f6cccf29640 1 --2- 172.21.15.22:0/19524969 >> v2:172.21.15.31:3300/0 conn(0x7f6cc8161350 0x7f6cc80b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f6cccf29640 1 -- 172.21.15.22:0/19524969 >> v1:172.21.15.22:6789/0 conn(0x7f6cc815d100 legacy=0x7f6cc80d3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.572+0000 7f6cccf29640 1 -- 172.21.15.22:0/19524969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80ce6c0 con 0x7f6cc815d4e0 2023-11-24T06:12:12.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.573+0000 7f98137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c005eb0 0x7f980c0dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.573+0000 7f98137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c005eb0 0x7f980c0dcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37652/0 (socket says 172.21.15.22:37652) 2023-11-24T06:12:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.573+0000 7f98137fe640 1 -- 172.21.15.22:0/3868200758 learned_addr learned my addr 172.21.15.22:0/3868200758 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.573+0000 7f9813fff640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c0eacd0 0x7f980c04f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.573+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e40459a0 con 0x7f12e40380e0 2023-11-24T06:12:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.573+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4045f20 con 0x7f12e404ffa0 2023-11-24T06:12:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.573+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4045c40 con 0x7f12e40eacd0 2023-11-24T06:12:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.573+0000 7f88f8f48640 1 Processor -- start 2023-11-24T06:12:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7f9812ffd640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f980c006830 0x7f980c0455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7f88f8f48640 1 -- start start 2023-11-24T06:12:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7f12f0a77640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 0x7f12e4045460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3223814022 shutdown_connections 2023-11-24T06:12:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7fbc72ee0640 1 --2- 172.21.15.22:0/3223814022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c0b2080 0x7fbc6c0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7fbc72ee0640 1 --2- 172.21.15.22:0/3223814022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c06d520 0x7fbc6c06d900 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3223814022 >> 172.21.15.22:0/3223814022 conn(0x7fbc6c0b0d80 msgr2=0x7fbc6c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7f6cccf29640 1 --2- 172.21.15.22:0/19524969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d4e0 0x7f6cc8160e10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40097a0 tx=0x7f6cc402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=871d807727465d89 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f9813fff640 1 -- 172.21.15.22:0/3868200758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f980c006830 msgr2=0x7f980c0455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f9813fff640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f980c006830 0x7f980c0455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7f12ebfff640 1 -- 172.21.15.22:0/3427848931 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 msgr2=0x7f12e4045460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7f12ebfff640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12e40eacd0 0x7f12e4045460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7f12ebfff640 1 -- 172.21.15.22:0/3427848931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12e404ffa0 msgr2=0x7f12e404e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7f12ebfff640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12e404ffa0 0x7f12e404e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.574+0000 7f12ebfff640 1 -- 172.21.15.22:0/3427848931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec04f730 con 0x7f12e40380e0 2023-11-24T06:12:12.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f9813fff640 1 -- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c005eb0 msgr2=0x7f980c0dcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f9813fff640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c005eb0 0x7f980c0dcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f9813fff640 1 -- 172.21.15.22:0/3868200758 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808009400 con 0x7f980c0eacd0 2023-11-24T06:12:12.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f6cbffff640 1 -- 172.21.15.22:0/19524969 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4031830 con 0x7f6cc815d4e0 2023-11-24T06:12:12.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f12ebfff640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e40380e0 0x7f12e4180d20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f12ec050140 tx=0x7f12ec068480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f9813fff640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c0eacd0 0x7f980c04f520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9814069dd0 tx=0x7f9814067fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f12e8ff9640 1 -- 172.21.15.22:0/3427848931 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0b7400 con 0x7f12e40380e0 2023-11-24T06:12:12.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f12e8ff9640 1 -- 172.21.15.22:0/3427848931 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec0b7560 con 0x7f12e40380e0 2023-11-24T06:12:12.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f12e8ff9640 1 -- 172.21.15.22:0/3427848931 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0b78d0 con 0x7f12e40380e0 2023-11-24T06:12:12.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e4180240 con 0x7f12e40380e0 2023-11-24T06:12:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f6cbffff640 1 -- 172.21.15.22:0/19524969 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc4031990 con 0x7f6cc815d4e0 2023-11-24T06:12:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.575+0000 7f6cbffff640 1 -- 172.21.15.22:0/19524969 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4031830 con 0x7f6cc815d4e0 2023-11-24T06:12:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e4180800 con 0x7f12e40380e0 2023-11-24T06:12:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f6cce72c640 1 -- 172.21.15.22:0/19524969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d4e0 msgr2=0x7f6cc8160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f6cce72c640 1 --2- 172.21.15.22:0/19524969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d4e0 0x7f6cc8160e10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40097a0 tx=0x7f6cc402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f97fffff640 1 -- 172.21.15.22:0/3868200758 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981406a440 con 0x7f980c0eacd0 2023-11-24T06:12:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f97fffff640 1 -- 172.21.15.22:0/3868200758 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981406a5a0 con 0x7f980c0eacd0 2023-11-24T06:12:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f97fffff640 1 -- 172.21.15.22:0/3868200758 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981406a930 con 0x7f980c0eacd0 2023-11-24T06:12:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f88f8f48640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88f415d770 0x7f88f40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f88f8f48640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f40d0b40 con 0x7f88f40d3980 2023-11-24T06:12:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f88f8f48640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f415db50 con 0x7f88f40d2740 2023-11-24T06:12:12.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f88f8f48640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40d0860 con 0x7f88f415d770 2023-11-24T06:12:12.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3223814022 shutdown_connections 2023-11-24T06:12:12.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c044ae0 con 0x7f980c0eacd0 2023-11-24T06:12:12.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f6cce72c640 1 -- 172.21.15.22:0/19524969 shutdown_connections 2023-11-24T06:12:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f6cce72c640 1 --2- 172.21.15.22:0/19524969 >> v2:172.21.15.31:3300/0 conn(0x7f6cc8161350 0x7f6cc80b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f6cce72c640 1 --2- 172.21.15.22:0/19524969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d4e0 0x7f6cc8160e10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f6cce72c640 1 -- 172.21.15.22:0/19524969 >> 172.21.15.22:0/19524969 conn(0x7f6cc809c3d0 msgr2=0x7f6cc80d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.577+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c045b00 con 0x7f980c0eacd0 2023-11-24T06:12:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.577+0000 7f6cce72c640 1 -- 172.21.15.22:0/19524969 shutdown_connections 2023-11-24T06:12:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f88f1d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f88f40d2740 0x7f88f40d3270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:39788/0 (socket says 172.21.15.22:39788) 2023-11-24T06:12:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7f88f1d9b640 1 -- 172.21.15.22:0/1322797847 learned_addr learned my addr 172.21.15.22:0/1322797847 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.577+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12e4038c80 con 0x7f12e40380e0 2023-11-24T06:12:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.578+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f980c039b40 con 0x7f980c0eacd0 2023-11-24T06:12:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.578+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876893440 0 0) 0x7f88f415db50 con 0x7f88f40d2740 2023-11-24T06:12:12.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.578+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e0003520 con 0x7f88f40d2740 2023-11-24T06:12:12.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.577+0000 7f6cce72c640 1 -- 172.21.15.22:0/19524969 wait complete. 2023-11-24T06:12:12.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.578+0000 7f80b3423640 1 Processor -- start 2023-11-24T06:12:12.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.578+0000 7f80b3423640 1 -- start start 2023-11-24T06:12:12.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f6cce72c640 1 Processor -- start 2023-11-24T06:12:12.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f6cce72c640 1 -- start start 2023-11-24T06:12:12.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.576+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3223814022 wait complete. 2023-11-24T06:12:12.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7fbc72ee0640 1 Processor -- start 2023-11-24T06:12:12.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7fbc72ee0640 1 -- start start 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1117547931 0 0) 0x7f88e0003520 con 0x7f88f40d2740 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 >> v2:172.21.15.22:3300/0 conn(0x7f88f415d770 msgr2=0x7f88f40d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 --2- 172.21.15.22:0/1322797847 >> v2:172.21.15.22:3300/0 conn(0x7f88f415d770 0x7f88f40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 >> v1:172.21.15.22:6789/0 conn(0x7f88f40d3980 legacy=0x7f88f40b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40d1720 con 0x7f88f40d2740 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f88e40019f0 con 0x7f88f40d2740 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 >> v1:172.21.15.31:6789/0 conn(0x7f88f40d2740 legacy=0x7f88f40d3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 --2- 172.21.15.22:0/1322797847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88e0003970 0x7f88e0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 --2- 172.21.15.22:0/1322797847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88e00047c0 0x7f88e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 --2- 172.21.15.22:0/1322797847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88e0005280 0x7f88e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40d0860 con 0x7f88e0003970 2023-11-24T06:12:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e000c1c0 con 0x7f88e00047c0 2023-11-24T06:12:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e000c380 con 0x7f88e0005280 2023-11-24T06:12:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f88f1d9b640 1 --2- 172.21.15.22:0/1322797847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88e00047c0 0x7f88e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7fed7a3a9640 1 Processor -- start 2023-11-24T06:12:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.579+0000 7fed7a3a9640 1 -- start start 2023-11-24T06:12:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f88f1d9b640 1 -- 172.21.15.22:0/1322797847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88e0005280 msgr2=0x7f88e000b980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:12:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f88f1d9b640 1 --2- 172.21.15.22:0/1322797847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88e0005280 0x7f88e000b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f88f1d9b640 1 -- 172.21.15.22:0/1322797847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88e0003970 msgr2=0x7f88e0003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:12:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f88f1d9b640 1 --2- 172.21.15.22:0/1322797847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88e0003970 0x7f88e0003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f88f1d9b640 1 -- 172.21.15.22:0/1322797847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40d0b40 con 0x7f88e00047c0 2023-11-24T06:12:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.581+0000 7f88f2d9d640 1 -- 172.21.15.22:0/1322797847 reap_dead start 2023-11-24T06:12:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f80b3423640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80ac06e320 0x7f80ac06a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f80b3423640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac06f4a0 con 0x7f80ac161aa0 2023-11-24T06:12:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f80b3423640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac06e890 con 0x7f80ac06a980 2023-11-24T06:12:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.580+0000 7f80b3423640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ac06ae10 con 0x7f80ac06e320 2023-11-24T06:12:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.581+0000 7f80b11bf640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f80ac161aa0 0x7f80ac0b33c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53312/0 (socket says 172.21.15.22:53312) 2023-11-24T06:12:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.581+0000 7f80b09be640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80ac06e320 0x7f80ac06a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.581+0000 7f80b11bf640 1 -- 172.21.15.22:0/2413095202 learned_addr learned my addr 172.21.15.22:0/2413095202 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.581+0000 7fed7a3a9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fed74159d00 0x7fed7415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.581+0000 7f6cce72c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d100 0x7f6cc815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7f6cce72c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc815d4e0 0x7f6cc81f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7f6cce72c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cc8161350 0x7f6cc80c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7f6ccd72a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d100 0x7f6cc815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7f6cce72c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc815f150 con 0x7f6cc8161350 2023-11-24T06:12:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7f6cce72c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc815c030 con 0x7f6cc815d4e0 2023-11-24T06:12:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7f6cce72c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80cb970 con 0x7f6cc815d100 2023-11-24T06:12:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7f6ccd72a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d100 0x7f6cc815baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:36344/0 (socket says 172.21.15.22:36344) 2023-11-24T06:12:12.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7fed7a3a9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fed7415a620 0x7fed740ae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.581+0000 7f97fffff640 1 -- 172.21.15.22:0/3868200758 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f981406aa90 con 0x7f980c0eacd0 2023-11-24T06:12:12.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7f6ccd72a640 1 -- 172.21.15.22:0/4109464493 learned_addr learned my addr 172.21.15.22:0/4109464493 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7fed7a3a9640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740ae9e0 con 0x7fed7415abe0 2023-11-24T06:12:12.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7fed7a3a9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed74153f70 con 0x7fed74159d00 2023-11-24T06:12:12.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7fed7a3a9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7406c550 con 0x7fed7415a620 2023-11-24T06:12:12.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.582+0000 7f6cccf29640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc815d4e0 0x7f6cc81f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f80a3fff640 1 -- 172.21.15.22:0/2413095202 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296677090 0 0) 0x7f80ac06e890 con 0x7f80ac06a980 2023-11-24T06:12:12.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f12e8ff9640 1 -- 172.21.15.22:0/3427848931 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12ec0b5040 con 0x7f12e40380e0 2023-11-24T06:12:12.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f97fffff640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f97f806af10 0x7f97f806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f80b09be640 1 -- 172.21.15.22:0/2413095202 >> v1:172.21.15.31:6789/0 conn(0x7f80ac06a980 legacy=0x7f80ac0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f80b09be640 1 -- 172.21.15.22:0/2413095202 >> v1:172.21.15.22:6789/0 conn(0x7f80ac161aa0 legacy=0x7f80ac0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f80b09be640 1 -- 172.21.15.22:0/2413095202 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac06eb70 con 0x7f80ac06e320 2023-11-24T06:12:12.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f97fffff640 1 -- 172.21.15.22:0/3868200758 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9814103720 con 0x7f980c0eacd0 2023-11-24T06:12:12.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7fed737fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fed7415abe0 0x7fed740adc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53328/0 (socket says 172.21.15.22:53328) 2023-11-24T06:12:12.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7fed737fe640 1 -- 172.21.15.22:0/2186673006 learned_addr learned my addr 172.21.15.22:0/2186673006 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:12.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7fed78946640 1 --2- 172.21.15.22:0/2186673006 >> v2:172.21.15.31:3300/0 conn(0x7fed7415a620 0x7fed740ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f97fffff640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f97f8073130 0x7f97f8075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f97fffff640 1 -- 172.21.15.22:0/3868200758 --> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97f8075c00 con 0x7f97f8073130 2023-11-24T06:12:12.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7f97fffff640 1 -- 172.21.15.22:0/3868200758 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9814103ad0 con 0x7f980c0eacd0 2023-11-24T06:12:12.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7fed72ffd640 1 -- 172.21.15.22:0/2186673006 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695816921 0 0) 0x7fed740ae9e0 con 0x7fed7415abe0 2023-11-24T06:12:12.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fed72ffd640 1 -- 172.21.15.22:0/2186673006 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed5c003520 con 0x7fed7415abe0 2023-11-24T06:12:12.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.583+0000 7fbc72ee0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c06d520 0x7fbc6c151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fbc72ee0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc6c0acb50 0x7fbc6c09c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fbc72ee0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c0b2080 0x7fbc6c0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fed78946640 1 -- 172.21.15.22:0/2186673006 >> v2:172.21.15.22:3300/0 conn(0x7fed74159d00 msgr2=0x7fed7415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fed78946640 1 --2- 172.21.15.22:0/2186673006 >> v2:172.21.15.22:3300/0 conn(0x7fed74159d00 0x7fed7415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fed78946640 1 -- 172.21.15.22:0/2186673006 >> v1:172.21.15.22:6789/0 conn(0x7fed7415abe0 legacy=0x7fed740adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fed78946640 1 -- 172.21.15.22:0/2186673006 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7406c830 con 0x7fed7415a620 2023-11-24T06:12:12.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fbc72ee0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c09d1d0 con 0x7fbc6c0b2080 2023-11-24T06:12:12.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fbc72ee0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c09be80 con 0x7fbc6c0acb50 2023-11-24T06:12:12.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fbc7147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c0b2080 0x7fbc6c0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fbc7147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c0b2080 0x7fbc6c0afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37694/0 (socket says 172.21.15.22:37694) 2023-11-24T06:12:12.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fbc7147d640 1 -- 172.21.15.22:0/3655411171 learned_addr learned my addr 172.21.15.22:0/3655411171 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fbc70c7c640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c06d520 0x7fbc6c151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7fbc6bfff640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc6c0acb50 0x7fbc6c09c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7f98137fe640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f97f806af10 0x7f97f806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.585+0000 7f6ccdf2b640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cc8161350 0x7f6cc80c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.585+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c1523e0 con 0x7fbc6c06d520 2023-11-24T06:12:12.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.584+0000 7f12e8ff9640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f12d006af10 0x7f12d006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.585+0000 7f12e8ff9640 1 -- 172.21.15.22:0/3427848931 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12ec125d40 con 0x7f12e40380e0 2023-11-24T06:12:12.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.585+0000 7f12e8ff9640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f12d0073130 0x7f12d0075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.585+0000 7f12e8ff9640 1 -- 172.21.15.22:0/3427848931 --> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12d0075c00 con 0x7f12d0073130 2023-11-24T06:12:12.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.585+0000 7f12e8ff9640 1 -- 172.21.15.22:0/3427848931 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12ec1260f0 con 0x7f12e40380e0 2023-11-24T06:12:12.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.585+0000 7f9812ffd640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f97f8073130 0x7f97f8075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.585+0000 7f80b09be640 1 --2- 172.21.15.22:0/2413095202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80ac06e320 0x7f80ac06a440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f80a80097a0 tx=0x7f80a802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca3012a90b86afe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.585+0000 7f12eb7fe640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f12d006af10 0x7f12d006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f6ccd72a640 1 -- 172.21.15.22:0/4109464493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc815d4e0 msgr2=0x7f6cc81f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f6ccd72a640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cc815d4e0 0x7f6cc81f6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f6ccd72a640 1 -- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cc8161350 msgr2=0x7f6cc80c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f6ccd72a640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cc8161350 0x7f6cc80c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f6ccd72a640 1 -- 172.21.15.22:0/4109464493 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4009400 con 0x7f6cc815d100 2023-11-24T06:12:12.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f98137fe640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f97f806af10 0x7f97f806d3d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9800005880 tx=0x7f9800009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f80a3fff640 1 -- 172.21.15.22:0/2413095202 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8030860 con 0x7f80ac06e320 2023-11-24T06:12:12.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f88f1d9b640 1 --2- 172.21.15.22:0/1322797847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88e00047c0 0x7f88e0004c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88f40ca360 tx=0x7f88e00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=328b169c48c755e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f12f0a77640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f12d0073130 0x7f12d0075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f80a3fff640 1 -- 172.21.15.22:0/2413095202 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a80309c0 con 0x7f80ac06e320 2023-11-24T06:12:12.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f80a3fff640 1 -- 172.21.15.22:0/2413095202 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8030d50 con 0x7f80ac06e320 2023-11-24T06:12:12.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f12eb7fe640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f12d006af10 0x7f12d006d3d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12e404e4c0 tx=0x7f12e0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7fed78946640 1 --2- 172.21.15.22:0/2186673006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed7415a620 0x7fed740ae330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fed740ceab0 tx=0x7fed6c02bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa1b63d8d006ba69 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.586+0000 7f6ccd72a640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d100 0x7f6cc815baf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c410 tx=0x7f6cb800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40070d0 con 0x7f88e00047c0 2023-11-24T06:12:12.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e402f070 con 0x7f88e00047c0 2023-11-24T06:12:12.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fed72ffd640 1 -- 172.21.15.22:0/2186673006 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c02cc70 con 0x7fed7415a620 2023-11-24T06:12:12.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7f88f159a640 1 -- 172.21.15.22:0/1322797847 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40074f0 con 0x7f88e00047c0 2023-11-24T06:12:12.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fed72ffd640 1 -- 172.21.15.22:0/2186673006 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c02cdd0 con 0x7fed7415a620 2023-11-24T06:12:12.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7f80b3423640 1 -- 172.21.15.22:0/2413095202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80ac06e320 msgr2=0x7f80ac06a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7f80b3423640 1 --2- 172.21.15.22:0/2413095202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80ac06e320 0x7f80ac06a440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f80a80097a0 tx=0x7f80a802b9a0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fbc7147d640 1 -- 172.21.15.22:0/3655411171 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c06d520 msgr2=0x7fbc6c151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fbc7147d640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c06d520 0x7fbc6c151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fbc7147d640 1 -- 172.21.15.22:0/3655411171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc6c0acb50 msgr2=0x7fbc6c09c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fbc7147d640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc6c0acb50 0x7fbc6c09c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fbc7147d640 1 -- 172.21.15.22:0/3655411171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0094d0 con 0x7fbc6c0b2080 2023-11-24T06:12:12.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fbc6bfff640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc6c0acb50 0x7fbc6c09c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:12.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fbc7147d640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c0b2080 0x7fbc6c0afdf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400d5d0 tx=0x7fbc6400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7fbc70c7c640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc6c06d520 0x7fbc6c151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:12.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7f80b3423640 1 -- 172.21.15.22:0/2413095202 shutdown_connections 2023-11-24T06:12:12.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7f80b3423640 1 --2- 172.21.15.22:0/2413095202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80ac06e320 0x7f80ac06a440 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7f80b3423640 1 -- 172.21.15.22:0/2413095202 >> 172.21.15.22:0/2413095202 conn(0x7f80ac0cff80 msgr2=0x7f80ac0d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.587+0000 7f9812ffd640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f97f8073130 0x7f97f8075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fed72ffd640 1 -- 172.21.15.22:0/2186673006 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c034640 con 0x7fed7415a620 2023-11-24T06:12:12.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f88f8f48640 1 -- 172.21.15.22:0/1322797847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88e00047c0 msgr2=0x7f88e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f88f8f48640 1 --2- 172.21.15.22:0/1322797847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88e00047c0 0x7f88e0004c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88f40ca360 tx=0x7f88e00057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f88f8f48640 1 -- 172.21.15.22:0/1322797847 shutdown_connections 2023-11-24T06:12:12.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f88f8f48640 1 --2- 172.21.15.22:0/1322797847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88e00047c0 0x7f88e0004c40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f88f8f48640 1 -- 172.21.15.22:0/1322797847 >> 172.21.15.22:0/1322797847 conn(0x7f88f40721a0 msgr2=0x7f88f406b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fbc697fa640 1 -- 172.21.15.22:0/3655411171 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc640125f0 con 0x7fbc6c0b2080 2023-11-24T06:12:12.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fbc697fa640 1 -- 172.21.15.22:0/3655411171 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64012750 con 0x7fbc6c0b2080 2023-11-24T06:12:12.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fbc697fa640 1 -- 172.21.15.22:0/3655411171 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc640125f0 con 0x7fbc6c0b2080 2023-11-24T06:12:12.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2186673006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed7415a620 msgr2=0x7fed740ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f6cbdffb640 1 -- 172.21.15.22:0/4109464493 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8005ce0 con 0x7f6cc815d100 2023-11-24T06:12:12.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f6cbdffb640 1 -- 172.21.15.22:0/4109464493 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8005e40 con 0x7f6cc815d100 2023-11-24T06:12:12.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f6cbdffb640 1 -- 172.21.15.22:0/4109464493 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80072f0 con 0x7f6cc815d100 2023-11-24T06:12:12.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fed7a3a9640 1 --2- 172.21.15.22:0/2186673006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed7415a620 0x7fed740ae330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fed740ceab0 tx=0x7fed6c02bec0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc80cbc50 con 0x7f6cc815d100 2023-11-24T06:12:12.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc80cc210 con 0x7f6cc815d100 2023-11-24T06:12:12.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2186673006 shutdown_connections 2023-11-24T06:12:12.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fed7a3a9640 1 --2- 172.21.15.22:0/2186673006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed7415a620 0x7fed740ae330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fed7a3a9640 1 --2- 172.21.15.22:0/2186673006 >> v2:172.21.15.22:3300/0 conn(0x7fed74159d00 0x7fed7415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2186673006 >> 172.21.15.22:0/2186673006 conn(0x7fed740709f0 msgr2=0x7fed740718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.589+0000 7f88f8f48640 1 -- 172.21.15.22:0/1322797847 shutdown_connections 2023-11-24T06:12:12.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.589+0000 7f88f8f48640 1 -- 172.21.15.22:0/1322797847 wait complete. 2023-11-24T06:12:12.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.589+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c09b4e0 con 0x7fbc6c0b2080 2023-11-24T06:12:12.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.589+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2186673006 shutdown_connections 2023-11-24T06:12:12.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.590+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6cc80b5f20 con 0x7f6cc815d100 2023-11-24T06:12:12.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.590+0000 7f12f0a77640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f12d0073130 0x7f12d0075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.589+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c09baa0 con 0x7fbc6c0b2080 2023-11-24T06:12:12.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f80b3423640 1 -- 172.21.15.22:0/2413095202 shutdown_connections 2023-11-24T06:12:12.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.590+0000 7f16187b0640 1 Processor -- start 2023-11-24T06:12:12.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.588+0000 7f80b3423640 1 -- 172.21.15.22:0/2413095202 wait complete. 2023-11-24T06:12:12.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.591+0000 7f80b3423640 1 Processor -- start 2023-11-24T06:12:12.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.591+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc6c165860 con 0x7fbc6c0b2080 2023-11-24T06:12:12.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.591+0000 7f16187b0640 1 -- start start 2023-11-24T06:12:12.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.591+0000 7f88f8f48640 1 Processor -- start 2023-11-24T06:12:12.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.591+0000 7f97fffff640 1 -- 172.21.15.22:0/3868200758 <== osd.0 v2:172.21.15.22:6805/3183424560 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f97f8075c00 con 0x7f97f8073130 2023-11-24T06:12:12.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.592+0000 7f88f8f48640 1 -- start start 2023-11-24T06:12:12.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f12e8ff9640 1 -- 172.21.15.22:0/3427848931 <== osd.1 v2:172.21.15.22:6800/3484548105 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f12d0075c00 con 0x7f12d0073130 2023-11-24T06:12:12.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.592+0000 7f16187b0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f161015d770 0x7f16100d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f16187b0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16100d2740 0x7f16100d3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f16187b0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16100d37b0 0x7f16100b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f16187b0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16100d3c30 con 0x7f16100d37b0 2023-11-24T06:12:12.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f16187b0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16100d0b40 con 0x7f16100d2740 2023-11-24T06:12:12.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f16187b0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161015db50 con 0x7f161015d770 2023-11-24T06:12:12.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.592+0000 7f80b3423640 1 -- start start 2023-11-24T06:12:12.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.591+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2186673006 wait complete. 2023-11-24T06:12:12.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f88f8f48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88e00047c0 0x7f88f41f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7fed7a3a9640 1 Processor -- start 2023-11-24T06:12:12.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f80b3423640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80ac06a980 0x7f80ac0b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f80b3423640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac06e320 0x7f80ac09bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f80b3423640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac161aa0 0x7f80ac151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f80b3423640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0b2a50 con 0x7f80ac06a980 2023-11-24T06:12:12.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f80b3423640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0b0320 con 0x7f80ac161aa0 2023-11-24T06:12:12.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f80b3423640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0b0600 con 0x7f80ac06e320 2023-11-24T06:12:12.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7f1616d4d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16100d37b0 0x7f16100b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7f88f8f48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f4141010 0x7f88f4141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7f1616d4d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16100d37b0 0x7f16100b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37710/0 (socket says 172.21.15.22:37710) 2023-11-24T06:12:12.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7f88f8f48640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88f41f0f80 0x7f88f41f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.593+0000 7f6cbdffb640 1 -- 172.21.15.22:0/4109464493 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6cb8007510 con 0x7f6cc815d100 2023-11-24T06:12:12.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7fed7a3a9640 1 -- start start 2023-11-24T06:12:12.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7f161654c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f161015d770 0x7f16100d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7f161654c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f161015d770 0x7f16100d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:36358/0 (socket says 172.21.15.22:36358) 2023-11-24T06:12:12.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7f161654c640 1 -- 172.21.15.22:0/2220350237 learned_addr learned my addr 172.21.15.22:0/2220350237 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7f88f259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88e00047c0 0x7f88f41f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7f1615d4b640 1 --2- 172.21.15.22:0/2220350237 >> v2:172.21.15.31:3300/0 conn(0x7f16100d2740 0x7f16100d3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f88f259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88e00047c0 0x7f88f41f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37724/0 (socket says 172.21.15.22:37724) 2023-11-24T06:12:12.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f88f2d9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88f41f0f80 0x7f88f41f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f88f259c640 1 -- 172.21.15.22:0/1295586885 learned_addr learned my addr 172.21.15.22:0/1295586885 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f1616d4d640 1 -- 172.21.15.22:0/2220350237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f161015d770 msgr2=0x7f16100d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f1616d4d640 1 --2- 172.21.15.22:0/2220350237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f161015d770 0x7f16100d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f1616d4d640 1 -- 172.21.15.22:0/2220350237 >> v2:172.21.15.31:3300/0 conn(0x7f16100d2740 msgr2=0x7f16100d3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f1616d4d640 1 --2- 172.21.15.22:0/2220350237 >> v2:172.21.15.31:3300/0 conn(0x7f16100d2740 0x7f16100d3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f1616d4d640 1 -- 172.21.15.22:0/2220350237 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100d0860 con 0x7f16100d37b0 2023-11-24T06:12:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f80b09be640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac06e320 0x7f80ac09bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f80b11bf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80ac06a980 0x7f80ac0b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f41419d0 con 0x7f88e00047c0 2023-11-24T06:12:12.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7f80b19c0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac161aa0 0x7f80ac151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f6cbdffb640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6cac06af10 0x7f6cac06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f6cbdffb640 1 -- 172.21.15.22:0/4109464493 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cb80892e0 con 0x7f6cc815d100 2023-11-24T06:12:12.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f6cbdffb640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f6cac073130 0x7f6cac075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f6cbdffb640 1 -- 172.21.15.22:0/4109464493 --> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6cac075c00 con 0x7f6cac073130 2023-11-24T06:12:12.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7f6cbdffb640 1 -- 172.21.15.22:0/4109464493 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cb8089690 con 0x7f6cc815d100 2023-11-24T06:12:12.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7f88f1d9b640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f4141010 0x7f88f4141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f41f1940 con 0x7f88f4141010 2023-11-24T06:12:12.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f4154be0 con 0x7f88f41f0f80 2023-11-24T06:12:12.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7f80b19c0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac161aa0 0x7f80ac151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:41182/0 (socket says 172.21.15.22:41182) 2023-11-24T06:12:12.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7f80b19c0640 1 -- 172.21.15.22:0/34411888 learned_addr learned my addr 172.21.15.22:0/34411888 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.594+0000 7fbc697fa640 1 -- 172.21.15.22:0/3655411171 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc640128c0 con 0x7fbc6c0b2080 2023-11-24T06:12:12.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.595+0000 7fbc697fa640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc4c06aea0 0x7fbc4c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7fbc697fa640 1 -- 172.21.15.22:0/3655411171 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc64089770 con 0x7fbc6c0b2080 2023-11-24T06:12:12.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7fbc697fa640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7fbc4c073040 0x7fbc4c075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7f6cccf29640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6cac06af10 0x7f6cac06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.596+0000 7f6ccdf2b640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f6cac073130 0x7f6cac075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f88f259c640 1 -- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88f41f0f80 msgr2=0x7f88f41f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f88f259c640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88f41f0f80 0x7f88f41f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f88f259c640 1 -- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f4141010 msgr2=0x7f88f4141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f88f259c640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f4141010 0x7f88f4141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f88f259c640 1 -- 172.21.15.22:0/1295586885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f41f4e50 con 0x7f88e00047c0 2023-11-24T06:12:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f88f2d9d640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88f41f0f80 0x7f88f41f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f88f1d9b640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f4141010 0x7f88f4141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f80b19c0640 1 -- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac06e320 msgr2=0x7f80ac09bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f80b19c0640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac06e320 0x7f80ac09bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f80b19c0640 1 -- 172.21.15.22:0/34411888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80ac06a980 msgr2=0x7f80ac0b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7fbc70c7c640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc4c06aea0 0x7fbc4c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7fbc697fa640 1 -- 172.21.15.22:0/3655411171 --> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc4c075b10 con 0x7fbc4c073040 2023-11-24T06:12:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7f1616d4d640 1 --2- 172.21.15.22:0/2220350237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16100d37b0 0x7f16100b6760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f16100d43e0 tx=0x7f160802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ff137a38b3b883 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7fbc6bfff640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7fbc4c073040 0x7fbc4c075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.597+0000 7fbc697fa640 1 -- 172.21.15.22:0/3655411171 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc64054790 con 0x7fbc6c0b2080 2023-11-24T06:12:12.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7f6ccdf2b640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f6cac073130 0x7f6cac075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7fed7a3a9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed74159d00 0x7fed741ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7f161554a640 1 -- 172.21.15.22:0/2220350237 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160802e070 con 0x7f16100d37b0 2023-11-24T06:12:12.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7f80b19c0640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80ac06a980 0x7f80ac0b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7f80b19c0640 1 -- 172.21.15.22:0/34411888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8009400 con 0x7f80ac161aa0 2023-11-24T06:12:12.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7f80b11bf640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80ac06a980 0x7f80ac0b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:12.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7f161554a640 1 -- 172.21.15.22:0/2220350237 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16080315a0 con 0x7f16100d37b0 2023-11-24T06:12:12.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7f161554a640 1 -- 172.21.15.22:0/2220350237 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160802e070 con 0x7f16100d37b0 2023-11-24T06:12:12.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7fbc70c7c640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc4c06aea0 0x7fbc4c06d360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c036000 tx=0x7fbc5c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7f88f259c640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88e00047c0 0x7f88f41f4910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00b390 tx=0x7f88dc00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.598+0000 7fed7a3a9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed7415a620 0x7fed740982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7fbc6bfff640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7fbc4c073040 0x7fbc4c075460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7fed73fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed74159d00 0x7fed741ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7f80b19c0640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac161aa0 0x7f80ac151e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f809c00c430 tx=0x7f809c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7fed7a3a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed7415abe0 0x7fed741f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7fed7a3a9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74098810 con 0x7fed7415abe0 2023-11-24T06:12:12.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7fed7a3a9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740b1200 con 0x7fed74159d00 2023-11-24T06:12:12.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7fed7a3a9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740b14e0 con 0x7fed7415a620 2023-11-24T06:12:12.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7fed73fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed74159d00 0x7fed741ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:41198/0 (socket says 172.21.15.22:41198) 2023-11-24T06:12:12.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7fed73fff640 1 -- 172.21.15.22:0/2076607796 learned_addr learned my addr 172.21.15.22:0/2076607796 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7f16187b0640 1 -- 172.21.15.22:0/2220350237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16100d37b0 msgr2=0x7f16100b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7f88eaffd640 1 -- 172.21.15.22:0/1295586885 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011830 con 0x7f88e00047c0 2023-11-24T06:12:12.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7f16187b0640 1 --2- 172.21.15.22:0/2220350237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16100d37b0 0x7f16100b6760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f16100d43e0 tx=0x7f160802b840 comp rx=0 tx=0).stop 2023-11-24T06:12:12.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f6cccf29640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6cac06af10 0x7f6cac06d3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4036000 tx=0x7f6cc403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7f88eaffd640 1 -- 172.21.15.22:0/1295586885 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0119b0 con 0x7f88e00047c0 2023-11-24T06:12:12.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7f88eaffd640 1 -- 172.21.15.22:0/1295586885 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011d60 con 0x7f88e00047c0 2023-11-24T06:12:12.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f4156420 con 0x7f88e00047c0 2023-11-24T06:12:12.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.599+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f41569e0 con 0x7f88e00047c0 2023-11-24T06:12:12.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f6cbdffb640 1 -- 172.21.15.22:0/4109464493 <== osd.2 v2:172.21.15.22:6806/2854052422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6cac075c00 con 0x7f6cac073130 2023-11-24T06:12:12.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7fed78946640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed7415abe0 0x7fed741f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f80a1ffb640 1 -- 172.21.15.22:0/34411888 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c0035f0 con 0x7f80ac161aa0 2023-11-24T06:12:12.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f80a1ffb640 1 -- 172.21.15.22:0/34411888 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c003770 con 0x7f80ac161aa0 2023-11-24T06:12:12.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f80a1ffb640 1 -- 172.21.15.22:0/34411888 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c003b20 con 0x7f80ac161aa0 2023-11-24T06:12:12.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.601+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac0b08e0 con 0x7f80ac161aa0 2023-11-24T06:12:12.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.601+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac0b10e0 con 0x7f80ac161aa0 2023-11-24T06:12:12.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7fed737fe640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed7415a620 0x7fed740982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.601+0000 7fed78946640 1 -- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed7415a620 msgr2=0x7fed740982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.601+0000 7fed78946640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed7415a620 0x7fed740982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.601+0000 7fed78946640 1 -- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed74159d00 msgr2=0x7fed741ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.601+0000 7fed78946640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed74159d00 0x7fed741ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.601+0000 7fed78946640 1 -- 172.21.15.22:0/2076607796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c009a70 con 0x7fed7415abe0 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.601+0000 7fed78946640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed7415abe0 0x7fed741f2310 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fed6c033000 tx=0x7fed6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f16187b0640 1 -- 172.21.15.22:0/2220350237 shutdown_connections 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f16187b0640 1 --2- 172.21.15.22:0/2220350237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16100d37b0 0x7f16100b6760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f16187b0640 1 --2- 172.21.15.22:0/2220350237 >> v2:172.21.15.31:3300/0 conn(0x7f16100d2740 0x7f16100d3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f16187b0640 1 --2- 172.21.15.22:0/2220350237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f161015d770 0x7f16100d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.600+0000 7f16187b0640 1 -- 172.21.15.22:0/2220350237 >> 172.21.15.22:0/2220350237 conn(0x7f16100721a0 msgr2=0x7f161006b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.602+0000 7fbc697fa640 1 -- 172.21.15.22:0/3655411171 <== osd.3 v2:172.21.15.22:6822/2514152945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbc4c075b10 con 0x7fbc4c073040 2023-11-24T06:12:12.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.602+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88f40d1ce0 con 0x7f88e00047c0 2023-11-24T06:12:12.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.602+0000 7f16187b0640 1 -- 172.21.15.22:0/2220350237 shutdown_connections 2023-11-24T06:12:12.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.602+0000 7f16187b0640 1 -- 172.21.15.22:0/2220350237 wait complete. 2023-11-24T06:12:12.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.602+0000 7fed70ff9640 1 -- 172.21.15.22:0/2076607796 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c009450 con 0x7fed7415abe0 2023-11-24T06:12:12.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.602+0000 7fed70ff9640 1 -- 172.21.15.22:0/2076607796 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c003e50 con 0x7fed7415abe0 2023-11-24T06:12:12.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.602+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed740b17c0 con 0x7fed7415abe0 2023-11-24T06:12:12.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.602+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80ac06f130 con 0x7f80ac161aa0 2023-11-24T06:12:12.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.603+0000 7fed70ff9640 1 -- 172.21.15.22:0/2076607796 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c004840 con 0x7fed7415abe0 2023-11-24T06:12:12.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.604+0000 7f16187b0640 1 Processor -- start 2023-11-24T06:12:12.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.604+0000 7f16187b0640 1 -- start start 2023-11-24T06:12:12.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.605+0000 7f16187b0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16100d37b0 0x7f161015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.605+0000 7f16187b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f161015d770 0x7f16100b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.605+0000 7f16187b0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f161014c470 0x7f16100c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.605+0000 7f16187b0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161014d210 con 0x7f161015d770 2023-11-24T06:12:12.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.605+0000 7f16187b0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16100c63c0 con 0x7f161014c470 2023-11-24T06:12:12.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.605+0000 7f16187b0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16100b8e90 con 0x7f16100d37b0 2023-11-24T06:12:12.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.604+0000 7f88eaffd640 1 -- 172.21.15.22:0/1295586885 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88dc01a400 con 0x7f88e00047c0 2023-11-24T06:12:12.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.606+0000 7f88eaffd640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f88d406af10 0x7f88d406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.608+0000 7f80a1ffb640 1 -- 172.21.15.22:0/34411888 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f809c003c80 con 0x7f80ac161aa0 2023-11-24T06:12:12.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.606+0000 7f88eaffd640 1 -- 172.21.15.22:0/1295586885 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88dc089600 con 0x7f88e00047c0 2023-11-24T06:12:12.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.606+0000 7f88eaffd640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f88d4073130 0x7f88d4075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.606+0000 7f88eaffd640 1 -- 172.21.15.22:0/1295586885 --> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88d4075c00 con 0x7f88d4073130 2023-11-24T06:12:12.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.606+0000 7f88eaffd640 1 -- 172.21.15.22:0/1295586885 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88dc08bc20 con 0x7f88e00047c0 2023-11-24T06:12:12.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.607+0000 7f88f2d9d640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f88d4073130 0x7f88d4075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.608+0000 7f88f1d9b640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f88d406af10 0x7f88d406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.605+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed741540e0 con 0x7fed7415abe0 2023-11-24T06:12:12.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.608+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed7406cdf0 con 0x7fed7415abe0 2023-11-24T06:12:12.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.608+0000 7fed70ff9640 1 -- 172.21.15.22:0/2076607796 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed6c03b070 con 0x7fed7415abe0 2023-11-24T06:12:12.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.606+0000 7f161654c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16100d37b0 0x7f161015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.606+0000 7f161654c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16100d37b0 0x7f161015cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:36392/0 (socket says 172.21.15.22:36392) 2023-11-24T06:12:12.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.606+0000 7f161654c640 1 -- 172.21.15.22:0/4085683948 learned_addr learned my addr 172.21.15.22:0/4085683948 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:12.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.607+0000 7f1616d4d640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f161014c470 0x7f16100c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.607+0000 7f1615d4b640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f161015d770 0x7f16100b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.607+0000 7f161654c640 1 -- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f161014c470 msgr2=0x7f16100c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.607+0000 7f161654c640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f161014c470 0x7f16100c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.607+0000 7f161654c640 1 -- 172.21.15.22:0/4085683948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f161015d770 msgr2=0x7f16100b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.607+0000 7f161654c640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f161015d770 0x7f16100b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.607+0000 7f161654c640 1 -- 172.21.15.22:0/4085683948 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1608009400 con 0x7f16100d37b0 2023-11-24T06:12:12.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.608+0000 7f161654c640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16100d37b0 0x7f161015cc60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f160400e840 tx=0x7f160400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.609+0000 7f160effd640 1 -- 172.21.15.22:0/4085683948 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160400c8e0 con 0x7f16100d37b0 2023-11-24T06:12:12.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.609+0000 7f160effd640 1 -- 172.21.15.22:0/4085683948 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160400ca40 con 0x7f16100d37b0 2023-11-24T06:12:12.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.609+0000 7f160effd640 1 -- 172.21.15.22:0/4085683948 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160400cdf0 con 0x7f16100d37b0 2023-11-24T06:12:12.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.609+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161015c2e0 con 0x7f16100d37b0 2023-11-24T06:12:12.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.609+0000 7f80a1ffb640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f809006ae90 0x7f809006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7f88f2d9d640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f88d4073130 0x7f88d4075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7fed70ff9640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fed6006ae40 0x7fed6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16100b4ac0 con 0x7f16100d37b0 2023-11-24T06:12:12.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7f80a1ffb640 1 -- 172.21.15.22:0/34411888 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f809c058150 con 0x7f80ac161aa0 2023-11-24T06:12:12.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7f80a1ffb640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f8090073cc0 0x7f8090076160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7f80a1ffb640 1 -- 172.21.15.22:0/34411888 --> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8090076830 con 0x7f8090073cc0 2023-11-24T06:12:12.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7f88f1d9b640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f88d406af10 0x7f88d406d3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88e4034000 tx=0x7f88e4009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7f80b11bf640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f809006ae90 0x7f809006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7fed70ff9640 1 -- 172.21.15.22:0/2076607796 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed6c0abaa0 con 0x7fed7415abe0 2023-11-24T06:12:12.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7fed70ff9640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fed60072fe0 0x7fed60075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7fed70ff9640 1 -- 172.21.15.22:0/2076607796 --> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed60075ab0 con 0x7fed60072fe0 2023-11-24T06:12:12.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.610+0000 7fed70ff9640 1 -- 172.21.15.22:0/2076607796 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed6c0b02a0 con 0x7fed7415abe0 2023-11-24T06:12:12.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.611+0000 7f80b09be640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f8090073cc0 0x7f8090076160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.611+0000 7fed73fff640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fed6006ae40 0x7fed6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.611+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16100b9000 con 0x7f16100d37b0 2023-11-24T06:12:12.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.611+0000 7fed737fe640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fed60072fe0 0x7fed60075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.611+0000 7f80a1ffb640 1 -- 172.21.15.22:0/34411888 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f809c007ea0 con 0x7f80ac161aa0 2023-11-24T06:12:12.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.611+0000 7f80b11bf640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f809006ae90 0x7f809006d350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80a40012e0 tx=0x7f80a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.612+0000 7f80b09be640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f8090073cc0 0x7f8090076160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.612+0000 7fed73fff640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fed6006ae40 0x7fed6006d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed64009a40 tx=0x7fed640091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.613+0000 7f88eaffd640 1 -- 172.21.15.22:0/1295586885 <== osd.5 v2:172.21.15.31:6816/2704270440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f88d4075c00 con 0x7f88d4073130 2023-11-24T06:12:12.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.613+0000 7f160effd640 1 -- 172.21.15.22:0/4085683948 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1604005990 con 0x7f16100d37b0 2023-11-24T06:12:12.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.614+0000 7fed737fe640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fed60072fe0 0x7fed60075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.615+0000 7f160effd640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f15fc06af40 0x7f15fc06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.615+0000 7f80a1ffb640 1 -- 172.21.15.22:0/34411888 <== osd.4 v2:172.21.15.31:6802/2142081467 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8090076830 con 0x7f8090073cc0 2023-11-24T06:12:12.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.615+0000 7f160effd640 1 -- 172.21.15.22:0/4085683948 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f160409a8e0 con 0x7f16100d37b0 2023-11-24T06:12:12.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.615+0000 7f1615d4b640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f15fc06af40 0x7f15fc06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.617+0000 7fed70ff9640 1 -- 172.21.15.22:0/2076607796 <== osd.6 v2:172.21.15.31:6800/1824539617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fed60075ab0 con 0x7fed60072fe0 2023-11-24T06:12:12.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.617+0000 7f160effd640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f15fc073160 0x7f15fc075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:12.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.617+0000 7f1615d4b640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f15fc06af40 0x7f15fc06d400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f161014db30 tx=0x7f160000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.618+0000 7f160effd640 1 -- 172.21.15.22:0/4085683948 --> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15fc075c30 con 0x7f15fc073160 2023-11-24T06:12:12.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.618+0000 7f160effd640 1 -- 172.21.15.22:0/4085683948 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f160409ac90 con 0x7f16100d37b0 2023-11-24T06:12:12.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.618+0000 7f1616d4d640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f15fc073160 0x7f15fc075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:12.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.622+0000 7f1616d4d640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f15fc073160 0x7f15fc075580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:12.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.623+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 --> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc6c0ad310 con 0x7fbc4c073040 2023-11-24T06:12:12.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.625+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 --> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f980c050170 con 0x7f97f8073130 2023-11-24T06:12:12.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.625+0000 7fbc697fa640 1 -- 172.21.15.22:0/3655411171 <== osd.3 v2:172.21.15.22:6822/2514152945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc540041a0 con 0x7fbc4c073040 2023-11-24T06:12:12.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.625+0000 7f160effd640 1 -- 172.21.15.22:0/4085683948 <== osd.7 v2:172.21.15.31:6820/682432999 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f15fc075c30 con 0x7f15fc073160 2023-11-24T06:12:12.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 --> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f12e4005290 con 0x7f12d0073130 2023-11-24T06:12:12.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7fbc4c073040 msgr2=0x7fbc4c075460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7fbc72ee0640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7fbc4c073040 0x7fbc4c075460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc4c06aea0 msgr2=0x7fbc4c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7fbc72ee0640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc4c06aea0 0x7fbc4c06d360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c036000 tx=0x7fbc5c030000 comp rx=0 tx=0).stop 2023-11-24T06:12:12.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c0b2080 msgr2=0x7fbc6c0afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7fbc72ee0640 1 --2- 172.21.15.22:0/3655411171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc6c0b2080 0x7fbc6c0afdf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400d5d0 tx=0x7fbc6400da90 comp rx=0 tx=0).stop 2023-11-24T06:12:12.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7fbc7147d640 1 -- 172.21.15.22:0/3655411171 reap_dead start 2023-11-24T06:12:12.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 shutdown_connections 2023-11-24T06:12:12.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.626+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 >> 172.21.15.22:0/3655411171 conn(0x7fbc6c0b0d80 msgr2=0x7fbc6c165150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.627+0000 7f12e8ff9640 1 -- 172.21.15.22:0/3427848931 <== osd.1 v2:172.21.15.22:6800/3484548105 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f12e4005290 con 0x7f12d0073130 2023-11-24T06:12:12.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.627+0000 7f97fffff640 1 -- 172.21.15.22:0/3868200758 <== osd.0 v2:172.21.15.22:6805/3183424560 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9808031910 con 0x7f97f8073130 2023-11-24T06:12:12.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.627+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 shutdown_connections 2023-11-24T06:12:12.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.627+0000 7fbc72ee0640 1 -- 172.21.15.22:0/3655411171 wait complete. 2023-11-24T06:12:12.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.627+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f97f8073130 msgr2=0x7f97f8075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.627+0000 7f9818fd0640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f97f8073130 0x7f97f8075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f97f806af10 msgr2=0x7f97f806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f9818fd0640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f97f806af10 0x7f97f806d3d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9800005880 tx=0x7f9800009040 comp rx=0 tx=0).stop 2023-11-24T06:12:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c0eacd0 msgr2=0x7f980c04f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f9818fd0640 1 --2- 172.21.15.22:0/3868200758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f980c0eacd0 0x7f980c04f520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9814069dd0 tx=0x7f9814067fe0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f9813fff640 1 -- 172.21.15.22:0/3868200758 reap_dead start 2023-11-24T06:12:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f12d0073130 msgr2=0x7f12d0075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f12f1278640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f12d0073130 0x7f12d0075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 shutdown_connections 2023-11-24T06:12:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 >> 172.21.15.22:0/3868200758 conn(0x7f980c009f80 msgr2=0x7f980c049b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f12d006af10 msgr2=0x7f12d006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.628+0000 7f12f1278640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f12d006af10 0x7f12d006d3d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12e404e4c0 tx=0x7f12e0009240 comp rx=0 tx=0).stop 2023-11-24T06:12:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.629+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e40380e0 msgr2=0x7f12e4180d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.629+0000 7f12f1278640 1 --2- 172.21.15.22:0/3427848931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e40380e0 0x7f12e4180d20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f12ec050140 tx=0x7f12ec068480 comp rx=0 tx=0).stop 2023-11-24T06:12:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.629+0000 7f12f0a77640 1 -- 172.21.15.22:0/3427848931 reap_dead start 2023-11-24T06:12:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.629+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 shutdown_connections 2023-11-24T06:12:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.629+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 >> 172.21.15.22:0/3427848931 conn(0x7f12e4009f80 msgr2=0x7f12e404f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.629+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 shutdown_connections 2023-11-24T06:12:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.629+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 shutdown_connections 2023-11-24T06:12:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.629+0000 7f12f1278640 1 -- 172.21.15.22:0/3427848931 wait complete. 2023-11-24T06:12:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.629+0000 7f9818fd0640 1 -- 172.21.15.22:0/3868200758 wait complete. 2023-11-24T06:12:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.640+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 --> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6cc80cec80 con 0x7f6cac073130 2023-11-24T06:12:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.642+0000 7f6cbdffb640 1 -- 172.21.15.22:0/4109464493 <== osd.2 v2:172.21.15.22:6806/2854052422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6cc000f040 con 0x7f6cac073130 2023-11-24T06:12:12.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.643+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f6cac073130 msgr2=0x7f6cac075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.643+0000 7f6cce72c640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f6cac073130 0x7f6cac075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.644+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6cac06af10 msgr2=0x7f6cac06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.644+0000 7f6cce72c640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6cac06af10 0x7f6cac06d3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4036000 tx=0x7f6cc403d040 comp rx=0 tx=0).stop 2023-11-24T06:12:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.644+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d100 msgr2=0x7f6cc815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.644+0000 7f6cce72c640 1 --2- 172.21.15.22:0/4109464493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6cc815d100 0x7f6cc815baf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c410 tx=0x7f6cb800c8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.644+0000 7f6ccdf2b640 1 -- 172.21.15.22:0/4109464493 reap_dead start 2023-11-24T06:12:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.646+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 --> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88f4074770 con 0x7f88d4073130 2023-11-24T06:12:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.646+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 shutdown_connections 2023-11-24T06:12:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.646+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 >> 172.21.15.22:0/4109464493 conn(0x7f6cc809c3d0 msgr2=0x7f6cc80b7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.647+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 shutdown_connections 2023-11-24T06:12:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.647+0000 7f6cce72c640 1 -- 172.21.15.22:0/4109464493 wait complete. 2023-11-24T06:12:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.647+0000 7f88eaffd640 1 -- 172.21.15.22:0/1295586885 <== osd.5 v2:172.21.15.31:6816/2704270440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f88f4074770 con 0x7f88d4073130 2023-11-24T06:12:12.673 INFO:teuthology.orchestra.run.smithi022.stdout:64424509446 2023-11-24T06:12:12.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T06:12:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.649+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 --> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fed741542d0 con 0x7fed60072fe0 2023-11-24T06:12:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.650+0000 7fed70ff9640 1 -- 172.21.15.22:0/2076607796 <== osd.6 v2:172.21.15.31:6800/1824539617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fed741542d0 con 0x7fed60072fe0 2023-11-24T06:12:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.651+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fed60072fe0 msgr2=0x7fed60075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.651+0000 7fed7a3a9640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fed60072fe0 0x7fed60075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.651+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f88d4073130 msgr2=0x7f88d4075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.651+0000 7f88f8f48640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f88d4073130 0x7f88d4075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f88d406af10 msgr2=0x7f88d406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f88f8f48640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f88d406af10 0x7f88d406d3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88e4034000 tx=0x7f88e4009000 comp rx=0 tx=0).stop 2023-11-24T06:12:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88e00047c0 msgr2=0x7f88f41f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f88f8f48640 1 --2- 172.21.15.22:0/1295586885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88e00047c0 0x7f88f41f4910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00b390 tx=0x7f88dc00b850 comp rx=0 tx=0).stop 2023-11-24T06:12:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f88f2d9d640 1 -- 172.21.15.22:0/1295586885 reap_dead start 2023-11-24T06:12:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fed6006ae40 msgr2=0x7fed6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7fed7a3a9640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fed6006ae40 0x7fed6006d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed64009a40 tx=0x7fed640091c0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed7415abe0 msgr2=0x7fed741f2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7fed7a3a9640 1 --2- 172.21.15.22:0/2076607796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed7415abe0 0x7fed741f2310 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fed6c033000 tx=0x7fed6c004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7fed78946640 1 -- 172.21.15.22:0/2076607796 reap_dead start 2023-11-24T06:12:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 shutdown_connections 2023-11-24T06:12:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 >> 172.21.15.22:0/1295586885 conn(0x7f88f40721a0 msgr2=0x7f88f40b4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 shutdown_connections 2023-11-24T06:12:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 >> 172.21.15.22:0/2076607796 conn(0x7fed740709f0 msgr2=0x7fed740b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 shutdown_connections 2023-11-24T06:12:12.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 shutdown_connections 2023-11-24T06:12:12.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f88f8f48640 1 -- 172.21.15.22:0/1295586885 wait complete. 2023-11-24T06:12:12.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7fed7a3a9640 1 -- 172.21.15.22:0/2076607796 wait complete. 2023-11-24T06:12:12.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.652+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 --> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80ac161e80 con 0x7f8090073cc0 2023-11-24T06:12:12.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.654+0000 7f80a1ffb640 1 -- 172.21.15.22:0/34411888 <== osd.4 v2:172.21.15.31:6802/2142081467 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f80a8030bb0 con 0x7f8090073cc0 2023-11-24T06:12:12.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.655+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f8090073cc0 msgr2=0x7f8090076160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.655+0000 7f80b3423640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f8090073cc0 0x7f8090076160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.655+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f809006ae90 msgr2=0x7f809006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.655+0000 7f80b3423640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f809006ae90 0x7f809006d350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80a40012e0 tx=0x7f80a4009040 comp rx=0 tx=0).stop 2023-11-24T06:12:12.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.655+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac161aa0 msgr2=0x7f80ac151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.655+0000 7f80b3423640 1 --2- 172.21.15.22:0/34411888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac161aa0 0x7f80ac151e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f809c00c430 tx=0x7f809c00c8f0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.680 INFO:teuthology.orchestra.run.smithi022.stdout:64424509447 2023-11-24T06:12:12.680 INFO:teuthology.orchestra.run.smithi022.stdout:60129542151 2023-11-24T06:12:12.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.657+0000 7f80b19c0640 1 -- 172.21.15.22:0/34411888 reap_dead start 2023-11-24T06:12:12.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.657+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 shutdown_connections 2023-11-24T06:12:12.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.657+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 >> 172.21.15.22:0/34411888 conn(0x7f80ac0cff80 msgr2=0x7f80ac1604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.657+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 shutdown_connections 2023-11-24T06:12:12.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.657+0000 7f80b3423640 1 -- 172.21.15.22:0/34411888 wait complete. 2023-11-24T06:12:12.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T06:12:12.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T06:12:12.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.661+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 --> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16100d1ce0 con 0x7f15fc073160 2023-11-24T06:12:12.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.662+0000 7f160effd640 1 -- 172.21.15.22:0/4085683948 <== osd.7 v2:172.21.15.31:6820/682432999 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1608043040 con 0x7f15fc073160 2023-11-24T06:12:12.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f15fc073160 msgr2=0x7f15fc075580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f16187b0640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f15fc073160 0x7f15fc075580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:12.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f15fc06af40 msgr2=0x7f15fc06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f16187b0640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f15fc06af40 0x7f15fc06d400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f161014db30 tx=0x7f160000b040 comp rx=0 tx=0).stop 2023-11-24T06:12:12.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16100d37b0 msgr2=0x7f161015cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:12.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f16187b0640 1 --2- 172.21.15.22:0/4085683948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16100d37b0 0x7f161015cc60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f160400e840 tx=0x7f160400ed00 comp rx=0 tx=0).stop 2023-11-24T06:12:12.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f1616d4d640 1 -- 172.21.15.22:0/4085683948 reap_dead start 2023-11-24T06:12:12.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 shutdown_connections 2023-11-24T06:12:12.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 >> 172.21.15.22:0/4085683948 conn(0x7f16100721a0 msgr2=0x7f16100cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:12.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.663+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 shutdown_connections 2023-11-24T06:12:12.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:12.664+0000 7f16187b0640 1 -- 172.21.15.22:0/4085683948 wait complete. 2023-11-24T06:12:12.685 INFO:teuthology.orchestra.run.smithi022.stdout:64424509446 2023-11-24T06:12:12.686 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T06:12:12.686 INFO:teuthology.orchestra.run.smithi022.stdout:64424509446 2023-11-24T06:12:12.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T06:12:12.687 INFO:teuthology.orchestra.run.smithi022.stdout:68719476743 2023-11-24T06:12:12.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T06:12:12.688 INFO:teuthology.orchestra.run.smithi022.stdout:64424509446 2023-11-24T06:12:12.689 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T06:12:12.689 INFO:teuthology.orchestra.run.smithi022.stdout:64424509447 2023-11-24T06:12:12.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T06:12:13.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.027+0000 7fa7d68ad640 1 Processor -- start 2023-11-24T06:12:13.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.027+0000 7fa7d68ad640 1 -- start start 2023-11-24T06:12:13.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.030+0000 7fa7d68ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7d015aea0 0x7fa7d0141280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.030+0000 7fa7d68ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d006f210 0x7fa7d00cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.030+0000 7fa7d68ad640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d00cfa00 con 0x7fa7d015b280 2023-11-24T06:12:13.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.030+0000 7fa7d68ad640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d015fc20 con 0x7fa7d015aea0 2023-11-24T06:12:13.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.030+0000 7fa7d68ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d01417c0 con 0x7fa7d006f210 2023-11-24T06:12:13.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.030+0000 7fa7cf7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa7d015b280 0x7fa7d006eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:39798/0 (socket says 172.21.15.22:39798) 2023-11-24T06:12:13.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.031+0000 7fa7cf7fe640 1 -- 172.21.15.22:0/466731681 learned_addr learned my addr 172.21.15.22:0/466731681 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:13.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.031+0000 7fa7d4e4a640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d006f210 0x7fa7d00cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.031+0000 7fa7cffff640 1 --2- 172.21.15.22:0/466731681 >> v2:172.21.15.31:3300/0 conn(0x7fa7d015aea0 0x7fa7d0141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.031+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620905482 0 0) 0x7fa7d00cfa00 con 0x7fa7d015b280 2023-11-24T06:12:13.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.032+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7b8003520 con 0x7fa7d015b280 2023-11-24T06:12:13.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.034+0000 7fea0443d640 1 Processor -- start 2023-11-24T06:12:13.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.034+0000 7fea0443d640 1 -- start start 2023-11-24T06:12:13.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821590926 0 0) 0x7fa7b8003520 con 0x7fa7d015b280 2023-11-24T06:12:13.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d006f210 msgr2=0x7fa7d00cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d006f210 0x7fa7d00cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 >> v2:172.21.15.31:3300/0 conn(0x7fa7d015aea0 msgr2=0x7fa7d0141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 --2- 172.21.15.22:0/466731681 >> v2:172.21.15.31:3300/0 conn(0x7fa7d015aea0 0x7fa7d0141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d015f0a0 con 0x7fa7d015b280 2023-11-24T06:12:13.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fa7c4001670 con 0x7fa7d015b280 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 >> v1:172.21.15.31:6789/0 conn(0x7fa7d015b280 legacy=0x7fa7d006eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7b8003970 0x7fa7b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7b80047c0 0x7fa7b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8009970 0x7fa7b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d015fc20 con 0x7fa7b8009970 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d01417c0 con 0x7fa7b80047c0 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.033+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80146b0 con 0x7fa7b8003970 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.034+0000 7fa7cf7fe640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7b80047c0 0x7fa7b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.034+0000 7fa7d4e4a640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8009970 0x7fa7b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.035+0000 7fa7d4e4a640 1 -- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7b8003970 msgr2=0x7fa7b8003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.035+0000 7fa7d4e4a640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7b8003970 0x7fa7b8003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.035+0000 7fa7d4e4a640 1 -- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7b80047c0 msgr2=0x7fa7b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.035+0000 7fa7d4e4a640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7b80047c0 0x7fa7b8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.035+0000 7fa7d4e4a640 1 -- 172.21.15.22:0/466731681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8003520 con 0x7fa7b8009970 2023-11-24T06:12:13.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.036+0000 7fea0443d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 0x7fe9fc0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.036+0000 7fea0443d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9fc0ce010 0x7fe9fc13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.036+0000 7fea0443d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc0ce460 con 0x7fe9fc13e120 2023-11-24T06:12:13.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.036+0000 7fea0443d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc15c440 con 0x7fe9fc0ce010 2023-11-24T06:12:13.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.036+0000 7fea0443d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc13e500 con 0x7fe9fc0b07d0 2023-11-24T06:12:13.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.037+0000 7fea021d9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe9fc13e120 0x7fe9fc06ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53342/0 (socket says 172.21.15.22:53342) 2023-11-24T06:12:13.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.037+0000 7fea021d9640 1 -- 172.21.15.22:0/130996763 learned_addr learned my addr 172.21.15.22:0/130996763 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:13.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.037+0000 7fea029da640 1 --2- 172.21.15.22:0/130996763 >> v2:172.21.15.31:3300/0 conn(0x7fe9fc0ce010 0x7fe9fc13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.037+0000 7fea019d8640 1 --2- 172.21.15.22:0/130996763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 0x7fe9fc0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.038+0000 7fa7d4e4a640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8009970 0x7fa7b8005180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0144d40 tx=0x7fa7b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9a35a2040616da server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.038+0000 7fea011d7640 1 -- 172.21.15.22:0/130996763 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331669208 0 0) 0x7fe9fc0ce460 con 0x7fe9fc13e120 2023-11-24T06:12:13.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.038+0000 7fea011d7640 1 -- 172.21.15.22:0/130996763 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e8003520 con 0x7fe9fc13e120 2023-11-24T06:12:13.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.038+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c802cb00 con 0x7fa7b8009970 2023-11-24T06:12:13.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.038+0000 7fea019d8640 1 -- 172.21.15.22:0/130996763 >> v2:172.21.15.31:3300/0 conn(0x7fe9fc0ce010 msgr2=0x7fe9fc13e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.039+0000 7fea019d8640 1 --2- 172.21.15.22:0/130996763 >> v2:172.21.15.31:3300/0 conn(0x7fe9fc0ce010 0x7fe9fc13e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.039+0000 7fea019d8640 1 -- 172.21.15.22:0/130996763 >> v1:172.21.15.22:6789/0 conn(0x7fe9fc13e120 legacy=0x7fe9fc06ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.039+0000 7fea019d8640 1 -- 172.21.15.22:0/130996763 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc15b7c0 con 0x7fe9fc0b07d0 2023-11-24T06:12:13.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.039+0000 7fea029da640 1 --2- 172.21.15.22:0/130996763 >> v2:172.21.15.31:3300/0 conn(0x7fe9fc0ce010 0x7fe9fc13e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:13.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.039+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c800f040 con 0x7fa7b8009970 2023-11-24T06:12:13.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.039+0000 7fa7ceffd640 1 -- 172.21.15.22:0/466731681 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c802cea0 con 0x7fa7b8009970 2023-11-24T06:12:13.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.041+0000 7fea019d8640 1 --2- 172.21.15.22:0/130996763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 0x7fe9fc0cdad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80097a0 tx=0x7fe9f802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d543fcdf703380f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.040+0000 7fa7d68ad640 1 -- 172.21.15.22:0/466731681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8009970 msgr2=0x7fa7b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.040+0000 7fa7d68ad640 1 --2- 172.21.15.22:0/466731681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8009970 0x7fa7b8005180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0144d40 tx=0x7fa7b80057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.041+0000 7fa7d4e4a640 1 -- 172.21.15.22:0/466731681 reap_dead start 2023-11-24T06:12:13.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.041+0000 7fa7d68ad640 1 -- 172.21.15.22:0/466731681 shutdown_connections 2023-11-24T06:12:13.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.041+0000 7fa7d68ad640 1 -- 172.21.15.22:0/466731681 >> 172.21.15.22:0/466731681 conn(0x7fa7d00663d0 msgr2=0x7fa7d00667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.041+0000 7fa7d68ad640 1 -- 172.21.15.22:0/466731681 shutdown_connections 2023-11-24T06:12:13.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.041+0000 7fa7d68ad640 1 -- 172.21.15.22:0/466731681 wait complete. 2023-11-24T06:12:13.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.042+0000 7fea011d7640 1 -- 172.21.15.22:0/130996763 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f802e070 con 0x7fe9fc0b07d0 2023-11-24T06:12:13.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.042+0000 7fea011d7640 1 -- 172.21.15.22:0/130996763 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f80315a0 con 0x7fe9fc0b07d0 2023-11-24T06:12:13.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.042+0000 7fea011d7640 1 -- 172.21.15.22:0/130996763 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8031970 con 0x7fe9fc0b07d0 2023-11-24T06:12:13.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.043+0000 7fea0443d640 1 -- 172.21.15.22:0/130996763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 msgr2=0x7fe9fc0cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.043+0000 7fea0443d640 1 --2- 172.21.15.22:0/130996763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 0x7fe9fc0cdad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80097a0 tx=0x7fe9f802b840 comp rx=0 tx=0).stop 2023-11-24T06:12:13.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.044+0000 7fea0443d640 1 -- 172.21.15.22:0/130996763 shutdown_connections 2023-11-24T06:12:13.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.044+0000 7fea0443d640 1 --2- 172.21.15.22:0/130996763 >> v2:172.21.15.31:3300/0 conn(0x7fe9fc0ce010 0x7fe9fc13e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.044+0000 7fea0443d640 1 --2- 172.21.15.22:0/130996763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 0x7fe9fc0cdad0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.044+0000 7fea0443d640 1 -- 172.21.15.22:0/130996763 >> 172.21.15.22:0/130996763 conn(0x7fe9fc0663d0 msgr2=0x7fe9fc0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.045+0000 7fea0443d640 1 -- 172.21.15.22:0/130996763 shutdown_connections 2023-11-24T06:12:13.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.045+0000 7fec975f5640 1 Processor -- start 2023-11-24T06:12:13.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.044+0000 7fa7d68ad640 1 Processor -- start 2023-11-24T06:12:13.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.045+0000 7fa7d68ad640 1 -- start start 2023-11-24T06:12:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.045+0000 7fec975f5640 1 -- start start 2023-11-24T06:12:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.046+0000 7fdeba924640 1 Processor -- start 2023-11-24T06:12:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.046+0000 7fdeba924640 1 -- start start 2023-11-24T06:12:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.047+0000 7fa7d68ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d0157650 0x7fa7d006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.047+0000 7fa7d68ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d006bb00 0x7fa7d0158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.045+0000 7fea0443d640 1 -- 172.21.15.22:0/130996763 wait complete. 2023-11-24T06:12:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.047+0000 7fec975f5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec900ce260 0x7fec900d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.047+0000 7fec975f5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec900d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.047+0000 7fec975f5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9015d8b0 con 0x7fec9015d4d0 2023-11-24T06:12:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.047+0000 7fec975f5640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec900b91b0 con 0x7fec900ce260 2023-11-24T06:12:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.047+0000 7fec975f5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec900b2400 con 0x7fec900ce6a0 2023-11-24T06:12:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.048+0000 7fa7d68ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d0158d40 0x7fa7d01591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.048+0000 7fea0443d640 1 Processor -- start 2023-11-24T06:12:13.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.048+0000 7fa7cffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d0157650 0x7fa7d006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.048+0000 7fea0443d640 1 -- start start 2023-11-24T06:12:13.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.048+0000 7fdeba924640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdeb415d4d0 0x7fdeb40cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.048+0000 7fa7cffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d0157650 0x7fa7d006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:36406/0 (socket says 172.21.15.22:36406) 2023-11-24T06:12:13.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.048+0000 7fec95391640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fec9015d4d0 0x7fec900cda70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:39810/0 (socket says 172.21.15.22:39810) 2023-11-24T06:12:13.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.048+0000 7fec95391640 1 -- 172.21.15.22:0/1964917400 learned_addr learned my addr 172.21.15.22:0/1964917400 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:13.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.048+0000 7fdeba924640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40d1f60 0x7fdeb40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fdeba924640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb415d8b0 con 0x7fdeb40ce260 2023-11-24T06:12:13.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fdeba924640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb40b91b0 con 0x7fdeb415d4d0 2023-11-24T06:12:13.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fdeba924640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40cdfb0 con 0x7fdeb40d1f60 2023-11-24T06:12:13.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fec95b92640 1 --2- 172.21.15.22:0/1964917400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec900d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fec94b90640 1 --2- 172.21.15.22:0/1964917400 >> v2:172.21.15.22:3300/0 conn(0x7fec900ce260 0x7fec900d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fa7cf7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d006bb00 0x7fa7d0158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fa7cf7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d006bb00 0x7fa7d0158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:41228/0 (socket says 172.21.15.22:41228) 2023-11-24T06:12:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fa7d4e4a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d0158d40 0x7fa7d01591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fdeb37fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdeb40ce260 0x7fdeb40d1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53354/0 (socket says 172.21.15.22:53354) 2023-11-24T06:12:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fdeb37fe640 1 -- 172.21.15.22:0/2598867209 learned_addr learned my addr 172.21.15.22:0/2598867209 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:13.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fec87fff640 1 -- 172.21.15.22:0/1964917400 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641475467 0 0) 0x7fec9015d8b0 con 0x7fec9015d4d0 2023-11-24T06:12:13.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.049+0000 7fec87fff640 1 -- 172.21.15.22:0/1964917400 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec7c003520 con 0x7fec9015d4d0 2023-11-24T06:12:13.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fdeb3fff640 1 --2- 172.21.15.22:0/2598867209 >> v2:172.21.15.31:3300/0 conn(0x7fdeb415d4d0 0x7fdeb40cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fdeb8ec1640 1 --2- 172.21.15.22:0/2598867209 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40d1f60 0x7fdeb40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fa7d4e4a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d0158d40 0x7fa7d01591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37780/0 (socket says 172.21.15.22:37780) 2023-11-24T06:12:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fa7d4e4a640 1 -- 172.21.15.22:0/1909061262 learned_addr learned my addr 172.21.15.22:0/1909061262 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fec95b92640 1 -- 172.21.15.22:0/1964917400 >> v2:172.21.15.22:3300/0 conn(0x7fec900ce260 msgr2=0x7fec900d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fec95b92640 1 --2- 172.21.15.22:0/1964917400 >> v2:172.21.15.22:3300/0 conn(0x7fec900ce260 0x7fec900d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fec95b92640 1 -- 172.21.15.22:0/1964917400 >> v1:172.21.15.31:6789/0 conn(0x7fec9015d4d0 legacy=0x7fec900cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fec95b92640 1 -- 172.21.15.22:0/1964917400 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec900b26e0 con 0x7fec900ce6a0 2023-11-24T06:12:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fea0443d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 0x7fe9fc0b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fea0443d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9fc0ce010 0x7fe9fc157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fea0443d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc13e120 0x7fe9fc0b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fea0443d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0b34b0 con 0x7fe9fc0ce010 2023-11-24T06:12:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fea0443d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0b52e0 con 0x7fe9fc13e120 2023-11-24T06:12:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.050+0000 7fea0443d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0b3dc0 con 0x7fe9fc0b07d0 2023-11-24T06:12:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d006bf80 con 0x7fa7d0158d40 2023-11-24T06:12:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d015e410 con 0x7fa7d006bb00 2023-11-24T06:12:13.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fea019d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9fc0ce010 0x7fe9fc157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fea021d9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 0x7fe9fc0b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fea019d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9fc0ce010 0x7fe9fc157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37796/0 (socket says 172.21.15.22:37796) 2023-11-24T06:12:13.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.052+0000 7fea019d8640 1 -- 172.21.15.22:0/1197256678 learned_addr learned my addr 172.21.15.22:0/1197256678 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.052+0000 7fea029da640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc13e120 0x7fe9fc0b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.052+0000 7f3606768640 1 Processor -- start 2023-11-24T06:12:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.052+0000 7f3606768640 1 -- start start 2023-11-24T06:12:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.053+0000 7fea019d8640 1 -- 172.21.15.22:0/1197256678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 msgr2=0x7fe9fc0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.053+0000 7fea019d8640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 0x7fe9fc0b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fdeb3fff640 1 -- 172.21.15.22:0/2598867209 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40d1f60 msgr2=0x7fdeb40b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fdeb3fff640 1 --2- 172.21.15.22:0/2598867209 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40d1f60 0x7fdeb40b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fdeb3fff640 1 -- 172.21.15.22:0/2598867209 >> v1:172.21.15.22:6789/0 conn(0x7fdeb40ce260 legacy=0x7fdeb40d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fdeb3fff640 1 -- 172.21.15.22:0/2598867209 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb40b2400 con 0x7fdeb415d4d0 2023-11-24T06:12:13.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.051+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d015d890 con 0x7fa7d0157650 2023-11-24T06:12:13.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.053+0000 7fec95b92640 1 --2- 172.21.15.22:0/1964917400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec900d1d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec88009d90 tx=0x7fec8802bc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8772b564da294e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.053+0000 7fea019d8640 1 -- 172.21.15.22:0/1197256678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc13e120 msgr2=0x7fe9fc0b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.053+0000 7fea019d8640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc13e120 0x7fe9fc0b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.053+0000 7fea019d8640 1 -- 172.21.15.22:0/1197256678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8009400 con 0x7fe9fc0ce010 2023-11-24T06:12:13.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.053+0000 7fec87fff640 1 -- 172.21.15.22:0/1964917400 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c001670 con 0x7fec900ce6a0 2023-11-24T06:12:13.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fdeb3fff640 1 --2- 172.21.15.22:0/2598867209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb415d4d0 0x7fdeb40cda70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdea40097a0 tx=0x7fdea402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d44bf6f23d56e3da server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fec87fff640 1 -- 172.21.15.22:0/1964917400 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8802c7c0 con 0x7fec900ce6a0 2023-11-24T06:12:13.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fec87fff640 1 -- 172.21.15.22:0/1964917400 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8802cb50 con 0x7fec900ce6a0 2023-11-24T06:12:13.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7f013b5d5640 1 Processor -- start 2023-11-24T06:12:13.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fea019d8640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9fc0ce010 0x7fe9fc157fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8034040 tx=0x7fe9f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7f013b5d5640 1 -- start start 2023-11-24T06:12:13.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fe9f2ffd640 1 -- 172.21.15.22:0/1197256678 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8032840 con 0x7fe9fc0ce010 2023-11-24T06:12:13.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fa7d4e4a640 1 -- 172.21.15.22:0/1909061262 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d0157650 msgr2=0x7fa7d006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fa7d4e4a640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d0157650 0x7fa7d006b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fa7d4e4a640 1 -- 172.21.15.22:0/1909061262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d006bb00 msgr2=0x7fa7d0158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fa7d4e4a640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d006bb00 0x7fa7d0158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7fa7d4e4a640 1 -- 172.21.15.22:0/1909061262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d015db70 con 0x7fa7d0158d40 2023-11-24T06:12:13.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7f3606768640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36000cec60 0x7f36000b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7f3606768640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3600070ae0 0x7f3600070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7f3606768640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36000cea90 con 0x7f360015d610 2023-11-24T06:12:13.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7f3606768640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3600071430 con 0x7f36000cec60 2023-11-24T06:12:13.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.054+0000 7f3606768640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36000ce7b0 con 0x7f3600070ae0 2023-11-24T06:12:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fec975f5640 1 -- 172.21.15.22:0/1964917400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 msgr2=0x7fec900d1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fec975f5640 1 --2- 172.21.15.22:0/1964917400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec900d1d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec88009d90 tx=0x7fec8802bc90 comp rx=0 tx=0).stop 2023-11-24T06:12:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fec975f5640 1 -- 172.21.15.22:0/1964917400 shutdown_connections 2023-11-24T06:12:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fec975f5640 1 --2- 172.21.15.22:0/1964917400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec900d1d90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fec975f5640 1 --2- 172.21.15.22:0/1964917400 >> v2:172.21.15.22:3300/0 conn(0x7fec900ce260 0x7fec900d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fec975f5640 1 -- 172.21.15.22:0/1964917400 >> 172.21.15.22:0/1964917400 conn(0x7fec90071f90 msgr2=0x7fec900723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fe9f2ffd640 1 -- 172.21.15.22:0/1197256678 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f80329c0 con 0x7fe9fc0ce010 2023-11-24T06:12:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fe9f2ffd640 1 -- 172.21.15.22:0/1197256678 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8032d70 con 0x7fe9fc0ce010 2023-11-24T06:12:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fdeb2ffd640 1 -- 172.21.15.22:0/2598867209 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea402d040 con 0x7fdeb415d4d0 2023-11-24T06:12:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fdeb2ffd640 1 -- 172.21.15.22:0/2598867209 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea4031810 con 0x7fdeb415d4d0 2023-11-24T06:12:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fdeb2ffd640 1 -- 172.21.15.22:0/2598867209 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea4031ba0 con 0x7fdeb415d4d0 2023-11-24T06:12:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7f35ff7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36000cec60 0x7f36000b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7f3604d05640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3600070ae0 0x7f3600070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7f3604d05640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3600070ae0 0x7f3600070ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:41270/0 (socket says 172.21.15.22:41270) 2023-11-24T06:12:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7f3604d05640 1 -- 172.21.15.22:0/2210779013 learned_addr learned my addr 172.21.15.22:0/2210779013 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fa7d4e4a640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d0158d40 0x7fa7d01591f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8037040 tx=0x7fa7c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7fa7ccff9640 1 -- 172.21.15.22:0/1909061262 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8004450 con 0x7fa7d0158d40 2023-11-24T06:12:13.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc0b5580 con 0x7fe9fc0ce010 2023-11-24T06:12:13.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc158520 con 0x7fe9fc0ce010 2023-11-24T06:12:13.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7f35ff7fe640 1 -- 172.21.15.22:0/2210779013 >> v2:172.21.15.31:3300/0 conn(0x7f3600070ae0 msgr2=0x7f3600070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7fdeba924640 1 -- 172.21.15.22:0/2598867209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb415d4d0 msgr2=0x7fdeb40cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7fdeba924640 1 --2- 172.21.15.22:0/2598867209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb415d4d0 0x7fdeb40cda70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdea40097a0 tx=0x7fdea402b8b0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7f013b5d5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0134161930 0x7f01340ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7f013b5d5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f013406d520 0x7f013406d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7f013b5d5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013406deb0 con 0x7f01340719c0 2023-11-24T06:12:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7f013b5d5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01340ad510 con 0x7f0134161930 2023-11-24T06:12:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7f013b5d5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01340acc50 con 0x7f013406d520 2023-11-24T06:12:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7fa7ccff9640 1 -- 172.21.15.22:0/1909061262 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80045b0 con 0x7fa7d0158d40 2023-11-24T06:12:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7f35ff7fe640 1 --2- 172.21.15.22:0/2210779013 >> v2:172.21.15.31:3300/0 conn(0x7f3600070ae0 0x7f3600070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7f35ff7fe640 1 -- 172.21.15.22:0/2210779013 >> v1:172.21.15.31:6789/0 conn(0x7f360015d610 legacy=0x7f360006cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.056+0000 7f35ff7fe640 1 -- 172.21.15.22:0/2210779013 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36000b2850 con 0x7f36000cec60 2023-11-24T06:12:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7f3604d05640 1 --2- 172.21.15.22:0/2210779013 >> v2:172.21.15.31:3300/0 conn(0x7f3600070ae0 0x7f3600070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:13.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7fa7ccff9640 1 -- 172.21.15.22:0/1909061262 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8009470 con 0x7fa7d0158d40 2023-11-24T06:12:13.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fec975f5640 1 -- 172.21.15.22:0/1964917400 shutdown_connections 2023-11-24T06:12:13.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.055+0000 7fec975f5640 1 -- 172.21.15.22:0/1964917400 wait complete. 2023-11-24T06:12:13.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d015de50 con 0x7fa7d0158d40 2023-11-24T06:12:13.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7f0139b72640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f013406d520 0x7f013406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7f0139371640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0134161930 0x7f01340ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7f0139371640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0134161930 0x7f01340ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:41272/0 (socket says 172.21.15.22:41272) 2023-11-24T06:12:13.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7f0139371640 1 -- 172.21.15.22:0/1001155028 learned_addr learned my addr 172.21.15.22:0/1001155028 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.058+0000 7fb6bf38a640 1 Processor -- start 2023-11-24T06:12:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.058+0000 7fec975f5640 1 Processor -- start 2023-11-24T06:12:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.058+0000 7f35ff7fe640 1 --2- 172.21.15.22:0/2210779013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36000cec60 0x7f36000b3b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f36001611d0 tx=0x7f35f402b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b290acc1263b7724 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.057+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d0157a30 con 0x7fa7d0158d40 2023-11-24T06:12:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.058+0000 7fdeba924640 1 -- 172.21.15.22:0/2598867209 shutdown_connections 2023-11-24T06:12:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.058+0000 7fdeba924640 1 --2- 172.21.15.22:0/2598867209 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb40d1f60 0x7fdeb40b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.058+0000 7fdeba924640 1 --2- 172.21.15.22:0/2598867209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb415d4d0 0x7fdeb40cda70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.058+0000 7fdeba924640 1 -- 172.21.15.22:0/2598867209 >> 172.21.15.22:0/2598867209 conn(0x7fdeb4071f90 msgr2=0x7fdeb40723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7f35feffd640 1 -- 172.21.15.22:0/2210779013 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4033640 con 0x7f36000cec60 2023-11-24T06:12:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7f35feffd640 1 -- 172.21.15.22:0/2210779013 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f40337a0 con 0x7f36000cec60 2023-11-24T06:12:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7f35feffd640 1 -- 172.21.15.22:0/2210779013 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4033b30 con 0x7f36000cec60 2023-11-24T06:12:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0158520 con 0x7fa7d0158d40 2023-11-24T06:12:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7fdeba924640 1 -- 172.21.15.22:0/2598867209 shutdown_connections 2023-11-24T06:12:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7fdeba924640 1 -- 172.21.15.22:0/2598867209 wait complete. 2023-11-24T06:12:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7fb6bf38a640 1 -- start start 2023-11-24T06:12:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.058+0000 7fec975f5640 1 -- start start 2023-11-24T06:12:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.058+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc0b3c00 con 0x7fe9fc0ce010 2023-11-24T06:12:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7fec975f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec900ce260 0x7fec9014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7fec975f5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec901544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7f0127fff640 1 -- 172.21.15.22:0/1001155028 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006296246 0 0) 0x7f0128001110 con 0x7f01340719c0 2023-11-24T06:12:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7f0127fff640 1 -- 172.21.15.22:0/1001155028 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0120003520 con 0x7f01340719c0 2023-11-24T06:12:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7f0139371640 1 -- 172.21.15.22:0/1001155028 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f013406d520 msgr2=0x7f013406d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7f0139371640 1 --2- 172.21.15.22:0/1001155028 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f013406d520 0x7f013406d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7f0139371640 1 -- 172.21.15.22:0/1001155028 >> v1:172.21.15.31:6789/0 conn(0x7f01340719c0 legacy=0x7f01340ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.059+0000 7f0139371640 1 -- 172.21.15.22:0/1001155028 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134071e60 con 0x7f0134161930 2023-11-24T06:12:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7f3606768640 1 -- 172.21.15.22:0/2210779013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36000cec60 msgr2=0x7f36000b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7f3606768640 1 --2- 172.21.15.22:0/2210779013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36000cec60 0x7f36000b3b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f36001611d0 tx=0x7f35f402b720 comp rx=0 tx=0).stop 2023-11-24T06:12:13.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7f3606768640 1 -- 172.21.15.22:0/2210779013 shutdown_connections 2023-11-24T06:12:13.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7f3606768640 1 --2- 172.21.15.22:0/2210779013 >> v2:172.21.15.31:3300/0 conn(0x7f3600070ae0 0x7f3600070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7f3606768640 1 --2- 172.21.15.22:0/2210779013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36000cec60 0x7f36000b3b90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7f3606768640 1 -- 172.21.15.22:0/2210779013 >> 172.21.15.22:0/2210779013 conn(0x7f36000b1420 msgr2=0x7f36000b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7f3606768640 1 -- 172.21.15.22:0/2210779013 shutdown_connections 2023-11-24T06:12:13.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7f3606768640 1 -- 172.21.15.22:0/2210779013 wait complete. 2023-11-24T06:12:13.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.060+0000 7fec975f5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec9015d4d0 0x7fec90153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fb6bf38a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6b80ce260 0x7fb6b80d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fb6bf38a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b80ce6a0 0x7fb6b80d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fb6bf38a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b815d8b0 con 0x7fb6b815d4d0 2023-11-24T06:12:13.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fb6bf38a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b80b91b0 con 0x7fb6b80ce260 2023-11-24T06:12:13.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fb6bf38a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80b2400 con 0x7fb6b80ce6a0 2023-11-24T06:12:13.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fec94b90640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec901544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fec94b90640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec901544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:36452/0 (socket says 172.21.15.22:36452) 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fec94b90640 1 -- 172.21.15.22:0/3821548413 learned_addr learned my addr 172.21.15.22:0/3821548413 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec900cc930 con 0x7fec900ce260 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fec95391640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec900ce260 0x7fec9014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec90155780 con 0x7fec9015d4d0 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec90155170 con 0x7fec900ce6a0 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fb6bd927640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b80ce6a0 0x7fb6b80d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fb6bc925640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6b80ce260 0x7fb6b80d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.061+0000 7fb6bd927640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b80ce6a0 0x7fb6b80d1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:36462/0 (socket says 172.21.15.22:36462) 2023-11-24T06:12:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fb6bd927640 1 -- 172.21.15.22:0/2928432945 learned_addr learned my addr 172.21.15.22:0/2928432945 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7f0139371640 1 --2- 172.21.15.22:0/1001155028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0134161930 0x7f01340ae6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f012c009e50 tx=0x7f012c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c10d6f822df51817 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fec95391640 1 -- 172.21.15.22:0/3821548413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 msgr2=0x7fec901544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fec95391640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec901544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fec95391640 1 -- 172.21.15.22:0/3821548413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec9015d4d0 msgr2=0x7fec90153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fec95b92640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec9015d4d0 0x7fec90153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fec95391640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec9015d4d0 0x7fec90153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fb6bc925640 1 -- 172.21.15.22:0/2928432945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b80ce6a0 msgr2=0x7fb6b80d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fb6bc925640 1 --2- 172.21.15.22:0/2928432945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b80ce6a0 0x7fb6b80d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fb6bc925640 1 -- 172.21.15.22:0/2928432945 >> v1:172.21.15.31:6789/0 conn(0x7fb6b815d4d0 legacy=0x7fb6b80cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.062+0000 7fb6bc925640 1 -- 172.21.15.22:0/2928432945 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b80b26e0 con 0x7fb6b80ce260 2023-11-24T06:12:13.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.063+0000 7fec95391640 1 -- 172.21.15.22:0/3821548413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88009a70 con 0x7fec900ce260 2023-11-24T06:12:13.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.063+0000 7fec95b92640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec9015d4d0 0x7fec90153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:13.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.063+0000 7f3606768640 1 Processor -- start 2023-11-24T06:12:13.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.063+0000 7f0127fff640 1 -- 172.21.15.22:0/1001155028 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c02cb00 con 0x7f0134161930 2023-11-24T06:12:13.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.063+0000 7fec95391640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec900ce260 0x7fec9014fdb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00cac0 tx=0x7fec8c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.063+0000 7f0127fff640 1 -- 172.21.15.22:0/1001155028 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c02cc60 con 0x7f0134161930 2023-11-24T06:12:13.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.063+0000 7f0127fff640 1 -- 172.21.15.22:0/1001155028 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c02cb00 con 0x7f0134161930 2023-11-24T06:12:13.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.063+0000 7f3606768640 1 -- start start 2023-11-24T06:12:13.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.063+0000 7fa7ccff9640 1 -- 172.21.15.22:0/1909061262 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7c803e440 con 0x7fa7d0158d40 2023-11-24T06:12:13.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.064+0000 7fb6bc925640 1 --2- 172.21.15.22:0/2928432945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 0x7fb6b80d1850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40097a0 tx=0x7fb6b402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c733394d4b245413 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.064+0000 7fdeba924640 1 Processor -- start 2023-11-24T06:12:13.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.064+0000 7fdeba924640 1 -- start start 2023-11-24T06:12:13.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.064+0000 7fe9f2ffd640 1 -- 172.21.15.22:0/1197256678 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9f804e430 con 0x7fe9fc0ce010 2023-11-24T06:12:13.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.064+0000 7f013b5d5640 1 -- 172.21.15.22:0/1001155028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0134161930 msgr2=0x7f01340ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.064+0000 7f013b5d5640 1 --2- 172.21.15.22:0/1001155028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0134161930 0x7f01340ae6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f012c009e50 tx=0x7f012c02bf60 comp rx=0 tx=0).stop 2023-11-24T06:12:13.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f3606768640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3600070ae0 0x7f36001464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f013b5d5640 1 -- 172.21.15.22:0/1001155028 shutdown_connections 2023-11-24T06:12:13.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f013b5d5640 1 --2- 172.21.15.22:0/1001155028 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f013406d520 0x7f013406d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f013b5d5640 1 --2- 172.21.15.22:0/1001155028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0134161930 0x7f01340ae6a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f013b5d5640 1 -- 172.21.15.22:0/1001155028 >> 172.21.15.22:0/1001155028 conn(0x7f01340b0d80 msgr2=0x7f01340b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f3606768640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36000cec60 0x7f360015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f3606768640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f360015d610 0x7f360015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f013b5d5640 1 -- 172.21.15.22:0/1001155028 shutdown_connections 2023-11-24T06:12:13.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7fa7ccff9640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa7bc06ae90 0x7fa7bc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7fa7ccff9640 1 -- 172.21.15.22:0/1909061262 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7c80aba60 con 0x7fa7d0158d40 2023-11-24T06:12:13.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f013b5d5640 1 -- 172.21.15.22:0/1001155028 wait complete. 2023-11-24T06:12:13.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7fa7cffff640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa7bc06ae90 0x7fa7bc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f3606768640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36000af1c0 con 0x7f3600070ae0 2023-11-24T06:12:13.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f3606768640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3600146a30 con 0x7f36000cec60 2023-11-24T06:12:13.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f3606768640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3600149c80 con 0x7f360015d610 2023-11-24T06:12:13.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f35fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3600070ae0 0x7f36001464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f35fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3600070ae0 0x7f36001464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37832/0 (socket says 172.21.15.22:37832) 2023-11-24T06:12:13.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.065+0000 7f35fffff640 1 -- 172.21.15.22:0/328707989 learned_addr learned my addr 172.21.15.22:0/328707989 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.066+0000 7f3604d05640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f360015d610 0x7f360015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.066+0000 7f35ff7fe640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36000cec60 0x7f360015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.066+0000 7fa7cffff640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa7bc06ae90 0x7fa7bc06d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009b40 tx=0x7fa7c0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.066+0000 7fdeba924640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40ce260 0x7fdeb41f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.066+0000 7fdeba924640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb40d1f60 0x7fdeb4151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fdeba924640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb415d4d0 0x7fdeb4153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fdeba924640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40cb8b0 con 0x7fdeb40d1f60 2023-11-24T06:12:13.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fdeba924640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb41f84b0 con 0x7fdeb40ce260 2023-11-24T06:12:13.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fdeba924640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb4151cc0 con 0x7fdeb415d4d0 2023-11-24T06:12:13.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7f3604d05640 1 -- 172.21.15.22:0/328707989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36000cec60 msgr2=0x7f360015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7f3604d05640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36000cec60 0x7f360015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7f3604d05640 1 -- 172.21.15.22:0/328707989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3600070ae0 msgr2=0x7f36001464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7f3604d05640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3600070ae0 0x7f36001464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7f3604d05640 1 -- 172.21.15.22:0/328707989 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4009400 con 0x7f360015d610 2023-11-24T06:12:13.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.066+0000 7fe9f2ffd640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9e006ae70 0x7fe9e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.066+0000 7fe9f2ffd640 1 -- 172.21.15.22:0/1197256678 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9f80ab4c0 con 0x7fe9fc0ce010 2023-11-24T06:12:13.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.066+0000 7fea021d9640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9e006ae70 0x7fe9e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fdeb3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40ce260 0x7fdeb41f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb40d1f60 0x7fdeb4151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7f3604d05640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f360015d610 0x7f360015c940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009440 tx=0x7f35f8007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb40d1f60 0x7fdeb4151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37848/0 (socket says 172.21.15.22:37848) 2023-11-24T06:12:13.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fea021d9640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9e006ae70 0x7fe9e006d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4001560 tx=0x7fe9f40019f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fdeb37fe640 1 -- 172.21.15.22:0/2668245297 learned_addr learned my addr 172.21.15.22:0/2668245297 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.067+0000 7fdeb8ec1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb415d4d0 0x7fdeb4153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7f35fcff9640 1 -- 172.21.15.22:0/328707989 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f800dbe0 con 0x7f360015d610 2023-11-24T06:12:13.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36001499a0 con 0x7f360015d610 2023-11-24T06:12:13.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36001f36f0 con 0x7f360015d610 2023-11-24T06:12:13.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7f013b5d5640 1 Processor -- start 2023-11-24T06:12:13.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7f013b5d5640 1 -- start start 2023-11-24T06:12:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7fdeb37fe640 1 -- 172.21.15.22:0/2668245297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb415d4d0 msgr2=0x7fdeb4153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7fdeb37fe640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb415d4d0 0x7fdeb4153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7fdeb37fe640 1 -- 172.21.15.22:0/2668245297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40ce260 msgr2=0x7fdeb41f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7fdeb37fe640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40ce260 0x7fdeb41f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7fdeb37fe640 1 -- 172.21.15.22:0/2668245297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4009400 con 0x7fdeb40d1f60 2023-11-24T06:12:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7f35fcff9640 1 -- 172.21.15.22:0/328707989 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f800f040 con 0x7f360015d610 2023-11-24T06:12:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.068+0000 7f35fcff9640 1 -- 172.21.15.22:0/328707989 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f8003990 con 0x7f360015d610 2023-11-24T06:12:13.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.069+0000 7fdeb37fe640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb40d1f60 0x7fdeb4151780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdea800c4a0 tx=0x7fdea800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.069+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e0005250 con 0x7f360015d610 2023-11-24T06:12:13.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.069+0000 7f013b5d5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f013406d520 0x7f01340cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7f013b5d5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01340719c0 0x7f0134148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7fb6affff640 1 -- 172.21.15.22:0/2928432945 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b402d040 con 0x7fb6b80ce260 2023-11-24T06:12:13.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.069+0000 7fec85ffb640 1 -- 172.21.15.22:0/3821548413 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c007350 con 0x7fec900ce260 2023-11-24T06:12:13.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7fa7ccff9640 1 -- 172.21.15.22:0/1909061262 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa7c8076d50 con 0x7fa7d0158d40 2023-11-24T06:12:13.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7f013b5d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0134161930 0x7f0134160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7f013b5d5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0134149190 con 0x7f0134161930 2023-11-24T06:12:13.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7f013b5d5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01340cdaa0 con 0x7f013406d520 2023-11-24T06:12:13.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7f013b5d5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01340cce90 con 0x7f01340719c0 2023-11-24T06:12:13.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7f0139b72640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0134161930 0x7f0134160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7f0139b72640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0134161930 0x7f0134160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37852/0 (socket says 172.21.15.22:37852) 2023-11-24T06:12:13.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7f0139b72640 1 -- 172.21.15.22:0/2073364506 learned_addr learned my addr 172.21.15.22:0/2073364506 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec900cc650 con 0x7fec900ce260 2023-11-24T06:12:13.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec90154a10 con 0x7fec900ce260 2023-11-24T06:12:13.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7fdeb0ff9640 1 -- 172.21.15.22:0/2668245297 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8005ce0 con 0x7fdeb40d1f60 2023-11-24T06:12:13.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.070+0000 7f0138b70640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01340719c0 0x7f0134148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.071+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb40caca0 con 0x7fdeb40d1f60 2023-11-24T06:12:13.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.071+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb40cb260 con 0x7fdeb40d1f60 2023-11-24T06:12:13.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.071+0000 7f0139b72640 1 -- 172.21.15.22:0/2073364506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01340719c0 msgr2=0x7f0134148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.071+0000 7f0139b72640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01340719c0 0x7f0134148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.071+0000 7f0139b72640 1 -- 172.21.15.22:0/2073364506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f013406d520 msgr2=0x7f01340cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.071+0000 7f0139371640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f013406d520 0x7f01340cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.072+0000 7f727887c640 1 Processor -- start 2023-11-24T06:12:13.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.072+0000 7f727887c640 1 -- start start 2023-11-24T06:12:13.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.072+0000 7f0139b72640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f013406d520 0x7f01340cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.072+0000 7f0139b72640 1 -- 172.21.15.22:0/2073364506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c009b30 con 0x7f0134161930 2023-11-24T06:12:13.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.072+0000 7f0139371640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f013406d520 0x7f01340cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:13.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.072+0000 7f35fcff9640 1 -- 172.21.15.22:0/328707989 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35f8003af0 con 0x7f360015d610 2023-11-24T06:12:13.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.072+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec90154fb0 con 0x7fec900ce260 2023-11-24T06:12:13.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.072+0000 7f0139b72640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0134161930 0x7f0134160b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f013000e7f0 tx=0x7f013000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.072+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb4074770 con 0x7fdeb40d1f60 2023-11-24T06:12:13.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.073+0000 7f35fcff9640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f35ec06ae40 0x7f35ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.073+0000 7f727887c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72740ce260 0x7f72740d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.073+0000 7f727887c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce6a0 0x7f72740d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.073+0000 7f727887c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727415d8b0 con 0x7f727415d4d0 2023-11-24T06:12:13.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.073+0000 7f727887c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740b91b0 con 0x7f72740ce260 2023-11-24T06:12:13.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.073+0000 7f727887c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72740b2400 con 0x7f72740ce6a0 2023-11-24T06:12:13.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f35fcff9640 1 -- 172.21.15.22:0/328707989 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35f8089980 con 0x7f360015d610 2023-11-24T06:12:13.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f35fffff640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f35ec06ae40 0x7f35ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f7271d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72740ce260 0x7f72740d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f7271d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72740ce260 0x7f72740d1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37856/0 (socket says 172.21.15.22:37856) 2023-11-24T06:12:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f7271d9b640 1 -- 172.21.15.22:0/21920106 learned_addr learned my addr 172.21.15.22:0/21920106 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f7272d9d640 1 --2- 172.21.15.22:0/21920106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce6a0 0x7f72740d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f7271d9b640 1 -- 172.21.15.22:0/21920106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce6a0 msgr2=0x7f72740d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f7271d9b640 1 --2- 172.21.15.22:0/21920106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce6a0 0x7f72740d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f7271d9b640 1 -- 172.21.15.22:0/21920106 >> v1:172.21.15.31:6789/0 conn(0x7f727415d4d0 legacy=0x7f72740cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.074+0000 7f7271d9b640 1 -- 172.21.15.22:0/21920106 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740b26e0 con 0x7f72740ce260 2023-11-24T06:12:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.075+0000 7f35fffff640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f35ec06ae40 0x7f35ec06d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009990 tx=0x7f35f0009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.075+0000 7f7271d9b640 1 --2- 172.21.15.22:0/21920106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce260 0x7f72740d1850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7264009e50 tx=0x7f726402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c672722bef6fb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7fec85ffb640 1 -- 172.21.15.22:0/3821548413 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c0074b0 con 0x7fec900ce260 2023-11-24T06:12:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7fec85ffb640 1 -- 172.21.15.22:0/3821548413 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0049e0 con 0x7fec900ce260 2023-11-24T06:12:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7fb6affff640 1 -- 172.21.15.22:0/2928432945 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4031810 con 0x7fb6b80ce260 2023-11-24T06:12:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7fb6affff640 1 -- 172.21.15.22:0/2928432945 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b402d040 con 0x7fb6b80ce260 2023-11-24T06:12:13.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7fe9f2ffd640 1 -- 172.21.15.22:0/1197256678 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9f80764e0 con 0x7fe9fc0ce010 2023-11-24T06:12:13.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7fdeb0ff9640 1 -- 172.21.15.22:0/2668245297 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea8005e40 con 0x7fdeb40d1f60 2023-11-24T06:12:13.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7fdeb0ff9640 1 -- 172.21.15.22:0/2668245297 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8007270 con 0x7fdeb40d1f60 2023-11-24T06:12:13.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7f0125ffb640 1 -- 172.21.15.22:0/2073364506 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130009510 con 0x7f0134161930 2023-11-24T06:12:13.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01340cd170 con 0x7f0134161930 2023-11-24T06:12:13.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.080+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01340cd730 con 0x7f0134161930 2023-11-24T06:12:13.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.079+0000 7f727159a640 1 -- 172.21.15.22:0/21920106 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726402cb00 con 0x7f72740ce260 2023-11-24T06:12:13.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.080+0000 7f727159a640 1 -- 172.21.15.22:0/21920106 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726402cc60 con 0x7f72740ce260 2023-11-24T06:12:13.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.080+0000 7f727159a640 1 -- 172.21.15.22:0/21920106 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640343f0 con 0x7f72740ce260 2023-11-24T06:12:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.080+0000 7fb6bf38a640 1 -- 172.21.15.22:0/2928432945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 msgr2=0x7fb6b80d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.080+0000 7fb6bf38a640 1 --2- 172.21.15.22:0/2928432945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 0x7fb6b80d1850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40097a0 tx=0x7fb6b402b8b0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7fb6bf38a640 1 -- 172.21.15.22:0/2928432945 shutdown_connections 2023-11-24T06:12:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7fb6bf38a640 1 --2- 172.21.15.22:0/2928432945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b80ce6a0 0x7fb6b80d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7fb6bf38a640 1 --2- 172.21.15.22:0/2928432945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 0x7fb6b80d1850 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7fb6bf38a640 1 -- 172.21.15.22:0/2928432945 >> 172.21.15.22:0/2928432945 conn(0x7fb6b8071f90 msgr2=0x7fb6b80723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7f727887c640 1 -- 172.21.15.22:0/21920106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce260 msgr2=0x7f72740d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7f727887c640 1 --2- 172.21.15.22:0/21920106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce260 0x7f72740d1850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7264009e50 tx=0x7f726402bf60 comp rx=0 tx=0).stop 2023-11-24T06:12:13.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7fb6bf38a640 1 -- 172.21.15.22:0/2928432945 shutdown_connections 2023-11-24T06:12:13.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7f0125ffb640 1 -- 172.21.15.22:0/2073364506 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013000ee40 con 0x7f0134161930 2023-11-24T06:12:13.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7f0125ffb640 1 -- 172.21.15.22:0/2073364506 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130005b90 con 0x7f0134161930 2023-11-24T06:12:13.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0134074770 con 0x7f0134161930 2023-11-24T06:12:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.082+0000 7f727887c640 1 -- 172.21.15.22:0/21920106 shutdown_connections 2023-11-24T06:12:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.082+0000 7f727887c640 1 --2- 172.21.15.22:0/21920106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce6a0 0x7f72740d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.082+0000 7f727887c640 1 --2- 172.21.15.22:0/21920106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce260 0x7f72740d1850 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.082+0000 7f727887c640 1 -- 172.21.15.22:0/21920106 >> 172.21.15.22:0/21920106 conn(0x7f7274071f90 msgr2=0x7f72740723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.082+0000 7f727887c640 1 -- 172.21.15.22:0/21920106 shutdown_connections 2023-11-24T06:12:13.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.081+0000 7fb6bf38a640 1 -- 172.21.15.22:0/2928432945 wait complete. 2023-11-24T06:12:13.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.082+0000 7f727887c640 1 -- 172.21.15.22:0/21920106 wait complete. 2023-11-24T06:12:13.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.083+0000 7fec85ffb640 1 -- 172.21.15.22:0/3821548413 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec8c004b40 con 0x7fec900ce260 2023-11-24T06:12:13.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.084+0000 7fb6bf38a640 1 Processor -- start 2023-11-24T06:12:13.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.084+0000 7fb6bf38a640 1 -- start start 2023-11-24T06:12:13.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.084+0000 7fdeb0ff9640 1 -- 172.21.15.22:0/2668245297 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdea8007490 con 0x7fdeb40d1f60 2023-11-24T06:12:13.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.085+0000 7f727887c640 1 Processor -- start 2023-11-24T06:12:13.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.085+0000 7fec85ffb640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec7406ae40 0x7fec7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.085+0000 7fec85ffb640 1 -- 172.21.15.22:0/3821548413 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec8c089210 con 0x7fec900ce260 2023-11-24T06:12:13.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.085+0000 7fec94b90640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec7406ae40 0x7fec7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.085+0000 7f727887c640 1 -- start start 2023-11-24T06:12:13.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.086+0000 7fb6bf38a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 0x7fb6b814ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.086+0000 7fb6bf38a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80ce6a0 0x7fb6b814b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.086+0000 7fb6bf38a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b815d4d0 0x7fb6b814c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.086+0000 7fb6bf38a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b8154420 con 0x7fb6b80ce260 2023-11-24T06:12:13.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.086+0000 7fb6bf38a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b8153550 con 0x7fb6b80ce6a0 2023-11-24T06:12:13.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.086+0000 7fb6bf38a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b814f3c0 con 0x7fb6b815d4d0 2023-11-24T06:12:13.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.086+0000 7fdeb0ff9640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdea006ae40 0x7fdea006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.086+0000 7fdeb0ff9640 1 -- 172.21.15.22:0/2668245297 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdea8088ff0 con 0x7fdeb40d1f60 2023-11-24T06:12:13.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.086+0000 7fec94b90640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec7406ae40 0x7fec7406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec900d33a0 tx=0x7fec80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7fdeb3fff640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdea006ae40 0x7fdea006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f727887c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce260 0x7f727415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f727887c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce6a0 0x7f72740ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f727887c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415d4d0 0x7f727414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f727887c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740cb980 con 0x7f72740ce6a0 2023-11-24T06:12:13.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f727887c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740cae00 con 0x7f727415d4d0 2023-11-24T06:12:13.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f727887c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72740cb0e0 con 0x7f72740ce260 2023-11-24T06:12:13.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7fb6bd126640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 0x7fb6b814ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7fb6bd126640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 0x7fb6b814ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37866/0 (socket says 172.21.15.22:37866) 2023-11-24T06:12:13.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7fb6bd126640 1 -- 172.21.15.22:0/1431209920 learned_addr learned my addr 172.21.15.22:0/1431209920 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f7271d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce6a0 0x7f72740ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f7271d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce6a0 0x7f72740ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37868/0 (socket says 172.21.15.22:37868) 2023-11-24T06:12:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f7271d9b640 1 -- 172.21.15.22:0/2626474185 learned_addr learned my addr 172.21.15.22:0/2626474185 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7fb6bd927640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b815d4d0 0x7fb6b814c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7fb6bc925640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80ce6a0 0x7fb6b814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.087+0000 7f35fcff9640 1 -- 172.21.15.22:0/328707989 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35f8054ac0 con 0x7f360015d610 2023-11-24T06:12:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7fdeb3fff640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdea006ae40 0x7fdea006d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdea4036000 tx=0x7fdea403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f727259c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce260 0x7f727415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f7272d9d640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415d4d0 0x7f727414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f7271d9b640 1 -- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce260 msgr2=0x7f727415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f7271d9b640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce260 0x7f727415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f7271d9b640 1 -- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415d4d0 msgr2=0x7f727414f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f7271d9b640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415d4d0 0x7f727414f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f7271d9b640 1 -- 172.21.15.22:0/2626474185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009b30 con 0x7f72740ce6a0 2023-11-24T06:12:13.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f7272d9d640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415d4d0 0x7f727414f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:13.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f727259c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce260 0x7f727415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:13.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.088+0000 7f7271d9b640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce6a0 0x7f72740ca340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7264000f80 tx=0x7f7264004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.089+0000 7fb6bd126640 1 -- 172.21.15.22:0/1431209920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b815d4d0 msgr2=0x7fb6b814c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.089+0000 7fb6bd126640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b815d4d0 0x7fb6b814c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.089+0000 7fb6bd126640 1 -- 172.21.15.22:0/1431209920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80ce6a0 msgr2=0x7fb6b814b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.089+0000 7fb6bd126640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80ce6a0 0x7fb6b814b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.089+0000 7fb6bd126640 1 -- 172.21.15.22:0/1431209920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4009400 con 0x7fb6b80ce260 2023-11-24T06:12:13.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.089+0000 7fb6bd126640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 0x7fb6b814ee80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c760 tx=0x7fb6b000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.090+0000 7fec85ffb640 1 -- 172.21.15.22:0/3821548413 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec8c0543e0 con 0x7fec900ce260 2023-11-24T06:12:13.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.099+0000 7fdeb0ff9640 1 -- 172.21.15.22:0/2668245297 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdea80541e0 con 0x7fdeb40d1f60 2023-11-24T06:12:13.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.100+0000 7f7262ffd640 1 -- 172.21.15.22:0/2626474185 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264009510 con 0x7f72740ce6a0 2023-11-24T06:12:13.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.100+0000 7fb6adffb640 1 -- 172.21.15.22:0/1431209920 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0003b70 con 0x7fb6b80ce260 2023-11-24T06:12:13.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.100+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72740cb3c0 con 0x7f72740ce6a0 2023-11-24T06:12:13.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.100+0000 7fb6adffb640 1 -- 172.21.15.22:0/1431209920 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b0003cf0 con 0x7fb6b80ce260 2023-11-24T06:12:13.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.100+0000 7fb6adffb640 1 -- 172.21.15.22:0/1431209920 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000aa90 con 0x7fb6b80ce260 2023-11-24T06:12:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.100+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72740b5020 con 0x7f72740ce6a0 2023-11-24T06:12:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.101+0000 7fb6bf38a640 1 -- 172.21.15.22:0/1431209920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b81537a0 con 0x7fb6b80ce260 2023-11-24T06:12:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.101+0000 7fb6bf38a640 1 -- 172.21.15.22:0/1431209920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b8153d60 con 0x7fb6b80ce260 2023-11-24T06:12:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.102+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7274074770 con 0x7f72740ce6a0 2023-11-24T06:12:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.102+0000 7f7262ffd640 1 -- 172.21.15.22:0/2626474185 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726403e450 con 0x7f72740ce6a0 2023-11-24T06:12:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.103+0000 7fb6a37fe640 1 -- 172.21.15.22:0/1431209920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb690005250 con 0x7fb6b80ce260 2023-11-24T06:12:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.103+0000 7f0125ffb640 1 -- 172.21.15.22:0/2073364506 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0130005cf0 con 0x7f0134161930 2023-11-24T06:12:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.102+0000 7f7262ffd640 1 -- 172.21.15.22:0/2626474185 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726403e800 con 0x7f72740ce6a0 2023-11-24T06:12:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.104+0000 7f0125ffb640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f011806ae40 0x7f011806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.104+0000 7f0125ffb640 1 -- 172.21.15.22:0/2073364506 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0130089b90 con 0x7f0134161930 2023-11-24T06:12:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.105+0000 7f0139371640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f011806ae40 0x7f011806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.106+0000 7f0139371640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f011806ae40 0x7f011806d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f012c035000 tx=0x7f012c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.110+0000 7f0125ffb640 1 -- 172.21.15.22:0/2073364506 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0130054ba0 con 0x7f0134161930 2023-11-24T06:12:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.116+0000 7fb6adffb640 1 -- 172.21.15.22:0/1431209920 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6b000abf0 con 0x7fb6b80ce260 2023-11-24T06:12:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.117+0000 7fb6adffb640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb69c06aec0 0x7fb69c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.118+0000 7fb6bc925640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb69c06aec0 0x7fb69c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.117+0000 7f7262ffd640 1 -- 172.21.15.22:0/2626474185 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f726403e960 con 0x7f72740ce6a0 2023-11-24T06:12:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.118+0000 7f7262ffd640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.118+0000 7f7262ffd640 1 -- 172.21.15.22:0/2626474185 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72640ac840 con 0x7f72740ce6a0 2023-11-24T06:12:13.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.119+0000 7fb6adffb640 1 -- 172.21.15.22:0/1431209920 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6b0058be0 con 0x7fb6b80ce260 2023-11-24T06:12:13.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.119+0000 7f727259c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:13.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.121+0000 7fb6adffb640 1 -- 172.21.15.22:0/1431209920 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6b00556b0 con 0x7fb6b80ce260 2023-11-24T06:12:13.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.121+0000 7fb6bc925640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb69c06aec0 0x7fb69c06d380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4036000 tx=0x7fb6b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.122+0000 7f727259c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f726c007fd0 tx=0x7f726c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:13.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.129+0000 7f7262ffd640 1 -- 172.21.15.22:0/2626474185 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7264077970 con 0x7f72740ce6a0 2023-11-24T06:12:13.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.488+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa7d0158520 con 0x7fa7d0158d40 2023-11-24T06:12:13.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.489+0000 7fa7ccff9640 1 -- 172.21.15.22:0/1909061262 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7d0158520 con 0x7fa7d0158d40 2023-11-24T06:12:13.491 INFO:teuthology.orchestra.run.smithi022.stdout:64424509446 2023-11-24T06:12:13.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.492+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa7bc06ae90 msgr2=0x7fa7bc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.492+0000 7fa7d68ad640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa7bc06ae90 0x7fa7bc06d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009b40 tx=0x7fa7c0009190 comp rx=0 tx=0).stop 2023-11-24T06:12:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.492+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d0158d40 msgr2=0x7fa7d01591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.492+0000 7fa7d68ad640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d0158d40 0x7fa7d01591f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8037040 tx=0x7fa7c8009750 comp rx=0 tx=0).stop 2023-11-24T06:12:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.493+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 shutdown_connections 2023-11-24T06:12:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.493+0000 7fa7d68ad640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa7bc06ae90 0x7fa7bc06d350 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.493+0000 7fa7d68ad640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d0158d40 0x7fa7d01591f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.493+0000 7fa7d68ad640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d006bb00 0x7fa7d0158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.493+0000 7fa7d68ad640 1 --2- 172.21.15.22:0/1909061262 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d0157650 0x7fa7d006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.493+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 >> 172.21.15.22:0/1909061262 conn(0x7fa7d00663d0 msgr2=0x7fa7d006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.494+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 shutdown_connections 2023-11-24T06:12:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.494+0000 7fa7d68ad640 1 -- 172.21.15.22:0/1909061262 wait complete. 2023-11-24T06:12:13.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.508+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe9fc0b5710 con 0x7fe9fc0ce010 2023-11-24T06:12:13.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.508+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f35e00057d0 con 0x7f360015d610 2023-11-24T06:12:13.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.509+0000 7fe9f2ffd640 1 -- 172.21.15.22:0/1197256678 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9f8079b00 con 0x7fe9fc0ce010 2023-11-24T06:12:13.512 INFO:teuthology.orchestra.run.smithi022.stdout:60129542151 2023-11-24T06:12:13.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.512+0000 7f35fcff9640 1 -- 172.21.15.22:0/328707989 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35f801a020 con 0x7f360015d610 2023-11-24T06:12:13.515 INFO:teuthology.orchestra.run.smithi022.stdout:64424509445 2023-11-24T06:12:13.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.514+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9e006ae70 msgr2=0x7fe9e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.514+0000 7fea0443d640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9e006ae70 0x7fe9e006d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4001560 tx=0x7fe9f40019f0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.514+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9fc0ce010 msgr2=0x7fe9fc157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.514+0000 7fea0443d640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9fc0ce010 0x7fe9fc157fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8034040 tx=0x7fe9f80046c0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 shutdown_connections 2023-11-24T06:12:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7fea0443d640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9e006ae70 0x7fe9e006d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7fea0443d640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9fc13e120 0x7fe9fc0b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7fea0443d640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9fc0ce010 0x7fe9fc157fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7fea0443d640 1 --2- 172.21.15.22:0/1197256678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9fc0b07d0 0x7fe9fc0b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 >> 172.21.15.22:0/1197256678 conn(0x7fe9fc0663d0 msgr2=0x7fe9fc15f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.514+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec90074770 con 0x7fec900ce260 2023-11-24T06:12:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7fec85ffb640 1 -- 172.21.15.22:0/3821548413 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec8c057a00 con 0x7fec900ce260 2023-11-24T06:12:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 shutdown_connections 2023-11-24T06:12:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.517+0000 7fea0443d640 1 -- 172.21.15.22:0/1197256678 wait complete. 2023-11-24T06:12:13.522 INFO:teuthology.orchestra.run.smithi022.stdout:64424509447 2023-11-24T06:12:13.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f35ec06ae40 msgr2=0x7f35ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.515+0000 7f3606768640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f35ec06ae40 0x7f35ec06d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009990 tx=0x7f35f0009110 comp rx=0 tx=0).stop 2023-11-24T06:12:13.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f360015d610 msgr2=0x7f360015c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f360015d610 0x7f360015c940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009440 tx=0x7f35f8007ef0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 shutdown_connections 2023-11-24T06:12:13.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f35ec06ae40 0x7f35ec06d300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f360015d610 0x7f360015c940 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36000cec60 0x7f360015c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 --2- 172.21.15.22:0/328707989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3600070ae0 0x7f36001464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 >> 172.21.15.22:0/328707989 conn(0x7f36000b1420 msgr2=0x7f3600157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 shutdown_connections 2023-11-24T06:12:13.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.516+0000 7f3606768640 1 -- 172.21.15.22:0/328707989 wait complete. 2023-11-24T06:12:13.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec7406ae40 msgr2=0x7fec7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec7406ae40 0x7fec7406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec900d33a0 tx=0x7fec80008040 comp rx=0 tx=0).stop 2023-11-24T06:12:13.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec900ce260 msgr2=0x7fec9014fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec900ce260 0x7fec9014fdb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00cac0 tx=0x7fec8c00cf80 comp rx=0 tx=0).stop 2023-11-24T06:12:13.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 shutdown_connections 2023-11-24T06:12:13.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec7406ae40 0x7fec7406d300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec9015d4d0 0x7fec90153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec900ce6a0 0x7fec901544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 --2- 172.21.15.22:0/3821548413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec900ce260 0x7fec9014fdb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.519+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 >> 172.21.15.22:0/3821548413 conn(0x7fec90071f90 msgr2=0x7fec900d1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.520+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 shutdown_connections 2023-11-24T06:12:13.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.520+0000 7fec975f5640 1 -- 172.21.15.22:0/3821548413 wait complete. 2023-11-24T06:12:13.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2023-11-24T06:12:13.528 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:13.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.532+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdeb40b5ae0 con 0x7fdeb40d1f60 2023-11-24T06:12:13.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.533+0000 7fdeb0ff9640 1 -- 172.21.15.22:0/2668245297 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdea8017020 con 0x7fdeb40d1f60 2023-11-24T06:12:13.536 INFO:teuthology.orchestra.run.smithi022.stdout:64424509446 2023-11-24T06:12:13.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.533+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f01340cdbe0 con 0x7f0134161930 2023-11-24T06:12:13.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.534+0000 7f0125ffb640 1 -- 172.21.15.22:0/2073364506 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0130017090 con 0x7f0134161930 2023-11-24T06:12:13.537 INFO:teuthology.orchestra.run.smithi022.stdout:68719476743 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.536+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdea006ae40 msgr2=0x7fdea006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.536+0000 7fdeba924640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdea006ae40 0x7fdea006d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdea4036000 tx=0x7fdea403c040 comp rx=0 tx=0).stop 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.536+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb40d1f60 msgr2=0x7fdeb4151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.536+0000 7fdeba924640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb40d1f60 0x7fdeb4151780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdea800c4a0 tx=0x7fdea800c960 comp rx=0 tx=0).stop 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.537+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 shutdown_connections 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.537+0000 7fdeba924640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdea006ae40 0x7fdea006d300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.537+0000 7fdeba924640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdeb415d4d0 0x7fdeb4153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.537+0000 7fdeba924640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb40d1f60 0x7fdeb4151780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.537+0000 7fdeba924640 1 --2- 172.21.15.22:0/2668245297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb40ce260 0x7fdeb41f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.537+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 >> 172.21.15.22:0/2668245297 conn(0x7fdeb4071f90 msgr2=0x7fdeb40b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.537+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 shutdown_connections 2023-11-24T06:12:13.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.537+0000 7fdeba924640 1 -- 172.21.15.22:0/2668245297 wait complete. 2023-11-24T06:12:13.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f011806ae40 msgr2=0x7f011806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f011806ae40 0x7f011806d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f012c035000 tx=0x7f012c030000 comp rx=0 tx=0).stop 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0134161930 msgr2=0x7f0134160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0134161930 0x7f0134160b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f013000e7f0 tx=0x7f013000ebf0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 shutdown_connections 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f011806ae40 0x7f011806d300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0134161930 0x7f0134160b90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01340719c0 0x7f0134148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 --2- 172.21.15.22:0/2073364506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f013406d520 0x7f01340cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.538+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 >> 172.21.15.22:0/2073364506 conn(0x7f01340b0d80 msgr2=0x7f0134163ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.539+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 shutdown_connections 2023-11-24T06:12:13.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.539+0000 7f013b5d5640 1 -- 172.21.15.22:0/2073364506 wait complete. 2023-11-24T06:12:13.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.541+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f727406a440 con 0x7f72740ce6a0 2023-11-24T06:12:13.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.541+0000 7fb6a37fe640 1 -- 172.21.15.22:0/1431209920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb6900057d0 con 0x7fb6b80ce260 2023-11-24T06:12:13.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2023-11-24T06:12:13.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.542+0000 7f7262ffd640 1 -- 172.21.15.22:0/2626474185 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7264043020 con 0x7f72740ce6a0 2023-11-24T06:12:13.546 INFO:teuthology.orchestra.run.smithi022.stdout:64424509445 2023-11-24T06:12:13.546 INFO:teuthology.orchestra.run.smithi022.stdout:64424509446 2023-11-24T06:12:13.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.542+0000 7fb6adffb640 1 -- 172.21.15.22:0/1431209920 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6b0003e60 con 0x7fb6b80ce260 2023-11-24T06:12:13.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.545+0000 7fb6a37fe640 1 -- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb69c06aec0 msgr2=0x7fb69c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.545+0000 7fb6a37fe640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb69c06aec0 0x7fb69c06d380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4036000 tx=0x7fb6b4008030 comp rx=0 tx=0).stop 2023-11-24T06:12:13.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.545+0000 7fb6a37fe640 1 -- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 msgr2=0x7fb6b814ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.545+0000 7fb6a37fe640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 0x7fb6b814ee80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c760 tx=0x7fb6b000cc20 comp rx=0 tx=0).stop 2023-11-24T06:12:13.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 msgr2=0x7f725406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f726c007fd0 tx=0x7f726c009040 comp rx=0 tx=0).stop 2023-11-24T06:12:13.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce6a0 msgr2=0x7f72740ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:13.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce6a0 0x7f72740ca340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7264000f80 tx=0x7f7264004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:13.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7fb6a37fe640 1 -- 172.21.15.22:0/1431209920 shutdown_connections 2023-11-24T06:12:13.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7fb6a37fe640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb69c06aec0 0x7fb69c06d380 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7fb6a37fe640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b815d4d0 0x7fb6b814c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7fb6a37fe640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80ce6a0 0x7fb6b814b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7fb6a37fe640 1 --2- 172.21.15.22:0/1431209920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b80ce260 0x7fb6b814ee80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7fb6a37fe640 1 -- 172.21.15.22:0/1431209920 >> 172.21.15.22:0/1431209920 conn(0x7fb6b8071f90 msgr2=0x7fb6b80d1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 shutdown_connections 2023-11-24T06:12:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415d4d0 0x7f727414f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72740ce6a0 0x7f72740ca340 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 --2- 172.21.15.22:0/2626474185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740ce260 0x7f727415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 >> 172.21.15.22:0/2626474185 conn(0x7f7274071f90 msgr2=0x7f7274159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:13.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.546+0000 7fb6a37fe640 1 -- 172.21.15.22:0/1431209920 shutdown_connections 2023-11-24T06:12:13.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.547+0000 7fb6a37fe640 1 -- 172.21.15.22:0/1431209920 wait complete. 2023-11-24T06:12:13.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.547+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 shutdown_connections 2023-11-24T06:12:13.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:13.547+0000 7f727887c640 1 -- 172.21.15.22:0/2626474185 wait complete. 2023-11-24T06:12:13.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2023-11-24T06:12:13.552 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:13.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2023-11-24T06:12:13.553 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:13.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2023-11-24T06:12:13.569 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:13.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.5 2023-11-24T06:12:13.570 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:13.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2023-11-24T06:12:13.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2023-11-24T06:12:14.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T06:12:14.572 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T06:12:14.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T06:12:14.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.755+0000 7fce9053c640 1 Processor -- start 2023-11-24T06:12:14.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.756+0000 7fce9053c640 1 -- start start 2023-11-24T06:12:14.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.757+0000 7fce9053c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce8815a100 0x7fce880b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.757+0000 7fce9053c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce880abff0 0x7fce880b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.757+0000 7fce9053c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce880ae7e0 0x7fce8806d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.757+0000 7fce9053c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce880ac840 con 0x7fce880abff0 2023-11-24T06:12:14.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.757+0000 7fce9053c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8813da30 con 0x7fce8815a100 2023-11-24T06:12:14.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.757+0000 7fce9053c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880ac560 con 0x7fce880ae7e0 2023-11-24T06:12:14.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.757+0000 7fce8dad7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce880abff0 0x7fce880b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.757+0000 7fce8dad7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce880abff0 0x7fce880b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37874/0 (socket says 172.21.15.22:37874) 2023-11-24T06:12:14.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.757+0000 7fce8dad7640 1 -- 172.21.15.22:0/1706604113 learned_addr learned my addr 172.21.15.22:0/1706604113 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:14.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.758+0000 7fce8ead9640 1 --2- 172.21.15.22:0/1706604113 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce880ae7e0 0x7fce8806d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.758+0000 7fce8e2d8640 1 --2- 172.21.15.22:0/1706604113 >> v2:172.21.15.31:3300/0 conn(0x7fce8815a100 0x7fce880b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.758+0000 7fce8dad7640 1 -- 172.21.15.22:0/1706604113 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce880ae7e0 msgr2=0x7fce8806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:14.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.758+0000 7fce8dad7640 1 --2- 172.21.15.22:0/1706604113 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce880ae7e0 0x7fce8806d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.758+0000 7fce8dad7640 1 -- 172.21.15.22:0/1706604113 >> v2:172.21.15.31:3300/0 conn(0x7fce8815a100 msgr2=0x7fce880b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:14.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.758+0000 7fce8dad7640 1 --2- 172.21.15.22:0/1706604113 >> v2:172.21.15.31:3300/0 conn(0x7fce8815a100 0x7fce880b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.758+0000 7fce8dad7640 1 -- 172.21.15.22:0/1706604113 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce88070650 con 0x7fce880abff0 2023-11-24T06:12:14.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.759+0000 7fce8dad7640 1 --2- 172.21.15.22:0/1706604113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 0x7fce880b37d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fce8806bc90 tx=0x7fce7802fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48092af103a10d27 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:14.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.759+0000 7fce8d2d6640 1 -- 172.21.15.22:0/1706604113 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78030ad0 con 0x7fce880abff0 2023-11-24T06:12:14.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.760+0000 7fce8d2d6640 1 -- 172.21.15.22:0/1706604113 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78030c30 con 0x7fce880abff0 2023-11-24T06:12:14.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.760+0000 7fce8d2d6640 1 -- 172.21.15.22:0/1706604113 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78038440 con 0x7fce880abff0 2023-11-24T06:12:14.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.760+0000 7fce9053c640 1 -- 172.21.15.22:0/1706604113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 msgr2=0x7fce880b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.760+0000 7fce9053c640 1 --2- 172.21.15.22:0/1706604113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 0x7fce880b37d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fce8806bc90 tx=0x7fce7802fd20 comp rx=0 tx=0).stop 2023-11-24T06:12:14.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.761+0000 7fce9053c640 1 -- 172.21.15.22:0/1706604113 shutdown_connections 2023-11-24T06:12:14.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.761+0000 7fce9053c640 1 --2- 172.21.15.22:0/1706604113 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce880ae7e0 0x7fce8806d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.761+0000 7fce9053c640 1 --2- 172.21.15.22:0/1706604113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 0x7fce880b37d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.761+0000 7fce9053c640 1 --2- 172.21.15.22:0/1706604113 >> v2:172.21.15.31:3300/0 conn(0x7fce8815a100 0x7fce880b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.761+0000 7fce9053c640 1 -- 172.21.15.22:0/1706604113 >> 172.21.15.22:0/1706604113 conn(0x7fce880b0d80 msgr2=0x7fce880b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:14.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.761+0000 7fce9053c640 1 -- 172.21.15.22:0/1706604113 shutdown_connections 2023-11-24T06:12:14.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.761+0000 7fce9053c640 1 -- 172.21.15.22:0/1706604113 wait complete. 2023-11-24T06:12:14.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.763+0000 7fce9053c640 1 Processor -- start 2023-11-24T06:12:14.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.764+0000 7fce9053c640 1 -- start start 2023-11-24T06:12:14.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.765+0000 7fce9053c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 0x7fce8809cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.765+0000 7fce9053c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce880ae7e0 0x7fce8815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.765+0000 7fce9053c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce8815a100 0x7fce8815c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.765+0000 7fce9053c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8813f780 con 0x7fce880abff0 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.765+0000 7fce9053c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8813fa60 con 0x7fce880ae7e0 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.765+0000 7fce9053c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8813fd40 con 0x7fce8815a100 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.765+0000 7fce8e2d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 0x7fce8809cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8e2d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 0x7fce8809cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37878/0 (socket says 172.21.15.22:37878) 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8e2d8640 1 -- 172.21.15.22:0/4101446400 learned_addr learned my addr 172.21.15.22:0/4101446400 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8dad7640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce880ae7e0 0x7fce8815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8ead9640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce8815a100 0x7fce8815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8e2d8640 1 -- 172.21.15.22:0/4101446400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce8815a100 msgr2=0x7fce8815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8e2d8640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce8815a100 0x7fce8815c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8e2d8640 1 -- 172.21.15.22:0/4101446400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce880ae7e0 msgr2=0x7fce8815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8e2d8640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce880ae7e0 0x7fce8815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8e2d8640 1 -- 172.21.15.22:0/4101446400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce780094d0 con 0x7fce880abff0 2023-11-24T06:12:14.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.766+0000 7fce8e2d8640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 0x7fce8809cdb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce8400d800 tx=0x7fce8400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:14.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.767+0000 7fce7effd640 1 -- 172.21.15.22:0/4101446400 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8400b6c0 con 0x7fce880abff0 2023-11-24T06:12:14.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.767+0000 7fce7effd640 1 -- 172.21.15.22:0/4101446400 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8400b820 con 0x7fce880abff0 2023-11-24T06:12:14.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.767+0000 7fce7effd640 1 -- 172.21.15.22:0/4101446400 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8400bbb0 con 0x7fce880abff0 2023-11-24T06:12:14.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.767+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce880cc650 con 0x7fce880abff0 2023-11-24T06:12:14.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.767+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8813eae0 con 0x7fce880abff0 2023-11-24T06:12:14.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.768+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce880ae650 con 0x7fce880abff0 2023-11-24T06:12:14.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.769+0000 7fce7effd640 1 -- 172.21.15.22:0/4101446400 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce8400bd10 con 0x7fce880abff0 2023-11-24T06:12:14.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.770+0000 7fce7effd640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce6c06ae40 0x7fce6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.770+0000 7fce7effd640 1 -- 172.21.15.22:0/4101446400 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce84089bb0 con 0x7fce880abff0 2023-11-24T06:12:14.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.770+0000 7fce8dad7640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce6c06ae40 0x7fce6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.771+0000 7fce8dad7640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce6c06ae40 0x7fce6c06d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce7803a000 tx=0x7fce78034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.778+0000 7fce7effd640 1 -- 172.21.15.22:0/4101446400 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce84054bc0 con 0x7fce880abff0 2023-11-24T06:12:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.786+0000 7fa3b8651640 1 Processor -- start 2023-11-24T06:12:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.786+0000 7fa3b8651640 1 -- start start 2023-11-24T06:12:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.788+0000 7fa3b8651640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa3b00abff0 0x7fa3b00b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.788+0000 7fa3b8651640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b015c360 con 0x7fa3b00ad720 2023-11-24T06:12:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.788+0000 7fa3b8651640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b015ba30 con 0x7fa3b006d520 2023-11-24T06:12:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.788+0000 7fa3b8651640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00b41a0 con 0x7fa3b00abff0 2023-11-24T06:12:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.788+0000 7fa3b5bec640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa3b00ad720 0x7fa3b00b2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53360/0 (socket says 172.21.15.22:53360) 2023-11-24T06:12:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.788+0000 7fa3b5bec640 1 -- 172.21.15.22:0/3461237491 learned_addr learned my addr 172.21.15.22:0/3461237491 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.788+0000 7fa3b6bee640 1 --2- 172.21.15.22:0/3461237491 >> v2:172.21.15.31:3300/0 conn(0x7fa3b00abff0 0x7fa3b00b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7f0bce568640 1 Processor -- start 2023-11-24T06:12:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446473513 0 0) 0x7fa3b015c360 con 0x7fa3b00ad720 2023-11-24T06:12:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa39c003520 con 0x7fa3b00ad720 2023-11-24T06:12:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1419489915 0 0) 0x7fa39c003520 con 0x7fa3b00ad720 2023-11-24T06:12:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 >> v2:172.21.15.31:3300/0 conn(0x7fa3b00abff0 msgr2=0x7fa3b00b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 --2- 172.21.15.22:0/3461237491 >> v2:172.21.15.31:3300/0 conn(0x7fa3b00abff0 0x7fa3b00b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 >> v1:172.21.15.31:6789/0 conn(0x7fa3b006d520 legacy=0x7fa3b006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b015bd10 con 0x7fa3b00ad720 2023-11-24T06:12:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fa3a0001670 con 0x7fa3b00ad720 2023-11-24T06:12:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7f0bce568640 1 -- start start 2023-11-24T06:12:14.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 >> v1:172.21.15.22:6789/0 conn(0x7fa3b00ad720 legacy=0x7fa3b00b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa39c0039c0 0x7fa39c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c0047c0 0x7fa39c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa39c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c00c050 con 0x7fa39c005180 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c00c1c0 con 0x7fa39c0047c0 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.789+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c00c380 con 0x7fa39c0039c0 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7fa3b6bee640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa39c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7fa3b63ed640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa39c0039c0 0x7fa39c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7fa3b5bec640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c0047c0 0x7fa39c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7fa3b6bee640 1 -- 172.21.15.22:0/3461237491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa39c0039c0 msgr2=0x7fa39c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7fa3b6bee640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa39c0039c0 0x7fa39c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7fa3b6bee640 1 -- 172.21.15.22:0/3461237491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c0047c0 msgr2=0x7fa39c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7fa3b6bee640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c0047c0 0x7fa39c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7fa3b6bee640 1 -- 172.21.15.22:0/3461237491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c003520 con 0x7fa39c005180 2023-11-24T06:12:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7fa3b5bec640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c0047c0 0x7fa39c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7f0bce568640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc815d4d0 0x7f0bc80cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7f0bce568640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0bc80d1f60 0x7f0bc80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7f0bce568640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc815d8b0 con 0x7f0bc80ce260 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7f0bce568640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc80b91b0 con 0x7f0bc80d1f60 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7f0bce568640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80cdfb0 con 0x7f0bc815d4d0 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7f0bc77fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0bc80ce260 0x7f0bc80d1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53366/0 (socket says 172.21.15.22:53366) 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.790+0000 7f0bc77fe640 1 -- 172.21.15.22:0/1483930448 learned_addr learned my addr 172.21.15.22:0/1483930448 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc7fff640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc815d4d0 0x7f0bc80cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bccb05640 1 --2- 172.21.15.22:0/1483930448 >> v2:172.21.15.31:3300/0 conn(0x7f0bc80d1f60 0x7f0bc80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538474048 0 0) 0x7f0bc815d8b0 con 0x7f0bc80ce260 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb0003520 con 0x7f0bc80ce260 2023-11-24T06:12:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7fa3b6bee640 1 -- 172.21.15.22:0/3461237491 reap_dead start 2023-11-24T06:12:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3371008376 0 0) 0x7f0bb0003520 con 0x7f0bc80ce260 2023-11-24T06:12:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc815d4d0 msgr2=0x7f0bc80cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc815d4d0 0x7f0bc80cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 >> v2:172.21.15.31:3300/0 conn(0x7f0bc80d1f60 msgr2=0x7f0bc80b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 --2- 172.21.15.22:0/1483930448 >> v2:172.21.15.31:3300/0 conn(0x7f0bc80d1f60 0x7f0bc80b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80b2400 con 0x7f0bc80ce260 2023-11-24T06:12:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f0bbc001670 con 0x7f0bc80ce260 2023-11-24T06:12:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 >> v1:172.21.15.22:6789/0 conn(0x7f0bc80ce260 legacy=0x7f0bc80d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb0003970 0x7f0bb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7fa3b6bee640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa39c00b980 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009fc0 tx=0x7fa39c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e00f47e2980812 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.791+0000 7f0bc6ffd640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc815d4d0 0x7f0bb00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bc6ffd640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bb0004d00 0x7f0bb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80b91b0 con 0x7f0bb0004d00 2023-11-24T06:12:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80cdfb0 con 0x7f0bb0003970 2023-11-24T06:12:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a802cc60 con 0x7fa39c005180 2023-11-24T06:12:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a800f040 con 0x7fa39c005180 2023-11-24T06:12:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7fa3b53eb640 1 -- 172.21.15.22:0/3461237491 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8003990 con 0x7fa39c005180 2023-11-24T06:12:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb000b980 con 0x7f0bc815d4d0 2023-11-24T06:12:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bccb05640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bb0004d00 0x7f0bb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bc7fff640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb0003970 0x7f0bb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bccb05640 1 -- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc815d4d0 msgr2=0x7f0bb00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bccb05640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc815d4d0 0x7f0bb00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bccb05640 1 -- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb0003970 msgr2=0x7f0bb0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bccb05640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb0003970 0x7f0bb0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.792+0000 7f0bccb05640 1 -- 172.21.15.22:0/1483930448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0003520 con 0x7f0bb0004d00 2023-11-24T06:12:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.793+0000 7fa3b8651640 1 -- 172.21.15.22:0/3461237491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 msgr2=0x7fa39c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.793+0000 7fa3b8651640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa39c00b980 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009fc0 tx=0x7fa39c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.793+0000 7fa3b8651640 1 -- 172.21.15.22:0/3461237491 shutdown_connections 2023-11-24T06:12:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.793+0000 7fa3b8651640 1 --2- 172.21.15.22:0/3461237491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa39c00b980 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.793+0000 7fa3b8651640 1 -- 172.21.15.22:0/3461237491 >> 172.21.15.22:0/3461237491 conn(0x7fa3b00b0d80 msgr2=0x7fa3b00b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.793+0000 7fa3b8651640 1 -- 172.21.15.22:0/3461237491 shutdown_connections 2023-11-24T06:12:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.793+0000 7fa3b8651640 1 -- 172.21.15.22:0/3461237491 wait complete. 2023-11-24T06:12:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.793+0000 7f0bccb05640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bb0004d00 0x7f0bb0005180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80d0d20 tx=0x7f0bb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1256799e8d3b97c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.794+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc002cc90 con 0x7f0bb0004d00 2023-11-24T06:12:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.794+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc000f040 con 0x7f0bb0004d00 2023-11-24T06:12:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.794+0000 7f0bc6ffd640 1 -- 172.21.15.22:0/1483930448 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0034440 con 0x7f0bb0004d00 2023-11-24T06:12:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.794+0000 7f0bce568640 1 -- 172.21.15.22:0/1483930448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bb0004d00 msgr2=0x7f0bb0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.794+0000 7f0bce568640 1 --2- 172.21.15.22:0/1483930448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bb0004d00 0x7f0bb0005180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80d0d20 tx=0x7f0bb00057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.794+0000 7f0bccb05640 1 -- 172.21.15.22:0/1483930448 reap_dead start 2023-11-24T06:12:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.794+0000 7f0bce568640 1 -- 172.21.15.22:0/1483930448 shutdown_connections 2023-11-24T06:12:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.794+0000 7f0bce568640 1 -- 172.21.15.22:0/1483930448 >> 172.21.15.22:0/1483930448 conn(0x7f0bc8071f90 msgr2=0x7f0bc80723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.794+0000 7f0bce568640 1 -- 172.21.15.22:0/1483930448 shutdown_connections 2023-11-24T06:12:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.795+0000 7f0bce568640 1 -- 172.21.15.22:0/1483930448 wait complete. 2023-11-24T06:12:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.796+0000 7fa3b8651640 1 Processor -- start 2023-11-24T06:12:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.796+0000 7f0bce568640 1 Processor -- start 2023-11-24T06:12:14.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.796+0000 7fa3b8651640 1 -- start start 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.796+0000 7f0bce568640 1 -- start start 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.797+0000 7f0bce568640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bb0004d00 0x7f0bc814b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.797+0000 7f0bce568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc80cc980 0x7f0bc80ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.797+0000 7f0bce568640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc815f840 0x7f0bc815fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.797+0000 7f0bce568640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc8160200 con 0x7f0bc80cc980 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.797+0000 7f0bce568640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80cbc40 con 0x7f0bc815f840 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.797+0000 7f0bce568640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80cad50 con 0x7f0bb0004d00 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc80cc980 0x7f0bc80ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc80cc980 0x7f0bc80ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37906/0 (socket says 172.21.15.22:37906) 2023-11-24T06:12:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc77fe640 1 -- 172.21.15.22:0/4176220696 learned_addr learned my addr 172.21.15.22:0/4176220696 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7fa3b8651640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa3b015d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7fa3b8651640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3b014a500 0x7fa3b0146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc7fff640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bb0004d00 0x7f0bc814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bccb05640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc815f840 0x7f0bc815fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc77fe640 1 -- 172.21.15.22:0/4176220696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bb0004d00 msgr2=0x7f0bc814b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc77fe640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bb0004d00 0x7f0bc814b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc77fe640 1 -- 172.21.15.22:0/4176220696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc815f840 msgr2=0x7f0bc815fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc77fe640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc815f840 0x7f0bc815fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc77fe640 1 -- 172.21.15.22:0/4176220696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80cb030 con 0x7f0bc80cc980 2023-11-24T06:12:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc7fff640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bb0004d00 0x7f0bc814b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7fa3b8651640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3b00717d0 0x7fa3b0071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7fa3b8651640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00713b0 con 0x7fa39c005180 2023-11-24T06:12:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7fa3b8651640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00704b0 con 0x7fa3b014a500 2023-11-24T06:12:14.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7fa3b8651640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b015dc80 con 0x7fa3b00717d0 2023-11-24T06:12:14.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7fa3b63ed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa3b015d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7fa3b63ed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa3b015d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37914/0 (socket says 172.21.15.22:37914) 2023-11-24T06:12:14.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7fa3b63ed640 1 -- 172.21.15.22:0/2724995431 learned_addr learned my addr 172.21.15.22:0/2724995431 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:14.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.798+0000 7f0bc77fe640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc80cc980 0x7f0bc80ccde0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c770 tx=0x7f0bbc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:14.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7fa3b5bec640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3b014a500 0x7fa3b0146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7fa3b6bee640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3b00717d0 0x7fa3b0071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7f0bc4ff9640 1 -- 172.21.15.22:0/4176220696 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0074e0 con 0x7f0bc80cc980 2023-11-24T06:12:14.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7fa3b63ed640 1 -- 172.21.15.22:0/2724995431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3b00717d0 msgr2=0x7fa3b0071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7fa3b63ed640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3b00717d0 0x7fa3b0071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7f0bc4ff9640 1 -- 172.21.15.22:0/4176220696 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc007640 con 0x7f0bc80cc980 2023-11-24T06:12:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc80cb310 con 0x7f0bc80cc980 2023-11-24T06:12:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7fa3b63ed640 1 -- 172.21.15.22:0/2724995431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3b014a500 msgr2=0x7fa3b0146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7fa3b63ed640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3b014a500 0x7fa3b0146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7fa3b63ed640 1 -- 172.21.15.22:0/2724995431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0147530 con 0x7fa39c005180 2023-11-24T06:12:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7f0bc4ff9640 1 -- 172.21.15.22:0/4176220696 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc004a20 con 0x7f0bc80cc980 2023-11-24T06:12:14.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc80cb8d0 con 0x7f0bc80cc980 2023-11-24T06:12:14.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.799+0000 7fa3b63ed640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa3b015d740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00e500 tx=0x7fa3ac00e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:14.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.800+0000 7fa3a6ffd640 1 -- 172.21.15.22:0/2724995431 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0052e0 con 0x7fa39c005180 2023-11-24T06:12:14.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.800+0000 7fa3a6ffd640 1 -- 172.21.15.22:0/2724995431 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac005440 con 0x7fa39c005180 2023-11-24T06:12:14.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.800+0000 7fa3a6ffd640 1 -- 172.21.15.22:0/2724995431 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac003810 con 0x7fa39c005180 2023-11-24T06:12:14.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.800+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b0070730 con 0x7fa39c005180 2023-11-24T06:12:14.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.800+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b0070cf0 con 0x7fa39c005180 2023-11-24T06:12:14.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.800+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc8074770 con 0x7f0bc80cc980 2023-11-24T06:12:14.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.801+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0074770 con 0x7fa39c005180 2023-11-24T06:12:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.802+0000 7fa3a6ffd640 1 -- 172.21.15.22:0/2724995431 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3ac003970 con 0x7fa39c005180 2023-11-24T06:12:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.803+0000 7fa3a6ffd640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa39406ae40 0x7fa39406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.803+0000 7fa3a6ffd640 1 -- 172.21.15.22:0/2724995431 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3ac089440 con 0x7fa39c005180 2023-11-24T06:12:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.802+0000 7f0bc4ff9640 1 -- 172.21.15.22:0/4176220696 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bbc004b80 con 0x7f0bc80cc980 2023-11-24T06:12:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.803+0000 7f0bc4ff9640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0bb406ae90 0x7f0bb406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.803+0000 7fa3b5bec640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa39406ae40 0x7fa39406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.803+0000 7f0bc4ff9640 1 -- 172.21.15.22:0/4176220696 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bbc088ef0 con 0x7f0bc80cc980 2023-11-24T06:12:14.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.804+0000 7f0bc7fff640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0bb406ae90 0x7f0bb406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:14.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.804+0000 7f0bc7fff640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0bb406ae90 0x7f0bb406d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009a00 tx=0x7f0bb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:14.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.804+0000 7fa3b5bec640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa39406ae40 0x7fa39406d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00017a0 tx=0x7fa3a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:14.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.808+0000 7fa3a6ffd640 1 -- 172.21.15.22:0/2724995431 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3ac054460 con 0x7fa39c005180 2023-11-24T06:12:14.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.812+0000 7f0bc4ff9640 1 -- 172.21.15.22:0/4176220696 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0bbc053ff0 con 0x7f0bc80cc980 2023-11-24T06:12:14.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.977+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fce880cc450 con 0x7fce880abff0 2023-11-24T06:12:14.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.978+0000 7fce7effd640 1 -- 172.21.15.22:0/4101446400 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce840581e0 con 0x7fce880abff0 2023-11-24T06:12:14.980 INFO:teuthology.orchestra.run.smithi022.stdout:64424509445 2023-11-24T06:12:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce6c06ae40 msgr2=0x7fce6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce6c06ae40 0x7fce6c06d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce7803a000 tx=0x7fce78034000 comp rx=0 tx=0).stop 2023-11-24T06:12:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 msgr2=0x7fce8809cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 0x7fce8809cdb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce8400d800 tx=0x7fce8400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 shutdown_connections 2023-11-24T06:12:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce6c06ae40 0x7fce6c06d300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce8815a100 0x7fce8815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce880ae7e0 0x7fce8815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 --2- 172.21.15.22:0/4101446400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce880abff0 0x7fce8809cdb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:14.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 >> 172.21.15.22:0/4101446400 conn(0x7fce880b0d80 msgr2=0x7fce880b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:14.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 shutdown_connections 2023-11-24T06:12:14.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.980+0000 7fce9053c640 1 -- 172.21.15.22:0/4101446400 wait complete. 2023-11-24T06:12:14.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2023-11-24T06:12:15.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.996+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa3b006b450 con 0x7fa39c005180 2023-11-24T06:12:15.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.997+0000 7fa3a6ffd640 1 -- 172.21.15.22:0/2724995431 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3ac057a80 con 0x7fa39c005180 2023-11-24T06:12:15.000 INFO:teuthology.orchestra.run.smithi022.stdout:64424509446 2023-11-24T06:12:15.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa39406ae40 msgr2=0x7fa39406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:15.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa39406ae40 0x7fa39406d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00017a0 tx=0x7fa3a0009040 comp rx=0 tx=0).stop 2023-11-24T06:12:15.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 msgr2=0x7fa3b015d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:15.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa3b015d740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00e500 tx=0x7fa3ac00e9c0 comp rx=0 tx=0).stop 2023-11-24T06:12:15.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 shutdown_connections 2023-11-24T06:12:15.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa39406ae40 0x7fa39406d300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:15.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa3b00717d0 0x7fa3b0071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:15.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3b014a500 0x7fa3b0146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:15.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 --2- 172.21.15.22:0/2724995431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa39c005180 0x7fa3b015d740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:15.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 >> 172.21.15.22:0/2724995431 conn(0x7fa3b00b0d80 msgr2=0x7fa3b00aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:15.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 shutdown_connections 2023-11-24T06:12:15.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:14.999+0000 7fa3b8651640 1 -- 172.21.15.22:0/2724995431 wait complete. 2023-11-24T06:12:15.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.002+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0bc80b7650 con 0x7f0bc80cc980 2023-11-24T06:12:15.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.002+0000 7f0bc4ff9640 1 -- 172.21.15.22:0/4176220696 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0bbc018030 con 0x7f0bc80cc980 2023-11-24T06:12:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:64424509445 2023-11-24T06:12:15.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0bb406ae90 msgr2=0x7f0bb406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:15.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0bb406ae90 0x7f0bb406d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009a00 tx=0x7f0bb8008040 comp rx=0 tx=0).stop 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc80cc980 msgr2=0x7f0bc80ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc80cc980 0x7f0bc80ccde0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c770 tx=0x7f0bbc00cc30 comp rx=0 tx=0).stop 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 shutdown_connections 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0bb406ae90 0x7f0bb406d350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc815f840 0x7f0bc815fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc80cc980 0x7f0bc80ccde0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 --2- 172.21.15.22:0/4176220696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bb0004d00 0x7f0bc814b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.004+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 >> 172.21.15.22:0/4176220696 conn(0x7f0bc8071f90 msgr2=0x7f0bc80b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.005+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 shutdown_connections 2023-11-24T06:12:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:15.005+0000 7f0bce568640 1 -- 172.21.15.22:0/4176220696 wait complete. 2023-11-24T06:12:15.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2023-11-24T06:12:15.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2023-11-24T06:12:16.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T06:12:16.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T06:12:16.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T06:12:16.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.215+0000 7fb76a407640 1 Processor -- start 2023-11-24T06:12:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.215+0000 7fb76a407640 1 -- start start 2023-11-24T06:12:16.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.216+0000 7fb76a407640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb764070780 0x7fb76406d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.216+0000 7fb76a407640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb764070cd0 0x7fb76406da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.216+0000 7fb76a407640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb764071cd0 con 0x7fb764160970 2023-11-24T06:12:16.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.216+0000 7fb76a407640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7640b2120 con 0x7fb764070cd0 2023-11-24T06:12:16.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.216+0000 7fb76a407640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640b2400 con 0x7fb764070780 2023-11-24T06:12:16.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb763fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb764160970 0x7fb7640b2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53378/0 (socket says 172.21.15.22:53378) 2023-11-24T06:12:16.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb763fff640 1 -- 172.21.15.22:0/3599413545 learned_addr learned my addr 172.21.15.22:0/3599413545 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb75bfff640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb764070780 0x7fb76406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7689a4640 1 --2- 172.21.15.22:0/3599413545 >> v2:172.21.15.31:3300/0 conn(0x7fb764070cd0 0x7fb76406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329397323 0 0) 0x7fb764071cd0 con 0x7fb764160970 2023-11-24T06:12:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb750003520 con 0x7fb764160970 2023-11-24T06:12:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1616838056 0 0) 0x7fb750003520 con 0x7fb764160970 2023-11-24T06:12:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb764070780 msgr2=0x7fb76406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb764070780 0x7fb76406d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 >> v2:172.21.15.31:3300/0 conn(0x7fb764070cd0 msgr2=0x7fb76406da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 --2- 172.21.15.22:0/3599413545 >> v2:172.21.15.31:3300/0 conn(0x7fb764070cd0 0x7fb76406da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640b26e0 con 0x7fb764160970 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fb754001670 con 0x7fb764160970 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.217+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 >> v1:172.21.15.22:6789/0 conn(0x7fb764160970 legacy=0x7fb7640b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb7637fe640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb750003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb7637fe640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb764070780 0x7fb7500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb7637fe640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb750004d00 0x7fb750005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640b2120 con 0x7fb750003970 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640b2400 con 0x7fb750004d00 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75000b980 con 0x7fb764070780 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb763fff640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb750003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb763fff640 1 -- 172.21.15.22:0/3599413545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb764070780 msgr2=0x7fb7500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb763fff640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb764070780 0x7fb7500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb763fff640 1 -- 172.21.15.22:0/3599413545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb750004d00 msgr2=0x7fb750005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb763fff640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb750004d00 0x7fb750005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.218+0000 7fb763fff640 1 -- 172.21.15.22:0/3599413545 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb750003520 con 0x7fb750003970 2023-11-24T06:12:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.219+0000 7fb763fff640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb750003d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb75400c290 tx=0x7fb7500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef271ae7a41604dd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.219+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754005ad0 con 0x7fb750003970 2023-11-24T06:12:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.220+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb754005c30 con 0x7fb750003970 2023-11-24T06:12:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.220+0000 7fb7637fe640 1 -- 172.21.15.22:0/3599413545 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75402c8d0 con 0x7fb750003970 2023-11-24T06:12:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.220+0000 7fb76a407640 1 -- 172.21.15.22:0/3599413545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 msgr2=0x7fb750003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.220+0000 7fb76a407640 1 --2- 172.21.15.22:0/3599413545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb750003d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb75400c290 tx=0x7fb7500057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.220+0000 7fb7689a4640 1 -- 172.21.15.22:0/3599413545 reap_dead start 2023-11-24T06:12:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.220+0000 7fb76a407640 1 -- 172.21.15.22:0/3599413545 shutdown_connections 2023-11-24T06:12:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.220+0000 7fb76a407640 1 -- 172.21.15.22:0/3599413545 >> 172.21.15.22:0/3599413545 conn(0x7fb7640b0d80 msgr2=0x7fb7640b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.220+0000 7fb76a407640 1 -- 172.21.15.22:0/3599413545 shutdown_connections 2023-11-24T06:12:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.220+0000 7fb76a407640 1 -- 172.21.15.22:0/3599413545 wait complete. 2023-11-24T06:12:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.223+0000 7fb76a407640 1 Processor -- start 2023-11-24T06:12:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.223+0000 7fb76a407640 1 -- start start 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.223+0000 7fb76a407640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb764150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb76a407640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb76409a630 0x7fb7641f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb76a407640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb76409aab0 0x7fb76415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb76a407640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb764150960 con 0x7fb750003970 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb76a407640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76415dae0 con 0x7fb76409aab0 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb76a407640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76415ddc0 con 0x7fb76409a630 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb763fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb764150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb763fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb764150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37940/0 (socket says 172.21.15.22:37940) 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb763fff640 1 -- 172.21.15.22:0/201121459 learned_addr learned my addr 172.21.15.22:0/201121459 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb75bfff640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb76409a630 0x7fb7641f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb763fff640 1 -- 172.21.15.22:0/201121459 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb76409a630 msgr2=0x7fb7641f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb763fff640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb76409a630 0x7fb7641f2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb763fff640 1 -- 172.21.15.22:0/201121459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb76409aab0 msgr2=0x7fb76415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb763fff640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb76409aab0 0x7fb76415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.224+0000 7fb763fff640 1 -- 172.21.15.22:0/201121459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76415e0a0 con 0x7fb750003970 2023-11-24T06:12:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.225+0000 7fb763fff640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb764150420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb754001930 tx=0x7fb754000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.225+0000 7fb7617fa640 1 -- 172.21.15.22:0/201121459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754039070 con 0x7fb750003970 2023-11-24T06:12:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.225+0000 7fb7617fa640 1 -- 172.21.15.22:0/201121459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75402de10 con 0x7fb750003970 2023-11-24T06:12:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.225+0000 7fb7617fa640 1 -- 172.21.15.22:0/201121459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7540072b0 con 0x7fb750003970 2023-11-24T06:12:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.225+0000 7fb76a407640 1 -- 172.21.15.22:0/201121459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76415e380 con 0x7fb750003970 2023-11-24T06:12:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.225+0000 7fb76a407640 1 -- 172.21.15.22:0/201121459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb764099870 con 0x7fb750003970 2023-11-24T06:12:16.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.227+0000 7fb75a7fc640 1 -- 172.21.15.22:0/201121459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76415df00 con 0x7fb750003970 2023-11-24T06:12:16.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.227+0000 7fb7617fa640 1 -- 172.21.15.22:0/201121459 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb754032070 con 0x7fb750003970 2023-11-24T06:12:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.228+0000 7fb7617fa640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb74406ae40 0x7fb74406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.228+0000 7fb7617fa640 1 -- 172.21.15.22:0/201121459 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb75403c040 con 0x7fb750003970 2023-11-24T06:12:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.229+0000 7fb75bfff640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb74406ae40 0x7fb74406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.229+0000 7fb75bfff640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb74406ae40 0x7fb74406d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb764150ca0 tx=0x7fb74c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.234+0000 7fb7617fa640 1 -- 172.21.15.22:0/201121459 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb76415df00 con 0x7fb750003970 2023-11-24T06:12:16.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.245+0000 7f4175a61640 1 Processor -- start 2023-11-24T06:12:16.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.246+0000 7f4175a61640 1 -- start start 2023-11-24T06:12:16.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.246+0000 7ff32678a640 1 Processor -- start 2023-11-24T06:12:16.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.246+0000 7ff32678a640 1 -- start start 2023-11-24T06:12:16.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.247+0000 7ff32678a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff32015d4d0 0x7ff3200cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.247+0000 7ff32678a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3200ce260 0x7ff3200d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.247+0000 7ff32678a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32015d8b0 con 0x7ff3200ce6c0 2023-11-24T06:12:16.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.247+0000 7ff32678a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3200b91b0 con 0x7ff3200ce260 2023-11-24T06:12:16.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.247+0000 7ff32678a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200cdfb0 con 0x7ff32015d4d0 2023-11-24T06:12:16.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7f4175a61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417006d520 0x7f417006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7f4175a61640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417015c360 con 0x7f41700abff0 2023-11-24T06:12:16.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7f4175a61640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417015faf0 con 0x7f41700ad720 2023-11-24T06:12:16.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7f4175a61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41700b41a0 con 0x7f417006d520 2023-11-24T06:12:16.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7ff31ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff32015d4d0 0x7ff3200cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7ff31f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3200ce260 0x7ff3200d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7f416f7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f41700abff0 0x7f417015f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53388/0 (socket says 172.21.15.22:53388) 2023-11-24T06:12:16.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7f416f7fe640 1 -- 172.21.15.22:0/822169039 learned_addr learned my addr 172.21.15.22:0/822169039 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:16.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7ff31ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff32015d4d0 0x7ff3200cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:36606/0 (socket says 172.21.15.22:36606) 2023-11-24T06:12:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7ff31ffff640 1 -- 172.21.15.22:0/4038600213 learned_addr learned my addr 172.21.15.22:0/4038600213 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.248+0000 7f416effd640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417006d520 0x7f417006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639718710 0 0) 0x7f417015c360 con 0x7f41700abff0 2023-11-24T06:12:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4158003520 con 0x7f41700abff0 2023-11-24T06:12:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7ff31f7fe640 1 -- 172.21.15.22:0/4038600213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff32015d4d0 msgr2=0x7ff3200cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7ff31f7fe640 1 --2- 172.21.15.22:0/4038600213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff32015d4d0 0x7ff3200cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 662476550 0 0) 0x7f4158003520 con 0x7f41700abff0 2023-11-24T06:12:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417006d520 msgr2=0x7f417006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417006d520 0x7f417006d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7ff31f7fe640 1 -- 172.21.15.22:0/4038600213 >> v1:172.21.15.31:6789/0 conn(0x7ff3200ce6c0 legacy=0x7ff3200b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7ff31f7fe640 1 -- 172.21.15.22:0/4038600213 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3200b2400 con 0x7ff3200ce260 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 >> v1:172.21.15.31:6789/0 conn(0x7f41700ad720 legacy=0x7f417015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417006de40 con 0x7f41700abff0 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f41680019f0 con 0x7f41700abff0 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 >> v1:172.21.15.22:6789/0 conn(0x7f41700abff0 legacy=0x7f417015f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.249+0000 7f416dffb640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f4158003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416dffb640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417006d520 0x7f41580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416dffb640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158004d00 0x7f4158005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415800ba30 con 0x7f41580039a0 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415800bba0 con 0x7f4158004d00 2023-11-24T06:12:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415800bd60 con 0x7f417006d520 2023-11-24T06:12:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416effd640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f4158003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416effd640 1 -- 172.21.15.22:0/822169039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417006d520 msgr2=0x7f41580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416effd640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417006d520 0x7f41580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416effd640 1 -- 172.21.15.22:0/822169039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158004d00 msgr2=0x7f4158005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416effd640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4158004d00 0x7f4158005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.250+0000 7f416effd640 1 -- 172.21.15.22:0/822169039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4158003520 con 0x7f41580039a0 2023-11-24T06:12:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.251+0000 7ff31f7fe640 1 --2- 172.21.15.22:0/4038600213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3200ce260 0x7ff3200d1850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3140097a0 tx=0x7ff31402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fe6dadefabc15e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.251+0000 7ff31effd640 1 -- 172.21.15.22:0/4038600213 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314031780 con 0x7ff3200ce260 2023-11-24T06:12:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.251+0000 7f416effd640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f4158003dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4160009a90 tx=0x7f41580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c4a3ff7ec58d93 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.251+0000 7ff31effd640 1 -- 172.21.15.22:0/4038600213 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3140318e0 con 0x7ff3200ce260 2023-11-24T06:12:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.251+0000 7ff31effd640 1 -- 172.21.15.22:0/4038600213 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314031c70 con 0x7ff3200ce260 2023-11-24T06:12:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416002c6f0 con 0x7f41580039a0 2023-11-24T06:12:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416002c850 con 0x7f41580039a0 2023-11-24T06:12:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7ff32678a640 1 -- 172.21.15.22:0/4038600213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3200ce260 msgr2=0x7ff3200d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7ff32678a640 1 --2- 172.21.15.22:0/4038600213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3200ce260 0x7ff3200d1850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3140097a0 tx=0x7ff31402b820 comp rx=0 tx=0).stop 2023-11-24T06:12:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7ff32678a640 1 -- 172.21.15.22:0/4038600213 shutdown_connections 2023-11-24T06:12:16.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7ff32678a640 1 --2- 172.21.15.22:0/4038600213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3200ce260 0x7ff3200d1850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7ff32678a640 1 --2- 172.21.15.22:0/4038600213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff32015d4d0 0x7ff3200cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7ff32678a640 1 -- 172.21.15.22:0/4038600213 >> 172.21.15.22:0/4038600213 conn(0x7ff320071f90 msgr2=0x7ff3200723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:16.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7f416dffb640 1 -- 172.21.15.22:0/822169039 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416002cbe0 con 0x7f41580039a0 2023-11-24T06:12:16.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7ff32678a640 1 -- 172.21.15.22:0/4038600213 shutdown_connections 2023-11-24T06:12:16.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7ff32678a640 1 -- 172.21.15.22:0/4038600213 wait complete. 2023-11-24T06:12:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7f4175a61640 1 -- 172.21.15.22:0/822169039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 msgr2=0x7f4158003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7f4175a61640 1 --2- 172.21.15.22:0/822169039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f4158003dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4160009a90 tx=0x7f41580057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.252+0000 7f416f7fe640 1 -- 172.21.15.22:0/822169039 reap_dead start 2023-11-24T06:12:16.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.253+0000 7f4175a61640 1 -- 172.21.15.22:0/822169039 shutdown_connections 2023-11-24T06:12:16.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.253+0000 7f4175a61640 1 -- 172.21.15.22:0/822169039 >> 172.21.15.22:0/822169039 conn(0x7f41700b0d80 msgr2=0x7f41700b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:16.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.253+0000 7f4175a61640 1 -- 172.21.15.22:0/822169039 shutdown_connections 2023-11-24T06:12:16.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.253+0000 7f4175a61640 1 -- 172.21.15.22:0/822169039 wait complete. 2023-11-24T06:12:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.254+0000 7ff32678a640 1 Processor -- start 2023-11-24T06:12:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.254+0000 7ff32678a640 1 -- start start 2023-11-24T06:12:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.255+0000 7ff32678a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3200ce260 0x7ff320154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.255+0000 7ff32678a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3200ce6c0 0x7ff3200cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.255+0000 7ff32678a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff32015d4d0 0x7ff320154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.255+0000 7ff32678a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200cb620 con 0x7ff3200ce260 2023-11-24T06:12:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.255+0000 7ff32678a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200cb900 con 0x7ff32015d4d0 2023-11-24T06:12:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.255+0000 7ff32678a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200cbbe0 con 0x7ff3200ce6c0 2023-11-24T06:12:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3200ce260 0x7ff320154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3200ce260 0x7ff320154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37968/0 (socket says 172.21.15.22:37968) 2023-11-24T06:12:16.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31ffff640 1 -- 172.21.15.22:0/4067133182 learned_addr learned my addr 172.21.15.22:0/4067133182 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:16.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7f4175a61640 1 Processor -- start 2023-11-24T06:12:16.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31f7fe640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3200ce6c0 0x7ff3200cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31ffff640 1 -- 172.21.15.22:0/4067133182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3200ce6c0 msgr2=0x7ff3200cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31ffff640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3200ce6c0 0x7ff3200cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7f4175a61640 1 -- start start 2023-11-24T06:12:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31ffff640 1 -- 172.21.15.22:0/4067133182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff32015d4d0 msgr2=0x7ff320154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31ffff640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff32015d4d0 0x7ff320154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31ffff640 1 -- 172.21.15.22:0/4067133182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314009400 con 0x7ff3200ce260 2023-11-24T06:12:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.256+0000 7ff31ffff640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3200ce260 0x7ff320154080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff31000e840 tx=0x7ff31000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.257+0000 7ff31cff9640 1 -- 172.21.15.22:0/4067133182 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000c8e0 con 0x7ff3200ce260 2023-11-24T06:12:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.257+0000 7ff31cff9640 1 -- 172.21.15.22:0/4067133182 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31000ca40 con 0x7ff3200ce260 2023-11-24T06:12:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.257+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3200cbec0 con 0x7ff3200ce260 2023-11-24T06:12:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.257+0000 7ff31cff9640 1 -- 172.21.15.22:0/4067133182 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000cdf0 con 0x7ff3200ce260 2023-11-24T06:12:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.257+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3201545c0 con 0x7ff3200ce260 2023-11-24T06:12:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f4175a61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f41701f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f4175a61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417014b480 0x7f417009afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f4175a61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417009b520 0x7f4170099b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f4175a61640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417009b9a0 con 0x7f41580039a0 2023-11-24T06:12:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f4175a61640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41700ce8f0 con 0x7f417014b480 2023-11-24T06:12:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f4175a61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41700cc640 con 0x7f417009b520 2023-11-24T06:12:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3200b29a0 con 0x7ff3200ce260 2023-11-24T06:12:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f416effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f41701f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f416e7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417014b480 0x7f417009afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f416effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f41701f0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37976/0 (socket says 172.21.15.22:37976) 2023-11-24T06:12:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.258+0000 7f416effd640 1 -- 172.21.15.22:0/1791751332 learned_addr learned my addr 172.21.15.22:0/1791751332 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.259+0000 7f416effd640 1 -- 172.21.15.22:0/1791751332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417009b520 msgr2=0x7f4170099b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.259+0000 7f416effd640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417009b520 0x7f4170099b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.259+0000 7f416effd640 1 -- 172.21.15.22:0/1791751332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417014b480 msgr2=0x7f417009afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.259+0000 7f416effd640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417014b480 0x7f417009afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.259+0000 7f416effd640 1 -- 172.21.15.22:0/1791751332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417009a760 con 0x7f41580039a0 2023-11-24T06:12:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.259+0000 7f416effd640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f41701f0bd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4160009bb0 tx=0x7f4160004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.259+0000 7ff31cff9640 1 -- 172.21.15.22:0/4067133182 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff310013470 con 0x7ff3200ce260 2023-11-24T06:12:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.259+0000 7f4157fff640 1 -- 172.21.15.22:0/1791751332 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160003810 con 0x7f41580039a0 2023-11-24T06:12:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.259+0000 7f4157fff640 1 -- 172.21.15.22:0/1791751332 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160003970 con 0x7f41580039a0 2023-11-24T06:12:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.260+0000 7f4157fff640 1 -- 172.21.15.22:0/1791751332 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160003d00 con 0x7f41580039a0 2023-11-24T06:12:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.260+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41700cbd10 con 0x7f41580039a0 2023-11-24T06:12:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.260+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41700cc2d0 con 0x7f41580039a0 2023-11-24T06:12:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.260+0000 7ff31cff9640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff30c06ae90 0x7ff30c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.260+0000 7ff31cff9640 1 -- 172.21.15.22:0/4067133182 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff310089700 con 0x7ff3200ce260 2023-11-24T06:12:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.261+0000 7ff31f7fe640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff30c06ae90 0x7ff30c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.261+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417009b940 con 0x7f41580039a0 2023-11-24T06:12:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.262+0000 7ff31f7fe640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff30c06ae90 0x7ff30c06d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff314036000 tx=0x7ff31403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.265+0000 7ff31cff9640 1 -- 172.21.15.22:0/4067133182 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3200b29a0 con 0x7ff3200ce260 2023-11-24T06:12:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.267+0000 7f4157fff640 1 -- 172.21.15.22:0/1791751332 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4160051480 con 0x7f41580039a0 2023-11-24T06:12:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.268+0000 7f4157fff640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f415c06ae90 0x7f415c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.269+0000 7f4157fff640 1 -- 172.21.15.22:0/1791751332 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41600ab770 con 0x7f41580039a0 2023-11-24T06:12:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.269+0000 7f416e7fc640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f415c06ae90 0x7f415c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.270+0000 7f416e7fc640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f415c06ae90 0x7f415c06d350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41700b04f0 tx=0x7f4164009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.270+0000 7f4157fff640 1 -- 172.21.15.22:0/1791751332 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41600768b0 con 0x7f41580039a0 2023-11-24T06:12:16.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.442+0000 7fb75a7fc640 1 -- 172.21.15.22:0/201121459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb76415df00 con 0x7fb750003970 2023-11-24T06:12:16.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.443+0000 7fb7617fa640 1 -- 172.21.15.22:0/201121459 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb76415df00 con 0x7fb750003970 2023-11-24T06:12:16.445 INFO:teuthology.orchestra.run.smithi022.stdout:64424509447 2023-11-24T06:12:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 -- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb74406ae40 msgr2=0x7fb74406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb74406ae40 0x7fb74406d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb764150ca0 tx=0x7fb74c008040 comp rx=0 tx=0).stop 2023-11-24T06:12:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 -- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 msgr2=0x7fb764150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb764150420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb754001930 tx=0x7fb754000fe0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 -- 172.21.15.22:0/201121459 shutdown_connections 2023-11-24T06:12:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb74406ae40 0x7fb74406d300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb76409aab0 0x7fb76415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb76409a630 0x7fb7641f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 --2- 172.21.15.22:0/201121459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750003970 0x7fb764150420 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 -- 172.21.15.22:0/201121459 >> 172.21.15.22:0/201121459 conn(0x7fb7640b0d80 msgr2=0x7fb7641537b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:16.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 -- 172.21.15.22:0/201121459 shutdown_connections 2023-11-24T06:12:16.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.445+0000 7fb75a7fc640 1 -- 172.21.15.22:0/201121459 wait complete. 2023-11-24T06:12:16.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.462+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff3200b29a0 con 0x7ff3200ce260 2023-11-24T06:12:16.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2023-11-24T06:12:16.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.462+0000 7ff31cff9640 1 -- 172.21.15.22:0/4067133182 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3200b29a0 con 0x7ff3200ce260 2023-11-24T06:12:16.466 INFO:teuthology.orchestra.run.smithi022.stdout:64424509447 2023-11-24T06:12:16.466 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:16.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff30c06ae90 msgr2=0x7ff30c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff30c06ae90 0x7ff30c06d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff314036000 tx=0x7ff31403d040 comp rx=0 tx=0).stop 2023-11-24T06:12:16.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3200ce260 msgr2=0x7ff320154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3200ce260 0x7ff320154080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff31000e840 tx=0x7ff31000ed00 comp rx=0 tx=0).stop 2023-11-24T06:12:16.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 shutdown_connections 2023-11-24T06:12:16.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff30c06ae90 0x7ff30c06d350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff32015d4d0 0x7ff320154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3200ce6c0 0x7ff3200cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 --2- 172.21.15.22:0/4067133182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3200ce260 0x7ff320154080 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 >> 172.21.15.22:0/4067133182 conn(0x7ff320071f90 msgr2=0x7ff3200d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:16.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 shutdown_connections 2023-11-24T06:12:16.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.465+0000 7ff32678a640 1 -- 172.21.15.22:0/4067133182 wait complete. 2023-11-24T06:12:16.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.476+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f41700cc460 con 0x7f41580039a0 2023-11-24T06:12:16.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.476+0000 7f4157fff640 1 -- 172.21.15.22:0/1791751332 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41700cc460 con 0x7f41580039a0 2023-11-24T06:12:16.479 INFO:teuthology.orchestra.run.smithi022.stdout:64424509448 2023-11-24T06:12:16.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f415c06ae90 msgr2=0x7f415c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f415c06ae90 0x7f415c06d350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41700b04f0 tx=0x7f4164009040 comp rx=0 tx=0).stop 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 msgr2=0x7f41701f0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f41701f0bd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4160009bb0 tx=0x7f4160004730 comp rx=0 tx=0).stop 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 shutdown_connections 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f415c06ae90 0x7f415c06d350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f417009b520 0x7f4170099b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417014b480 0x7f417009afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 --2- 172.21.15.22:0/1791751332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41580039a0 0x7f41701f0bd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 >> 172.21.15.22:0/1791751332 conn(0x7f41700b0d80 msgr2=0x7f41700b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 shutdown_connections 2023-11-24T06:12:16.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.479+0000 7f4175a61640 1 -- 172.21.15.22:0/1791751332 wait complete. 2023-11-24T06:12:16.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.6 2023-11-24T06:12:16.485 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:16.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.7 2023-11-24T06:12:16.498 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:16.498 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T06:12:16.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:12:16.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.766+0000 7fdbd8a0d640 1 Processor -- start 2023-11-24T06:12:16.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.767+0000 7fdbd8a0d640 1 -- start start 2023-11-24T06:12:16.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.768+0000 7fdbd8a0d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd413dfd0 0x7fdbd415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.768+0000 7fdbd8a0d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdbd40cf050 0x7fdbd40cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.768+0000 7fdbd8a0d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd40ce7c0 con 0x7fdbd406c130 2023-11-24T06:12:16.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.768+0000 7fdbd8a0d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40cfa10 con 0x7fdbd40cf050 2023-11-24T06:12:16.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.768+0000 7fdbd8a0d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4140900 con 0x7fdbd413dfd0 2023-11-24T06:12:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.769+0000 7fdbcbfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdbd40cf050 0x7fdbd40cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.769+0000 7fdbcbfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdbd40cf050 0x7fdbd40cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37986/0 (socket says 172.21.15.22:37986) 2023-11-24T06:12:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.769+0000 7fdbcbfff640 1 -- 172.21.15.22:0/4112244301 learned_addr learned my addr 172.21.15.22:0/4112244301 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.769+0000 7fdbd2d9d640 1 --2- 172.21.15.22:0/4112244301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd413dfd0 0x7fdbd415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.769+0000 7fdbcbfff640 1 -- 172.21.15.22:0/4112244301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd413dfd0 msgr2=0x7fdbd415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.769+0000 7fdbcbfff640 1 --2- 172.21.15.22:0/4112244301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd413dfd0 0x7fdbd415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.769+0000 7fdbcbfff640 1 -- 172.21.15.22:0/4112244301 >> v1:172.21.15.31:6789/0 conn(0x7fdbd406c130 legacy=0x7fdbd406c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:16.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.769+0000 7fdbcbfff640 1 -- 172.21.15.22:0/4112244301 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd415fa70 con 0x7fdbd40cf050 2023-11-24T06:12:16.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.770+0000 7fdbcbfff640 1 --2- 172.21.15.22:0/4112244301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd40cf050 0x7fdbd40cf4d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009870 tx=0x7fdbbc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d25abc9d3f05e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.770+0000 7fdbd259c640 1 -- 172.21.15.22:0/4112244301 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc031640 con 0x7fdbd40cf050 2023-11-24T06:12:16.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd259c640 1 -- 172.21.15.22:0/4112244301 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc0317a0 con 0x7fdbd40cf050 2023-11-24T06:12:16.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd259c640 1 -- 172.21.15.22:0/4112244301 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc031b30 con 0x7fdbd40cf050 2023-11-24T06:12:16.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/4112244301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd40cf050 msgr2=0x7fdbd40cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd8a0d640 1 --2- 172.21.15.22:0/4112244301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd40cf050 0x7fdbd40cf4d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009870 tx=0x7fdbbc02b8f0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/4112244301 shutdown_connections 2023-11-24T06:12:16.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd8a0d640 1 --2- 172.21.15.22:0/4112244301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd40cf050 0x7fdbd40cf4d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd8a0d640 1 --2- 172.21.15.22:0/4112244301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd413dfd0 0x7fdbd415be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/4112244301 >> 172.21.15.22:0/4112244301 conn(0x7fdbd406a860 msgr2=0x7fdbd406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:16.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/4112244301 shutdown_connections 2023-11-24T06:12:16.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.771+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/4112244301 wait complete. 2023-11-24T06:12:16.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.773+0000 7fdbd8a0d640 1 Processor -- start 2023-11-24T06:12:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.773+0000 7fdbd8a0d640 1 -- start start 2023-11-24T06:12:16.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.774+0000 7fdbd8a0d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd406c130 0x7fdbd414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.774+0000 7fdbd8a0d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40cf050 0x7fdbd40b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.774+0000 7fdbd8a0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd413dfd0 0x7fdbd40b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.774+0000 7fdbd8a0d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4155c00 con 0x7fdbd413dfd0 2023-11-24T06:12:16.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.774+0000 7fdbd8a0d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4134080 con 0x7fdbd406c130 2023-11-24T06:12:16.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.774+0000 7fdbd8a0d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40b38b0 con 0x7fdbd40cf050 2023-11-24T06:12:16.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.774+0000 7fdbd359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd413dfd0 0x7fdbd40b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.774+0000 7fdbd359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd413dfd0 0x7fdbd40b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37988/0 (socket says 172.21.15.22:37988) 2023-11-24T06:12:16.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.774+0000 7fdbd359e640 1 -- 172.21.15.22:0/1530204398 learned_addr learned my addr 172.21.15.22:0/1530204398 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbd359e640 1 -- 172.21.15.22:0/1530204398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40cf050 msgr2=0x7fdbd40b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbd359e640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40cf050 0x7fdbd40b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbd359e640 1 -- 172.21.15.22:0/1530204398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd406c130 msgr2=0x7fdbd414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbd359e640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd406c130 0x7fdbd414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbd359e640 1 -- 172.21.15.22:0/1530204398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0094d0 con 0x7fdbd413dfd0 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbd359e640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd413dfd0 0x7fdbd40b27e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00c780 tx=0x7fdbcc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbcb7fe640 1 -- 172.21.15.22:0/1530204398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc003d80 con 0x7fdbd413dfd0 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbcb7fe640 1 -- 172.21.15.22:0/1530204398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc00ce90 con 0x7fdbd413dfd0 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbcb7fe640 1 -- 172.21.15.22:0/1530204398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0052b0 con 0x7fdbd413dfd0 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd40b2e10 con 0x7fdbd413dfd0 2023-11-24T06:12:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.775+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd4155e50 con 0x7fdbd413dfd0 2023-11-24T06:12:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.777+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd404e840 con 0x7fdbd413dfd0 2023-11-24T06:12:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.777+0000 7fdbcb7fe640 1 -- 172.21.15.22:0/1530204398 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbcc005410 con 0x7fdbd413dfd0 2023-11-24T06:12:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.778+0000 7fdbcb7fe640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdbb406ae40 0x7fdbb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.778+0000 7fdbcb7fe640 1 -- 172.21.15.22:0/1530204398 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbcc088af0 con 0x7fdbd413dfd0 2023-11-24T06:12:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.779+0000 7fdbd2d9d640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdbb406ae40 0x7fdbb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:16.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.779+0000 7fdbd2d9d640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdbb406ae40 0x7fdbb406d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdbd413f120 tx=0x7fdbc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:16.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.783+0000 7fdbcb7fe640 1 -- 172.21.15.22:0/1530204398 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdbcc053b90 con 0x7fdbd413dfd0 2023-11-24T06:12:16.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.967+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbd415f420 con 0x7fdbb406ae40 2023-11-24T06:12:16.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.979+0000 7fdbcb7fe640 1 -- 172.21.15.22:0/1530204398 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264400 (secure 0 0 0) 0x7fdbc400adc0 con 0x7fdbb406ae40 2023-11-24T06:12:16.987 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:16.988 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:12:16.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.984+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdbb406ae40 msgr2=0x7fdbb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.984+0000 7fdbd8a0d640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdbb406ae40 0x7fdbb406d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdbd413f120 tx=0x7fdbc4008040 comp rx=0 tx=0).stop 2023-11-24T06:12:16.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.984+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd413dfd0 msgr2=0x7fdbd40b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:16.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.984+0000 7fdbd8a0d640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd413dfd0 0x7fdbd40b27e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00c780 tx=0x7fdbcc00cc40 comp rx=0 tx=0).stop 2023-11-24T06:12:16.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.985+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 shutdown_connections 2023-11-24T06:12:16.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.985+0000 7fdbd8a0d640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdbb406ae40 0x7fdbb406d300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.985+0000 7fdbd8a0d640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbd413dfd0 0x7fdbd40b27e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.985+0000 7fdbd8a0d640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbd40cf050 0x7fdbd40b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.985+0000 7fdbd8a0d640 1 --2- 172.21.15.22:0/1530204398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd406c130 0x7fdbd414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:16.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.985+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 >> 172.21.15.22:0/1530204398 conn(0x7fdbd406a860 msgr2=0x7fdbd415b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:16.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.985+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 shutdown_connections 2023-11-24T06:12:16.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:16.985+0000 7fdbd8a0d640 1 -- 172.21.15.22:0/1530204398 wait complete. 2023-11-24T06:12:17.006 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-11-24T06:12:16.652750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235780,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738940,"statfs":{"total":773094113280,"available":772852674560,"internally_reserved":0,"allocated":3022848,"data_stored":1793332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005059"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386950+0000","last_change":"2023-11-24T06:12:00.409989+0000","last_active":"2023-11-24T06:12:01.386950+0000","last_peered":"2023-11-24T06:12:01.386950+0000","last_clean":"2023-11-24T06:12:01.386950+0000","last_became_active":"2023-11-24T06:12:00.409672+0000","last_became_peered":"2023-11-24T06:12:00.409672+0000","last_unstale":"2023-11-24T06:12:01.386950+0000","last_undegraded":"2023-11-24T06:12:01.386950+0000","last_fullsized":"2023-11-24T06:12:01.386950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386025+0000","last_change":"2023-11-24T06:12:00.416425+0000","last_active":"2023-11-24T06:12:01.386025+0000","last_peered":"2023-11-24T06:12:01.386025+0000","last_clean":"2023-11-24T06:12:01.386025+0000","last_became_active":"2023-11-24T06:12:00.415783+0000","last_became_peered":"2023-11-24T06:12:00.415783+0000","last_unstale":"2023-11-24T06:12:01.386025+0000","last_undegraded":"2023-11-24T06:12:01.386025+0000","last_fullsized":"2023-11-24T06:12:01.386025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:38:17.759240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811686+0000","last_change":"2023-11-24T06:12:00.408399+0000","last_active":"2023-11-24T06:12:01.811686+0000","last_peered":"2023-11-24T06:12:01.811686+0000","last_clean":"2023-11-24T06:12:01.811686+0000","last_became_active":"2023-11-24T06:12:00.408067+0000","last_became_peered":"2023-11-24T06:12:00.408067+0000","last_unstale":"2023-11-24T06:12:01.811686+0000","last_undegraded":"2023-11-24T06:12:01.811686+0000","last_fullsized":"2023-11-24T06:12:01.811686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813152+0000","last_change":"2023-11-24T06:12:00.423704+0000","last_active":"2023-11-24T06:12:01.813152+0000","last_peered":"2023-11-24T06:12:01.813152+0000","last_clean":"2023-11-24T06:12:01.813152+0000","last_became_active":"2023-11-24T06:12:00.423106+0000","last_became_peered":"2023-11-24T06:12:00.423106+0000","last_unstale":"2023-11-24T06:12:01.813152+0000","last_undegraded":"2023-11-24T06:12:01.813152+0000","last_fullsized":"2023-11-24T06:12:01.813152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:12:00.400306+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:12:00.399964+0000","last_became_peered":"2023-11-24T06:12:00.399964+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812946+0000","last_change":"2023-11-24T06:12:00.418713+0000","last_active":"2023-11-24T06:12:01.812946+0000","last_peered":"2023-11-24T06:12:01.812946+0000","last_clean":"2023-11-24T06:12:01.812946+0000","last_became_active":"2023-11-24T06:12:00.417992+0000","last_became_peered":"2023-11-24T06:12:00.417992+0000","last_unstale":"2023-11-24T06:12:01.812946+0000","last_undegraded":"2023-11-24T06:12:01.812946+0000","last_fullsized":"2023-11-24T06:12:01.812946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385528+0000","last_change":"2023-11-24T06:12:00.408860+0000","last_active":"2023-11-24T06:12:01.385528+0000","last_peered":"2023-11-24T06:12:01.385528+0000","last_clean":"2023-11-24T06:12:01.385528+0000","last_became_active":"2023-11-24T06:12:00.408549+0000","last_became_peered":"2023-11-24T06:12:00.408549+0000","last_unstale":"2023-11-24T06:12:01.385528+0000","last_undegraded":"2023-11-24T06:12:01.385528+0000","last_fullsized":"2023-11-24T06:12:01.385528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383026+0000","last_change":"2023-11-24T06:12:00.413017+0000","last_active":"2023-11-24T06:12:01.383026+0000","last_peered":"2023-11-24T06:12:01.383026+0000","last_clean":"2023-11-24T06:12:01.383026+0000","last_became_active":"2023-11-24T06:12:00.411843+0000","last_became_peered":"2023-11-24T06:12:00.411843+0000","last_unstale":"2023-11-24T06:12:01.383026+0000","last_undegraded":"2023-11-24T06:12:01.383026+0000","last_fullsized":"2023-11-24T06:12:01.383026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387045+0000","last_change":"2023-11-24T06:12:00.418547+0000","last_active":"2023-11-24T06:12:01.387045+0000","last_peered":"2023-11-24T06:12:01.387045+0000","last_clean":"2023-11-24T06:12:01.387045+0000","last_became_active":"2023-11-24T06:12:00.418264+0000","last_became_peered":"2023-11-24T06:12:00.418264+0000","last_unstale":"2023-11-24T06:12:01.387045+0000","last_undegraded":"2023-11-24T06:12:01.387045+0000","last_fullsized":"2023-11-24T06:12:01.387045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792917+0000","last_change":"2023-11-24T06:12:00.413548+0000","last_active":"2023-11-24T06:12:01.792917+0000","last_peered":"2023-11-24T06:12:01.792917+0000","last_clean":"2023-11-24T06:12:01.792917+0000","last_became_active":"2023-11-24T06:12:00.413225+0000","last_became_peered":"2023-11-24T06:12:00.413225+0000","last_unstale":"2023-11-24T06:12:01.792917+0000","last_undegraded":"2023-11-24T06:12:01.792917+0000","last_fullsized":"2023-11-24T06:12:01.792917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792746+0000","last_change":"2023-11-24T06:12:00.415528+0000","last_active":"2023-11-24T06:12:01.792746+0000","last_peered":"2023-11-24T06:12:01.792746+0000","last_clean":"2023-11-24T06:12:01.792746+0000","last_became_active":"2023-11-24T06:12:00.414074+0000","last_became_peered":"2023-11-24T06:12:00.414074+0000","last_unstale":"2023-11-24T06:12:01.792746+0000","last_undegraded":"2023-11-24T06:12:01.792746+0000","last_fullsized":"2023-11-24T06:12:01.792746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814560+0000","last_change":"2023-11-24T06:12:00.412466+0000","last_active":"2023-11-24T06:12:01.814560+0000","last_peered":"2023-11-24T06:12:01.814560+0000","last_clean":"2023-11-24T06:12:01.814560+0000","last_became_active":"2023-11-24T06:12:00.412189+0000","last_became_peered":"2023-11-24T06:12:00.412189+0000","last_unstale":"2023-11-24T06:12:01.814560+0000","last_undegraded":"2023-11-24T06:12:01.814560+0000","last_fullsized":"2023-11-24T06:12:01.814560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:33.179248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384061+0000","last_change":"2023-11-24T06:12:00.410091+0000","last_active":"2023-11-24T06:12:01.384061+0000","last_peered":"2023-11-24T06:12:01.384061+0000","last_clean":"2023-11-24T06:12:01.384061+0000","last_became_active":"2023-11-24T06:12:00.409724+0000","last_became_peered":"2023-11-24T06:12:00.409724+0000","last_unstale":"2023-11-24T06:12:01.384061+0000","last_undegraded":"2023-11-24T06:12:01.384061+0000","last_fullsized":"2023-11-24T06:12:01.384061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811279+0000","last_change":"2023-11-24T06:12:00.413928+0000","last_active":"2023-11-24T06:12:01.811279+0000","last_peered":"2023-11-24T06:12:01.811279+0000","last_clean":"2023-11-24T06:12:01.811279+0000","last_became_active":"2023-11-24T06:12:00.408524+0000","last_became_peered":"2023-11-24T06:12:00.408524+0000","last_unstale":"2023-11-24T06:12:01.811279+0000","last_undegraded":"2023-11-24T06:12:01.811279+0000","last_fullsized":"2023-11-24T06:12:01.811279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:21.383018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385301+0000","last_change":"2023-11-24T06:12:00.414487+0000","last_active":"2023-11-24T06:12:01.385301+0000","last_peered":"2023-11-24T06:12:01.385301+0000","last_clean":"2023-11-24T06:12:01.385301+0000","last_became_active":"2023-11-24T06:12:00.412548+0000","last_became_peered":"2023-11-24T06:12:00.412548+0000","last_unstale":"2023-11-24T06:12:01.385301+0000","last_undegraded":"2023-11-24T06:12:01.385301+0000","last_fullsized":"2023-11-24T06:12:01.385301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:04.491629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812440+0000","last_change":"2023-11-24T06:12:00.418298+0000","last_active":"2023-11-24T06:12:01.812440+0000","last_peered":"2023-11-24T06:12:01.812440+0000","last_clean":"2023-11-24T06:12:01.812440+0000","last_became_active":"2023-11-24T06:12:00.417933+0000","last_became_peered":"2023-11-24T06:12:00.417933+0000","last_unstale":"2023-11-24T06:12:01.812440+0000","last_undegraded":"2023-11-24T06:12:01.812440+0000","last_fullsized":"2023-11-24T06:12:01.812440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814235+0000","last_change":"2023-11-24T06:12:00.424325+0000","last_active":"2023-11-24T06:12:01.814235+0000","last_peered":"2023-11-24T06:12:01.814235+0000","last_clean":"2023-11-24T06:12:01.814235+0000","last_became_active":"2023-11-24T06:12:00.419795+0000","last_became_peered":"2023-11-24T06:12:00.419795+0000","last_unstale":"2023-11-24T06:12:01.814235+0000","last_undegraded":"2023-11-24T06:12:01.814235+0000","last_fullsized":"2023-11-24T06:12:01.814235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812634+0000","last_change":"2023-11-24T06:12:00.415065+0000","last_active":"2023-11-24T06:12:01.812634+0000","last_peered":"2023-11-24T06:12:01.812634+0000","last_clean":"2023-11-24T06:12:01.812634+0000","last_became_active":"2023-11-24T06:12:00.414686+0000","last_became_peered":"2023-11-24T06:12:00.414686+0000","last_unstale":"2023-11-24T06:12:01.812634+0000","last_undegraded":"2023-11-24T06:12:01.812634+0000","last_fullsized":"2023-11-24T06:12:01.812634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.404241+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.403972+0000","last_became_peered":"2023-11-24T06:12:00.403972+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792421+0000","last_change":"2023-11-24T06:12:00.422094+0000","last_active":"2023-11-24T06:12:01.792421+0000","last_peered":"2023-11-24T06:12:01.792421+0000","last_clean":"2023-11-24T06:12:01.792421+0000","last_became_active":"2023-11-24T06:12:00.421724+0000","last_became_peered":"2023-11-24T06:12:00.421724+0000","last_unstale":"2023-11-24T06:12:01.792421+0000","last_undegraded":"2023-11-24T06:12:01.792421+0000","last_fullsized":"2023-11-24T06:12:01.792421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811370+0000","last_change":"2023-11-24T06:12:00.411570+0000","last_active":"2023-11-24T06:12:01.811370+0000","last_peered":"2023-11-24T06:12:01.811370+0000","last_clean":"2023-11-24T06:12:01.811370+0000","last_became_active":"2023-11-24T06:12:00.411118+0000","last_became_peered":"2023-11-24T06:12:00.411118+0000","last_unstale":"2023-11-24T06:12:01.811370+0000","last_undegraded":"2023-11-24T06:12:01.811370+0000","last_fullsized":"2023-11-24T06:12:01.811370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:15.863418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814833+0000","last_change":"2023-11-24T06:12:00.417371+0000","last_active":"2023-11-24T06:12:01.814833+0000","last_peered":"2023-11-24T06:12:01.814833+0000","last_clean":"2023-11-24T06:12:01.814833+0000","last_became_active":"2023-11-24T06:12:00.417046+0000","last_became_peered":"2023-11-24T06:12:00.417046+0000","last_unstale":"2023-11-24T06:12:01.814833+0000","last_undegraded":"2023-11-24T06:12:01.814833+0000","last_fullsized":"2023-11-24T06:12:01.814833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383318+0000","last_change":"2023-11-24T06:12:00.410431+0000","last_active":"2023-11-24T06:12:01.383318+0000","last_peered":"2023-11-24T06:12:01.383318+0000","last_clean":"2023-11-24T06:12:01.383318+0000","last_became_active":"2023-11-24T06:12:00.410132+0000","last_became_peered":"2023-11-24T06:12:00.410132+0000","last_unstale":"2023-11-24T06:12:01.383318+0000","last_undegraded":"2023-11-24T06:12:01.383318+0000","last_fullsized":"2023-11-24T06:12:01.383318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812700+0000","last_change":"2023-11-24T06:12:00.417335+0000","last_active":"2023-11-24T06:12:01.812700+0000","last_peered":"2023-11-24T06:12:01.812700+0000","last_clean":"2023-11-24T06:12:01.812700+0000","last_became_active":"2023-11-24T06:12:00.416822+0000","last_became_peered":"2023-11-24T06:12:00.416822+0000","last_unstale":"2023-11-24T06:12:01.812700+0000","last_undegraded":"2023-11-24T06:12:01.812700+0000","last_fullsized":"2023-11-24T06:12:01.812700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384663+0000","last_change":"2023-11-24T06:12:00.419798+0000","last_active":"2023-11-24T06:12:01.384663+0000","last_peered":"2023-11-24T06:12:01.384663+0000","last_clean":"2023-11-24T06:12:01.384663+0000","last_became_active":"2023-11-24T06:12:00.419568+0000","last_became_peered":"2023-11-24T06:12:00.419568+0000","last_unstale":"2023-11-24T06:12:01.384663+0000","last_undegraded":"2023-11-24T06:12:01.384663+0000","last_fullsized":"2023-11-24T06:12:01.384663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.793026+0000","last_change":"2023-11-24T06:12:00.412430+0000","last_active":"2023-11-24T06:12:01.793026+0000","last_peered":"2023-11-24T06:12:01.793026+0000","last_clean":"2023-11-24T06:12:01.793026+0000","last_became_active":"2023-11-24T06:12:00.411971+0000","last_became_peered":"2023-11-24T06:12:00.411971+0000","last_unstale":"2023-11-24T06:12:01.793026+0000","last_undegraded":"2023-11-24T06:12:01.793026+0000","last_fullsized":"2023-11-24T06:12:01.793026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385763+0000","last_change":"2023-11-24T06:12:00.414558+0000","last_active":"2023-11-24T06:12:01.385763+0000","last_peered":"2023-11-24T06:12:01.385763+0000","last_clean":"2023-11-24T06:12:01.385763+0000","last_became_active":"2023-11-24T06:12:00.414279+0000","last_became_peered":"2023-11-24T06:12:00.414279+0000","last_unstale":"2023-11-24T06:12:01.385763+0000","last_undegraded":"2023-11-24T06:12:01.385763+0000","last_fullsized":"2023-11-24T06:12:01.385763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:00.298898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384237+0000","last_change":"2023-11-24T06:12:00.423044+0000","last_active":"2023-11-24T06:12:01.384237+0000","last_peered":"2023-11-24T06:12:01.384237+0000","last_clean":"2023-11-24T06:12:01.384237+0000","last_became_active":"2023-11-24T06:12:00.422684+0000","last_became_peered":"2023-11-24T06:12:00.422684+0000","last_unstale":"2023-11-24T06:12:01.384237+0000","last_undegraded":"2023-11-24T06:12:01.384237+0000","last_fullsized":"2023-11-24T06:12:01.384237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811420+0000","last_change":"2023-11-24T06:12:00.406540+0000","last_active":"2023-11-24T06:12:01.811420+0000","last_peered":"2023-11-24T06:12:01.811420+0000","last_clean":"2023-11-24T06:12:01.811420+0000","last_became_active":"2023-11-24T06:12:00.406115+0000","last_became_peered":"2023-11-24T06:12:00.406115+0000","last_unstale":"2023-11-24T06:12:01.811420+0000","last_undegraded":"2023-11-24T06:12:01.811420+0000","last_fullsized":"2023-11-24T06:12:01.811420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813334+0000","last_change":"2023-11-24T06:12:00.421363+0000","last_active":"2023-11-24T06:12:01.813334+0000","last_peered":"2023-11-24T06:12:01.813334+0000","last_clean":"2023-11-24T06:12:01.813334+0000","last_became_active":"2023-11-24T06:12:00.420976+0000","last_became_peered":"2023-11-24T06:12:00.420976+0000","last_unstale":"2023-11-24T06:12:01.813334+0000","last_undegraded":"2023-11-24T06:12:01.813334+0000","last_fullsized":"2023-11-24T06:12:01.813334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812046+0000","last_change":"2023-11-24T06:12:00.413545+0000","last_active":"2023-11-24T06:12:01.812046+0000","last_peered":"2023-11-24T06:12:01.812046+0000","last_clean":"2023-11-24T06:12:01.812046+0000","last_became_active":"2023-11-24T06:12:00.411644+0000","last_became_peered":"2023-11-24T06:12:00.411644+0000","last_unstale":"2023-11-24T06:12:01.812046+0000","last_undegraded":"2023-11-24T06:12:01.812046+0000","last_fullsized":"2023-11-24T06:12:01.812046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792092+0000","last_change":"2023-11-24T06:12:00.411309+0000","last_active":"2023-11-24T06:12:01.792092+0000","last_peered":"2023-11-24T06:12:01.792092+0000","last_clean":"2023-11-24T06:12:01.792092+0000","last_became_active":"2023-11-24T06:12:00.409967+0000","last_became_peered":"2023-11-24T06:12:00.409967+0000","last_unstale":"2023-11-24T06:12:01.792092+0000","last_undegraded":"2023-11-24T06:12:01.792092+0000","last_fullsized":"2023-11-24T06:12:01.792092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814781+0000","last_change":"2023-11-24T06:12:00.417149+0000","last_active":"2023-11-24T06:12:01.814781+0000","last_peered":"2023-11-24T06:12:01.814781+0000","last_clean":"2023-11-24T06:12:01.814781+0000","last_became_active":"2023-11-24T06:12:00.410529+0000","last_became_peered":"2023-11-24T06:12:00.410529+0000","last_unstale":"2023-11-24T06:12:01.814781+0000","last_undegraded":"2023-11-24T06:12:01.814781+0000","last_fullsized":"2023-11-24T06:12:01.814781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654819+0000","last_change":"2023-11-24T06:11:59.645470+0000","last_active":"2023-11-24T06:12:00.654819+0000","last_peered":"2023-11-24T06:12:00.654819+0000","last_clean":"2023-11-24T06:12:00.654819+0000","last_became_active":"2023-11-24T06:11:59.644424+0000","last_became_peered":"2023-11-24T06:11:59.644424+0000","last_unstale":"2023-11-24T06:12:00.654819+0000","last_undegraded":"2023-11-24T06:12:00.654819+0000","last_fullsized":"2023-11-24T06:12:00.654819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811571+0000","last_change":"2023-11-24T06:12:00.421116+0000","last_active":"2023-11-24T06:12:01.811571+0000","last_peered":"2023-11-24T06:12:01.811571+0000","last_clean":"2023-11-24T06:12:01.811571+0000","last_became_active":"2023-11-24T06:12:00.420793+0000","last_became_peered":"2023-11-24T06:12:00.420793+0000","last_unstale":"2023-11-24T06:12:01.811571+0000","last_undegraded":"2023-11-24T06:12:01.811571+0000","last_fullsized":"2023-11-24T06:12:01.811571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654126+0000","last_change":"2023-11-24T06:11:59.657132+0000","last_active":"2023-11-24T06:12:00.654126+0000","last_peered":"2023-11-24T06:12:00.654126+0000","last_clean":"2023-11-24T06:12:00.654126+0000","last_became_active":"2023-11-24T06:11:59.656475+0000","last_became_peered":"2023-11-24T06:11:59.656475+0000","last_unstale":"2023-11-24T06:12:00.654126+0000","last_undegraded":"2023-11-24T06:12:00.654126+0000","last_fullsized":"2023-11-24T06:12:00.654126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.392519+0000","last_change":"2023-11-24T06:11:59.647264+0000","last_active":"2023-11-24T06:12:00.392519+0000","last_peered":"2023-11-24T06:12:00.392519+0000","last_clean":"2023-11-24T06:12:00.392519+0000","last_became_active":"2023-11-24T06:11:59.646951+0000","last_became_peered":"2023-11-24T06:11:59.646951+0000","last_unstale":"2023-11-24T06:12:00.392519+0000","last_undegraded":"2023-11-24T06:12:00.392519+0000","last_fullsized":"2023-11-24T06:12:00.392519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383246+0000","last_change":"2023-11-24T06:12:00.410276+0000","last_active":"2023-11-24T06:12:01.383246+0000","last_peered":"2023-11-24T06:12:01.383246+0000","last_clean":"2023-11-24T06:12:01.383246+0000","last_became_active":"2023-11-24T06:12:00.407839+0000","last_became_peered":"2023-11-24T06:12:00.407839+0000","last_unstale":"2023-11-24T06:12:01.383246+0000","last_undegraded":"2023-11-24T06:12:01.383246+0000","last_fullsized":"2023-11-24T06:12:01.383246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.405489+0000","last_change":"2023-11-24T06:11:59.656673+0000","last_active":"2023-11-24T06:12:00.405489+0000","last_peered":"2023-11-24T06:12:00.405489+0000","last_clean":"2023-11-24T06:12:00.405489+0000","last_became_active":"2023-11-24T06:11:59.656322+0000","last_became_peered":"2023-11-24T06:11:59.656322+0000","last_unstale":"2023-11-24T06:12:00.405489+0000","last_undegraded":"2023-11-24T06:12:00.405489+0000","last_fullsized":"2023-11-24T06:12:00.405489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:18.929168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385041+0000","last_change":"2023-11-24T06:12:00.411377+0000","last_active":"2023-11-24T06:12:01.385041+0000","last_peered":"2023-11-24T06:12:01.385041+0000","last_clean":"2023-11-24T06:12:01.385041+0000","last_became_active":"2023-11-24T06:12:00.411117+0000","last_became_peered":"2023-11-24T06:12:00.411117+0000","last_unstale":"2023-11-24T06:12:01.385041+0000","last_undegraded":"2023-11-24T06:12:01.385041+0000","last_fullsized":"2023-11-24T06:12:01.385041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:55.958831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.404314+0000","last_change":"2023-11-24T06:11:59.652584+0000","last_active":"2023-11-24T06:12:00.404314+0000","last_peered":"2023-11-24T06:12:00.404314+0000","last_clean":"2023-11-24T06:12:00.404314+0000","last_became_active":"2023-11-24T06:11:59.652269+0000","last_became_peered":"2023-11-24T06:11:59.652269+0000","last_unstale":"2023-11-24T06:12:00.404314+0000","last_undegraded":"2023-11-24T06:12:00.404314+0000","last_fullsized":"2023-11-24T06:12:00.404314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814238+0000","last_change":"2023-11-24T06:12:00.422883+0000","last_active":"2023-11-24T06:12:01.814238+0000","last_peered":"2023-11-24T06:12:01.814238+0000","last_clean":"2023-11-24T06:12:01.814238+0000","last_became_active":"2023-11-24T06:12:00.422163+0000","last_became_peered":"2023-11-24T06:12:00.422163+0000","last_unstale":"2023-11-24T06:12:01.814238+0000","last_undegraded":"2023-11-24T06:12:01.814238+0000","last_fullsized":"2023-11-24T06:12:01.814238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406883+0000","last_change":"2023-11-24T06:11:59.649342+0000","last_active":"2023-11-24T06:12:00.406883+0000","last_peered":"2023-11-24T06:12:00.406883+0000","last_clean":"2023-11-24T06:12:00.406883+0000","last_became_active":"2023-11-24T06:11:59.649022+0000","last_became_peered":"2023-11-24T06:11:59.649022+0000","last_unstale":"2023-11-24T06:12:00.406883+0000","last_undegraded":"2023-11-24T06:12:00.406883+0000","last_fullsized":"2023-11-24T06:12:00.406883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:06.711959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812025+0000","last_change":"2023-11-24T06:12:00.418160+0000","last_active":"2023-11-24T06:12:01.812025+0000","last_peered":"2023-11-24T06:12:01.812025+0000","last_clean":"2023-11-24T06:12:01.812025+0000","last_became_active":"2023-11-24T06:12:00.417836+0000","last_became_peered":"2023-11-24T06:12:00.417836+0000","last_unstale":"2023-11-24T06:12:01.812025+0000","last_undegraded":"2023-11-24T06:12:01.812025+0000","last_fullsized":"2023-11-24T06:12:01.812025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385956+0000","last_change":"2023-11-24T06:11:59.644472+0000","last_active":"2023-11-24T06:12:01.385956+0000","last_peered":"2023-11-24T06:12:01.385956+0000","last_clean":"2023-11-24T06:12:01.385956+0000","last_became_active":"2023-11-24T06:11:59.644152+0000","last_became_peered":"2023-11-24T06:11:59.644152+0000","last_unstale":"2023-11-24T06:12:01.385956+0000","last_undegraded":"2023-11-24T06:12:01.385956+0000","last_fullsized":"2023-11-24T06:12:01.385956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:50.982166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814768+0000","last_change":"2023-11-24T06:12:00.411893+0000","last_active":"2023-11-24T06:12:01.814768+0000","last_peered":"2023-11-24T06:12:01.814768+0000","last_clean":"2023-11-24T06:12:01.814768+0000","last_became_active":"2023-11-24T06:12:00.411029+0000","last_became_peered":"2023-11-24T06:12:00.411029+0000","last_unstale":"2023-11-24T06:12:01.814768+0000","last_undegraded":"2023-11-24T06:12:01.814768+0000","last_fullsized":"2023-11-24T06:12:01.814768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:01.536292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.658392+0000","last_change":"2023-11-24T06:11:59.648134+0000","last_active":"2023-11-24T06:12:00.658392+0000","last_peered":"2023-11-24T06:12:00.658392+0000","last_clean":"2023-11-24T06:12:00.658392+0000","last_became_active":"2023-11-24T06:11:59.647824+0000","last_became_peered":"2023-11-24T06:11:59.647824+0000","last_unstale":"2023-11-24T06:12:00.658392+0000","last_undegraded":"2023-11-24T06:12:00.658392+0000","last_fullsized":"2023-11-24T06:12:00.658392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385778+0000","last_change":"2023-11-24T06:12:00.417420+0000","last_active":"2023-11-24T06:12:01.385778+0000","last_peered":"2023-11-24T06:12:01.385778+0000","last_clean":"2023-11-24T06:12:01.385778+0000","last_became_active":"2023-11-24T06:12:00.416624+0000","last_became_peered":"2023-11-24T06:12:00.416624+0000","last_unstale":"2023-11-24T06:12:01.385778+0000","last_undegraded":"2023-11-24T06:12:01.385778+0000","last_fullsized":"2023-11-24T06:12:01.385778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656684+0000","last_change":"2023-11-24T06:11:59.650532+0000","last_active":"2023-11-24T06:12:00.656684+0000","last_peered":"2023-11-24T06:12:00.656684+0000","last_clean":"2023-11-24T06:12:00.656684+0000","last_became_active":"2023-11-24T06:11:59.650193+0000","last_became_peered":"2023-11-24T06:11:59.650193+0000","last_unstale":"2023-11-24T06:12:00.656684+0000","last_undegraded":"2023-11-24T06:12:00.656684+0000","last_fullsized":"2023-11-24T06:12:00.656684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811425+0000","last_change":"2023-11-24T06:12:00.411372+0000","last_active":"2023-11-24T06:12:01.811425+0000","last_peered":"2023-11-24T06:12:01.811425+0000","last_clean":"2023-11-24T06:12:01.811425+0000","last_became_active":"2023-11-24T06:12:00.410699+0000","last_became_peered":"2023-11-24T06:12:00.410699+0000","last_unstale":"2023-11-24T06:12:01.811425+0000","last_undegraded":"2023-11-24T06:12:01.811425+0000","last_fullsized":"2023-11-24T06:12:01.811425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406094+0000","last_change":"2023-11-24T06:11:59.650677+0000","last_active":"2023-11-24T06:12:00.406094+0000","last_peered":"2023-11-24T06:12:00.406094+0000","last_clean":"2023-11-24T06:12:00.406094+0000","last_became_active":"2023-11-24T06:11:59.650368+0000","last_became_peered":"2023-11-24T06:11:59.650368+0000","last_unstale":"2023-11-24T06:12:00.406094+0000","last_undegraded":"2023-11-24T06:12:00.406094+0000","last_fullsized":"2023-11-24T06:12:00.406094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:29.182982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386237+0000","last_change":"2023-11-24T06:12:00.409066+0000","last_active":"2023-11-24T06:12:01.386237+0000","last_peered":"2023-11-24T06:12:01.386237+0000","last_clean":"2023-11-24T06:12:01.386237+0000","last_became_active":"2023-11-24T06:12:00.408722+0000","last_became_peered":"2023-11-24T06:12:00.408722+0000","last_unstale":"2023-11-24T06:12:01.386237+0000","last_undegraded":"2023-11-24T06:12:01.386237+0000","last_fullsized":"2023-11-24T06:12:01.386237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.399698+0000","last_change":"2023-11-24T06:11:59.653443+0000","last_active":"2023-11-24T06:12:00.399698+0000","last_peered":"2023-11-24T06:12:00.399698+0000","last_clean":"2023-11-24T06:12:00.399698+0000","last_became_active":"2023-11-24T06:11:59.653091+0000","last_became_peered":"2023-11-24T06:11:59.653091+0000","last_unstale":"2023-11-24T06:12:00.399698+0000","last_undegraded":"2023-11-24T06:12:00.399698+0000","last_fullsized":"2023-11-24T06:12:00.399698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792087+0000","last_change":"2023-11-24T06:12:00.415948+0000","last_active":"2023-11-24T06:12:01.792087+0000","last_peered":"2023-11-24T06:12:01.792087+0000","last_clean":"2023-11-24T06:12:01.792087+0000","last_became_active":"2023-11-24T06:12:00.415597+0000","last_became_peered":"2023-11-24T06:12:00.415597+0000","last_unstale":"2023-11-24T06:12:01.792087+0000","last_undegraded":"2023-11-24T06:12:01.792087+0000","last_fullsized":"2023-11-24T06:12:01.792087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648785+0000","last_change":"2023-11-24T06:11:59.620020+0000","last_active":"2023-11-24T06:12:00.648785+0000","last_peered":"2023-11-24T06:12:00.648785+0000","last_clean":"2023-11-24T06:12:00.648785+0000","last_became_active":"2023-11-24T06:11:59.619675+0000","last_became_peered":"2023-11-24T06:11:59.619675+0000","last_unstale":"2023-11-24T06:12:00.648785+0000","last_undegraded":"2023-11-24T06:12:00.648785+0000","last_fullsized":"2023-11-24T06:12:00.648785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385713+0000","last_change":"2023-11-24T06:12:00.412328+0000","last_active":"2023-11-24T06:12:01.385713+0000","last_peered":"2023-11-24T06:12:01.385713+0000","last_clean":"2023-11-24T06:12:01.385713+0000","last_became_active":"2023-11-24T06:12:00.412057+0000","last_became_peered":"2023-11-24T06:12:00.412057+0000","last_unstale":"2023-11-24T06:12:01.385713+0000","last_undegraded":"2023-11-24T06:12:01.385713+0000","last_fullsized":"2023-11-24T06:12:01.385713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.650279+0000","last_change":"2023-11-24T06:11:59.650120+0000","last_active":"2023-11-24T06:12:00.650279+0000","last_peered":"2023-11-24T06:12:00.650279+0000","last_clean":"2023-11-24T06:12:00.650279+0000","last_became_active":"2023-11-24T06:11:59.647975+0000","last_became_peered":"2023-11-24T06:11:59.647975+0000","last_unstale":"2023-11-24T06:12:00.650279+0000","last_undegraded":"2023-11-24T06:12:00.650279+0000","last_fullsized":"2023-11-24T06:12:00.650279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.407351+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.406978+0000","last_became_peered":"2023-11-24T06:12:00.406978+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648323+0000","last_change":"2023-11-24T06:11:59.628459+0000","last_active":"2023-11-24T06:12:00.648323+0000","last_peered":"2023-11-24T06:12:00.648323+0000","last_clean":"2023-11-24T06:12:00.648323+0000","last_became_active":"2023-11-24T06:11:59.628147+0000","last_became_peered":"2023-11-24T06:11:59.628147+0000","last_unstale":"2023-11-24T06:12:00.648323+0000","last_undegraded":"2023-11-24T06:12:00.648323+0000","last_fullsized":"2023-11-24T06:12:00.648323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387133+0000","last_change":"2023-11-24T06:12:00.424920+0000","last_active":"2023-11-24T06:12:01.387133+0000","last_peered":"2023-11-24T06:12:01.387133+0000","last_clean":"2023-11-24T06:12:01.387133+0000","last_became_active":"2023-11-24T06:12:00.423927+0000","last_became_peered":"2023-11-24T06:12:00.423927+0000","last_unstale":"2023-11-24T06:12:01.387133+0000","last_undegraded":"2023-11-24T06:12:01.387133+0000","last_fullsized":"2023-11-24T06:12:01.387133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:54:14.921315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:11:59.643977+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:11:59.643552+0000","last_became_peered":"2023-11-24T06:11:59.643552+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:02.323910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813574+0000","last_change":"2023-11-24T06:12:00.417408+0000","last_active":"2023-11-24T06:12:01.813574+0000","last_peered":"2023-11-24T06:12:01.813574+0000","last_clean":"2023-11-24T06:12:01.813574+0000","last_became_active":"2023-11-24T06:12:00.417026+0000","last_became_peered":"2023-11-24T06:12:00.417026+0000","last_unstale":"2023-11-24T06:12:01.813574+0000","last_undegraded":"2023-11-24T06:12:01.813574+0000","last_fullsized":"2023-11-24T06:12:01.813574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379381+0000","last_change":"2023-11-24T06:11:59.643121+0000","last_active":"2023-11-24T06:12:00.379381+0000","last_peered":"2023-11-24T06:12:00.379381+0000","last_clean":"2023-11-24T06:12:00.379381+0000","last_became_active":"2023-11-24T06:11:59.642797+0000","last_became_peered":"2023-11-24T06:11:59.642797+0000","last_unstale":"2023-11-24T06:12:00.379381+0000","last_undegraded":"2023-11-24T06:12:00.379381+0000","last_fullsized":"2023-11-24T06:12:00.379381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386156+0000","last_change":"2023-11-24T06:12:00.417716+0000","last_active":"2023-11-24T06:12:01.386156+0000","last_peered":"2023-11-24T06:12:01.386156+0000","last_clean":"2023-11-24T06:12:01.386156+0000","last_became_active":"2023-11-24T06:12:00.417088+0000","last_became_peered":"2023-11-24T06:12:00.417088+0000","last_unstale":"2023-11-24T06:12:01.386156+0000","last_undegraded":"2023-11-24T06:12:01.386156+0000","last_fullsized":"2023-11-24T06:12:01.386156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383162+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:12:00.383162+0000","last_peered":"2023-11-24T06:12:00.383162+0000","last_clean":"2023-11-24T06:12:00.383162+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:12:00.383162+0000","last_undegraded":"2023-11-24T06:12:00.383162+0000","last_fullsized":"2023-11-24T06:12:00.383162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.403650+0000","last_change":"2023-11-24T06:11:59.649393+0000","last_active":"2023-11-24T06:12:00.403650+0000","last_peered":"2023-11-24T06:12:00.403650+0000","last_clean":"2023-11-24T06:12:00.403650+0000","last_became_active":"2023-11-24T06:11:59.649045+0000","last_became_peered":"2023-11-24T06:11:59.649045+0000","last_unstale":"2023-11-24T06:12:00.403650+0000","last_undegraded":"2023-11-24T06:12:00.403650+0000","last_fullsized":"2023-11-24T06:12:00.403650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383623+0000","last_change":"2023-11-24T06:12:00.417107+0000","last_active":"2023-11-24T06:12:01.383623+0000","last_peered":"2023-11-24T06:12:01.383623+0000","last_clean":"2023-11-24T06:12:01.383623+0000","last_became_active":"2023-11-24T06:12:00.416181+0000","last_became_peered":"2023-11-24T06:12:00.416181+0000","last_unstale":"2023-11-24T06:12:01.383623+0000","last_undegraded":"2023-11-24T06:12:01.383623+0000","last_fullsized":"2023-11-24T06:12:01.383623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383049+0000","last_change":"2023-11-24T06:11:59.641692+0000","last_active":"2023-11-24T06:12:00.383049+0000","last_peered":"2023-11-24T06:12:00.383049+0000","last_clean":"2023-11-24T06:12:00.383049+0000","last_became_active":"2023-11-24T06:11:59.641199+0000","last_became_peered":"2023-11-24T06:11:59.641199+0000","last_unstale":"2023-11-24T06:12:00.383049+0000","last_undegraded":"2023-11-24T06:12:00.383049+0000","last_fullsized":"2023-11-24T06:12:00.383049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811125+0000","last_change":"2023-11-24T06:12:00.421725+0000","last_active":"2023-11-24T06:12:01.811125+0000","last_peered":"2023-11-24T06:12:01.811125+0000","last_clean":"2023-11-24T06:12:01.811125+0000","last_became_active":"2023-11-24T06:12:00.421402+0000","last_became_peered":"2023-11-24T06:12:00.421402+0000","last_unstale":"2023-11-24T06:12:01.811125+0000","last_undegraded":"2023-11-24T06:12:01.811125+0000","last_fullsized":"2023-11-24T06:12:01.811125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:16.430001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379330+0000","last_change":"2023-11-24T06:11:59.628457+0000","last_active":"2023-11-24T06:12:00.379330+0000","last_peered":"2023-11-24T06:12:00.379330+0000","last_clean":"2023-11-24T06:12:00.379330+0000","last_became_active":"2023-11-24T06:11:59.628109+0000","last_became_peered":"2023-11-24T06:11:59.628109+0000","last_unstale":"2023-11-24T06:12:00.379330+0000","last_undegraded":"2023-11-24T06:12:00.379330+0000","last_fullsized":"2023-11-24T06:12:00.379330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385318+0000","last_change":"2023-11-24T06:12:00.406591+0000","last_active":"2023-11-24T06:12:01.385318+0000","last_peered":"2023-11-24T06:12:01.385318+0000","last_clean":"2023-11-24T06:12:01.385318+0000","last_became_active":"2023-11-24T06:12:00.406217+0000","last_became_peered":"2023-11-24T06:12:00.406217+0000","last_unstale":"2023-11-24T06:12:01.385318+0000","last_undegraded":"2023-11-24T06:12:01.385318+0000","last_fullsized":"2023-11-24T06:12:01.385318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:49.548969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406285+0000","last_change":"2023-11-24T06:11:59.645058+0000","last_active":"2023-11-24T06:12:00.406285+0000","last_peered":"2023-11-24T06:12:00.406285+0000","last_clean":"2023-11-24T06:12:00.406285+0000","last_became_active":"2023-11-24T06:11:59.642696+0000","last_became_peered":"2023-11-24T06:11:59.642696+0000","last_unstale":"2023-11-24T06:12:00.406285+0000","last_undegraded":"2023-11-24T06:12:00.406285+0000","last_fullsized":"2023-11-24T06:12:00.406285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:17.577492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.815366+0000","last_change":"2023-11-24T06:12:00.415699+0000","last_active":"2023-11-24T06:12:01.815366+0000","last_peered":"2023-11-24T06:12:01.815366+0000","last_clean":"2023-11-24T06:12:01.815366+0000","last_became_active":"2023-11-24T06:12:00.412274+0000","last_became_peered":"2023-11-24T06:12:00.412274+0000","last_unstale":"2023-11-24T06:12:01.815366+0000","last_undegraded":"2023-11-24T06:12:01.815366+0000","last_fullsized":"2023-11-24T06:12:01.815366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385632+0000","last_change":"2023-11-24T06:11:59.633842+0000","last_active":"2023-11-24T06:12:01.385632+0000","last_peered":"2023-11-24T06:12:01.385632+0000","last_clean":"2023-11-24T06:12:01.385632+0000","last_became_active":"2023-11-24T06:11:59.632890+0000","last_became_peered":"2023-11-24T06:11:59.632890+0000","last_unstale":"2023-11-24T06:12:01.385632+0000","last_undegraded":"2023-11-24T06:12:01.385632+0000","last_fullsized":"2023-11-24T06:12:01.385632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:00.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813832+0000","last_change":"2023-11-24T06:12:00.424534+0000","last_active":"2023-11-24T06:12:01.813832+0000","last_peered":"2023-11-24T06:12:01.813832+0000","last_clean":"2023-11-24T06:12:01.813832+0000","last_became_active":"2023-11-24T06:12:00.419919+0000","last_became_peered":"2023-11-24T06:12:00.419919+0000","last_unstale":"2023-11-24T06:12:01.813832+0000","last_undegraded":"2023-11-24T06:12:01.813832+0000","last_fullsized":"2023-11-24T06:12:01.813832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.389114+0000","last_change":"2023-11-24T06:11:59.644082+0000","last_active":"2023-11-24T06:12:00.389114+0000","last_peered":"2023-11-24T06:12:00.389114+0000","last_clean":"2023-11-24T06:12:00.389114+0000","last_became_active":"2023-11-24T06:11:59.640160+0000","last_became_peered":"2023-11-24T06:11:59.640160+0000","last_unstale":"2023-11-24T06:12:00.389114+0000","last_undegraded":"2023-11-24T06:12:00.389114+0000","last_fullsized":"2023-11-24T06:12:00.389114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385733+0000","last_change":"2023-11-24T06:12:00.406268+0000","last_active":"2023-11-24T06:12:01.385733+0000","last_peered":"2023-11-24T06:12:01.385733+0000","last_clean":"2023-11-24T06:12:01.385733+0000","last_became_active":"2023-11-24T06:12:00.405965+0000","last_became_peered":"2023-11-24T06:12:00.405965+0000","last_unstale":"2023-11-24T06:12:01.385733+0000","last_undegraded":"2023-11-24T06:12:01.385733+0000","last_fullsized":"2023-11-24T06:12:01.385733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:42.193371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:02.714599+0000","last_change":"2023-11-24T06:11:59.645602+0000","last_active":"2023-11-24T06:12:02.714599+0000","last_peered":"2023-11-24T06:12:02.714599+0000","last_clean":"2023-11-24T06:12:02.714599+0000","last_became_active":"2023-11-24T06:11:59.645312+0000","last_became_peered":"2023-11-24T06:11:59.645312+0000","last_unstale":"2023-11-24T06:12:02.714599+0000","last_undegraded":"2023-11-24T06:12:02.714599+0000","last_fullsized":"2023-11-24T06:12:02.714599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:43.860695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384670+0000","last_change":"2023-11-24T06:12:00.417986+0000","last_active":"2023-11-24T06:12:01.384670+0000","last_peered":"2023-11-24T06:12:01.384670+0000","last_clean":"2023-11-24T06:12:01.384670+0000","last_became_active":"2023-11-24T06:12:00.417578+0000","last_became_peered":"2023-11-24T06:12:00.417578+0000","last_unstale":"2023-11-24T06:12:01.384670+0000","last_undegraded":"2023-11-24T06:12:01.384670+0000","last_fullsized":"2023-11-24T06:12:01.384670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656198+0000","last_change":"2023-11-24T06:11:59.648128+0000","last_active":"2023-11-24T06:12:00.656198+0000","last_peered":"2023-11-24T06:12:00.656198+0000","last_clean":"2023-11-24T06:12:00.656198+0000","last_became_active":"2023-11-24T06:11:59.647817+0000","last_became_peered":"2023-11-24T06:11:59.647817+0000","last_unstale":"2023-11-24T06:12:00.656198+0000","last_undegraded":"2023-11-24T06:12:00.656198+0000","last_fullsized":"2023-11-24T06:12:00.656198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812611+0000","last_change":"2023-11-24T06:12:00.407315+0000","last_active":"2023-11-24T06:12:01.812611+0000","last_peered":"2023-11-24T06:12:01.812611+0000","last_clean":"2023-11-24T06:12:01.812611+0000","last_became_active":"2023-11-24T06:12:00.406966+0000","last_became_peered":"2023-11-24T06:12:00.406966+0000","last_unstale":"2023-11-24T06:12:01.812611+0000","last_undegraded":"2023-11-24T06:12:01.812611+0000","last_fullsized":"2023-11-24T06:12:01.812611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.382934+0000","last_change":"2023-11-24T06:11:59.641473+0000","last_active":"2023-11-24T06:12:00.382934+0000","last_peered":"2023-11-24T06:12:00.382934+0000","last_clean":"2023-11-24T06:12:00.382934+0000","last_became_active":"2023-11-24T06:11:59.640882+0000","last_became_peered":"2023-11-24T06:11:59.640882+0000","last_unstale":"2023-11-24T06:12:00.382934+0000","last_undegraded":"2023-11-24T06:12:00.382934+0000","last_fullsized":"2023-11-24T06:12:00.382934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:15.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814297+0000","last_change":"2023-11-24T06:12:00.420629+0000","last_active":"2023-11-24T06:12:01.814297+0000","last_peered":"2023-11-24T06:12:01.814297+0000","last_clean":"2023-11-24T06:12:01.814297+0000","last_became_active":"2023-11-24T06:12:00.420121+0000","last_became_peered":"2023-11-24T06:12:00.420121+0000","last_unstale":"2023-11-24T06:12:01.814297+0000","last_undegraded":"2023-11-24T06:12:01.814297+0000","last_fullsized":"2023-11-24T06:12:01.814297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:16.361272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385138+0000","last_change":"2023-11-24T06:11:59.642028+0000","last_active":"2023-11-24T06:12:01.385138+0000","last_peered":"2023-11-24T06:12:01.385138+0000","last_clean":"2023-11-24T06:12:01.385138+0000","last_became_active":"2023-11-24T06:11:59.641734+0000","last_became_peered":"2023-11-24T06:11:59.641734+0000","last_unstale":"2023-11-24T06:12:01.385138+0000","last_undegraded":"2023-11-24T06:12:01.385138+0000","last_fullsized":"2023-11-24T06:12:01.385138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:44.578653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384138+0000","last_change":"2023-11-24T06:12:00.410266+0000","last_active":"2023-11-24T06:12:01.384138+0000","last_peered":"2023-11-24T06:12:01.384138+0000","last_clean":"2023-11-24T06:12:01.384138+0000","last_became_active":"2023-11-24T06:12:00.409968+0000","last_became_peered":"2023-11-24T06:12:00.409968+0000","last_unstale":"2023-11-24T06:12:01.384138+0000","last_undegraded":"2023-11-24T06:12:01.384138+0000","last_fullsized":"2023-11-24T06:12:01.384138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385736+0000","last_change":"2023-11-24T06:11:59.630765+0000","last_active":"2023-11-24T06:12:01.385736+0000","last_peered":"2023-11-24T06:12:01.385736+0000","last_clean":"2023-11-24T06:12:01.385736+0000","last_became_active":"2023-11-24T06:11:59.629875+0000","last_became_peered":"2023-11-24T06:11:59.629875+0000","last_unstale":"2023-11-24T06:12:01.385736+0000","last_undegraded":"2023-11-24T06:12:01.385736+0000","last_fullsized":"2023-11-24T06:12:01.385736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:19.421623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384213+0000","last_change":"2023-11-24T06:12:00.408041+0000","last_active":"2023-11-24T06:12:01.384213+0000","last_peered":"2023-11-24T06:12:01.384213+0000","last_clean":"2023-11-24T06:12:01.384213+0000","last_became_active":"2023-11-24T06:12:00.407616+0000","last_became_peered":"2023-11-24T06:12:00.407616+0000","last_unstale":"2023-11-24T06:12:01.384213+0000","last_undegraded":"2023-11-24T06:12:01.384213+0000","last_fullsized":"2023-11-24T06:12:01.384213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656982+0000","last_change":"2023-11-24T06:11:59.652850+0000","last_active":"2023-11-24T06:12:00.656982+0000","last_peered":"2023-11-24T06:12:00.656982+0000","last_clean":"2023-11-24T06:12:00.656982+0000","last_became_active":"2023-11-24T06:11:59.652583+0000","last_became_peered":"2023-11-24T06:11:59.652583+0000","last_unstale":"2023-11-24T06:12:00.656982+0000","last_undegraded":"2023-11-24T06:12:00.656982+0000","last_fullsized":"2023-11-24T06:12:00.656982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792109+0000","last_change":"2023-11-24T06:12:00.408854+0000","last_active":"2023-11-24T06:12:01.792109+0000","last_peered":"2023-11-24T06:12:01.792109+0000","last_clean":"2023-11-24T06:12:01.792109+0000","last_became_active":"2023-11-24T06:12:00.408541+0000","last_became_peered":"2023-11-24T06:12:00.408541+0000","last_unstale":"2023-11-24T06:12:01.792109+0000","last_undegraded":"2023-11-24T06:12:01.792109+0000","last_fullsized":"2023-11-24T06:12:01.792109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813395+0000","last_change":"2023-11-24T06:12:00.425989+0000","last_active":"2023-11-24T06:12:01.813395+0000","last_peered":"2023-11-24T06:12:01.813395+0000","last_clean":"2023-11-24T06:12:01.813395+0000","last_became_active":"2023-11-24T06:12:00.425649+0000","last_became_peered":"2023-11-24T06:12:00.425649+0000","last_unstale":"2023-11-24T06:12:01.813395+0000","last_undegraded":"2023-11-24T06:12:01.813395+0000","last_fullsized":"2023-11-24T06:12:01.813395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.655824+0000","last_change":"2023-11-24T06:11:59.649445+0000","last_active":"2023-11-24T06:12:00.655824+0000","last_peered":"2023-11-24T06:12:00.655824+0000","last_clean":"2023-11-24T06:12:00.655824+0000","last_became_active":"2023-11-24T06:11:59.649024+0000","last_became_peered":"2023-11-24T06:11:59.649024+0000","last_unstale":"2023-11-24T06:12:00.655824+0000","last_undegraded":"2023-11-24T06:12:00.655824+0000","last_fullsized":"2023-11-24T06:12:00.655824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813376+0000","last_change":"2023-11-24T06:12:00.425911+0000","last_active":"2023-11-24T06:12:01.813376+0000","last_peered":"2023-11-24T06:12:01.813376+0000","last_clean":"2023-11-24T06:12:01.813376+0000","last_became_active":"2023-11-24T06:12:00.425590+0000","last_became_peered":"2023-11-24T06:12:00.425590+0000","last_unstale":"2023-11-24T06:12:01.813376+0000","last_undegraded":"2023-11-24T06:12:01.813376+0000","last_fullsized":"2023-11-24T06:12:01.813376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656014+0000","last_change":"2023-11-24T06:11:59.648255+0000","last_active":"2023-11-24T06:12:00.656014+0000","last_peered":"2023-11-24T06:12:00.656014+0000","last_clean":"2023-11-24T06:12:00.656014+0000","last_became_active":"2023-11-24T06:11:59.647961+0000","last_became_peered":"2023-11-24T06:11:59.647961+0000","last_unstale":"2023-11-24T06:12:00.656014+0000","last_undegraded":"2023-11-24T06:12:00.656014+0000","last_fullsized":"2023-11-24T06:12:00.656014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811821+0000","last_change":"2023-11-24T06:12:00.415607+0000","last_active":"2023-11-24T06:12:01.811821+0000","last_peered":"2023-11-24T06:12:01.811821+0000","last_clean":"2023-11-24T06:12:01.811821+0000","last_became_active":"2023-11-24T06:12:00.415309+0000","last_became_peered":"2023-11-24T06:12:00.415309+0000","last_unstale":"2023-11-24T06:12:01.811821+0000","last_undegraded":"2023-11-24T06:12:01.811821+0000","last_fullsized":"2023-11-24T06:12:01.811821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.646459+0000","last_change":"2023-11-24T06:11:59.634657+0000","last_active":"2023-11-24T06:12:00.646459+0000","last_peered":"2023-11-24T06:12:00.646459+0000","last_clean":"2023-11-24T06:12:00.646459+0000","last_became_active":"2023-11-24T06:11:59.634335+0000","last_became_peered":"2023-11-24T06:11:59.634335+0000","last_unstale":"2023-11-24T06:12:00.646459+0000","last_undegraded":"2023-11-24T06:12:00.646459+0000","last_fullsized":"2023-11-24T06:12:00.646459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384001+0000","last_change":"2023-11-24T06:12:00.415376+0000","last_active":"2023-11-24T06:12:01.384001+0000","last_peered":"2023-11-24T06:12:01.384001+0000","last_clean":"2023-11-24T06:12:01.384001+0000","last_became_active":"2023-11-24T06:12:00.415114+0000","last_became_peered":"2023-11-24T06:12:00.415114+0000","last_unstale":"2023-11-24T06:12:01.384001+0000","last_undegraded":"2023-11-24T06:12:01.384001+0000","last_fullsized":"2023-11-24T06:12:01.384001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654742+0000","last_change":"2023-11-24T06:11:59.645253+0000","last_active":"2023-11-24T06:12:00.654742+0000","last_peered":"2023-11-24T06:12:00.654742+0000","last_clean":"2023-11-24T06:12:00.654742+0000","last_became_active":"2023-11-24T06:11:59.644979+0000","last_became_peered":"2023-11-24T06:11:59.644979+0000","last_unstale":"2023-11-24T06:12:00.654742+0000","last_undegraded":"2023-11-24T06:12:00.654742+0000","last_fullsized":"2023-11-24T06:12:00.654742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:36:07.535502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9750000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7589999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.829}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":666978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6240000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6589999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9770000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:12:17.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:12:17.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.272+0000 7f3a88bdb640 1 Processor -- start 2023-11-24T06:12:17.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.273+0000 7f3a88bdb640 1 -- start start 2023-11-24T06:12:17.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.274+0000 7f3a88bdb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a84157770 0x7f3a8406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.274+0000 7f3a88bdb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a8415df80 0x7f3a84070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.274+0000 7f3a88bdb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84161670 con 0x7f3a8406d080 2023-11-24T06:12:17.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.274+0000 7f3a88bdb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8415e410 con 0x7f3a8415df80 2023-11-24T06:12:17.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a88bdb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8406d500 con 0x7f3a84157770 2023-11-24T06:12:17.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a7bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3a8406d080 0x7f3a8415d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53404/0 (socket says 172.21.15.22:53404) 2023-11-24T06:12:17.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a7bfff640 1 -- 172.21.15.22:0/933258358 learned_addr learned my addr 172.21.15.22:0/933258358 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:17.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a83fff640 1 --2- 172.21.15.22:0/933258358 >> v2:172.21.15.22:3300/0 conn(0x7f3a8415df80 0x7f3a84070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a837fe640 1 --2- 172.21.15.22:0/933258358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a84157770 0x7f3a8406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a82ffd640 1 -- 172.21.15.22:0/933258358 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058987515 0 0) 0x7f3a84161670 con 0x7f3a8406d080 2023-11-24T06:12:17.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a82ffd640 1 -- 172.21.15.22:0/933258358 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a70003520 con 0x7f3a8406d080 2023-11-24T06:12:17.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a83fff640 1 -- 172.21.15.22:0/933258358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a84157770 msgr2=0x7f3a8406cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:17.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a83fff640 1 --2- 172.21.15.22:0/933258358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a84157770 0x7f3a8406cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a83fff640 1 -- 172.21.15.22:0/933258358 >> v1:172.21.15.22:6789/0 conn(0x7f3a8406d080 legacy=0x7f3a8415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.275+0000 7f3a83fff640 1 -- 172.21.15.22:0/933258358 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8415e610 con 0x7f3a8415df80 2023-11-24T06:12:17.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.276+0000 7f3a83fff640 1 --2- 172.21.15.22:0/933258358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a8415df80 0x7f3a84070720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009d90 tx=0x7f3a7c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743a94ab9305823 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:17.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.277+0000 7f3a82ffd640 1 -- 172.21.15.22:0/933258358 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c02cc50 con 0x7f3a8415df80 2023-11-24T06:12:17.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.277+0000 7f3a82ffd640 1 -- 172.21.15.22:0/933258358 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c02cdb0 con 0x7f3a8415df80 2023-11-24T06:12:17.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.277+0000 7f3a82ffd640 1 -- 172.21.15.22:0/933258358 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c034660 con 0x7f3a8415df80 2023-11-24T06:12:17.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.277+0000 7f3a88bdb640 1 -- 172.21.15.22:0/933258358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a8415df80 msgr2=0x7f3a84070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.277+0000 7f3a88bdb640 1 --2- 172.21.15.22:0/933258358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a8415df80 0x7f3a84070720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009d90 tx=0x7f3a7c02bea0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.277+0000 7f3a88bdb640 1 -- 172.21.15.22:0/933258358 shutdown_connections 2023-11-24T06:12:17.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.277+0000 7f3a88bdb640 1 --2- 172.21.15.22:0/933258358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a8415df80 0x7f3a84070720 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.277+0000 7f3a88bdb640 1 --2- 172.21.15.22:0/933258358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a84157770 0x7f3a8406cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.277+0000 7f3a88bdb640 1 -- 172.21.15.22:0/933258358 >> 172.21.15.22:0/933258358 conn(0x7f3a8406a860 msgr2=0x7f3a8406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:17.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.278+0000 7f3a88bdb640 1 -- 172.21.15.22:0/933258358 shutdown_connections 2023-11-24T06:12:17.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.278+0000 7f3a88bdb640 1 -- 172.21.15.22:0/933258358 wait complete. 2023-11-24T06:12:17.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.279+0000 7f3a88bdb640 1 Processor -- start 2023-11-24T06:12:17.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.279+0000 7f3a88bdb640 1 -- start start 2023-11-24T06:12:17.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.280+0000 7f3a88bdb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406d080 0x7f3a840cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.280+0000 7f3a88bdb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a84157770 0x7f3a840b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.280+0000 7f3a88bdb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415df80 0x7f3a841f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.280+0000 7f3a88bdb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840cb3b0 con 0x7f3a84157770 2023-11-24T06:12:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.280+0000 7f3a88bdb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840cad30 con 0x7f3a8415df80 2023-11-24T06:12:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.280+0000 7f3a88bdb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a841f34d0 con 0x7f3a8406d080 2023-11-24T06:12:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a84157770 0x7f3a840b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a84157770 0x7f3a840b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38002/0 (socket says 172.21.15.22:38002) 2023-11-24T06:12:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a7bfff640 1 -- 172.21.15.22:0/998426311 learned_addr learned my addr 172.21.15.22:0/998426311 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:17.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a837fe640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406d080 0x7f3a840cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a83fff640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415df80 0x7f3a841f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a7bfff640 1 -- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406d080 msgr2=0x7f3a840cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a7bfff640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406d080 0x7f3a840cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a7bfff640 1 -- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415df80 msgr2=0x7f3a841f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a7bfff640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415df80 0x7f3a841f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a7bfff640 1 -- 172.21.15.22:0/998426311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c009a70 con 0x7f3a84157770 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a837fe640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406d080 0x7f3a840cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a83fff640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415df80 0x7f3a841f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.281+0000 7f3a7bfff640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a84157770 0x7f3a840b37f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c500 tx=0x7f3a6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.282+0000 7f3a80ff9640 1 -- 172.21.15.22:0/998426311 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c005ce0 con 0x7f3a84157770 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.282+0000 7f3a80ff9640 1 -- 172.21.15.22:0/998426311 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c005e40 con 0x7f3a84157770 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.282+0000 7f3a80ff9640 1 -- 172.21.15.22:0/998426311 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c007330 con 0x7f3a84157770 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.282+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a841f37b0 con 0x7f3a84157770 2023-11-24T06:12:17.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.282+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a840cbd10 con 0x7f3a84157770 2023-11-24T06:12:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.283+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a840cb4f0 con 0x7f3a84157770 2023-11-24T06:12:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.284+0000 7f3a80ff9640 1 -- 172.21.15.22:0/998426311 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a6c007550 con 0x7f3a84157770 2023-11-24T06:12:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.285+0000 7f3a80ff9640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3a6406ae40 0x7f3a6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.285+0000 7f3a80ff9640 1 -- 172.21.15.22:0/998426311 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a6c088c40 con 0x7f3a84157770 2023-11-24T06:12:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.285+0000 7f3a837fe640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3a6406ae40 0x7f3a6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.286+0000 7f3a837fe640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3a6406ae40 0x7f3a6406d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a74006fd0 tx=0x7f3a74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:17.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.290+0000 7f3a80ff9640 1 -- 172.21.15.22:0/998426311 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a840cb4f0 con 0x7f3a84157770 2023-11-24T06:12:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.479+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a84161300 con 0x7f3a6406ae40 2023-11-24T06:12:17.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.495+0000 7f3a80ff9640 1 -- 172.21.15.22:0/998426311 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264400 (secure 0 0 0) 0x7f3a74009e10 con 0x7f3a6406ae40 2023-11-24T06:12:17.502 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:17.503 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:12:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3a6406ae40 msgr2=0x7f3a6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3a6406ae40 0x7f3a6406d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a74006fd0 tx=0x7f3a74008040 comp rx=0 tx=0).stop 2023-11-24T06:12:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a84157770 msgr2=0x7f3a840b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a84157770 0x7f3a840b37f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c500 tx=0x7f3a6c00c9c0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 shutdown_connections 2023-11-24T06:12:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3a6406ae40 0x7f3a6406d300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415df80 0x7f3a841f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a84157770 0x7f3a840b37f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 --2- 172.21.15.22:0/998426311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406d080 0x7f3a840cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 >> 172.21.15.22:0/998426311 conn(0x7f3a8406a860 msgr2=0x7f3a84155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:17.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 shutdown_connections 2023-11-24T06:12:17.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.501+0000 7f3a88bdb640 1 -- 172.21.15.22:0/998426311 wait complete. 2023-11-24T06:12:17.526 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-11-24T06:12:16.652750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235780,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738940,"statfs":{"total":773094113280,"available":772852674560,"internally_reserved":0,"allocated":3022848,"data_stored":1793332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005059"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386950+0000","last_change":"2023-11-24T06:12:00.409989+0000","last_active":"2023-11-24T06:12:01.386950+0000","last_peered":"2023-11-24T06:12:01.386950+0000","last_clean":"2023-11-24T06:12:01.386950+0000","last_became_active":"2023-11-24T06:12:00.409672+0000","last_became_peered":"2023-11-24T06:12:00.409672+0000","last_unstale":"2023-11-24T06:12:01.386950+0000","last_undegraded":"2023-11-24T06:12:01.386950+0000","last_fullsized":"2023-11-24T06:12:01.386950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386025+0000","last_change":"2023-11-24T06:12:00.416425+0000","last_active":"2023-11-24T06:12:01.386025+0000","last_peered":"2023-11-24T06:12:01.386025+0000","last_clean":"2023-11-24T06:12:01.386025+0000","last_became_active":"2023-11-24T06:12:00.415783+0000","last_became_peered":"2023-11-24T06:12:00.415783+0000","last_unstale":"2023-11-24T06:12:01.386025+0000","last_undegraded":"2023-11-24T06:12:01.386025+0000","last_fullsized":"2023-11-24T06:12:01.386025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:38:17.759240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811686+0000","last_change":"2023-11-24T06:12:00.408399+0000","last_active":"2023-11-24T06:12:01.811686+0000","last_peered":"2023-11-24T06:12:01.811686+0000","last_clean":"2023-11-24T06:12:01.811686+0000","last_became_active":"2023-11-24T06:12:00.408067+0000","last_became_peered":"2023-11-24T06:12:00.408067+0000","last_unstale":"2023-11-24T06:12:01.811686+0000","last_undegraded":"2023-11-24T06:12:01.811686+0000","last_fullsized":"2023-11-24T06:12:01.811686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813152+0000","last_change":"2023-11-24T06:12:00.423704+0000","last_active":"2023-11-24T06:12:01.813152+0000","last_peered":"2023-11-24T06:12:01.813152+0000","last_clean":"2023-11-24T06:12:01.813152+0000","last_became_active":"2023-11-24T06:12:00.423106+0000","last_became_peered":"2023-11-24T06:12:00.423106+0000","last_unstale":"2023-11-24T06:12:01.813152+0000","last_undegraded":"2023-11-24T06:12:01.813152+0000","last_fullsized":"2023-11-24T06:12:01.813152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:12:00.400306+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:12:00.399964+0000","last_became_peered":"2023-11-24T06:12:00.399964+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812946+0000","last_change":"2023-11-24T06:12:00.418713+0000","last_active":"2023-11-24T06:12:01.812946+0000","last_peered":"2023-11-24T06:12:01.812946+0000","last_clean":"2023-11-24T06:12:01.812946+0000","last_became_active":"2023-11-24T06:12:00.417992+0000","last_became_peered":"2023-11-24T06:12:00.417992+0000","last_unstale":"2023-11-24T06:12:01.812946+0000","last_undegraded":"2023-11-24T06:12:01.812946+0000","last_fullsized":"2023-11-24T06:12:01.812946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385528+0000","last_change":"2023-11-24T06:12:00.408860+0000","last_active":"2023-11-24T06:12:01.385528+0000","last_peered":"2023-11-24T06:12:01.385528+0000","last_clean":"2023-11-24T06:12:01.385528+0000","last_became_active":"2023-11-24T06:12:00.408549+0000","last_became_peered":"2023-11-24T06:12:00.408549+0000","last_unstale":"2023-11-24T06:12:01.385528+0000","last_undegraded":"2023-11-24T06:12:01.385528+0000","last_fullsized":"2023-11-24T06:12:01.385528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383026+0000","last_change":"2023-11-24T06:12:00.413017+0000","last_active":"2023-11-24T06:12:01.383026+0000","last_peered":"2023-11-24T06:12:01.383026+0000","last_clean":"2023-11-24T06:12:01.383026+0000","last_became_active":"2023-11-24T06:12:00.411843+0000","last_became_peered":"2023-11-24T06:12:00.411843+0000","last_unstale":"2023-11-24T06:12:01.383026+0000","last_undegraded":"2023-11-24T06:12:01.383026+0000","last_fullsized":"2023-11-24T06:12:01.383026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387045+0000","last_change":"2023-11-24T06:12:00.418547+0000","last_active":"2023-11-24T06:12:01.387045+0000","last_peered":"2023-11-24T06:12:01.387045+0000","last_clean":"2023-11-24T06:12:01.387045+0000","last_became_active":"2023-11-24T06:12:00.418264+0000","last_became_peered":"2023-11-24T06:12:00.418264+0000","last_unstale":"2023-11-24T06:12:01.387045+0000","last_undegraded":"2023-11-24T06:12:01.387045+0000","last_fullsized":"2023-11-24T06:12:01.387045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792917+0000","last_change":"2023-11-24T06:12:00.413548+0000","last_active":"2023-11-24T06:12:01.792917+0000","last_peered":"2023-11-24T06:12:01.792917+0000","last_clean":"2023-11-24T06:12:01.792917+0000","last_became_active":"2023-11-24T06:12:00.413225+0000","last_became_peered":"2023-11-24T06:12:00.413225+0000","last_unstale":"2023-11-24T06:12:01.792917+0000","last_undegraded":"2023-11-24T06:12:01.792917+0000","last_fullsized":"2023-11-24T06:12:01.792917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792746+0000","last_change":"2023-11-24T06:12:00.415528+0000","last_active":"2023-11-24T06:12:01.792746+0000","last_peered":"2023-11-24T06:12:01.792746+0000","last_clean":"2023-11-24T06:12:01.792746+0000","last_became_active":"2023-11-24T06:12:00.414074+0000","last_became_peered":"2023-11-24T06:12:00.414074+0000","last_unstale":"2023-11-24T06:12:01.792746+0000","last_undegraded":"2023-11-24T06:12:01.792746+0000","last_fullsized":"2023-11-24T06:12:01.792746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814560+0000","last_change":"2023-11-24T06:12:00.412466+0000","last_active":"2023-11-24T06:12:01.814560+0000","last_peered":"2023-11-24T06:12:01.814560+0000","last_clean":"2023-11-24T06:12:01.814560+0000","last_became_active":"2023-11-24T06:12:00.412189+0000","last_became_peered":"2023-11-24T06:12:00.412189+0000","last_unstale":"2023-11-24T06:12:01.814560+0000","last_undegraded":"2023-11-24T06:12:01.814560+0000","last_fullsized":"2023-11-24T06:12:01.814560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:33.179248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384061+0000","last_change":"2023-11-24T06:12:00.410091+0000","last_active":"2023-11-24T06:12:01.384061+0000","last_peered":"2023-11-24T06:12:01.384061+0000","last_clean":"2023-11-24T06:12:01.384061+0000","last_became_active":"2023-11-24T06:12:00.409724+0000","last_became_peered":"2023-11-24T06:12:00.409724+0000","last_unstale":"2023-11-24T06:12:01.384061+0000","last_undegraded":"2023-11-24T06:12:01.384061+0000","last_fullsized":"2023-11-24T06:12:01.384061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811279+0000","last_change":"2023-11-24T06:12:00.413928+0000","last_active":"2023-11-24T06:12:01.811279+0000","last_peered":"2023-11-24T06:12:01.811279+0000","last_clean":"2023-11-24T06:12:01.811279+0000","last_became_active":"2023-11-24T06:12:00.408524+0000","last_became_peered":"2023-11-24T06:12:00.408524+0000","last_unstale":"2023-11-24T06:12:01.811279+0000","last_undegraded":"2023-11-24T06:12:01.811279+0000","last_fullsized":"2023-11-24T06:12:01.811279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:21.383018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385301+0000","last_change":"2023-11-24T06:12:00.414487+0000","last_active":"2023-11-24T06:12:01.385301+0000","last_peered":"2023-11-24T06:12:01.385301+0000","last_clean":"2023-11-24T06:12:01.385301+0000","last_became_active":"2023-11-24T06:12:00.412548+0000","last_became_peered":"2023-11-24T06:12:00.412548+0000","last_unstale":"2023-11-24T06:12:01.385301+0000","last_undegraded":"2023-11-24T06:12:01.385301+0000","last_fullsized":"2023-11-24T06:12:01.385301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:04.491629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812440+0000","last_change":"2023-11-24T06:12:00.418298+0000","last_active":"2023-11-24T06:12:01.812440+0000","last_peered":"2023-11-24T06:12:01.812440+0000","last_clean":"2023-11-24T06:12:01.812440+0000","last_became_active":"2023-11-24T06:12:00.417933+0000","last_became_peered":"2023-11-24T06:12:00.417933+0000","last_unstale":"2023-11-24T06:12:01.812440+0000","last_undegraded":"2023-11-24T06:12:01.812440+0000","last_fullsized":"2023-11-24T06:12:01.812440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814235+0000","last_change":"2023-11-24T06:12:00.424325+0000","last_active":"2023-11-24T06:12:01.814235+0000","last_peered":"2023-11-24T06:12:01.814235+0000","last_clean":"2023-11-24T06:12:01.814235+0000","last_became_active":"2023-11-24T06:12:00.419795+0000","last_became_peered":"2023-11-24T06:12:00.419795+0000","last_unstale":"2023-11-24T06:12:01.814235+0000","last_undegraded":"2023-11-24T06:12:01.814235+0000","last_fullsized":"2023-11-24T06:12:01.814235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812634+0000","last_change":"2023-11-24T06:12:00.415065+0000","last_active":"2023-11-24T06:12:01.812634+0000","last_peered":"2023-11-24T06:12:01.812634+0000","last_clean":"2023-11-24T06:12:01.812634+0000","last_became_active":"2023-11-24T06:12:00.414686+0000","last_became_peered":"2023-11-24T06:12:00.414686+0000","last_unstale":"2023-11-24T06:12:01.812634+0000","last_undegraded":"2023-11-24T06:12:01.812634+0000","last_fullsized":"2023-11-24T06:12:01.812634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.404241+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.403972+0000","last_became_peered":"2023-11-24T06:12:00.403972+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792421+0000","last_change":"2023-11-24T06:12:00.422094+0000","last_active":"2023-11-24T06:12:01.792421+0000","last_peered":"2023-11-24T06:12:01.792421+0000","last_clean":"2023-11-24T06:12:01.792421+0000","last_became_active":"2023-11-24T06:12:00.421724+0000","last_became_peered":"2023-11-24T06:12:00.421724+0000","last_unstale":"2023-11-24T06:12:01.792421+0000","last_undegraded":"2023-11-24T06:12:01.792421+0000","last_fullsized":"2023-11-24T06:12:01.792421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811370+0000","last_change":"2023-11-24T06:12:00.411570+0000","last_active":"2023-11-24T06:12:01.811370+0000","last_peered":"2023-11-24T06:12:01.811370+0000","last_clean":"2023-11-24T06:12:01.811370+0000","last_became_active":"2023-11-24T06:12:00.411118+0000","last_became_peered":"2023-11-24T06:12:00.411118+0000","last_unstale":"2023-11-24T06:12:01.811370+0000","last_undegraded":"2023-11-24T06:12:01.811370+0000","last_fullsized":"2023-11-24T06:12:01.811370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:15.863418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814833+0000","last_change":"2023-11-24T06:12:00.417371+0000","last_active":"2023-11-24T06:12:01.814833+0000","last_peered":"2023-11-24T06:12:01.814833+0000","last_clean":"2023-11-24T06:12:01.814833+0000","last_became_active":"2023-11-24T06:12:00.417046+0000","last_became_peered":"2023-11-24T06:12:00.417046+0000","last_unstale":"2023-11-24T06:12:01.814833+0000","last_undegraded":"2023-11-24T06:12:01.814833+0000","last_fullsized":"2023-11-24T06:12:01.814833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:55.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383318+0000","last_change":"2023-11-24T06:12:00.410431+0000","last_active":"2023-11-24T06:12:01.383318+0000","last_peered":"2023-11-24T06:12:01.383318+0000","last_clean":"2023-11-24T06:12:01.383318+0000","last_became_active":"2023-11-24T06:12:00.410132+0000","last_became_peered":"2023-11-24T06:12:00.410132+0000","last_unstale":"2023-11-24T06:12:01.383318+0000","last_undegraded":"2023-11-24T06:12:01.383318+0000","last_fullsized":"2023-11-24T06:12:01.383318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812700+0000","last_change":"2023-11-24T06:12:00.417335+0000","last_active":"2023-11-24T06:12:01.812700+0000","last_peered":"2023-11-24T06:12:01.812700+0000","last_clean":"2023-11-24T06:12:01.812700+0000","last_became_active":"2023-11-24T06:12:00.416822+0000","last_became_peered":"2023-11-24T06:12:00.416822+0000","last_unstale":"2023-11-24T06:12:01.812700+0000","last_undegraded":"2023-11-24T06:12:01.812700+0000","last_fullsized":"2023-11-24T06:12:01.812700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384663+0000","last_change":"2023-11-24T06:12:00.419798+0000","last_active":"2023-11-24T06:12:01.384663+0000","last_peered":"2023-11-24T06:12:01.384663+0000","last_clean":"2023-11-24T06:12:01.384663+0000","last_became_active":"2023-11-24T06:12:00.419568+0000","last_became_peered":"2023-11-24T06:12:00.419568+0000","last_unstale":"2023-11-24T06:12:01.384663+0000","last_undegraded":"2023-11-24T06:12:01.384663+0000","last_fullsized":"2023-11-24T06:12:01.384663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.793026+0000","last_change":"2023-11-24T06:12:00.412430+0000","last_active":"2023-11-24T06:12:01.793026+0000","last_peered":"2023-11-24T06:12:01.793026+0000","last_clean":"2023-11-24T06:12:01.793026+0000","last_became_active":"2023-11-24T06:12:00.411971+0000","last_became_peered":"2023-11-24T06:12:00.411971+0000","last_unstale":"2023-11-24T06:12:01.793026+0000","last_undegraded":"2023-11-24T06:12:01.793026+0000","last_fullsized":"2023-11-24T06:12:01.793026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385763+0000","last_change":"2023-11-24T06:12:00.414558+0000","last_active":"2023-11-24T06:12:01.385763+0000","last_peered":"2023-11-24T06:12:01.385763+0000","last_clean":"2023-11-24T06:12:01.385763+0000","last_became_active":"2023-11-24T06:12:00.414279+0000","last_became_peered":"2023-11-24T06:12:00.414279+0000","last_unstale":"2023-11-24T06:12:01.385763+0000","last_undegraded":"2023-11-24T06:12:01.385763+0000","last_fullsized":"2023-11-24T06:12:01.385763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:00.298898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384237+0000","last_change":"2023-11-24T06:12:00.423044+0000","last_active":"2023-11-24T06:12:01.384237+0000","last_peered":"2023-11-24T06:12:01.384237+0000","last_clean":"2023-11-24T06:12:01.384237+0000","last_became_active":"2023-11-24T06:12:00.422684+0000","last_became_peered":"2023-11-24T06:12:00.422684+0000","last_unstale":"2023-11-24T06:12:01.384237+0000","last_undegraded":"2023-11-24T06:12:01.384237+0000","last_fullsized":"2023-11-24T06:12:01.384237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811420+0000","last_change":"2023-11-24T06:12:00.406540+0000","last_active":"2023-11-24T06:12:01.811420+0000","last_peered":"2023-11-24T06:12:01.811420+0000","last_clean":"2023-11-24T06:12:01.811420+0000","last_became_active":"2023-11-24T06:12:00.406115+0000","last_became_peered":"2023-11-24T06:12:00.406115+0000","last_unstale":"2023-11-24T06:12:01.811420+0000","last_undegraded":"2023-11-24T06:12:01.811420+0000","last_fullsized":"2023-11-24T06:12:01.811420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813334+0000","last_change":"2023-11-24T06:12:00.421363+0000","last_active":"2023-11-24T06:12:01.813334+0000","last_peered":"2023-11-24T06:12:01.813334+0000","last_clean":"2023-11-24T06:12:01.813334+0000","last_became_active":"2023-11-24T06:12:00.420976+0000","last_became_peered":"2023-11-24T06:12:00.420976+0000","last_unstale":"2023-11-24T06:12:01.813334+0000","last_undegraded":"2023-11-24T06:12:01.813334+0000","last_fullsized":"2023-11-24T06:12:01.813334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812046+0000","last_change":"2023-11-24T06:12:00.413545+0000","last_active":"2023-11-24T06:12:01.812046+0000","last_peered":"2023-11-24T06:12:01.812046+0000","last_clean":"2023-11-24T06:12:01.812046+0000","last_became_active":"2023-11-24T06:12:00.411644+0000","last_became_peered":"2023-11-24T06:12:00.411644+0000","last_unstale":"2023-11-24T06:12:01.812046+0000","last_undegraded":"2023-11-24T06:12:01.812046+0000","last_fullsized":"2023-11-24T06:12:01.812046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792092+0000","last_change":"2023-11-24T06:12:00.411309+0000","last_active":"2023-11-24T06:12:01.792092+0000","last_peered":"2023-11-24T06:12:01.792092+0000","last_clean":"2023-11-24T06:12:01.792092+0000","last_became_active":"2023-11-24T06:12:00.409967+0000","last_became_peered":"2023-11-24T06:12:00.409967+0000","last_unstale":"2023-11-24T06:12:01.792092+0000","last_undegraded":"2023-11-24T06:12:01.792092+0000","last_fullsized":"2023-11-24T06:12:01.792092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:26.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814781+0000","last_change":"2023-11-24T06:12:00.417149+0000","last_active":"2023-11-24T06:12:01.814781+0000","last_peered":"2023-11-24T06:12:01.814781+0000","last_clean":"2023-11-24T06:12:01.814781+0000","last_became_active":"2023-11-24T06:12:00.410529+0000","last_became_peered":"2023-11-24T06:12:00.410529+0000","last_unstale":"2023-11-24T06:12:01.814781+0000","last_undegraded":"2023-11-24T06:12:01.814781+0000","last_fullsized":"2023-11-24T06:12:01.814781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:34.267340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654819+0000","last_change":"2023-11-24T06:11:59.645470+0000","last_active":"2023-11-24T06:12:00.654819+0000","last_peered":"2023-11-24T06:12:00.654819+0000","last_clean":"2023-11-24T06:12:00.654819+0000","last_became_active":"2023-11-24T06:11:59.644424+0000","last_became_peered":"2023-11-24T06:11:59.644424+0000","last_unstale":"2023-11-24T06:12:00.654819+0000","last_undegraded":"2023-11-24T06:12:00.654819+0000","last_fullsized":"2023-11-24T06:12:00.654819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811571+0000","last_change":"2023-11-24T06:12:00.421116+0000","last_active":"2023-11-24T06:12:01.811571+0000","last_peered":"2023-11-24T06:12:01.811571+0000","last_clean":"2023-11-24T06:12:01.811571+0000","last_became_active":"2023-11-24T06:12:00.420793+0000","last_became_peered":"2023-11-24T06:12:00.420793+0000","last_unstale":"2023-11-24T06:12:01.811571+0000","last_undegraded":"2023-11-24T06:12:01.811571+0000","last_fullsized":"2023-11-24T06:12:01.811571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654126+0000","last_change":"2023-11-24T06:11:59.657132+0000","last_active":"2023-11-24T06:12:00.654126+0000","last_peered":"2023-11-24T06:12:00.654126+0000","last_clean":"2023-11-24T06:12:00.654126+0000","last_became_active":"2023-11-24T06:11:59.656475+0000","last_became_peered":"2023-11-24T06:11:59.656475+0000","last_unstale":"2023-11-24T06:12:00.654126+0000","last_undegraded":"2023-11-24T06:12:00.654126+0000","last_fullsized":"2023-11-24T06:12:00.654126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:15.415515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.392519+0000","last_change":"2023-11-24T06:11:59.647264+0000","last_active":"2023-11-24T06:12:00.392519+0000","last_peered":"2023-11-24T06:12:00.392519+0000","last_clean":"2023-11-24T06:12:00.392519+0000","last_became_active":"2023-11-24T06:11:59.646951+0000","last_became_peered":"2023-11-24T06:11:59.646951+0000","last_unstale":"2023-11-24T06:12:00.392519+0000","last_undegraded":"2023-11-24T06:12:00.392519+0000","last_fullsized":"2023-11-24T06:12:00.392519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383246+0000","last_change":"2023-11-24T06:12:00.410276+0000","last_active":"2023-11-24T06:12:01.383246+0000","last_peered":"2023-11-24T06:12:01.383246+0000","last_clean":"2023-11-24T06:12:01.383246+0000","last_became_active":"2023-11-24T06:12:00.407839+0000","last_became_peered":"2023-11-24T06:12:00.407839+0000","last_unstale":"2023-11-24T06:12:01.383246+0000","last_undegraded":"2023-11-24T06:12:01.383246+0000","last_fullsized":"2023-11-24T06:12:01.383246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.405489+0000","last_change":"2023-11-24T06:11:59.656673+0000","last_active":"2023-11-24T06:12:00.405489+0000","last_peered":"2023-11-24T06:12:00.405489+0000","last_clean":"2023-11-24T06:12:00.405489+0000","last_became_active":"2023-11-24T06:11:59.656322+0000","last_became_peered":"2023-11-24T06:11:59.656322+0000","last_unstale":"2023-11-24T06:12:00.405489+0000","last_undegraded":"2023-11-24T06:12:00.405489+0000","last_fullsized":"2023-11-24T06:12:00.405489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:18.929168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385041+0000","last_change":"2023-11-24T06:12:00.411377+0000","last_active":"2023-11-24T06:12:01.385041+0000","last_peered":"2023-11-24T06:12:01.385041+0000","last_clean":"2023-11-24T06:12:01.385041+0000","last_became_active":"2023-11-24T06:12:00.411117+0000","last_became_peered":"2023-11-24T06:12:00.411117+0000","last_unstale":"2023-11-24T06:12:01.385041+0000","last_undegraded":"2023-11-24T06:12:01.385041+0000","last_fullsized":"2023-11-24T06:12:01.385041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:55.958831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.404314+0000","last_change":"2023-11-24T06:11:59.652584+0000","last_active":"2023-11-24T06:12:00.404314+0000","last_peered":"2023-11-24T06:12:00.404314+0000","last_clean":"2023-11-24T06:12:00.404314+0000","last_became_active":"2023-11-24T06:11:59.652269+0000","last_became_peered":"2023-11-24T06:11:59.652269+0000","last_unstale":"2023-11-24T06:12:00.404314+0000","last_undegraded":"2023-11-24T06:12:00.404314+0000","last_fullsized":"2023-11-24T06:12:00.404314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814238+0000","last_change":"2023-11-24T06:12:00.422883+0000","last_active":"2023-11-24T06:12:01.814238+0000","last_peered":"2023-11-24T06:12:01.814238+0000","last_clean":"2023-11-24T06:12:01.814238+0000","last_became_active":"2023-11-24T06:12:00.422163+0000","last_became_peered":"2023-11-24T06:12:00.422163+0000","last_unstale":"2023-11-24T06:12:01.814238+0000","last_undegraded":"2023-11-24T06:12:01.814238+0000","last_fullsized":"2023-11-24T06:12:01.814238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:47.036929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406883+0000","last_change":"2023-11-24T06:11:59.649342+0000","last_active":"2023-11-24T06:12:00.406883+0000","last_peered":"2023-11-24T06:12:00.406883+0000","last_clean":"2023-11-24T06:12:00.406883+0000","last_became_active":"2023-11-24T06:11:59.649022+0000","last_became_peered":"2023-11-24T06:11:59.649022+0000","last_unstale":"2023-11-24T06:12:00.406883+0000","last_undegraded":"2023-11-24T06:12:00.406883+0000","last_fullsized":"2023-11-24T06:12:00.406883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:06.711959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812025+0000","last_change":"2023-11-24T06:12:00.418160+0000","last_active":"2023-11-24T06:12:01.812025+0000","last_peered":"2023-11-24T06:12:01.812025+0000","last_clean":"2023-11-24T06:12:01.812025+0000","last_became_active":"2023-11-24T06:12:00.417836+0000","last_became_peered":"2023-11-24T06:12:00.417836+0000","last_unstale":"2023-11-24T06:12:01.812025+0000","last_undegraded":"2023-11-24T06:12:01.812025+0000","last_fullsized":"2023-11-24T06:12:01.812025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:34:24.025660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385956+0000","last_change":"2023-11-24T06:11:59.644472+0000","last_active":"2023-11-24T06:12:01.385956+0000","last_peered":"2023-11-24T06:12:01.385956+0000","last_clean":"2023-11-24T06:12:01.385956+0000","last_became_active":"2023-11-24T06:11:59.644152+0000","last_became_peered":"2023-11-24T06:11:59.644152+0000","last_unstale":"2023-11-24T06:12:01.385956+0000","last_undegraded":"2023-11-24T06:12:01.385956+0000","last_fullsized":"2023-11-24T06:12:01.385956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:50.982166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814768+0000","last_change":"2023-11-24T06:12:00.411893+0000","last_active":"2023-11-24T06:12:01.814768+0000","last_peered":"2023-11-24T06:12:01.814768+0000","last_clean":"2023-11-24T06:12:01.814768+0000","last_became_active":"2023-11-24T06:12:00.411029+0000","last_became_peered":"2023-11-24T06:12:00.411029+0000","last_unstale":"2023-11-24T06:12:01.814768+0000","last_undegraded":"2023-11-24T06:12:01.814768+0000","last_fullsized":"2023-11-24T06:12:01.814768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:01.536292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.658392+0000","last_change":"2023-11-24T06:11:59.648134+0000","last_active":"2023-11-24T06:12:00.658392+0000","last_peered":"2023-11-24T06:12:00.658392+0000","last_clean":"2023-11-24T06:12:00.658392+0000","last_became_active":"2023-11-24T06:11:59.647824+0000","last_became_peered":"2023-11-24T06:11:59.647824+0000","last_unstale":"2023-11-24T06:12:00.658392+0000","last_undegraded":"2023-11-24T06:12:00.658392+0000","last_fullsized":"2023-11-24T06:12:00.658392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385778+0000","last_change":"2023-11-24T06:12:00.417420+0000","last_active":"2023-11-24T06:12:01.385778+0000","last_peered":"2023-11-24T06:12:01.385778+0000","last_clean":"2023-11-24T06:12:01.385778+0000","last_became_active":"2023-11-24T06:12:00.416624+0000","last_became_peered":"2023-11-24T06:12:00.416624+0000","last_unstale":"2023-11-24T06:12:01.385778+0000","last_undegraded":"2023-11-24T06:12:01.385778+0000","last_fullsized":"2023-11-24T06:12:01.385778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:04.201927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656684+0000","last_change":"2023-11-24T06:11:59.650532+0000","last_active":"2023-11-24T06:12:00.656684+0000","last_peered":"2023-11-24T06:12:00.656684+0000","last_clean":"2023-11-24T06:12:00.656684+0000","last_became_active":"2023-11-24T06:11:59.650193+0000","last_became_peered":"2023-11-24T06:11:59.650193+0000","last_unstale":"2023-11-24T06:12:00.656684+0000","last_undegraded":"2023-11-24T06:12:00.656684+0000","last_fullsized":"2023-11-24T06:12:00.656684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811425+0000","last_change":"2023-11-24T06:12:00.411372+0000","last_active":"2023-11-24T06:12:01.811425+0000","last_peered":"2023-11-24T06:12:01.811425+0000","last_clean":"2023-11-24T06:12:01.811425+0000","last_became_active":"2023-11-24T06:12:00.410699+0000","last_became_peered":"2023-11-24T06:12:00.410699+0000","last_unstale":"2023-11-24T06:12:01.811425+0000","last_undegraded":"2023-11-24T06:12:01.811425+0000","last_fullsized":"2023-11-24T06:12:01.811425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406094+0000","last_change":"2023-11-24T06:11:59.650677+0000","last_active":"2023-11-24T06:12:00.406094+0000","last_peered":"2023-11-24T06:12:00.406094+0000","last_clean":"2023-11-24T06:12:00.406094+0000","last_became_active":"2023-11-24T06:11:59.650368+0000","last_became_peered":"2023-11-24T06:11:59.650368+0000","last_unstale":"2023-11-24T06:12:00.406094+0000","last_undegraded":"2023-11-24T06:12:00.406094+0000","last_fullsized":"2023-11-24T06:12:00.406094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:29.182982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386237+0000","last_change":"2023-11-24T06:12:00.409066+0000","last_active":"2023-11-24T06:12:01.386237+0000","last_peered":"2023-11-24T06:12:01.386237+0000","last_clean":"2023-11-24T06:12:01.386237+0000","last_became_active":"2023-11-24T06:12:00.408722+0000","last_became_peered":"2023-11-24T06:12:00.408722+0000","last_unstale":"2023-11-24T06:12:01.386237+0000","last_undegraded":"2023-11-24T06:12:01.386237+0000","last_fullsized":"2023-11-24T06:12:01.386237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.399698+0000","last_change":"2023-11-24T06:11:59.653443+0000","last_active":"2023-11-24T06:12:00.399698+0000","last_peered":"2023-11-24T06:12:00.399698+0000","last_clean":"2023-11-24T06:12:00.399698+0000","last_became_active":"2023-11-24T06:11:59.653091+0000","last_became_peered":"2023-11-24T06:11:59.653091+0000","last_unstale":"2023-11-24T06:12:00.399698+0000","last_undegraded":"2023-11-24T06:12:00.399698+0000","last_fullsized":"2023-11-24T06:12:00.399698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792087+0000","last_change":"2023-11-24T06:12:00.415948+0000","last_active":"2023-11-24T06:12:01.792087+0000","last_peered":"2023-11-24T06:12:01.792087+0000","last_clean":"2023-11-24T06:12:01.792087+0000","last_became_active":"2023-11-24T06:12:00.415597+0000","last_became_peered":"2023-11-24T06:12:00.415597+0000","last_unstale":"2023-11-24T06:12:01.792087+0000","last_undegraded":"2023-11-24T06:12:01.792087+0000","last_fullsized":"2023-11-24T06:12:01.792087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:15:19.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648785+0000","last_change":"2023-11-24T06:11:59.620020+0000","last_active":"2023-11-24T06:12:00.648785+0000","last_peered":"2023-11-24T06:12:00.648785+0000","last_clean":"2023-11-24T06:12:00.648785+0000","last_became_active":"2023-11-24T06:11:59.619675+0000","last_became_peered":"2023-11-24T06:11:59.619675+0000","last_unstale":"2023-11-24T06:12:00.648785+0000","last_undegraded":"2023-11-24T06:12:00.648785+0000","last_fullsized":"2023-11-24T06:12:00.648785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:38.179433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385713+0000","last_change":"2023-11-24T06:12:00.412328+0000","last_active":"2023-11-24T06:12:01.385713+0000","last_peered":"2023-11-24T06:12:01.385713+0000","last_clean":"2023-11-24T06:12:01.385713+0000","last_became_active":"2023-11-24T06:12:00.412057+0000","last_became_peered":"2023-11-24T06:12:00.412057+0000","last_unstale":"2023-11-24T06:12:01.385713+0000","last_undegraded":"2023-11-24T06:12:01.385713+0000","last_fullsized":"2023-11-24T06:12:01.385713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:07.004391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.650279+0000","last_change":"2023-11-24T06:11:59.650120+0000","last_active":"2023-11-24T06:12:00.650279+0000","last_peered":"2023-11-24T06:12:00.650279+0000","last_clean":"2023-11-24T06:12:00.650279+0000","last_became_active":"2023-11-24T06:11:59.647975+0000","last_became_peered":"2023-11-24T06:11:59.647975+0000","last_unstale":"2023-11-24T06:12:00.650279+0000","last_undegraded":"2023-11-24T06:12:00.650279+0000","last_fullsized":"2023-11-24T06:12:00.650279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386788+0000","last_change":"2023-11-24T06:12:00.407351+0000","last_active":"2023-11-24T06:12:01.386788+0000","last_peered":"2023-11-24T06:12:01.386788+0000","last_clean":"2023-11-24T06:12:01.386788+0000","last_became_active":"2023-11-24T06:12:00.406978+0000","last_became_peered":"2023-11-24T06:12:00.406978+0000","last_unstale":"2023-11-24T06:12:01.386788+0000","last_undegraded":"2023-11-24T06:12:01.386788+0000","last_fullsized":"2023-11-24T06:12:01.386788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:44.354543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.648323+0000","last_change":"2023-11-24T06:11:59.628459+0000","last_active":"2023-11-24T06:12:00.648323+0000","last_peered":"2023-11-24T06:12:00.648323+0000","last_clean":"2023-11-24T06:12:00.648323+0000","last_became_active":"2023-11-24T06:11:59.628147+0000","last_became_peered":"2023-11-24T06:11:59.628147+0000","last_unstale":"2023-11-24T06:12:00.648323+0000","last_undegraded":"2023-11-24T06:12:00.648323+0000","last_fullsized":"2023-11-24T06:12:00.648323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.387133+0000","last_change":"2023-11-24T06:12:00.424920+0000","last_active":"2023-11-24T06:12:01.387133+0000","last_peered":"2023-11-24T06:12:01.387133+0000","last_clean":"2023-11-24T06:12:01.387133+0000","last_became_active":"2023-11-24T06:12:00.423927+0000","last_became_peered":"2023-11-24T06:12:00.423927+0000","last_unstale":"2023-11-24T06:12:01.387133+0000","last_undegraded":"2023-11-24T06:12:01.387133+0000","last_fullsized":"2023-11-24T06:12:01.387133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:54:14.921315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386089+0000","last_change":"2023-11-24T06:11:59.643977+0000","last_active":"2023-11-24T06:12:01.386089+0000","last_peered":"2023-11-24T06:12:01.386089+0000","last_clean":"2023-11-24T06:12:01.386089+0000","last_became_active":"2023-11-24T06:11:59.643552+0000","last_became_peered":"2023-11-24T06:11:59.643552+0000","last_unstale":"2023-11-24T06:12:01.386089+0000","last_undegraded":"2023-11-24T06:12:01.386089+0000","last_fullsized":"2023-11-24T06:12:01.386089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:02.323910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813574+0000","last_change":"2023-11-24T06:12:00.417408+0000","last_active":"2023-11-24T06:12:01.813574+0000","last_peered":"2023-11-24T06:12:01.813574+0000","last_clean":"2023-11-24T06:12:01.813574+0000","last_became_active":"2023-11-24T06:12:00.417026+0000","last_became_peered":"2023-11-24T06:12:00.417026+0000","last_unstale":"2023-11-24T06:12:01.813574+0000","last_undegraded":"2023-11-24T06:12:01.813574+0000","last_fullsized":"2023-11-24T06:12:01.813574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:02.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379381+0000","last_change":"2023-11-24T06:11:59.643121+0000","last_active":"2023-11-24T06:12:00.379381+0000","last_peered":"2023-11-24T06:12:00.379381+0000","last_clean":"2023-11-24T06:12:00.379381+0000","last_became_active":"2023-11-24T06:11:59.642797+0000","last_became_peered":"2023-11-24T06:11:59.642797+0000","last_unstale":"2023-11-24T06:12:00.379381+0000","last_undegraded":"2023-11-24T06:12:00.379381+0000","last_fullsized":"2023-11-24T06:12:00.379381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:15:12.802511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.386156+0000","last_change":"2023-11-24T06:12:00.417716+0000","last_active":"2023-11-24T06:12:01.386156+0000","last_peered":"2023-11-24T06:12:01.386156+0000","last_clean":"2023-11-24T06:12:01.386156+0000","last_became_active":"2023-11-24T06:12:00.417088+0000","last_became_peered":"2023-11-24T06:12:00.417088+0000","last_unstale":"2023-11-24T06:12:01.386156+0000","last_undegraded":"2023-11-24T06:12:01.386156+0000","last_fullsized":"2023-11-24T06:12:01.386156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383162+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:12:00.383162+0000","last_peered":"2023-11-24T06:12:00.383162+0000","last_clean":"2023-11-24T06:12:00.383162+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:12:00.383162+0000","last_undegraded":"2023-11-24T06:12:00.383162+0000","last_fullsized":"2023-11-24T06:12:00.383162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.403650+0000","last_change":"2023-11-24T06:11:59.649393+0000","last_active":"2023-11-24T06:12:00.403650+0000","last_peered":"2023-11-24T06:12:00.403650+0000","last_clean":"2023-11-24T06:12:00.403650+0000","last_became_active":"2023-11-24T06:11:59.649045+0000","last_became_peered":"2023-11-24T06:11:59.649045+0000","last_unstale":"2023-11-24T06:12:00.403650+0000","last_undegraded":"2023-11-24T06:12:00.403650+0000","last_fullsized":"2023-11-24T06:12:00.403650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.383623+0000","last_change":"2023-11-24T06:12:00.417107+0000","last_active":"2023-11-24T06:12:01.383623+0000","last_peered":"2023-11-24T06:12:01.383623+0000","last_clean":"2023-11-24T06:12:01.383623+0000","last_became_active":"2023-11-24T06:12:00.416181+0000","last_became_peered":"2023-11-24T06:12:00.416181+0000","last_unstale":"2023-11-24T06:12:01.383623+0000","last_undegraded":"2023-11-24T06:12:01.383623+0000","last_fullsized":"2023-11-24T06:12:01.383623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:18.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.383049+0000","last_change":"2023-11-24T06:11:59.641692+0000","last_active":"2023-11-24T06:12:00.383049+0000","last_peered":"2023-11-24T06:12:00.383049+0000","last_clean":"2023-11-24T06:12:00.383049+0000","last_became_active":"2023-11-24T06:11:59.641199+0000","last_became_peered":"2023-11-24T06:11:59.641199+0000","last_unstale":"2023-11-24T06:12:00.383049+0000","last_undegraded":"2023-11-24T06:12:00.383049+0000","last_fullsized":"2023-11-24T06:12:00.383049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:34:32.164762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811125+0000","last_change":"2023-11-24T06:12:00.421725+0000","last_active":"2023-11-24T06:12:01.811125+0000","last_peered":"2023-11-24T06:12:01.811125+0000","last_clean":"2023-11-24T06:12:01.811125+0000","last_became_active":"2023-11-24T06:12:00.421402+0000","last_became_peered":"2023-11-24T06:12:00.421402+0000","last_unstale":"2023-11-24T06:12:01.811125+0000","last_undegraded":"2023-11-24T06:12:01.811125+0000","last_fullsized":"2023-11-24T06:12:01.811125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:16.430001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.379330+0000","last_change":"2023-11-24T06:11:59.628457+0000","last_active":"2023-11-24T06:12:00.379330+0000","last_peered":"2023-11-24T06:12:00.379330+0000","last_clean":"2023-11-24T06:12:00.379330+0000","last_became_active":"2023-11-24T06:11:59.628109+0000","last_became_peered":"2023-11-24T06:11:59.628109+0000","last_unstale":"2023-11-24T06:12:00.379330+0000","last_undegraded":"2023-11-24T06:12:00.379330+0000","last_fullsized":"2023-11-24T06:12:00.379330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:56:29.150979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385318+0000","last_change":"2023-11-24T06:12:00.406591+0000","last_active":"2023-11-24T06:12:01.385318+0000","last_peered":"2023-11-24T06:12:01.385318+0000","last_clean":"2023-11-24T06:12:01.385318+0000","last_became_active":"2023-11-24T06:12:00.406217+0000","last_became_peered":"2023-11-24T06:12:00.406217+0000","last_unstale":"2023-11-24T06:12:01.385318+0000","last_undegraded":"2023-11-24T06:12:01.385318+0000","last_fullsized":"2023-11-24T06:12:01.385318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:47:49.548969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.406285+0000","last_change":"2023-11-24T06:11:59.645058+0000","last_active":"2023-11-24T06:12:00.406285+0000","last_peered":"2023-11-24T06:12:00.406285+0000","last_clean":"2023-11-24T06:12:00.406285+0000","last_became_active":"2023-11-24T06:11:59.642696+0000","last_became_peered":"2023-11-24T06:11:59.642696+0000","last_unstale":"2023-11-24T06:12:00.406285+0000","last_undegraded":"2023-11-24T06:12:00.406285+0000","last_fullsized":"2023-11-24T06:12:00.406285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:22:17.577492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.815366+0000","last_change":"2023-11-24T06:12:00.415699+0000","last_active":"2023-11-24T06:12:01.815366+0000","last_peered":"2023-11-24T06:12:01.815366+0000","last_clean":"2023-11-24T06:12:01.815366+0000","last_became_active":"2023-11-24T06:12:00.412274+0000","last_became_peered":"2023-11-24T06:12:00.412274+0000","last_unstale":"2023-11-24T06:12:01.815366+0000","last_undegraded":"2023-11-24T06:12:01.815366+0000","last_fullsized":"2023-11-24T06:12:01.815366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:48:06.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385632+0000","last_change":"2023-11-24T06:11:59.633842+0000","last_active":"2023-11-24T06:12:01.385632+0000","last_peered":"2023-11-24T06:12:01.385632+0000","last_clean":"2023-11-24T06:12:01.385632+0000","last_became_active":"2023-11-24T06:11:59.632890+0000","last_became_peered":"2023-11-24T06:11:59.632890+0000","last_unstale":"2023-11-24T06:12:01.385632+0000","last_undegraded":"2023-11-24T06:12:01.385632+0000","last_fullsized":"2023-11-24T06:12:01.385632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:00.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813832+0000","last_change":"2023-11-24T06:12:00.424534+0000","last_active":"2023-11-24T06:12:01.813832+0000","last_peered":"2023-11-24T06:12:01.813832+0000","last_clean":"2023-11-24T06:12:01.813832+0000","last_became_active":"2023-11-24T06:12:00.419919+0000","last_became_peered":"2023-11-24T06:12:00.419919+0000","last_unstale":"2023-11-24T06:12:01.813832+0000","last_undegraded":"2023-11-24T06:12:01.813832+0000","last_fullsized":"2023-11-24T06:12:01.813832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:09.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.389114+0000","last_change":"2023-11-24T06:11:59.644082+0000","last_active":"2023-11-24T06:12:00.389114+0000","last_peered":"2023-11-24T06:12:00.389114+0000","last_clean":"2023-11-24T06:12:00.389114+0000","last_became_active":"2023-11-24T06:11:59.640160+0000","last_became_peered":"2023-11-24T06:11:59.640160+0000","last_unstale":"2023-11-24T06:12:00.389114+0000","last_undegraded":"2023-11-24T06:12:00.389114+0000","last_fullsized":"2023-11-24T06:12:00.389114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:14.848931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385733+0000","last_change":"2023-11-24T06:12:00.406268+0000","last_active":"2023-11-24T06:12:01.385733+0000","last_peered":"2023-11-24T06:12:01.385733+0000","last_clean":"2023-11-24T06:12:01.385733+0000","last_became_active":"2023-11-24T06:12:00.405965+0000","last_became_peered":"2023-11-24T06:12:00.405965+0000","last_unstale":"2023-11-24T06:12:01.385733+0000","last_undegraded":"2023-11-24T06:12:01.385733+0000","last_fullsized":"2023-11-24T06:12:01.385733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:42.193371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:02.714599+0000","last_change":"2023-11-24T06:11:59.645602+0000","last_active":"2023-11-24T06:12:02.714599+0000","last_peered":"2023-11-24T06:12:02.714599+0000","last_clean":"2023-11-24T06:12:02.714599+0000","last_became_active":"2023-11-24T06:11:59.645312+0000","last_became_peered":"2023-11-24T06:11:59.645312+0000","last_unstale":"2023-11-24T06:12:02.714599+0000","last_undegraded":"2023-11-24T06:12:02.714599+0000","last_fullsized":"2023-11-24T06:12:02.714599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:43.860695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384670+0000","last_change":"2023-11-24T06:12:00.417986+0000","last_active":"2023-11-24T06:12:01.384670+0000","last_peered":"2023-11-24T06:12:01.384670+0000","last_clean":"2023-11-24T06:12:01.384670+0000","last_became_active":"2023-11-24T06:12:00.417578+0000","last_became_peered":"2023-11-24T06:12:00.417578+0000","last_unstale":"2023-11-24T06:12:01.384670+0000","last_undegraded":"2023-11-24T06:12:01.384670+0000","last_fullsized":"2023-11-24T06:12:01.384670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656198+0000","last_change":"2023-11-24T06:11:59.648128+0000","last_active":"2023-11-24T06:12:00.656198+0000","last_peered":"2023-11-24T06:12:00.656198+0000","last_clean":"2023-11-24T06:12:00.656198+0000","last_became_active":"2023-11-24T06:11:59.647817+0000","last_became_peered":"2023-11-24T06:11:59.647817+0000","last_unstale":"2023-11-24T06:12:00.656198+0000","last_undegraded":"2023-11-24T06:12:00.656198+0000","last_fullsized":"2023-11-24T06:12:00.656198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.812611+0000","last_change":"2023-11-24T06:12:00.407315+0000","last_active":"2023-11-24T06:12:01.812611+0000","last_peered":"2023-11-24T06:12:01.812611+0000","last_clean":"2023-11-24T06:12:01.812611+0000","last_became_active":"2023-11-24T06:12:00.406966+0000","last_became_peered":"2023-11-24T06:12:00.406966+0000","last_unstale":"2023-11-24T06:12:01.812611+0000","last_undegraded":"2023-11-24T06:12:01.812611+0000","last_fullsized":"2023-11-24T06:12:01.812611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.382934+0000","last_change":"2023-11-24T06:11:59.641473+0000","last_active":"2023-11-24T06:12:00.382934+0000","last_peered":"2023-11-24T06:12:00.382934+0000","last_clean":"2023-11-24T06:12:00.382934+0000","last_became_active":"2023-11-24T06:11:59.640882+0000","last_became_peered":"2023-11-24T06:11:59.640882+0000","last_unstale":"2023-11-24T06:12:00.382934+0000","last_undegraded":"2023-11-24T06:12:00.382934+0000","last_fullsized":"2023-11-24T06:12:00.382934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:15.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.814297+0000","last_change":"2023-11-24T06:12:00.420629+0000","last_active":"2023-11-24T06:12:01.814297+0000","last_peered":"2023-11-24T06:12:01.814297+0000","last_clean":"2023-11-24T06:12:01.814297+0000","last_became_active":"2023-11-24T06:12:00.420121+0000","last_became_peered":"2023-11-24T06:12:00.420121+0000","last_unstale":"2023-11-24T06:12:01.814297+0000","last_undegraded":"2023-11-24T06:12:01.814297+0000","last_fullsized":"2023-11-24T06:12:01.814297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:16.361272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385138+0000","last_change":"2023-11-24T06:11:59.642028+0000","last_active":"2023-11-24T06:12:01.385138+0000","last_peered":"2023-11-24T06:12:01.385138+0000","last_clean":"2023-11-24T06:12:01.385138+0000","last_became_active":"2023-11-24T06:11:59.641734+0000","last_became_peered":"2023-11-24T06:11:59.641734+0000","last_unstale":"2023-11-24T06:12:01.385138+0000","last_undegraded":"2023-11-24T06:12:01.385138+0000","last_fullsized":"2023-11-24T06:12:01.385138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:44.578653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384138+0000","last_change":"2023-11-24T06:12:00.410266+0000","last_active":"2023-11-24T06:12:01.384138+0000","last_peered":"2023-11-24T06:12:01.384138+0000","last_clean":"2023-11-24T06:12:01.384138+0000","last_became_active":"2023-11-24T06:12:00.409968+0000","last_became_peered":"2023-11-24T06:12:00.409968+0000","last_unstale":"2023-11-24T06:12:01.384138+0000","last_undegraded":"2023-11-24T06:12:01.384138+0000","last_fullsized":"2023-11-24T06:12:01.384138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:08.544883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.385736+0000","last_change":"2023-11-24T06:11:59.630765+0000","last_active":"2023-11-24T06:12:01.385736+0000","last_peered":"2023-11-24T06:12:01.385736+0000","last_clean":"2023-11-24T06:12:01.385736+0000","last_became_active":"2023-11-24T06:11:59.629875+0000","last_became_peered":"2023-11-24T06:11:59.629875+0000","last_unstale":"2023-11-24T06:12:01.385736+0000","last_undegraded":"2023-11-24T06:12:01.385736+0000","last_fullsized":"2023-11-24T06:12:01.385736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:19.421623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384213+0000","last_change":"2023-11-24T06:12:00.408041+0000","last_active":"2023-11-24T06:12:01.384213+0000","last_peered":"2023-11-24T06:12:01.384213+0000","last_clean":"2023-11-24T06:12:01.384213+0000","last_became_active":"2023-11-24T06:12:00.407616+0000","last_became_peered":"2023-11-24T06:12:00.407616+0000","last_unstale":"2023-11-24T06:12:01.384213+0000","last_undegraded":"2023-11-24T06:12:01.384213+0000","last_fullsized":"2023-11-24T06:12:01.384213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:16.275094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656982+0000","last_change":"2023-11-24T06:11:59.652850+0000","last_active":"2023-11-24T06:12:00.656982+0000","last_peered":"2023-11-24T06:12:00.656982+0000","last_clean":"2023-11-24T06:12:00.656982+0000","last_became_active":"2023-11-24T06:11:59.652583+0000","last_became_peered":"2023-11-24T06:11:59.652583+0000","last_unstale":"2023-11-24T06:12:00.656982+0000","last_undegraded":"2023-11-24T06:12:00.656982+0000","last_fullsized":"2023-11-24T06:12:00.656982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:41.913788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.792109+0000","last_change":"2023-11-24T06:12:00.408854+0000","last_active":"2023-11-24T06:12:01.792109+0000","last_peered":"2023-11-24T06:12:01.792109+0000","last_clean":"2023-11-24T06:12:01.792109+0000","last_became_active":"2023-11-24T06:12:00.408541+0000","last_became_peered":"2023-11-24T06:12:00.408541+0000","last_unstale":"2023-11-24T06:12:01.792109+0000","last_undegraded":"2023-11-24T06:12:01.792109+0000","last_fullsized":"2023-11-24T06:12:01.792109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:30.197468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813395+0000","last_change":"2023-11-24T06:12:00.425989+0000","last_active":"2023-11-24T06:12:01.813395+0000","last_peered":"2023-11-24T06:12:01.813395+0000","last_clean":"2023-11-24T06:12:01.813395+0000","last_became_active":"2023-11-24T06:12:00.425649+0000","last_became_peered":"2023-11-24T06:12:00.425649+0000","last_unstale":"2023-11-24T06:12:01.813395+0000","last_undegraded":"2023-11-24T06:12:01.813395+0000","last_fullsized":"2023-11-24T06:12:01.813395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:39.402058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.655824+0000","last_change":"2023-11-24T06:11:59.649445+0000","last_active":"2023-11-24T06:12:00.655824+0000","last_peered":"2023-11-24T06:12:00.655824+0000","last_clean":"2023-11-24T06:12:00.655824+0000","last_became_active":"2023-11-24T06:11:59.649024+0000","last_became_peered":"2023-11-24T06:11:59.649024+0000","last_unstale":"2023-11-24T06:12:00.655824+0000","last_undegraded":"2023-11-24T06:12:00.655824+0000","last_fullsized":"2023-11-24T06:12:00.655824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:33.252854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.813376+0000","last_change":"2023-11-24T06:12:00.425911+0000","last_active":"2023-11-24T06:12:01.813376+0000","last_peered":"2023-11-24T06:12:01.813376+0000","last_clean":"2023-11-24T06:12:01.813376+0000","last_became_active":"2023-11-24T06:12:00.425590+0000","last_became_peered":"2023-11-24T06:12:00.425590+0000","last_unstale":"2023-11-24T06:12:01.813376+0000","last_undegraded":"2023-11-24T06:12:01.813376+0000","last_fullsized":"2023-11-24T06:12:01.813376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:52.042913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.656014+0000","last_change":"2023-11-24T06:11:59.648255+0000","last_active":"2023-11-24T06:12:00.656014+0000","last_peered":"2023-11-24T06:12:00.656014+0000","last_clean":"2023-11-24T06:12:00.656014+0000","last_became_active":"2023-11-24T06:11:59.647961+0000","last_became_peered":"2023-11-24T06:11:59.647961+0000","last_unstale":"2023-11-24T06:12:00.656014+0000","last_undegraded":"2023-11-24T06:12:00.656014+0000","last_fullsized":"2023-11-24T06:12:00.656014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:52.309188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.811821+0000","last_change":"2023-11-24T06:12:00.415607+0000","last_active":"2023-11-24T06:12:01.811821+0000","last_peered":"2023-11-24T06:12:01.811821+0000","last_clean":"2023-11-24T06:12:01.811821+0000","last_became_active":"2023-11-24T06:12:00.415309+0000","last_became_peered":"2023-11-24T06:12:00.415309+0000","last_unstale":"2023-11-24T06:12:01.811821+0000","last_undegraded":"2023-11-24T06:12:01.811821+0000","last_fullsized":"2023-11-24T06:12:01.811821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.646459+0000","last_change":"2023-11-24T06:11:59.634657+0000","last_active":"2023-11-24T06:12:00.646459+0000","last_peered":"2023-11-24T06:12:00.646459+0000","last_clean":"2023-11-24T06:12:00.646459+0000","last_became_active":"2023-11-24T06:11:59.634335+0000","last_became_peered":"2023-11-24T06:11:59.634335+0000","last_unstale":"2023-11-24T06:12:00.646459+0000","last_undegraded":"2023-11-24T06:12:00.646459+0000","last_fullsized":"2023-11-24T06:12:00.646459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:11:20.368532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T06:12:01.384001+0000","last_change":"2023-11-24T06:12:00.415376+0000","last_active":"2023-11-24T06:12:01.384001+0000","last_peered":"2023-11-24T06:12:01.384001+0000","last_clean":"2023-11-24T06:12:01.384001+0000","last_became_active":"2023-11-24T06:12:00.415114+0000","last_became_peered":"2023-11-24T06:12:00.415114+0000","last_unstale":"2023-11-24T06:12:01.384001+0000","last_undegraded":"2023-11-24T06:12:01.384001+0000","last_fullsized":"2023-11-24T06:12:01.384001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:59.598693+0000","last_clean_scrub_stamp":"2023-11-24T06:11:59.598693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:03:07.726445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T06:12:00.654742+0000","last_change":"2023-11-24T06:11:59.645253+0000","last_active":"2023-11-24T06:12:00.654742+0000","last_peered":"2023-11-24T06:12:00.654742+0000","last_clean":"2023-11-24T06:12:00.654742+0000","last_became_active":"2023-11-24T06:11:59.644979+0000","last_became_peered":"2023-11-24T06:11:59.644979+0000","last_unstale":"2023-11-24T06:12:00.654742+0000","last_undegraded":"2023-11-24T06:12:00.654742+0000","last_fullsized":"2023-11-24T06:12:00.654742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:58.584207+0000","last_clean_scrub_stamp":"2023-11-24T06:11:58.584207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:36:07.535502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9750000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7589999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.829}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":77584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":666978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6240000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6589999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9770000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:12:17.531 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T06:12:17.531 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-24T06:12:17.531 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-24T06:12:17.531 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-24T06:12:17.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.795+0000 7f8d99d1a640 1 Processor -- start 2023-11-24T06:12:17.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.795+0000 7f8d99d1a640 1 -- start start 2023-11-24T06:12:17.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.797+0000 7f8d99d1a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d940cf500 0x7f8d940cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.797+0000 7f8d99d1a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d94140900 con 0x7f8d9413dfd0 2023-11-24T06:12:17.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.797+0000 7f8d99d1a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9415fa70 con 0x7f8d940cf050 2023-11-24T06:12:17.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.797+0000 7f8d99d1a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9415c580 con 0x7f8d940cf500 2023-11-24T06:12:17.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.797+0000 7f8d98d18640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8d9413dfd0 0x7f8d9415be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53412/0 (socket says 172.21.15.22:53412) 2023-11-24T06:12:17.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.797+0000 7f8d98d18640 1 -- 172.21.15.22:0/966765987 learned_addr learned my addr 172.21.15.22:0/966765987 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:17.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.797+0000 7f8d99519640 1 --2- 172.21.15.22:0/966765987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d940cf500 0x7f8d940cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.798+0000 7f8d8b7fe640 1 -- 172.21.15.22:0/966765987 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439239070 0 0) 0x7f8d94140900 con 0x7f8d9413dfd0 2023-11-24T06:12:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.798+0000 7f8d8b7fe640 1 -- 172.21.15.22:0/966765987 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d7c003520 con 0x7f8d9413dfd0 2023-11-24T06:12:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.798+0000 7f8d8b7fe640 1 -- 172.21.15.22:0/966765987 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503774545 0 0) 0x7f8d9415fa70 con 0x7f8d940cf050 2023-11-24T06:12:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.798+0000 7f8d99519640 1 -- 172.21.15.22:0/966765987 >> v1:172.21.15.31:6789/0 conn(0x7f8d940cf050 legacy=0x7f8d940cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.798+0000 7f8d99519640 1 -- 172.21.15.22:0/966765987 >> v1:172.21.15.22:6789/0 conn(0x7f8d9413dfd0 legacy=0x7f8d9415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.798+0000 7f8d99519640 1 -- 172.21.15.22:0/966765987 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940cf950 con 0x7f8d940cf500 2023-11-24T06:12:17.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.800+0000 7f8d99519640 1 --2- 172.21.15.22:0/966765987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d940cf500 0x7f8d940cdec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009dc0 tx=0x7f8d8c02bd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9fd4aca60811099 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:17.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.800+0000 7f8d8b7fe640 1 -- 172.21.15.22:0/966765987 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90001690 con 0x7f8d940cf500 2023-11-24T06:12:17.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.800+0000 7f8d8b7fe640 1 -- 172.21.15.22:0/966765987 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c02c840 con 0x7f8d940cf500 2023-11-24T06:12:17.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.800+0000 7f8d8b7fe640 1 -- 172.21.15.22:0/966765987 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c02cbd0 con 0x7f8d940cf500 2023-11-24T06:12:17.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.801+0000 7f8d99d1a640 1 -- 172.21.15.22:0/966765987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d940cf500 msgr2=0x7f8d940cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.801+0000 7f8d99d1a640 1 --2- 172.21.15.22:0/966765987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d940cf500 0x7f8d940cdec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009dc0 tx=0x7f8d8c02bd10 comp rx=0 tx=0).stop 2023-11-24T06:12:17.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.801+0000 7f8d99d1a640 1 -- 172.21.15.22:0/966765987 shutdown_connections 2023-11-24T06:12:17.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.801+0000 7f8d99d1a640 1 --2- 172.21.15.22:0/966765987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d940cf500 0x7f8d940cdec0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.801+0000 7f8d99d1a640 1 -- 172.21.15.22:0/966765987 >> 172.21.15.22:0/966765987 conn(0x7f8d9406a860 msgr2=0x7f8d9406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:17.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.801+0000 7f8d99d1a640 1 -- 172.21.15.22:0/966765987 shutdown_connections 2023-11-24T06:12:17.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.801+0000 7f8d99d1a640 1 -- 172.21.15.22:0/966765987 wait complete. 2023-11-24T06:12:17.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.803+0000 7f8d99d1a640 1 Processor -- start 2023-11-24T06:12:17.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.803+0000 7f8d99d1a640 1 -- start start 2023-11-24T06:12:17.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d99d1a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d940cf050 0x7f8d94155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d99d1a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d940cf500 0x7f8d94159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d99d1a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d9413dfd0 0x7f8d940b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d99d1a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9415b050 con 0x7f8d940cf500 2023-11-24T06:12:17.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d99d1a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d941557b0 con 0x7f8d940cf050 2023-11-24T06:12:17.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d99d1a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9415a3d0 con 0x7f8d9413dfd0 2023-11-24T06:12:17.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d8bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d940cf500 0x7f8d94159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d8bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d940cf500 0x7f8d94159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38008/0 (socket says 172.21.15.22:38008) 2023-11-24T06:12:17.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d8bfff640 1 -- 172.21.15.22:0/975393347 learned_addr learned my addr 172.21.15.22:0/975393347 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:17.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d99519640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d9413dfd0 0x7f8d940b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d98d18640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d940cf050 0x7f8d94155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.804+0000 7f8d8bfff640 1 -- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d9413dfd0 msgr2=0x7f8d940b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d8bfff640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d9413dfd0 0x7f8d940b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d8bfff640 1 -- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d940cf050 msgr2=0x7f8d94155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d8bfff640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d940cf050 0x7f8d94155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d8bfff640 1 -- 172.21.15.22:0/975393347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c009a70 con 0x7f8d940cf500 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d98d18640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d940cf050 0x7f8d94155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d99519640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d9413dfd0 0x7f8d940b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d8bfff640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d940cf500 0x7f8d94159910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400c410 tx=0x7f8d8400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d897fa640 1 -- 172.21.15.22:0/975393347 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840035f0 con 0x7f8d940cf500 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d897fa640 1 -- 172.21.15.22:0/975393347 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d84003770 con 0x7f8d940cf500 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d897fa640 1 -- 172.21.15.22:0/975393347 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d84003b20 con 0x7f8d940cf500 2023-11-24T06:12:17.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9415a6b0 con 0x7f8d940cf500 2023-11-24T06:12:17.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.805+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9415ac70 con 0x7f8d940cf500 2023-11-24T06:12:17.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.806+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9404e840 con 0x7f8d940cf500 2023-11-24T06:12:17.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.807+0000 7f8d897fa640 1 -- 172.21.15.22:0/975393347 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d84003c80 con 0x7f8d940cf500 2023-11-24T06:12:17.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.809+0000 7f8d897fa640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8d8006ae40 0x7f8d8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:17.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.809+0000 7f8d897fa640 1 -- 172.21.15.22:0/975393347 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d84088bf0 con 0x7f8d940cf500 2023-11-24T06:12:17.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.809+0000 7f8d98d18640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8d8006ae40 0x7f8d8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:17.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.810+0000 7f8d98d18640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8d8006ae40 0x7f8d8006d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d94141720 tx=0x7f8d90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:17.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:17.813+0000 7f8d897fa640 1 -- 172.21.15.22:0/975393347 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8d84053d30 con 0x7f8d940cf500 2023-11-24T06:12:18.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.048+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8d940ce9a0 con 0x7f8d940cf500 2023-11-24T06:12:18.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.049+0000 7f8d897fa640 1 -- 172.21.15.22:0/975393347 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8d84017080 con 0x7f8d940cf500 2023-11-24T06:12:18.053 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:18.053 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-24T06:12:18.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.051+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8d8006ae40 msgr2=0x7f8d8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.051+0000 7f8d99d1a640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8d8006ae40 0x7f8d8006d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d94141720 tx=0x7f8d90009040 comp rx=0 tx=0).stop 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.051+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d940cf500 msgr2=0x7f8d94159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.051+0000 7f8d99d1a640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d940cf500 0x7f8d94159910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400c410 tx=0x7f8d8400c8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.052+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 shutdown_connections 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.052+0000 7f8d99d1a640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8d8006ae40 0x7f8d8006d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.052+0000 7f8d99d1a640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d9413dfd0 0x7f8d940b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.052+0000 7f8d99d1a640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d940cf500 0x7f8d94159910 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.052+0000 7f8d99d1a640 1 --2- 172.21.15.22:0/975393347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d940cf050 0x7f8d94155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.052+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 >> 172.21.15.22:0/975393347 conn(0x7f8d9406a860 msgr2=0x7f8d940aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.052+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 shutdown_connections 2023-11-24T06:12:18.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.052+0000 7f8d99d1a640 1 -- 172.21.15.22:0/975393347 wait complete. 2023-11-24T06:12:18.076 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-24T06:12:18.076 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:18.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.302+0000 7f1552da7640 1 Processor -- start 2023-11-24T06:12:18.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.302+0000 7f1552da7640 1 -- start start 2023-11-24T06:12:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.304+0000 7f1552da7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f154c14b1c0 0x7f154c162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.304+0000 7f1552da7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f154c1651a0 0x7f154c165610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.304+0000 7f1552da7640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154c162bb0 con 0x7f154c0cf050 2023-11-24T06:12:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.304+0000 7f1552da7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154c165ca0 con 0x7f154c14b1c0 2023-11-24T06:12:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.304+0000 7f1552da7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c165f80 con 0x7f154c1651a0 2023-11-24T06:12:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.304+0000 7f15525a6640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f154c0cf050 0x7f154c0cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53424/0 (socket says 172.21.15.22:53424) 2023-11-24T06:12:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.304+0000 7f15525a6640 1 -- 172.21.15.22:0/583754313 learned_addr learned my addr 172.21.15.22:0/583754313 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.304+0000 7f15515a4640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f154c1651a0 0x7f154c165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.304+0000 7f1551da5640 1 --2- 172.21.15.22:0/583754313 >> v2:172.21.15.31:3300/0 conn(0x7f154c14b1c0 0x7f154c162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270976118 0 0) 0x7f154c162bb0 con 0x7f154c0cf050 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1538003520 con 0x7f154c0cf050 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1966269307 0 0) 0x7f1538003520 con 0x7f154c0cf050 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f154c1651a0 msgr2=0x7f154c165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f154c1651a0 0x7f154c165610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 >> v2:172.21.15.31:3300/0 conn(0x7f154c14b1c0 msgr2=0x7f154c162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 --2- 172.21.15.22:0/583754313 >> v2:172.21.15.31:3300/0 conn(0x7f154c14b1c0 0x7f154c162670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c161e70 con 0x7f154c0cf050 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f1544001a10 con 0x7f154c0cf050 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 >> v1:172.21.15.22:6789/0 conn(0x7f154c0cf050 legacy=0x7f154c0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15380039e0 0x7f1538003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15380047c0 0x7f1538004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f154c1651a0 0x7f1538005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c165ca0 con 0x7f15380047c0 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c165f80 con 0x7f15380039e0 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.305+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153800ba00 con 0x7f154c1651a0 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.306+0000 7f15515a4640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15380047c0 0x7f1538004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.306+0000 7f15525a6640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f154c1651a0 0x7f1538005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.306+0000 7f1551da5640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15380039e0 0x7f1538003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.306+0000 7f15515a4640 1 -- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f154c1651a0 msgr2=0x7f1538005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:18.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.306+0000 7f15515a4640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f154c1651a0 0x7f1538005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.306+0000 7f15515a4640 1 -- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15380039e0 msgr2=0x7f1538003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:18.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.306+0000 7f15515a4640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15380039e0 0x7f1538003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.306+0000 7f15515a4640 1 -- 172.21.15.22:0/583754313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538003520 con 0x7f15380047c0 2023-11-24T06:12:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.307+0000 7f15515a4640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15380047c0 0x7f1538004c40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f153c009ac0 tx=0x7f15380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449bf79aa4caef22 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.307+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c02c6b0 con 0x7f15380047c0 2023-11-24T06:12:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.307+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c02c810 con 0x7f15380047c0 2023-11-24T06:12:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.307+0000 7f1550da3640 1 -- 172.21.15.22:0/583754313 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c02cba0 con 0x7f15380047c0 2023-11-24T06:12:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.308+0000 7f1552da7640 1 -- 172.21.15.22:0/583754313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15380047c0 msgr2=0x7f1538004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.308+0000 7f1552da7640 1 --2- 172.21.15.22:0/583754313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15380047c0 0x7f1538004c40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f153c009ac0 tx=0x7f15380057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.308+0000 7f15525a6640 1 -- 172.21.15.22:0/583754313 reap_dead start 2023-11-24T06:12:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.308+0000 7f1552da7640 1 -- 172.21.15.22:0/583754313 shutdown_connections 2023-11-24T06:12:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.308+0000 7f1552da7640 1 -- 172.21.15.22:0/583754313 >> 172.21.15.22:0/583754313 conn(0x7f154c06a860 msgr2=0x7f154c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.308+0000 7f1552da7640 1 -- 172.21.15.22:0/583754313 shutdown_connections 2023-11-24T06:12:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.308+0000 7f1552da7640 1 -- 172.21.15.22:0/583754313 wait complete. 2023-11-24T06:12:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.310+0000 7f1552da7640 1 Processor -- start 2023-11-24T06:12:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.310+0000 7f1552da7640 1 -- start start 2023-11-24T06:12:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.311+0000 7f1552da7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15380047c0 0x7f154c160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.311+0000 7f1552da7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f154c1637b0 0x7f154c163c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.311+0000 7f1552da7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c0a86e0 0x7f154c0a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.311+0000 7f1552da7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c164170 con 0x7f154c1637b0 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.311+0000 7f1552da7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c148d90 con 0x7f154c0a86e0 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.311+0000 7f1552da7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c0a9450 con 0x7f15380047c0 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.311+0000 7f15515a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f154c1637b0 0x7f154c163c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.311+0000 7f15515a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f154c1637b0 0x7f154c163c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38024/0 (socket says 172.21.15.22:38024) 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.311+0000 7f15515a4640 1 -- 172.21.15.22:0/479905358 learned_addr learned my addr 172.21.15.22:0/479905358 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f1551da5640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15380047c0 0x7f154c160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15515a4640 1 -- 172.21.15.22:0/479905358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15380047c0 msgr2=0x7f154c160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15525a6640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c0a86e0 0x7f154c0a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15515a4640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15380047c0 0x7f154c160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15515a4640 1 -- 172.21.15.22:0/479905358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c0a86e0 msgr2=0x7f154c0a8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15515a4640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c0a86e0 0x7f154c0a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15515a4640 1 -- 172.21.15.22:0/479905358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0a9730 con 0x7f154c1637b0 2023-11-24T06:12:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15515a4640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f154c1637b0 0x7f154c163c30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f153c02c250 tx=0x7f153c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15427fc640 1 -- 172.21.15.22:0/479905358 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c003810 con 0x7f154c1637b0 2023-11-24T06:12:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15427fc640 1 -- 172.21.15.22:0/479905358 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c003970 con 0x7f154c1637b0 2023-11-24T06:12:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f15427fc640 1 -- 172.21.15.22:0/479905358 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c003ce0 con 0x7f154c1637b0 2023-11-24T06:12:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c0a9a10 con 0x7f154c1637b0 2023-11-24T06:12:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.312+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154c0a90a0 con 0x7f154c1637b0 2023-11-24T06:12:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.314+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154c148f20 con 0x7f154c1637b0 2023-11-24T06:12:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.314+0000 7f15427fc640 1 -- 172.21.15.22:0/479905358 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f153c034440 con 0x7f154c1637b0 2023-11-24T06:12:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.316+0000 7f15427fc640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f153006ae70 0x7f153006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.316+0000 7f15427fc640 1 -- 172.21.15.22:0/479905358 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f153c0ab7f0 con 0x7f154c1637b0 2023-11-24T06:12:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.316+0000 7f1551da5640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f153006ae70 0x7f153006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.317+0000 7f1551da5640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f153006ae70 0x7f153006d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f154c06cd50 tx=0x7f1548008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:18.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.320+0000 7f15427fc640 1 -- 172.21.15.22:0/479905358 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f153c076a60 con 0x7f154c1637b0 2023-11-24T06:12:18.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.520+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f154c04e840 con 0x7f154c1637b0 2023-11-24T06:12:18.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.522+0000 7f15427fc640 1 -- 172.21.15.22:0/479905358 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f153c0044e0 con 0x7f154c1637b0 2023-11-24T06:12:18.527 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:18.527 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:01.374181+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:18.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.525+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f153006ae70 msgr2=0x7f153006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.525+0000 7f1552da7640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f153006ae70 0x7f153006d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f154c06cd50 tx=0x7f1548008040 comp rx=0 tx=0).stop 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.525+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f154c1637b0 msgr2=0x7f154c163c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.525+0000 7f1552da7640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f154c1637b0 0x7f154c163c30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f153c02c250 tx=0x7f153c004730 comp rx=0 tx=0).stop 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.526+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 shutdown_connections 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.526+0000 7f1552da7640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f153006ae70 0x7f153006d330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.526+0000 7f1552da7640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c0a86e0 0x7f154c0a8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.526+0000 7f1552da7640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f154c1637b0 0x7f154c163c30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.526+0000 7f1552da7640 1 --2- 172.21.15.22:0/479905358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15380047c0 0x7f154c160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.526+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 >> 172.21.15.22:0/479905358 conn(0x7f154c06a860 msgr2=0x7f154c06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.526+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 shutdown_connections 2023-11-24T06:12:18.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.526+0000 7f1552da7640 1 -- 172.21.15.22:0/479905358 wait complete. 2023-11-24T06:12:18.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:18.549 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.771+0000 7f0599490640 1 Processor -- start 2023-11-24T06:12:18.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.772+0000 7f0599490640 1 -- start start 2023-11-24T06:12:18.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.773+0000 7f0599490640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f059415b350 0x7f05940abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.773+0000 7f0599490640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f059409cb30 0x7f05940b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.773+0000 7f0599490640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059415b730 con 0x7f05940adb60 2023-11-24T06:12:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.773+0000 7f0599490640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05940ac740 con 0x7f059409cb30 2023-11-24T06:12:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.773+0000 7f0599490640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05940ac460 con 0x7f059415b350 2023-11-24T06:12:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.774+0000 7f05927fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f059409cb30 0x7f05940b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.774+0000 7f05927fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f059409cb30 0x7f05940b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38036/0 (socket says 172.21.15.22:38036) 2023-11-24T06:12:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.774+0000 7f05927fc640 1 -- 172.21.15.22:0/3809680724 learned_addr learned my addr 172.21.15.22:0/3809680724 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.774+0000 7f0592ffd640 1 --2- 172.21.15.22:0/3809680724 >> v2:172.21.15.31:3300/0 conn(0x7f059415b350 0x7f05940abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.774+0000 7f05927fc640 1 -- 172.21.15.22:0/3809680724 >> v2:172.21.15.31:3300/0 conn(0x7f059415b350 msgr2=0x7f05940abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.774+0000 7f05927fc640 1 --2- 172.21.15.22:0/3809680724 >> v2:172.21.15.31:3300/0 conn(0x7f059415b350 0x7f05940abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.774+0000 7f05927fc640 1 -- 172.21.15.22:0/3809680724 >> v1:172.21.15.31:6789/0 conn(0x7f05940adb60 legacy=0x7f05940adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.774+0000 7f05927fc640 1 -- 172.21.15.22:0/3809680724 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05940b2a50 con 0x7f059409cb30 2023-11-24T06:12:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.774+0000 7f0592ffd640 1 --2- 172.21.15.22:0/3809680724 >> v2:172.21.15.31:3300/0 conn(0x7f059415b350 0x7f05940abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.775+0000 7f05927fc640 1 --2- 172.21.15.22:0/3809680724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 0x7f05940b3530 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f05940b5100 tx=0x7f058802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c08b0a64ceea8d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.776+0000 7f0591ffb640 1 -- 172.21.15.22:0/3809680724 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588031870 con 0x7f059409cb30 2023-11-24T06:12:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.776+0000 7f0591ffb640 1 -- 172.21.15.22:0/3809680724 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05880319d0 con 0x7f059409cb30 2023-11-24T06:12:18.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.776+0000 7f0591ffb640 1 -- 172.21.15.22:0/3809680724 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588031d60 con 0x7f059409cb30 2023-11-24T06:12:18.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.776+0000 7f0599490640 1 -- 172.21.15.22:0/3809680724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 msgr2=0x7f05940b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.776+0000 7f0599490640 1 --2- 172.21.15.22:0/3809680724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 0x7f05940b3530 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f05940b5100 tx=0x7f058802b910 comp rx=0 tx=0).stop 2023-11-24T06:12:18.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.777+0000 7f0599490640 1 -- 172.21.15.22:0/3809680724 shutdown_connections 2023-11-24T06:12:18.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.777+0000 7f0599490640 1 --2- 172.21.15.22:0/3809680724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 0x7f05940b3530 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.777+0000 7f0599490640 1 --2- 172.21.15.22:0/3809680724 >> v2:172.21.15.31:3300/0 conn(0x7f059415b350 0x7f05940abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.777+0000 7f0599490640 1 -- 172.21.15.22:0/3809680724 >> 172.21.15.22:0/3809680724 conn(0x7f05940b0ba0 msgr2=0x7f05940b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:18.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.777+0000 7f0599490640 1 -- 172.21.15.22:0/3809680724 shutdown_connections 2023-11-24T06:12:18.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.777+0000 7f0599490640 1 -- 172.21.15.22:0/3809680724 wait complete. 2023-11-24T06:12:18.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.778+0000 7f0599490640 1 Processor -- start 2023-11-24T06:12:18.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.779+0000 7f0599490640 1 -- start start 2023-11-24T06:12:18.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0599490640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 0x7f0594148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0599490640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05940adb60 0x7f05940cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0599490640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f059415b350 0x7f05941537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0599490640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0594099a00 con 0x7f059409cb30 2023-11-24T06:12:18.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0599490640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0594149090 con 0x7f059415b350 2023-11-24T06:12:18.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0599490640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0594071580 con 0x7f05940adb60 2023-11-24T06:12:18.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0592ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 0x7f0594148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0592ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 0x7f0594148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38046/0 (socket says 172.21.15.22:38046) 2023-11-24T06:12:18.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0592ffd640 1 -- 172.21.15.22:0/874061953 learned_addr learned my addr 172.21.15.22:0/874061953 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:18.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f05927fc640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05940adb60 0x7f05940cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f05937fe640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f059415b350 0x7f05941537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0592ffd640 1 -- 172.21.15.22:0/874061953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05940adb60 msgr2=0x7f05940cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0592ffd640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05940adb60 0x7f05940cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0592ffd640 1 -- 172.21.15.22:0/874061953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f059415b350 msgr2=0x7f05941537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0592ffd640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f059415b350 0x7f05941537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.780+0000 7f0592ffd640 1 -- 172.21.15.22:0/874061953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05880094d0 con 0x7f059409cb30 2023-11-24T06:12:18.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.781+0000 7f0592ffd640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 0x7f0594148b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0584007f20 tx=0x7f058400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:18.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.781+0000 7f057b7fe640 1 -- 172.21.15.22:0/874061953 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058400dee0 con 0x7f059409cb30 2023-11-24T06:12:18.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.781+0000 7f057b7fe640 1 -- 172.21.15.22:0/874061953 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058400f040 con 0x7f059409cb30 2023-11-24T06:12:18.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.781+0000 7f057b7fe640 1 -- 172.21.15.22:0/874061953 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584003db0 con 0x7f059409cb30 2023-11-24T06:12:18.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.781+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0594071860 con 0x7f059409cb30 2023-11-24T06:12:18.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.781+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0594071e20 con 0x7f059409cb30 2023-11-24T06:12:18.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.782+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059409d200 con 0x7f059409cb30 2023-11-24T06:12:18.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.783+0000 7f057b7fe640 1 -- 172.21.15.22:0/874061953 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0584004030 con 0x7f059409cb30 2023-11-24T06:12:18.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.784+0000 7f057b7fe640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f058006ae70 0x7f058006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:18.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.784+0000 7f057b7fe640 1 -- 172.21.15.22:0/874061953 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05840898d0 con 0x7f059409cb30 2023-11-24T06:12:18.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.785+0000 7f05927fc640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f058006ae70 0x7f058006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:18.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.785+0000 7f05927fc640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f058006ae70 0x7f058006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0588036000 tx=0x7f058803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:18.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.788+0000 7f057b7fe640 1 -- 172.21.15.22:0/874061953 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0584054990 con 0x7f059409cb30 2023-11-24T06:12:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.987+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f059404e920 con 0x7f059409cb30 2023-11-24T06:12:18.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.988+0000 7f057b7fe640 1 -- 172.21.15.22:0/874061953 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f058401a020 con 0x7f059409cb30 2023-11-24T06:12:18.993 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.991+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f058006ae70 msgr2=0x7f058006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.991+0000 7f0599490640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f058006ae70 0x7f058006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0588036000 tx=0x7f058803c040 comp rx=0 tx=0).stop 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.991+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 msgr2=0x7f0594148b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.991+0000 7f0599490640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 0x7f0594148b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0584007f20 tx=0x7f058400d560 comp rx=0 tx=0).stop 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.992+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 shutdown_connections 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.992+0000 7f0599490640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f058006ae70 0x7f058006d330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.992+0000 7f0599490640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f059415b350 0x7f05941537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.992+0000 7f0599490640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05940adb60 0x7f05940cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.992+0000 7f0599490640 1 --2- 172.21.15.22:0/874061953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059409cb30 0x7f0594148b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.992+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 >> 172.21.15.22:0/874061953 conn(0x7f05940b0ba0 msgr2=0x7f05940aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.992+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 shutdown_connections 2023-11-24T06:12:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:18.992+0000 7f0599490640 1 -- 172.21.15.22:0/874061953 wait complete. 2023-11-24T06:12:19.015 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.226+0000 7f7c64ba0640 1 Processor -- start 2023-11-24T06:12:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.226+0000 7f7c64ba0640 1 -- start start 2023-11-24T06:12:19.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.228+0000 7f7c64ba0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c600ad450 0x7f7c60154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.228+0000 7f7c64ba0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c600ce650 con 0x7f7c60153ea0 2023-11-24T06:12:19.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.228+0000 7f7c64ba0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6015e0a0 con 0x7f7c60070850 2023-11-24T06:12:19.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.228+0000 7f7c64ba0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c601547c0 con 0x7f7c600ad450 2023-11-24T06:12:19.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.228+0000 7f7c5f7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7c60153ea0 0x7f7c6015d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53432/0 (socket says 172.21.15.22:53432) 2023-11-24T06:12:19.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.228+0000 7f7c5f7fe640 1 -- 172.21.15.22:0/3429901594 learned_addr learned my addr 172.21.15.22:0/3429901594 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:19.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.228+0000 7f7c57fff640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c600ad450 0x7f7c60154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314716043 0 0) 0x7f7c600ce650 con 0x7f7c60153ea0 2023-11-24T06:12:19.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c4c003520 con 0x7f7c60153ea0 2023-11-24T06:12:19.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283028303 0 0) 0x7f7c4c003520 con 0x7f7c60153ea0 2023-11-24T06:12:19.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c600ad450 msgr2=0x7f7c60154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:19.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c600ad450 0x7f7c60154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 >> v1:172.21.15.31:6789/0 conn(0x7f7c60070850 legacy=0x7f7c60071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6015e380 con 0x7f7c60153ea0 2023-11-24T06:12:19.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f7c50001670 con 0x7f7c60153ea0 2023-11-24T06:12:19.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 >> v1:172.21.15.22:6789/0 conn(0x7f7c60153ea0 legacy=0x7f7c6015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c003a10 0x7f7c4c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c600ad450 0x7f7c4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c4c004d00 0x7f7c4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c601547c0 con 0x7f7c4c004d00 2023-11-24T06:12:19.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c00bac0 con 0x7f7c4c003a10 2023-11-24T06:12:19.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.229+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c00bc80 con 0x7f7c600ad450 2023-11-24T06:12:19.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.230+0000 7f7c5ffff640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c4c004d00 0x7f7c4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.230+0000 7f7c57fff640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c600ad450 0x7f7c4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.230+0000 7f7c5f7fe640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c003a10 0x7f7c4c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.230+0000 7f7c5ffff640 1 -- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c600ad450 msgr2=0x7f7c4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:19.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.230+0000 7f7c5ffff640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c600ad450 0x7f7c4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.230+0000 7f7c5ffff640 1 -- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c003a10 msgr2=0x7f7c4c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:19.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.230+0000 7f7c5ffff640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c003a10 0x7f7c4c003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.230+0000 7f7c5ffff640 1 -- 172.21.15.22:0/3429901594 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c003520 con 0x7f7c4c004d00 2023-11-24T06:12:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.231+0000 7f7c5ffff640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c4c004d00 0x7f7c4c005180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7c58001e20 tx=0x7f7c4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4f29c83b47836d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.231+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58003b70 con 0x7f7c4c004d00 2023-11-24T06:12:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.231+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58003cd0 con 0x7f7c4c004d00 2023-11-24T06:12:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.231+0000 7f7c5effd640 1 -- 172.21.15.22:0/3429901594 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58005310 con 0x7f7c4c004d00 2023-11-24T06:12:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.232+0000 7f7c64ba0640 1 -- 172.21.15.22:0/3429901594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c4c004d00 msgr2=0x7f7c4c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.232+0000 7f7c64ba0640 1 --2- 172.21.15.22:0/3429901594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c4c004d00 0x7f7c4c005180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7c58001e20 tx=0x7f7c4c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.232+0000 7f7c5ffff640 1 -- 172.21.15.22:0/3429901594 reap_dead start 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.232+0000 7f7c64ba0640 1 -- 172.21.15.22:0/3429901594 shutdown_connections 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.232+0000 7f7c64ba0640 1 -- 172.21.15.22:0/3429901594 >> 172.21.15.22:0/3429901594 conn(0x7f7c600cec10 msgr2=0x7f7c600cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.232+0000 7f7c64ba0640 1 -- 172.21.15.22:0/3429901594 shutdown_connections 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.232+0000 7f7c64ba0640 1 -- 172.21.15.22:0/3429901594 wait complete. 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.234+0000 7f7c64ba0640 1 Processor -- start 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.234+0000 7f7c64ba0640 1 -- start start 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c64ba0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c004d00 0x7f7c60143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c64ba0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c601f3060 0x7f7c60156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c64ba0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c60157110 0x7f7c601e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c64ba0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c601575c0 con 0x7f7c60157110 2023-11-24T06:12:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c64ba0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60154900 con 0x7f7c4c004d00 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c64ba0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c601e6910 con 0x7f7c601f3060 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c60157110 0x7f7c601e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c60157110 0x7f7c601e5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38072/0 (socket says 172.21.15.22:38072) 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c5ffff640 1 -- 172.21.15.22:0/4170290615 learned_addr learned my addr 172.21.15.22:0/4170290615 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.235+0000 7f7c57fff640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c601f3060 0x7f7c60156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5ffff640 1 -- 172.21.15.22:0/4170290615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c601f3060 msgr2=0x7f7c60156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5ffff640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c601f3060 0x7f7c60156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5f7fe640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c004d00 0x7f7c60143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5ffff640 1 -- 172.21.15.22:0/4170290615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c004d00 msgr2=0x7f7c60143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5ffff640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c004d00 0x7f7c60143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5ffff640 1 -- 172.21.15.22:0/4170290615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60154b50 con 0x7f7c60157110 2023-11-24T06:12:19.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5f7fe640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c004d00 0x7f7c60143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:19.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5ffff640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c60157110 0x7f7c601e5ba0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7c58005040 tx=0x7f7c580014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:19.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5cff9640 1 -- 172.21.15.22:0/4170290615 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5803e070 con 0x7f7c60157110 2023-11-24T06:12:19.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5cff9640 1 -- 172.21.15.22:0/4170290615 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58003e40 con 0x7f7c60157110 2023-11-24T06:12:19.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c5cff9640 1 -- 172.21.15.22:0/4170290615 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58006d50 con 0x7f7c60157110 2023-11-24T06:12:19.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c60154e30 con 0x7f7c60157110 2023-11-24T06:12:19.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.236+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c601e60e0 con 0x7f7c60157110 2023-11-24T06:12:19.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.238+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c60155350 con 0x7f7c60157110 2023-11-24T06:12:19.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.238+0000 7f7c5cff9640 1 -- 172.21.15.22:0/4170290615 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c58007030 con 0x7f7c60157110 2023-11-24T06:12:19.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.239+0000 7f7c5cff9640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c4006ae70 0x7f7c4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.239+0000 7f7c5cff9640 1 -- 172.21.15.22:0/4170290615 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c580aa760 con 0x7f7c60157110 2023-11-24T06:12:19.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.240+0000 7f7c5f7fe640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c4006ae70 0x7f7c4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.240+0000 7f7c5f7fe640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c4006ae70 0x7f7c4006d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7c50001200 tx=0x7f7c50001490 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:19.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.244+0000 7f7c5cff9640 1 -- 172.21.15.22:0/4170290615 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c60155350 con 0x7f7c60157110 2023-11-24T06:12:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.438+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c60155350 con 0x7f7c60157110 2023-11-24T06:12:19.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.440+0000 7f7c5cff9640 1 -- 172.21.15.22:0/4170290615 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c60155350 con 0x7f7c60157110 2023-11-24T06:12:19.443 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:19.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.442+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c4006ae70 msgr2=0x7f7c4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.442+0000 7f7c64ba0640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c4006ae70 0x7f7c4006d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7c50001200 tx=0x7f7c50001490 comp rx=0 tx=0).stop 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.442+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c60157110 msgr2=0x7f7c601e5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.442+0000 7f7c64ba0640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c60157110 0x7f7c601e5ba0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7c58005040 tx=0x7f7c580014a0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.443+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 shutdown_connections 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.443+0000 7f7c64ba0640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7c4006ae70 0x7f7c4006d330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.443+0000 7f7c64ba0640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c60157110 0x7f7c601e5ba0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.443+0000 7f7c64ba0640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c601f3060 0x7f7c60156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.443+0000 7f7c64ba0640 1 --2- 172.21.15.22:0/4170290615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c004d00 0x7f7c60143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.443+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 >> 172.21.15.22:0/4170290615 conn(0x7f7c600cec10 msgr2=0x7f7c6015d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.443+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 shutdown_connections 2023-11-24T06:12:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.443+0000 7f7c64ba0640 1 -- 172.21.15.22:0/4170290615 wait complete. 2023-11-24T06:12:19.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:19.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.692+0000 7f2ea19dc640 1 Processor -- start 2023-11-24T06:12:19.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.692+0000 7f2ea19dc640 1 -- start start 2023-11-24T06:12:19.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.694+0000 7f2ea19dc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e9c15b350 0x7f2e9c0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.694+0000 7f2ea19dc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c09cb30 0x7f2e9c0b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.694+0000 7f2ea19dc640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c15b730 con 0x7f2e9c0adb60 2023-11-24T06:12:19.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.694+0000 7f2ea19dc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ac740 con 0x7f2e9c15b350 2023-11-24T06:12:19.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.694+0000 7f2ea19dc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ac460 con 0x7f2e9c09cb30 2023-11-24T06:12:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.694+0000 7f2e9b7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2e9c0adb60 0x7f2e9c0adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53436/0 (socket says 172.21.15.22:53436) 2023-11-24T06:12:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.694+0000 7f2e9b7fe640 1 -- 172.21.15.22:0/4168180914 learned_addr learned my addr 172.21.15.22:0/4168180914 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e9a7fc640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c09cb30 0x7f2e9c0b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e9affd640 1 --2- 172.21.15.22:0/4168180914 >> v2:172.21.15.31:3300/0 conn(0x7f2e9c15b350 0x7f2e9c0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839436277 0 0) 0x7f2e94001490 con 0x7f2e9c0adb60 2023-11-24T06:12:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e84003520 con 0x7f2e9c0adb60 2023-11-24T06:12:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764222120 0 0) 0x7f2e84003520 con 0x7f2e9c0adb60 2023-11-24T06:12:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c09cb30 msgr2=0x7f2e9c0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c09cb30 0x7f2e9c0b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 >> v2:172.21.15.31:3300/0 conn(0x7f2e9c15b350 msgr2=0x7f2e9c0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 --2- 172.21.15.22:0/4168180914 >> v2:172.21.15.31:3300/0 conn(0x7f2e9c15b350 0x7f2e9c0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0b2a50 con 0x7f2e9c0adb60 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f2e94001b80 con 0x7f2e9c0adb60 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 >> v1:172.21.15.22:6789/0 conn(0x7f2e9c0adb60 legacy=0x7f2e9c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c09cb30 0x7f2e84003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e84004d00 0x7f2e84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ac740 con 0x7f2e84003ef0 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ac460 con 0x7f2e84004d00 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.695+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8400b980 con 0x7f2e9c09cb30 2023-11-24T06:12:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.696+0000 7f2e9a7fc640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.696+0000 7f2e9b7fe640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e84004d00 0x7f2e84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.696+0000 7f2e9affd640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c09cb30 0x7f2e84003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.696+0000 7f2e9a7fc640 1 -- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c09cb30 msgr2=0x7f2e84003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:19.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.696+0000 7f2e9a7fc640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c09cb30 0x7f2e84003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.696+0000 7f2e9a7fc640 1 -- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e84004d00 msgr2=0x7f2e84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:19.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.696+0000 7f2e9a7fc640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e84004d00 0x7f2e84005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.696+0000 7f2e9a7fc640 1 -- 172.21.15.22:0/4168180914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84003520 con 0x7f2e84003ef0 2023-11-24T06:12:19.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.697+0000 7f2e9a7fc640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e840047c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009ac0 tx=0x7f2e840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e19738619b7142 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:19.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9002c6b0 con 0x7f2e84003ef0 2023-11-24T06:12:19.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9002c810 con 0x7f2e84003ef0 2023-11-24T06:12:19.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2e99ffb640 1 -- 172.21.15.22:0/4168180914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9002cba0 con 0x7f2e84003ef0 2023-11-24T06:12:19.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2ea19dc640 1 -- 172.21.15.22:0/4168180914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 msgr2=0x7f2e840047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2ea19dc640 1 --2- 172.21.15.22:0/4168180914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e840047c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009ac0 tx=0x7f2e840057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2e9b7fe640 1 -- 172.21.15.22:0/4168180914 reap_dead start 2023-11-24T06:12:19.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2ea19dc640 1 -- 172.21.15.22:0/4168180914 shutdown_connections 2023-11-24T06:12:19.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2ea19dc640 1 -- 172.21.15.22:0/4168180914 >> 172.21.15.22:0/4168180914 conn(0x7f2e9c0b0ba0 msgr2=0x7f2e9c0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:19.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2ea19dc640 1 -- 172.21.15.22:0/4168180914 shutdown_connections 2023-11-24T06:12:19.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.698+0000 7f2ea19dc640 1 -- 172.21.15.22:0/4168180914 wait complete. 2023-11-24T06:12:19.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.700+0000 7f2ea19dc640 1 Processor -- start 2023-11-24T06:12:19.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.700+0000 7f2ea19dc640 1 -- start start 2023-11-24T06:12:19.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.701+0000 7f2ea19dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e9c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.701+0000 7f2ea19dc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c15d010 0x7f2e9c143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.701+0000 7f2ea19dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c156390 0x7f2e9c156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.701+0000 7f2ea19dc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c156d80 con 0x7f2e84003ef0 2023-11-24T06:12:19.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.701+0000 7f2ea19dc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c15c2e0 con 0x7f2e9c156390 2023-11-24T06:12:19.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.701+0000 7f2ea19dc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c143fb0 con 0x7f2e9c15d010 2023-11-24T06:12:19.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e9c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e9c15db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38102/0 (socket says 172.21.15.22:38102) 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9affd640 1 -- 172.21.15.22:0/2578957841 learned_addr learned my addr 172.21.15.22:0/2578957841 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9a7fc640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c15d010 0x7f2e9c143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9b7fe640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c156390 0x7f2e9c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9affd640 1 -- 172.21.15.22:0/2578957841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c15d010 msgr2=0x7f2e9c143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9affd640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c15d010 0x7f2e9c143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9affd640 1 -- 172.21.15.22:0/2578957841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c156390 msgr2=0x7f2e9c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9affd640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c156390 0x7f2e9c156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9affd640 1 -- 172.21.15.22:0/2578957841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c15e190 con 0x7f2e84003ef0 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9b7fe640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c156390 0x7f2e9c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:19.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.702+0000 7f2e9affd640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e9c15db90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0108e0 tx=0x7f2e8c010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:19.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.703+0000 7f2e83fff640 1 -- 172.21.15.22:0/2578957841 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00eb60 con 0x7f2e84003ef0 2023-11-24T06:12:19.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.703+0000 7f2e83fff640 1 -- 172.21.15.22:0/2578957841 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c00ecc0 con 0x7f2e84003ef0 2023-11-24T06:12:19.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.703+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c15c530 con 0x7f2e84003ef0 2023-11-24T06:12:19.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.703+0000 7f2e83fff640 1 -- 172.21.15.22:0/2578957841 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c01c400 con 0x7f2e84003ef0 2023-11-24T06:12:19.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.703+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c15caf0 con 0x7f2e84003ef0 2023-11-24T06:12:19.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.704+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c09d200 con 0x7f2e84003ef0 2023-11-24T06:12:19.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.705+0000 7f2e83fff640 1 -- 172.21.15.22:0/2578957841 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e8c01c560 con 0x7f2e84003ef0 2023-11-24T06:12:19.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.706+0000 7f2e83fff640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e8806ae70 0x7f2e8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:19.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.707+0000 7f2e83fff640 1 -- 172.21.15.22:0/2578957841 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e8c089d80 con 0x7f2e84003ef0 2023-11-24T06:12:19.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.707+0000 7f2e9a7fc640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e8806ae70 0x7f2e8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:19.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.707+0000 7f2e9a7fc640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e8806ae70 0x7f2e8806d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e90036000 tx=0x7f2e90030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:19.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.711+0000 7f2e83fff640 1 -- 172.21.15.22:0/2578957841 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e8c054e40 con 0x7f2e84003ef0 2023-11-24T06:12:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.904+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e9c04e920 con 0x7f2e84003ef0 2023-11-24T06:12:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.905+0000 7f2e83fff640 1 -- 172.21.15.22:0/2578957841 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e8c058460 con 0x7f2e84003ef0 2023-11-24T06:12:19.909 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e8806ae70 msgr2=0x7f2e8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e8806ae70 0x7f2e8806d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e90036000 tx=0x7f2e90030000 comp rx=0 tx=0).stop 2023-11-24T06:12:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 msgr2=0x7f2e9c15db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e9c15db90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0108e0 tx=0x7f2e8c010da0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 shutdown_connections 2023-11-24T06:12:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e8806ae70 0x7f2e8806d330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c156390 0x7f2e9c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c15d010 0x7f2e9c143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 --2- 172.21.15.22:0/2578957841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e84003ef0 0x7f2e9c15db90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 >> 172.21.15.22:0/2578957841 conn(0x7f2e9c0b0ba0 msgr2=0x7f2e9c06db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 shutdown_connections 2023-11-24T06:12:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:19.908+0000 7f2ea19dc640 1 -- 172.21.15.22:0/2578957841 wait complete. 2023-11-24T06:12:19.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:12:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.142+0000 7f6c6ffff640 1 Processor -- start 2023-11-24T06:12:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.142+0000 7f6c6ffff640 1 -- start start 2023-11-24T06:12:20.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.144+0000 7f6c6ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c700cf760 0x7f6c7015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.144+0000 7f6c6ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c70143950 0x7f6c7015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.144+0000 7f6c6ffff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c70071700 con 0x7f6c70143570 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.144+0000 7f6c6ffff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7015af30 con 0x7f6c700cf760 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.144+0000 7f6c6ffff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7015b410 con 0x7f6c70143950 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.144+0000 7f6c6e7fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c700cf760 0x7f6c7015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.144+0000 7f6c6e7fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c700cf760 0x7f6c7015a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38112/0 (socket says 172.21.15.22:38112) 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.144+0000 7f6c6e7fc640 1 -- 172.21.15.22:0/364732946 learned_addr learned my addr 172.21.15.22:0/364732946 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.144+0000 7f6c6f7fe640 1 --2- 172.21.15.22:0/364732946 >> v2:172.21.15.31:3300/0 conn(0x7f6c70143950 0x7f6c7015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.145+0000 7f6c6e7fc640 1 -- 172.21.15.22:0/364732946 >> v2:172.21.15.31:3300/0 conn(0x7f6c70143950 msgr2=0x7f6c7015a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.145+0000 7f6c6e7fc640 1 --2- 172.21.15.22:0/364732946 >> v2:172.21.15.31:3300/0 conn(0x7f6c70143950 0x7f6c7015a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.145+0000 7f6c6e7fc640 1 -- 172.21.15.22:0/364732946 >> v1:172.21.15.31:6789/0 conn(0x7f6c70143570 legacy=0x7f6c700cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:20.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.145+0000 7f6c6e7fc640 1 -- 172.21.15.22:0/364732946 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7015b130 con 0x7f6c700cf760 2023-11-24T06:12:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.146+0000 7f6c6e7fc640 1 --2- 172.21.15.22:0/364732946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c700cf760 0x7f6c7015a4b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6c700b3b30 tx=0x7f6c6402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158736d1ea23a670 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.146+0000 7f6c6dffb640 1 -- 172.21.15.22:0/364732946 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6402ee00 con 0x7f6c700cf760 2023-11-24T06:12:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.146+0000 7f6c6dffb640 1 -- 172.21.15.22:0/364732946 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c64036440 con 0x7f6c700cf760 2023-11-24T06:12:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.146+0000 7f6c6dffb640 1 -- 172.21.15.22:0/364732946 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640367d0 con 0x7f6c700cf760 2023-11-24T06:12:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.147+0000 7f6c6ffff640 1 -- 172.21.15.22:0/364732946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c700cf760 msgr2=0x7f6c7015a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.147+0000 7f6c6ffff640 1 --2- 172.21.15.22:0/364732946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c700cf760 0x7f6c7015a4b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6c700b3b30 tx=0x7f6c6402e050 comp rx=0 tx=0).stop 2023-11-24T06:12:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.147+0000 7f6c6ffff640 1 -- 172.21.15.22:0/364732946 shutdown_connections 2023-11-24T06:12:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.147+0000 7f6c6ffff640 1 --2- 172.21.15.22:0/364732946 >> v2:172.21.15.31:3300/0 conn(0x7f6c70143950 0x7f6c7015a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.147+0000 7f6c6ffff640 1 --2- 172.21.15.22:0/364732946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c700cf760 0x7f6c7015a4b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.147+0000 7f6c6ffff640 1 -- 172.21.15.22:0/364732946 >> 172.21.15.22:0/364732946 conn(0x7f6c7006a860 msgr2=0x7f6c7006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.147+0000 7f6c6ffff640 1 -- 172.21.15.22:0/364732946 shutdown_connections 2023-11-24T06:12:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.147+0000 7f6c6ffff640 1 -- 172.21.15.22:0/364732946 wait complete. 2023-11-24T06:12:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.149+0000 7f6c6ffff640 1 Processor -- start 2023-11-24T06:12:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.149+0000 7f6c6ffff640 1 -- start start 2023-11-24T06:12:20.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.150+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c700cf760 0x7f6c70141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.150+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c70143570 0x7f6c70158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.150+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c70143950 0x7f6c7013c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.150+0000 7f6c6ffff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700c9c80 con 0x7f6c70143950 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.150+0000 7f6c6ffff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c701422f0 con 0x7f6c70143570 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.150+0000 7f6c6ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70159280 con 0x7f6c700cf760 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.150+0000 7f6c6f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c70143950 0x7f6c7013c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.150+0000 7f6c6f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c70143950 0x7f6c7013c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38124/0 (socket says 172.21.15.22:38124) 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.150+0000 7f6c6f7fe640 1 -- 172.21.15.22:0/2540647526 learned_addr learned my addr 172.21.15.22:0/2540647526 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6e7fc640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c70143570 0x7f6c70158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6effd640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c700cf760 0x7f6c70141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6f7fe640 1 -- 172.21.15.22:0/2540647526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c700cf760 msgr2=0x7f6c70141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6f7fe640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c700cf760 0x7f6c70141d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6f7fe640 1 -- 172.21.15.22:0/2540647526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c70143570 msgr2=0x7f6c70158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6f7fe640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c70143570 0x7f6c70158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6f7fe640 1 -- 172.21.15.22:0/2540647526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6400b770 con 0x7f6c70143950 2023-11-24T06:12:20.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6effd640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c700cf760 0x7f6c70141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:20.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6f7fe640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c70143950 0x7f6c7013c7f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800d5a0 tx=0x7f6c6800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:20.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c577fe640 1 -- 172.21.15.22:0/2540647526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c680125f0 con 0x7f6c70143950 2023-11-24T06:12:20.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c577fe640 1 -- 172.21.15.22:0/2540647526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c68012770 con 0x7f6c70143950 2023-11-24T06:12:20.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c577fe640 1 -- 172.21.15.22:0/2540647526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68012b20 con 0x7f6c70143950 2023-11-24T06:12:20.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.151+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c700c92e0 con 0x7f6c70143950 2023-11-24T06:12:20.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.152+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c700c98a0 con 0x7f6c70143950 2023-11-24T06:12:20.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.153+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c700c9dc0 con 0x7f6c70143950 2023-11-24T06:12:20.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.154+0000 7f6c577fe640 1 -- 172.21.15.22:0/2540647526 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c68012c80 con 0x7f6c70143950 2023-11-24T06:12:20.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.154+0000 7f6c577fe640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6c5c06ae40 0x7f6c5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.154+0000 7f6c577fe640 1 -- 172.21.15.22:0/2540647526 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c68089a70 con 0x7f6c70143950 2023-11-24T06:12:20.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.155+0000 7f6c6effd640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6c5c06ae40 0x7f6c5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.155+0000 7f6c6effd640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6c5c06ae40 0x7f6c5c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c60004520 tx=0x7f6c60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:20.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.159+0000 7f6c577fe640 1 -- 172.21.15.22:0/2540647526 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c700c9dc0 con 0x7f6c70143950 2023-11-24T06:12:20.210 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:12:20.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:12:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.393+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c700c9dc0 con 0x7f6c70143950 2023-11-24T06:12:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.394+0000 7f6c577fe640 1 -- 172.21.15.22:0/2540647526 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f6c700c9dc0 con 0x7f6c70143950 2023-11-24T06:12:20.398 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:20.398 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2596011389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2596011389},{"type":"v1","addr":"172.21.15.22:6837","nonce":2596011389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1715395658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1715395658},{"type":"v1","addr":"172.21.15.31:6834","nonce":1715395658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2020783180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2020783180},{"type":"v1","addr":"172.21.15.31:6835","nonce":2020783180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:12:00.092195+0000","modified":"2023-11-24T06:12:03.157366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/4189980327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":4189980327},{"type":"v1","addr":"172.21.15.22:6835","nonce":4189980327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:12:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-11-24T06:12:20.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6c5c06ae40 msgr2=0x7f6c5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6c5c06ae40 0x7f6c5c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c60004520 tx=0x7f6c60009040 comp rx=0 tx=0).stop 2023-11-24T06:12:20.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c70143950 msgr2=0x7f6c7013c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c70143950 0x7f6c7013c7f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800d5a0 tx=0x7f6c6800da60 comp rx=0 tx=0).stop 2023-11-24T06:12:20.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 shutdown_connections 2023-11-24T06:12:20.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6c5c06ae40 0x7f6c5c06d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c70143950 0x7f6c7013c7f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c70143570 0x7f6c70158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 --2- 172.21.15.22:0/2540647526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c700cf760 0x7f6c70141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 >> 172.21.15.22:0/2540647526 conn(0x7f6c7006a860 msgr2=0x7f6c7006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:20.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 shutdown_connections 2023-11-24T06:12:20.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.397+0000 7f6c6ffff640 1 -- 172.21.15.22:0/2540647526 wait complete. 2023-11-24T06:12:20.420 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.638+0000 7f65752a6640 1 Processor -- start 2023-11-24T06:12:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.639+0000 7f65752a6640 1 -- start start 2023-11-24T06:12:20.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.640+0000 7f65752a6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f657013fca0 0x7f6570164b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.640+0000 7f65752a6640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700cf180 con 0x7f657013cbc0 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.640+0000 7f65752a6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700cf460 con 0x7f65701401c0 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.640+0000 7f65752a6640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700cfd00 con 0x7f657013fca0 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.640+0000 7f656ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f657013cbc0 0x7f65700ce730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53452/0 (socket says 172.21.15.22:53452) 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.640+0000 7f656ffff640 1 -- 172.21.15.22:0/1664842099 learned_addr learned my addr 172.21.15.22:0/1664842099 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.640+0000 7f6574aa5640 1 --2- 172.21.15.22:0/1664842099 >> v2:172.21.15.22:3300/0 conn(0x7f657013fca0 0x7f6570164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.641+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168354868 0 0) 0x7f65700cf180 con 0x7f657013cbc0 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.641+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f655c003520 con 0x7f657013cbc0 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.641+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2947270933 0 0) 0x7f655c003520 con 0x7f657013cbc0 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.641+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 >> v2:172.21.15.22:3300/0 conn(0x7f657013fca0 msgr2=0x7f6570164b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.641+0000 7f656effd640 1 --2- 172.21.15.22:0/1664842099 >> v2:172.21.15.22:3300/0 conn(0x7f657013fca0 0x7f6570164b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.641+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 >> v1:172.21.15.31:6789/0 conn(0x7f65701401c0 legacy=0x7f657013f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.641+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700cf740 con 0x7f657013cbc0 2023-11-24T06:12:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.641+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f6560001670 con 0x7f657013cbc0 2023-11-24T06:12:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 >> v1:172.21.15.22:6789/0 conn(0x7f657013cbc0 legacy=0x7f65700ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f656effd640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f655c0039e0 0x7f655c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f656effd640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f655c0047c0 0x7f655c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f656effd640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f655c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700cfd00 con 0x7f655c0051f0 2023-11-24T06:12:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c00c150 con 0x7f655c0039e0 2023-11-24T06:12:20.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c00c310 con 0x7f655c0047c0 2023-11-24T06:12:20.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f6574aa5640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f655c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f6574aa5640 1 -- 172.21.15.22:0/1664842099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f655c0047c0 msgr2=0x7f655c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:20.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f6574aa5640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f655c0047c0 0x7f655c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f656ffff640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f655c0039e0 0x7f655c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f6574aa5640 1 -- 172.21.15.22:0/1664842099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f655c0039e0 msgr2=0x7f655c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:20.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f6574aa5640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f655c0039e0 0x7f655c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f6574aa5640 1 -- 172.21.15.22:0/1664842099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c003520 con 0x7f655c0051f0 2023-11-24T06:12:20.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.642+0000 7f656ffff640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f655c0039e0 0x7f655c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:20.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.643+0000 7f6574aa5640 1 -- 172.21.15.22:0/1664842099 reap_dead start 2023-11-24T06:12:20.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.643+0000 7f6574aa5640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f655c00b980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6568009ac0 tx=0x7f655c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750493af2ae6fddc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:20.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568004020 con 0x7f655c0051f0 2023-11-24T06:12:20.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6568004180 con 0x7f655c0051f0 2023-11-24T06:12:20.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f656effd640 1 -- 172.21.15.22:0/1664842099 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656802c710 con 0x7f655c0051f0 2023-11-24T06:12:20.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f65752a6640 1 -- 172.21.15.22:0/1664842099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 msgr2=0x7f655c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f65752a6640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f655c00b980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6568009ac0 tx=0x7f655c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f65752a6640 1 -- 172.21.15.22:0/1664842099 shutdown_connections 2023-11-24T06:12:20.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f65752a6640 1 --2- 172.21.15.22:0/1664842099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f655c00b980 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f65752a6640 1 -- 172.21.15.22:0/1664842099 >> 172.21.15.22:0/1664842099 conn(0x7f65700b1c70 msgr2=0x7f65700b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:20.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f65752a6640 1 -- 172.21.15.22:0/1664842099 shutdown_connections 2023-11-24T06:12:20.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.644+0000 7f65752a6640 1 -- 172.21.15.22:0/1664842099 wait complete. 2023-11-24T06:12:20.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.646+0000 7f65752a6640 1 Processor -- start 2023-11-24T06:12:20.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.646+0000 7f65752a6640 1 -- start start 2023-11-24T06:12:20.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.647+0000 7f65752a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f6570136760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.647+0000 7f65752a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f657015afa0 0x7f65701514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.647+0000 7f65752a6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6570151a00 0x7f657006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.647+0000 7f65752a6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657015d880 con 0x7f655c0051f0 2023-11-24T06:12:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.647+0000 7f65752a6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570136ca0 con 0x7f657015afa0 2023-11-24T06:12:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.647+0000 7f65752a6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b4e70 con 0x7f6570151a00 2023-11-24T06:12:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f6570136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f6570136760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38140/0 (socket says 172.21.15.22:38140) 2023-11-24T06:12:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656ffff640 1 -- 172.21.15.22:0/2378423540 learned_addr learned my addr 172.21.15.22:0/2378423540 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f6574aa5640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6570151a00 0x7f657006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656f7fe640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f657015afa0 0x7f65701514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656ffff640 1 -- 172.21.15.22:0/2378423540 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6570151a00 msgr2=0x7f657006edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656ffff640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6570151a00 0x7f657006edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656ffff640 1 -- 172.21.15.22:0/2378423540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f657015afa0 msgr2=0x7f65701514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656ffff640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f657015afa0 0x7f65701514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656ffff640 1 -- 172.21.15.22:0/2378423540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657006e5d0 con 0x7f655c0051f0 2023-11-24T06:12:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656f7fe640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f657015afa0 0x7f65701514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.648+0000 7f656ffff640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f6570136760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6560008200 tx=0x7f65600086c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.649+0000 7f656cff9640 1 -- 172.21.15.22:0/2378423540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000e730 con 0x7f655c0051f0 2023-11-24T06:12:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.649+0000 7f656cff9640 1 -- 172.21.15.22:0/2378423540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656000e8b0 con 0x7f655c0051f0 2023-11-24T06:12:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.649+0000 7f656cff9640 1 -- 172.21.15.22:0/2378423540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000ec60 con 0x7f655c0051f0 2023-11-24T06:12:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.649+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657006e8b0 con 0x7f655c0051f0 2023-11-24T06:12:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.649+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657015c2f0 con 0x7f655c0051f0 2023-11-24T06:12:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.650+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657006eaa0 con 0x7f655c0051f0 2023-11-24T06:12:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.651+0000 7f656cff9640 1 -- 172.21.15.22:0/2378423540 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65600070d0 con 0x7f655c0051f0 2023-11-24T06:12:20.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.652+0000 7f656cff9640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f655006ae40 0x7f655006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:20.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.652+0000 7f656cff9640 1 -- 172.21.15.22:0/2378423540 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65600899c0 con 0x7f655c0051f0 2023-11-24T06:12:20.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.652+0000 7f656f7fe640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f655006ae40 0x7f655006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:20.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.653+0000 7f656f7fe640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f655006ae40 0x7f655006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6558007fd0 tx=0x7f6558009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:20.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.657+0000 7f656cff9640 1 -- 172.21.15.22:0/2378423540 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65600549e0 con 0x7f655c0051f0 2023-11-24T06:12:20.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.852+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f657004e840 con 0x7f655c0051f0 2023-11-24T06:12:20.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.855+0000 7f656cff9640 1 -- 172.21.15.22:0/2378423540 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f6560058000 con 0x7f655c0051f0 2023-11-24T06:12:20.859 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:20.859 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:01.374181+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:20.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f655006ae40 msgr2=0x7f655006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f655006ae40 0x7f655006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6558007fd0 tx=0x7f6558009040 comp rx=0 tx=0).stop 2023-11-24T06:12:20.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 msgr2=0x7f6570136760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:20.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f6570136760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6560008200 tx=0x7f65600086c0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 shutdown_connections 2023-11-24T06:12:20.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f655006ae40 0x7f655006d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6570151a00 0x7f657006edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f657015afa0 0x7f65701514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 --2- 172.21.15.22:0/2378423540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c0051f0 0x7f6570136760 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:20.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 >> 172.21.15.22:0/2378423540 conn(0x7f65700b1c70 msgr2=0x7f657013e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:20.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 shutdown_connections 2023-11-24T06:12:20.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:20.858+0000 7f65752a6640 1 -- 172.21.15.22:0/2378423540 wait complete. 2023-11-24T06:12:20.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:20.881 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:21.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.097+0000 7fd4df59e640 1 Processor -- start 2023-11-24T06:12:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.097+0000 7fd4df59e640 1 -- start start 2023-11-24T06:12:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.099+0000 7fd4df59e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4e015d3b0 0x7fd4e00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.099+0000 7fd4df59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 0x7fd4e00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.099+0000 7fd4df59e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e00d2010 con 0x7fd4e00d1bc0 2023-11-24T06:12:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.099+0000 7fd4df59e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e00c6bf0 con 0x7fd4e015d3b0 2023-11-24T06:12:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.099+0000 7fd4df59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e00d1400 con 0x7fd4e00d0fa0 2023-11-24T06:12:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.099+0000 7fd4ded9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd4e00d1bc0 0x7fd4e00b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56766/0 (socket says 172.21.15.22:56766) 2023-11-24T06:12:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.099+0000 7fd4ded9d640 1 -- 172.21.15.22:0/3166114961 learned_addr learned my addr 172.21.15.22:0/3166114961 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:21.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.099+0000 7fd4de59c640 1 --2- 172.21.15.22:0/3166114961 >> v2:172.21.15.22:3300/0 conn(0x7fd4e015d3b0 0x7fd4e00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.099+0000 7fd4ddd9b640 1 --2- 172.21.15.22:0/3166114961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 0x7fd4e00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.100+0000 7fd4dd59a640 1 -- 172.21.15.22:0/3166114961 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772105281 0 0) 0x7fd4d8001110 con 0x7fd4e00d1bc0 2023-11-24T06:12:21.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.100+0000 7fd4dd59a640 1 -- 172.21.15.22:0/3166114961 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4cc003520 con 0x7fd4e00d1bc0 2023-11-24T06:12:21.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.100+0000 7fd4de59c640 1 -- 172.21.15.22:0/3166114961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 msgr2=0x7fd4e00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:21.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.100+0000 7fd4de59c640 1 --2- 172.21.15.22:0/3166114961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 0x7fd4e00d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.100+0000 7fd4de59c640 1 -- 172.21.15.22:0/3166114961 >> v1:172.21.15.22:6789/0 conn(0x7fd4e00d1bc0 legacy=0x7fd4e00b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.100+0000 7fd4de59c640 1 -- 172.21.15.22:0/3166114961 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00cedc0 con 0x7fd4e015d3b0 2023-11-24T06:12:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.101+0000 7fd4de59c640 1 --2- 172.21.15.22:0/3166114961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 0x7fd4e00ce6c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009d90 tx=0x7fd4d002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3306e113452ac1c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.101+0000 7fd4dd59a640 1 -- 172.21.15.22:0/3166114961 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d002cbc0 con 0x7fd4e015d3b0 2023-11-24T06:12:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.101+0000 7fd4dd59a640 1 -- 172.21.15.22:0/3166114961 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d002cd20 con 0x7fd4e015d3b0 2023-11-24T06:12:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.101+0000 7fd4dd59a640 1 -- 172.21.15.22:0/3166114961 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0034660 con 0x7fd4e015d3b0 2023-11-24T06:12:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.102+0000 7fd4df59e640 1 -- 172.21.15.22:0/3166114961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 msgr2=0x7fd4e00ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.102+0000 7fd4df59e640 1 --2- 172.21.15.22:0/3166114961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 0x7fd4e00ce6c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009d90 tx=0x7fd4d002be10 comp rx=0 tx=0).stop 2023-11-24T06:12:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.102+0000 7fd4df59e640 1 -- 172.21.15.22:0/3166114961 shutdown_connections 2023-11-24T06:12:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.102+0000 7fd4df59e640 1 --2- 172.21.15.22:0/3166114961 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 0x7fd4e00d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.102+0000 7fd4df59e640 1 --2- 172.21.15.22:0/3166114961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 0x7fd4e00ce6c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.102+0000 7fd4df59e640 1 -- 172.21.15.22:0/3166114961 >> 172.21.15.22:0/3166114961 conn(0x7fd4e00d30a0 msgr2=0x7fd4e00d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:21.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.102+0000 7fd4df59e640 1 -- 172.21.15.22:0/3166114961 shutdown_connections 2023-11-24T06:12:21.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.102+0000 7fd4df59e640 1 -- 172.21.15.22:0/3166114961 wait complete. 2023-11-24T06:12:21.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.103+0000 7fd4df59e640 1 Processor -- start 2023-11-24T06:12:21.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.104+0000 7fd4df59e640 1 -- start start 2023-11-24T06:12:21.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4df59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 0x7fd4e01f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4df59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4e00d1bc0 0x7fd4e0157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4df59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 0x7fd4e014a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4df59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e01f3bd0 con 0x7fd4e015d3b0 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4df59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e015a840 con 0x7fd4e00d1bc0 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4df59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e015ab20 con 0x7fd4e00d0fa0 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4ded9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 0x7fd4e014a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4ded9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 0x7fd4e014a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54826/0 (socket says 172.21.15.22:54826) 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4ded9d640 1 -- 172.21.15.22:0/3654393155 learned_addr learned my addr 172.21.15.22:0/3654393155 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4de59c640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 0x7fd4e01f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4ded9d640 1 -- 172.21.15.22:0/3654393155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 msgr2=0x7fd4e01f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4ded9d640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 0x7fd4e01f3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4ddd9b640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4e00d1bc0 0x7fd4e0157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4ded9d640 1 -- 172.21.15.22:0/3654393155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4e00d1bc0 msgr2=0x7fd4e0157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4ded9d640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4e00d1bc0 0x7fd4e0157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.105+0000 7fd4ded9d640 1 -- 172.21.15.22:0/3654393155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d0009a70 con 0x7fd4e015d3b0 2023-11-24T06:12:21.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.106+0000 7fd4ded9d640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 0x7fd4e014a130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800c390 tx=0x7fd4d800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:21.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.106+0000 7fd4d6ffd640 1 -- 172.21.15.22:0/3654393155 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8005ce0 con 0x7fd4e015d3b0 2023-11-24T06:12:21.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.106+0000 7fd4d6ffd640 1 -- 172.21.15.22:0/3654393155 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d8005e40 con 0x7fd4e015d3b0 2023-11-24T06:12:21.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.106+0000 7fd4d6ffd640 1 -- 172.21.15.22:0/3654393155 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80072f0 con 0x7fd4e015d3b0 2023-11-24T06:12:21.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.106+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e015ae00 con 0x7fd4e015d3b0 2023-11-24T06:12:21.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.106+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e00cb260 con 0x7fd4e015d3b0 2023-11-24T06:12:21.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.107+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e00cb480 con 0x7fd4e015d3b0 2023-11-24T06:12:21.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.108+0000 7fd4d6ffd640 1 -- 172.21.15.22:0/3654393155 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4d8007450 con 0x7fd4e015d3b0 2023-11-24T06:12:21.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.109+0000 7fd4d6ffd640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd4c006ae40 0x7fd4c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.109+0000 7fd4d6ffd640 1 -- 172.21.15.22:0/3654393155 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4d8088ad0 con 0x7fd4e015d3b0 2023-11-24T06:12:21.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.109+0000 7fd4de59c640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd4c006ae40 0x7fd4c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.110+0000 7fd4de59c640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd4c006ae40 0x7fd4c006d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0036000 tx=0x7fd4d0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:21.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.114+0000 7fd4d6ffd640 1 -- 172.21.15.22:0/3654393155 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4d8053ae0 con 0x7fd4e015d3b0 2023-11-24T06:12:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.296+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4e00d2010 con 0x7fd4e015d3b0 2023-11-24T06:12:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.297+0000 7fd4d6ffd640 1 -- 172.21.15.22:0/3654393155 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4e00d2010 con 0x7fd4e015d3b0 2023-11-24T06:12:21.301 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.299+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd4c006ae40 msgr2=0x7fd4c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.299+0000 7fd4df59e640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd4c006ae40 0x7fd4c006d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0036000 tx=0x7fd4d0030000 comp rx=0 tx=0).stop 2023-11-24T06:12:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.299+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 msgr2=0x7fd4e014a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.299+0000 7fd4df59e640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 0x7fd4e014a130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800c390 tx=0x7fd4d800c850 comp rx=0 tx=0).stop 2023-11-24T06:12:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.300+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 shutdown_connections 2023-11-24T06:12:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.300+0000 7fd4df59e640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd4c006ae40 0x7fd4c006d300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.300+0000 7fd4df59e640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e015d3b0 0x7fd4e014a130 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.300+0000 7fd4df59e640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4e00d1bc0 0x7fd4e0157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.300+0000 7fd4df59e640 1 --2- 172.21.15.22:0/3654393155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4e00d0fa0 0x7fd4e01f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.300+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 >> 172.21.15.22:0/3654393155 conn(0x7fd4e00d30a0 msgr2=0x7fd4e006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.300+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 shutdown_connections 2023-11-24T06:12:21.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.300+0000 7fd4df59e640 1 -- 172.21.15.22:0/3654393155 wait complete. 2023-11-24T06:12:21.320 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:21.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.530+0000 7f41bf1ce640 1 Processor -- start 2023-11-24T06:12:21.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.530+0000 7f41bf1ce640 1 -- start start 2023-11-24T06:12:21.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.532+0000 7f41bf1ce640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41b80d17e0 0x7f41b80d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.532+0000 7f41bf1ce640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b80ce820 0x7f41b80b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.532+0000 7f41bf1ce640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b80b2670 con 0x7f41b815d840 2023-11-24T06:12:21.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.532+0000 7f41bf1ce640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b80cefc0 con 0x7f41b80d17e0 2023-11-24T06:12:21.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.532+0000 7f41bf1ce640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80b2910 con 0x7f41b80ce820 2023-11-24T06:12:21.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.532+0000 7f41b7fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f41b815d840 0x7f41b80d1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56768/0 (socket says 172.21.15.22:56768) 2023-11-24T06:12:21.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.532+0000 7f41b7fff640 1 -- 172.21.15.22:0/4033963877 learned_addr learned my addr 172.21.15.22:0/4033963877 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.532+0000 7f41bd76b640 1 --2- 172.21.15.22:0/4033963877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b80ce820 0x7f41b80b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.532+0000 7f41bcf6a640 1 --2- 172.21.15.22:0/4033963877 >> v2:172.21.15.31:3300/0 conn(0x7f41b80d17e0 0x7f41b80d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.533+0000 7f41b77fe640 1 -- 172.21.15.22:0/4033963877 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273716430 0 0) 0x7f41b80b2670 con 0x7f41b815d840 2023-11-24T06:12:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.533+0000 7f41b77fe640 1 -- 172.21.15.22:0/4033963877 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a8003520 con 0x7f41b815d840 2023-11-24T06:12:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.533+0000 7f41bd76b640 1 -- 172.21.15.22:0/4033963877 >> v2:172.21.15.31:3300/0 conn(0x7f41b80d17e0 msgr2=0x7f41b80d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.533+0000 7f41bd76b640 1 --2- 172.21.15.22:0/4033963877 >> v2:172.21.15.31:3300/0 conn(0x7f41b80d17e0 0x7f41b80d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.533+0000 7f41b77fe640 1 -- 172.21.15.22:0/4033963877 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2072934184 0 0) 0x7f41a8003520 con 0x7f41b815d840 2023-11-24T06:12:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.533+0000 7f41bd76b640 1 -- 172.21.15.22:0/4033963877 >> v1:172.21.15.22:6789/0 conn(0x7f41b815d840 legacy=0x7f41b80d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.533+0000 7f41bd76b640 1 -- 172.21.15.22:0/4033963877 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80b2bf0 con 0x7f41b80ce820 2023-11-24T06:12:21.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.535+0000 7f41bd76b640 1 --2- 172.21.15.22:0/4033963877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b80ce820 0x7f41b80b33f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009d90 tx=0x7f41b002bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16cf640838239d02 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:21.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41b77fe640 1 -- 172.21.15.22:0/4033963877 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4001670 con 0x7f41b80ce820 2023-11-24T06:12:21.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41b77fe640 1 -- 172.21.15.22:0/4033963877 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b002c810 con 0x7f41b80ce820 2023-11-24T06:12:21.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41b77fe640 1 -- 172.21.15.22:0/4033963877 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b002cba0 con 0x7f41b80ce820 2023-11-24T06:12:21.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41bf1ce640 1 -- 172.21.15.22:0/4033963877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b80ce820 msgr2=0x7f41b80b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41bf1ce640 1 --2- 172.21.15.22:0/4033963877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b80ce820 0x7f41b80b33f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009d90 tx=0x7f41b002bce0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41bf1ce640 1 -- 172.21.15.22:0/4033963877 shutdown_connections 2023-11-24T06:12:21.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41bf1ce640 1 --2- 172.21.15.22:0/4033963877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b80ce820 0x7f41b80b33f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41bf1ce640 1 --2- 172.21.15.22:0/4033963877 >> v2:172.21.15.31:3300/0 conn(0x7f41b80d17e0 0x7f41b80d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41bf1ce640 1 -- 172.21.15.22:0/4033963877 >> 172.21.15.22:0/4033963877 conn(0x7f41b809c560 msgr2=0x7f41b80d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:21.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.539+0000 7f41bf1ce640 1 -- 172.21.15.22:0/4033963877 shutdown_connections 2023-11-24T06:12:21.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.540+0000 7f41bf1ce640 1 -- 172.21.15.22:0/4033963877 wait complete. 2023-11-24T06:12:21.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.541+0000 7f41bf1ce640 1 Processor -- start 2023-11-24T06:12:21.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.542+0000 7f41bf1ce640 1 -- start start 2023-11-24T06:12:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.542+0000 7f41bf1ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b80ce820 0x7f41b80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.542+0000 7f41bf1ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41b80d17e0 0x7f41b80b8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.542+0000 7f41bf1ce640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b815d840 0x7f41b814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41bf1ce640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80b7e20 con 0x7f41b80d17e0 2023-11-24T06:12:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41bf1ce640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80c9cb0 con 0x7f41b80ce820 2023-11-24T06:12:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41bf1ce640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b814d1a0 con 0x7f41b815d840 2023-11-24T06:12:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41b7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41b80d17e0 0x7f41b80b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41b7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41b80d17e0 0x7f41b80b8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54832/0 (socket says 172.21.15.22:54832) 2023-11-24T06:12:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41b7fff640 1 -- 172.21.15.22:0/1438020671 learned_addr learned my addr 172.21.15.22:0/1438020671 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41bcf6a640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b80ce820 0x7f41b80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41b7fff640 1 -- 172.21.15.22:0/1438020671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b815d840 msgr2=0x7f41b814f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41b7fff640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b815d840 0x7f41b814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41b7fff640 1 -- 172.21.15.22:0/1438020671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b80ce820 msgr2=0x7f41b80c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41b7fff640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b80ce820 0x7f41b80c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41b7fff640 1 -- 172.21.15.22:0/1438020671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0009a70 con 0x7f41b80d17e0 2023-11-24T06:12:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.543+0000 7f41b7fff640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41b80d17e0 0x7f41b80b8240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f41a400c780 tx=0x7f41a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.544+0000 7f41b57fa640 1 -- 172.21.15.22:0/1438020671 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4005ad0 con 0x7f41b80d17e0 2023-11-24T06:12:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.544+0000 7f41b57fa640 1 -- 172.21.15.22:0/1438020671 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4005c50 con 0x7f41b80d17e0 2023-11-24T06:12:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.544+0000 7f41b57fa640 1 -- 172.21.15.22:0/1438020671 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4007070 con 0x7f41b80d17e0 2023-11-24T06:12:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.544+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b80b8780 con 0x7f41b80d17e0 2023-11-24T06:12:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.544+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b80ca920 con 0x7f41b80d17e0 2023-11-24T06:12:21.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.545+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b80b7f60 con 0x7f41b80d17e0 2023-11-24T06:12:21.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.546+0000 7f41b57fa640 1 -- 172.21.15.22:0/1438020671 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41a40071d0 con 0x7f41b80d17e0 2023-11-24T06:12:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.547+0000 7f41b57fa640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419c06ae40 0x7f419c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.547+0000 7f41b57fa640 1 -- 172.21.15.22:0/1438020671 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41a40892e0 con 0x7f41b80d17e0 2023-11-24T06:12:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.547+0000 7f41bcf6a640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419c06ae40 0x7f419c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.548+0000 7f41bcf6a640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419c06ae40 0x7f419c06d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009a10 tx=0x7f41ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.551+0000 7f41b57fa640 1 -- 172.21.15.22:0/1438020671 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41b80b7f60 con 0x7f41b80d17e0 2023-11-24T06:12:21.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.745+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41b80b7f60 con 0x7f41b80d17e0 2023-11-24T06:12:21.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.745+0000 7f41b57fa640 1 -- 172.21.15.22:0/1438020671 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41b80b7f60 con 0x7f41b80d17e0 2023-11-24T06:12:21.749 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:21.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419c06ae40 msgr2=0x7f419c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419c06ae40 0x7f419c06d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009a10 tx=0x7f41ac008040 comp rx=0 tx=0).stop 2023-11-24T06:12:21.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41b80d17e0 msgr2=0x7f41b80b8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:21.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41b80d17e0 0x7f41b80b8240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f41a400c780 tx=0x7f41a400cc40 comp rx=0 tx=0).stop 2023-11-24T06:12:21.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 shutdown_connections 2023-11-24T06:12:21.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419c06ae40 0x7f419c06d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b815d840 0x7f41b814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41b80d17e0 0x7f41b80b8240 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 --2- 172.21.15.22:0/1438020671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b80ce820 0x7f41b80c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:21.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 >> 172.21.15.22:0/1438020671 conn(0x7f41b809c560 msgr2=0x7f41b806c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:21.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 shutdown_connections 2023-11-24T06:12:21.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.748+0000 7f41bf1ce640 1 -- 172.21.15.22:0/1438020671 wait complete. 2023-11-24T06:12:21.770 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.995+0000 7fac5f1fa640 1 Processor -- start 2023-11-24T06:12:21.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.995+0000 7fac5f1fa640 1 -- start start 2023-11-24T06:12:22.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.996+0000 7fac5f1fa640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fac58144770 0x7fac5815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5f1fa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac580b35a0 0x7fac5815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5f1fa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5815f930 con 0x7fac5806c9d0 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5f1fa640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac580b43b0 con 0x7fac58144770 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5f1fa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac580b3b10 con 0x7fac580b35a0 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5e1f8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fac58144770 0x7fac5815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5e1f8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fac58144770 0x7fac5815eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54838/0 (socket says 172.21.15.22:54838) 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5e1f8640 1 -- 172.21.15.22:0/3788911791 learned_addr learned my addr 172.21.15.22:0/3788911791 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5d9f7640 1 --2- 172.21.15.22:0/3788911791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac580b35a0 0x7fac5815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5e1f8640 1 -- 172.21.15.22:0/3788911791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac580b35a0 msgr2=0x7fac5815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5e1f8640 1 --2- 172.21.15.22:0/3788911791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac580b35a0 0x7fac5815f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5e1f8640 1 -- 172.21.15.22:0/3788911791 >> v1:172.21.15.31:6789/0 conn(0x7fac5806c9d0 legacy=0x7fac5806ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.997+0000 7fac5e1f8640 1 -- 172.21.15.22:0/3788911791 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac580b3df0 con 0x7fac58144770 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.999+0000 7fac5e1f8640 1 --2- 172.21.15.22:0/3788911791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 0x7fac5815eb60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fac540098a0 tx=0x7fac5402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8534ea289522caa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.999+0000 7fac5d1f6640 1 -- 172.21.15.22:0/3788911791 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54031640 con 0x7fac58144770 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.999+0000 7fac5d1f6640 1 -- 172.21.15.22:0/3788911791 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac540317a0 con 0x7fac58144770 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:21.999+0000 7fac5d1f6640 1 -- 172.21.15.22:0/3788911791 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54031b30 con 0x7fac58144770 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.000+0000 7fac5f1fa640 1 -- 172.21.15.22:0/3788911791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 msgr2=0x7fac5815eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.000+0000 7fac5f1fa640 1 --2- 172.21.15.22:0/3788911791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 0x7fac5815eb60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fac540098a0 tx=0x7fac5402b8f0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.000+0000 7fac5f1fa640 1 -- 172.21.15.22:0/3788911791 shutdown_connections 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.000+0000 7fac5f1fa640 1 --2- 172.21.15.22:0/3788911791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac580b35a0 0x7fac5815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.000+0000 7fac5f1fa640 1 --2- 172.21.15.22:0/3788911791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 0x7fac5815eb60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.000+0000 7fac5f1fa640 1 -- 172.21.15.22:0/3788911791 >> 172.21.15.22:0/3788911791 conn(0x7fac580cec10 msgr2=0x7fac580cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:22.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.000+0000 7fac5f1fa640 1 -- 172.21.15.22:0/3788911791 shutdown_connections 2023-11-24T06:12:22.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.000+0000 7fac5f1fa640 1 -- 172.21.15.22:0/3788911791 wait complete. 2023-11-24T06:12:22.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.002+0000 7fac5f1fa640 1 Processor -- start 2023-11-24T06:12:22.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.002+0000 7fac5f1fa640 1 -- start start 2023-11-24T06:12:22.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5f1fa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5806c9d0 0x7fac58156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5f1fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac580b35a0 0x7fac58140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5f1fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 0x7fac581f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5f1fa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5813bf50 con 0x7fac58144770 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5f1fa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5813c230 con 0x7fac580b35a0 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5f1fa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5813c510 con 0x7fac5806c9d0 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e9f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 0x7fac581f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e9f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 0x7fac581f10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54852/0 (socket says 172.21.15.22:54852) 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e9f9640 1 -- 172.21.15.22:0/2305288186 learned_addr learned my addr 172.21.15.22:0/2305288186 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e1f8640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5806c9d0 0x7fac58156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5d9f7640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac580b35a0 0x7fac58140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e9f9640 1 -- 172.21.15.22:0/2305288186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5806c9d0 msgr2=0x7fac58156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e9f9640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5806c9d0 0x7fac58156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e9f9640 1 -- 172.21.15.22:0/2305288186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac580b35a0 msgr2=0x7fac58140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e9f9640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac580b35a0 0x7fac58140380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e9f9640 1 -- 172.21.15.22:0/2305288186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac540094d0 con 0x7fac58144770 2023-11-24T06:12:22.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.003+0000 7fac5e1f8640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5806c9d0 0x7fac58156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:22.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.004+0000 7fac5e9f9640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 0x7fac581f10c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c780 tx=0x7fac5000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:22.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.004+0000 7fac4effd640 1 -- 172.21.15.22:0/2305288186 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50004b60 con 0x7fac58144770 2023-11-24T06:12:22.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.004+0000 7fac4effd640 1 -- 172.21.15.22:0/2305288186 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5000ce90 con 0x7fac58144770 2023-11-24T06:12:22.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.004+0000 7fac4effd640 1 -- 172.21.15.22:0/2305288186 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5000a850 con 0x7fac58144770 2023-11-24T06:12:22.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.004+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5813c7f0 con 0x7fac58144770 2023-11-24T06:12:22.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.004+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac58156fa0 con 0x7fac58144770 2023-11-24T06:12:22.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.005+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5813cd10 con 0x7fac58144770 2023-11-24T06:12:22.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.007+0000 7fac4effd640 1 -- 172.21.15.22:0/2305288186 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac5000a9b0 con 0x7fac58144770 2023-11-24T06:12:22.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.007+0000 7fac4effd640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac3c06ae40 0x7fac3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.008+0000 7fac4effd640 1 -- 172.21.15.22:0/2305288186 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac50089870 con 0x7fac58144770 2023-11-24T06:12:22.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.008+0000 7fac5e1f8640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac3c06ae40 0x7fac3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.008+0000 7fac5e1f8640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac3c06ae40 0x7fac3c06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac54036000 tx=0x7fac5403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.012+0000 7fac4effd640 1 -- 172.21.15.22:0/2305288186 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac5813cd10 con 0x7fac58144770 2023-11-24T06:12:22.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.203+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac5813cd10 con 0x7fac58144770 2023-11-24T06:12:22.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.204+0000 7fac4effd640 1 -- 172.21.15.22:0/2305288186 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac5813cd10 con 0x7fac58144770 2023-11-24T06:12:22.208 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac3c06ae40 msgr2=0x7fac3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac3c06ae40 0x7fac3c06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac54036000 tx=0x7fac5403c040 comp rx=0 tx=0).stop 2023-11-24T06:12:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 msgr2=0x7fac581f10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 0x7fac581f10c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c780 tx=0x7fac5000cc40 comp rx=0 tx=0).stop 2023-11-24T06:12:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 shutdown_connections 2023-11-24T06:12:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac3c06ae40 0x7fac3c06d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac58144770 0x7fac581f10c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac580b35a0 0x7fac58140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 --2- 172.21.15.22:0/2305288186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5806c9d0 0x7fac58156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.206+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 >> 172.21.15.22:0/2305288186 conn(0x7fac580cec10 msgr2=0x7fac580cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:22.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.207+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 shutdown_connections 2023-11-24T06:12:22.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.207+0000 7fac5f1fa640 1 -- 172.21.15.22:0/2305288186 wait complete. 2023-11-24T06:12:22.229 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:12:22.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.452+0000 7fb503f05640 1 Processor -- start 2023-11-24T06:12:22.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.452+0000 7fb503f05640 1 -- start start 2023-11-24T06:12:22.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.454+0000 7fb503f05640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc06dc30 0x7fb4fc0acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.454+0000 7fb503f05640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc071cd0 con 0x7fb4fc070780 2023-11-24T06:12:22.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.454+0000 7fb503f05640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc0b2120 con 0x7fb4fc160970 2023-11-24T06:12:22.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.454+0000 7fb503f05640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0b2400 con 0x7fb4fc06dc30 2023-11-24T06:12:22.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.454+0000 7fb5014a0640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb4fc070780 0x7fb4fc06d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56778/0 (socket says 172.21.15.22:56778) 2023-11-24T06:12:22.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.454+0000 7fb5014a0640 1 -- 172.21.15.22:0/3503399283 learned_addr learned my addr 172.21.15.22:0/3503399283 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:22.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb5024a2640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc06dc30 0x7fb4fc0acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468188529 0 0) 0x7fb4fc071cd0 con 0x7fb4fc070780 2023-11-24T06:12:22.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e8003520 con 0x7fb4fc070780 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1010018384 0 0) 0x7fb4e8003520 con 0x7fb4fc070780 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc06dc30 msgr2=0x7fb4fc0acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc06dc30 0x7fb4fc0acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 >> v1:172.21.15.31:6789/0 conn(0x7fb4fc160970 legacy=0x7fb4fc0b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0b26e0 con 0x7fb4fc070780 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fb4ec001670 con 0x7fb4fc070780 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 >> v1:172.21.15.22:6789/0 conn(0x7fb4fc070780 legacy=0x7fb4fc06d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc06dc30 0x7fb4e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4e8004d00 0x7fb4e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0b2400 con 0x7fb4e80039a0 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e800bae0 con 0x7fb4e8004d00 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.455+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e800bca0 con 0x7fb4fc06dc30 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.456+0000 7fb501ca1640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.456+0000 7fb5014a0640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc06dc30 0x7fb4e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.456+0000 7fb5024a2640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4e8004d00 0x7fb4e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.456+0000 7fb501ca1640 1 -- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc06dc30 msgr2=0x7fb4e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.456+0000 7fb501ca1640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc06dc30 0x7fb4e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.456+0000 7fb501ca1640 1 -- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4e8004d00 msgr2=0x7fb4e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.456+0000 7fb501ca1640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4e8004d00 0x7fb4e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.456+0000 7fb501ca1640 1 -- 172.21.15.22:0/3503399283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8003520 con 0x7fb4e80039a0 2023-11-24T06:12:22.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.457+0000 7fb501ca1640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4e8003dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8001750 tx=0x7fb4e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657afcab44db831 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:22.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80052d0 con 0x7fb4e80039a0 2023-11-24T06:12:22.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f802e050 con 0x7fb4e80039a0 2023-11-24T06:12:22.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb500c9f640 1 -- 172.21.15.22:0/3503399283 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80035f0 con 0x7fb4e80039a0 2023-11-24T06:12:22.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb503f05640 1 -- 172.21.15.22:0/3503399283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 msgr2=0x7fb4e8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb503f05640 1 --2- 172.21.15.22:0/3503399283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4e8003dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8001750 tx=0x7fb4e80057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb5024a2640 1 -- 172.21.15.22:0/3503399283 reap_dead start 2023-11-24T06:12:22.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb503f05640 1 -- 172.21.15.22:0/3503399283 shutdown_connections 2023-11-24T06:12:22.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb503f05640 1 -- 172.21.15.22:0/3503399283 >> 172.21.15.22:0/3503399283 conn(0x7fb4fc0b0d80 msgr2=0x7fb4fc0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:22.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb503f05640 1 -- 172.21.15.22:0/3503399283 shutdown_connections 2023-11-24T06:12:22.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.458+0000 7fb503f05640 1 -- 172.21.15.22:0/3503399283 wait complete. 2023-11-24T06:12:22.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.460+0000 7fb503f05640 1 Processor -- start 2023-11-24T06:12:22.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.460+0000 7fb503f05640 1 -- start start 2023-11-24T06:12:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.461+0000 7fb503f05640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4fc1f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.461+0000 7fb503f05640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc1521e0 0x7fb4fc1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb503f05640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4fc1569b0 0x7fb4fc156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb503f05640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc1f73b0 con 0x7fb4e80039a0 2023-11-24T06:12:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb503f05640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc152bb0 con 0x7fb4fc1569b0 2023-11-24T06:12:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb503f05640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc154740 con 0x7fb4fc1521e0 2023-11-24T06:12:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb501ca1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4fc1f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb501ca1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4fc1f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54866/0 (socket says 172.21.15.22:54866) 2023-11-24T06:12:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb501ca1640 1 -- 172.21.15.22:0/3741447868 learned_addr learned my addr 172.21.15.22:0/3741447868 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb501ca1640 1 -- 172.21.15.22:0/3741447868 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc1521e0 msgr2=0x7fb4fc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb501ca1640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc1521e0 0x7fb4fc1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb501ca1640 1 -- 172.21.15.22:0/3741447868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4fc1569b0 msgr2=0x7fb4fc156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb501ca1640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4fc1569b0 0x7fb4fc156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.462+0000 7fb501ca1640 1 -- 172.21.15.22:0/3741447868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc1f6b10 con 0x7fb4e80039a0 2023-11-24T06:12:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.463+0000 7fb501ca1640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4fc1f64a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8008fd0 tx=0x7fb4f8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:22.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.463+0000 7fb4f27fc640 1 -- 172.21.15.22:0/3741447868 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8007a30 con 0x7fb4e80039a0 2023-11-24T06:12:22.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.463+0000 7fb4f27fc640 1 -- 172.21.15.22:0/3741447868 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80069e0 con 0x7fb4e80039a0 2023-11-24T06:12:22.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.463+0000 7fb4f27fc640 1 -- 172.21.15.22:0/3741447868 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8006d70 con 0x7fb4e80039a0 2023-11-24T06:12:22.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.463+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc1f6df0 con 0x7fb4e80039a0 2023-11-24T06:12:22.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.463+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc0af4b0 con 0x7fb4e80039a0 2023-11-24T06:12:22.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.464+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc1f7310 con 0x7fb4e80039a0 2023-11-24T06:12:22.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.465+0000 7fb4f27fc640 1 -- 172.21.15.22:0/3741447868 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4f80035f0 con 0x7fb4e80039a0 2023-11-24T06:12:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.466+0000 7fb4f27fc640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb4e006ae70 0x7fb4e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.466+0000 7fb4f27fc640 1 -- 172.21.15.22:0/3741447868 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4f80ab4e0 con 0x7fb4e80039a0 2023-11-24T06:12:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.467+0000 7fb5014a0640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb4e006ae70 0x7fb4e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.467+0000 7fb5014a0640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb4e006ae70 0x7fb4e006d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc15f750 tx=0x7fb4ec0011c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:22.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.471+0000 7fb4f27fc640 1 -- 172.21.15.22:0/3741447868 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4f80766a0 con 0x7fb4e80039a0 2023-11-24T06:12:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.704+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4fc074770 con 0x7fb4e80039a0 2023-11-24T06:12:22.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.706+0000 7fb4f27fc640 1 -- 172.21.15.22:0/3741447868 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fb4f8079cc0 con 0x7fb4e80039a0 2023-11-24T06:12:22.710 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:22.710 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2596011389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2596011389},{"type":"v1","addr":"172.21.15.22:6837","nonce":2596011389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1715395658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1715395658},{"type":"v1","addr":"172.21.15.31:6834","nonce":1715395658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2020783180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2020783180},{"type":"v1","addr":"172.21.15.31:6835","nonce":2020783180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:12:00.092195+0000","modified":"2023-11-24T06:12:03.157366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/4189980327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":4189980327},{"type":"v1","addr":"172.21.15.22:6835","nonce":4189980327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:12:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-11-24T06:12:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb4e006ae70 msgr2=0x7fb4e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb4e006ae70 0x7fb4e006d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc15f750 tx=0x7fb4ec0011c0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 msgr2=0x7fb4fc1f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4fc1f64a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8008fd0 tx=0x7fb4f8001120 comp rx=0 tx=0).stop 2023-11-24T06:12:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 shutdown_connections 2023-11-24T06:12:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb4e006ae70 0x7fb4e006d330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4fc1569b0 0x7fb4fc156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4fc1521e0 0x7fb4fc1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 --2- 172.21.15.22:0/3741447868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4e80039a0 0x7fb4fc1f64a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 >> 172.21.15.22:0/3741447868 conn(0x7fb4fc0b0d80 msgr2=0x7fb4fc0adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 shutdown_connections 2023-11-24T06:12:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.708+0000 7fb503f05640 1 -- 172.21.15.22:0/3741447868 wait complete. 2023-11-24T06:12:22.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:22.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.947+0000 7f59650df640 1 Processor -- start 2023-11-24T06:12:22.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.947+0000 7f59650df640 1 -- start start 2023-11-24T06:12:22.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f59650df640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596013dfd0 0x7f596015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f59650df640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59600cf050 0x7f59600cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f59650df640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f596006c130 0x7f596006c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f59650df640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59600cfa10 con 0x7f596006c130 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f59650df640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596015fa70 con 0x7f59600cf050 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f59650df640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596015ee60 con 0x7f596013dfd0 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f59648de640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f596006c130 0x7f596006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f59648de640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f596006c130 0x7f596006c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54880/0 (socket says 172.21.15.22:54880) 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f59648de640 1 -- 172.21.15.22:0/1175653659 learned_addr learned my addr 172.21.15.22:0/1175653659 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.950+0000 7f595ffff640 1 --2- 172.21.15.22:0/1175653659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596013dfd0 0x7f596015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.949+0000 7f5957fff640 1 --2- 172.21.15.22:0/1175653659 >> v2:172.21.15.31:3300/0 conn(0x7f59600cf050 0x7f59600cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.950+0000 7f59648de640 1 -- 172.21.15.22:0/1175653659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596013dfd0 msgr2=0x7f596015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:22.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.950+0000 7f59648de640 1 --2- 172.21.15.22:0/1175653659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596013dfd0 0x7f596015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.950+0000 7f59648de640 1 -- 172.21.15.22:0/1175653659 >> v2:172.21.15.31:3300/0 conn(0x7f59600cf050 msgr2=0x7f59600cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:22.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.950+0000 7f59648de640 1 --2- 172.21.15.22:0/1175653659 >> v2:172.21.15.31:3300/0 conn(0x7f59600cf050 0x7f59600cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.950+0000 7f59648de640 1 -- 172.21.15.22:0/1175653659 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596015f140 con 0x7f596006c130 2023-11-24T06:12:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.951+0000 7f59648de640 1 --2- 172.21.15.22:0/1175653659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596006c130 0x7f596006c580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f59600cfc40 tx=0x7f595802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e914b815fa343994 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.951+0000 7f595f7fe640 1 -- 172.21.15.22:0/1175653659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595802ca70 con 0x7f596006c130 2023-11-24T06:12:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.951+0000 7f595f7fe640 1 -- 172.21.15.22:0/1175653659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595802cbd0 con 0x7f596006c130 2023-11-24T06:12:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.951+0000 7f595f7fe640 1 -- 172.21.15.22:0/1175653659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580343f0 con 0x7f596006c130 2023-11-24T06:12:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.952+0000 7f59650df640 1 -- 172.21.15.22:0/1175653659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596006c130 msgr2=0x7f596006c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.952+0000 7f59650df640 1 --2- 172.21.15.22:0/1175653659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596006c130 0x7f596006c580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f59600cfc40 tx=0x7f595802bed0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.952+0000 7f59650df640 1 -- 172.21.15.22:0/1175653659 shutdown_connections 2023-11-24T06:12:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.952+0000 7f59650df640 1 --2- 172.21.15.22:0/1175653659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596006c130 0x7f596006c580 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.952+0000 7f59650df640 1 --2- 172.21.15.22:0/1175653659 >> v2:172.21.15.31:3300/0 conn(0x7f59600cf050 0x7f59600cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.952+0000 7f59650df640 1 --2- 172.21.15.22:0/1175653659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596013dfd0 0x7f596015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.952+0000 7f59650df640 1 -- 172.21.15.22:0/1175653659 >> 172.21.15.22:0/1175653659 conn(0x7f596006a860 msgr2=0x7f596006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.952+0000 7f59650df640 1 -- 172.21.15.22:0/1175653659 shutdown_connections 2023-11-24T06:12:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.952+0000 7f59650df640 1 -- 172.21.15.22:0/1175653659 wait complete. 2023-11-24T06:12:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.954+0000 7f59650df640 1 Processor -- start 2023-11-24T06:12:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.954+0000 7f59650df640 1 -- start start 2023-11-24T06:12:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f59650df640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596006c130 0x7f5960139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f59650df640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59600cf050 0x7f596013a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f59650df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596013dfd0 0x7f596015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f59650df640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600700d0 con 0x7f596013dfd0 2023-11-24T06:12:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f59650df640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596013ac40 con 0x7f59600cf050 2023-11-24T06:12:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f59650df640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596013af20 con 0x7f596006c130 2023-11-24T06:12:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f59648de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596013dfd0 0x7f596015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f59648de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596013dfd0 0x7f596015c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54896/0 (socket says 172.21.15.22:54896) 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f59648de640 1 -- 172.21.15.22:0/1851850348 learned_addr learned my addr 172.21.15.22:0/1851850348 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f5957fff640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59600cf050 0x7f596013a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.955+0000 7f595ffff640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596006c130 0x7f5960139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f59648de640 1 -- 172.21.15.22:0/1851850348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596006c130 msgr2=0x7f5960139ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f59648de640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596006c130 0x7f5960139ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f59648de640 1 -- 172.21.15.22:0/1851850348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59600cf050 msgr2=0x7f596013a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f59648de640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59600cf050 0x7f596013a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f59648de640 1 -- 172.21.15.22:0/1851850348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958009b30 con 0x7f596013dfd0 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f59648de640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596013dfd0 0x7f596015c0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5958036040 tx=0x7f5958004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f595d7fa640 1 -- 172.21.15.22:0/1851850348 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958009510 con 0x7f596013dfd0 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f595d7fa640 1 -- 172.21.15.22:0/1851850348 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595803e450 con 0x7f596013dfd0 2023-11-24T06:12:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f595d7fa640 1 -- 172.21.15.22:0/1851850348 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595803e800 con 0x7f596013dfd0 2023-11-24T06:12:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596013b200 con 0x7f596013dfd0 2023-11-24T06:12:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.956+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596013a960 con 0x7f596013dfd0 2023-11-24T06:12:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.957+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596013b6c0 con 0x7f596013dfd0 2023-11-24T06:12:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.958+0000 7f595d7fa640 1 -- 172.21.15.22:0/1851850348 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f595803e960 con 0x7f596013dfd0 2023-11-24T06:12:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.959+0000 7f595d7fa640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f594006ae40 0x7f594006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.959+0000 7f595d7fa640 1 -- 172.21.15.22:0/1851850348 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59580ac450 con 0x7f596013dfd0 2023-11-24T06:12:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.960+0000 7f595ffff640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f594006ae40 0x7f594006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.960+0000 7f595ffff640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f594006ae40 0x7f594006d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5950006fd0 tx=0x7f5950008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:22.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:22.964+0000 7f595d7fa640 1 -- 172.21.15.22:0/1851850348 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f596013b6c0 con 0x7f596013dfd0 2023-11-24T06:12:23.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.150+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5960070280 con 0x7f596013dfd0 2023-11-24T06:12:23.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.154+0000 7f595d7fa640 1 -- 172.21.15.22:0/1851850348 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f5960070280 con 0x7f596013dfd0 2023-11-24T06:12:23.157 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:23.158 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:01.374181+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:23.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.155+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f594006ae40 msgr2=0x7f594006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:23.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.155+0000 7f59650df640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f594006ae40 0x7f594006d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5950006fd0 tx=0x7f5950008040 comp rx=0 tx=0).stop 2023-11-24T06:12:23.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596013dfd0 msgr2=0x7f596015c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:23.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596013dfd0 0x7f596015c0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5958036040 tx=0x7f5958004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:23.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 shutdown_connections 2023-11-24T06:12:23.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f594006ae40 0x7f594006d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596013dfd0 0x7f596015c0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59600cf050 0x7f596013a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 --2- 172.21.15.22:0/1851850348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f596006c130 0x7f5960139ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 >> 172.21.15.22:0/1851850348 conn(0x7f596006a860 msgr2=0x7f596006c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:23.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 shutdown_connections 2023-11-24T06:12:23.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.156+0000 7f59650df640 1 -- 172.21.15.22:0/1851850348 wait complete. 2023-11-24T06:12:23.179 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:12:23.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.395+0000 7f4d8507c640 1 Processor -- start 2023-11-24T06:12:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.395+0000 7f4d8507c640 1 -- start start 2023-11-24T06:12:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.396+0000 7f4d8507c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d80070780 0x7f4d8006d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.396+0000 7f4d8507c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d80070cd0 0x7f4d8006da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d8507c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d80071cd0 con 0x7f4d80160970 2023-11-24T06:12:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d8507c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800b2120 con 0x7f4d80070780 2023-11-24T06:12:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d8507c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800b2400 con 0x7f4d80070cd0 2023-11-24T06:12:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d7ed9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4d80160970 0x7f4d800b2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56786/0 (socket says 172.21.15.22:56786) 2023-11-24T06:12:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d77fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d80070780 0x7f4d8006d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d7ed9d640 1 -- 172.21.15.22:0/3298020981 learned_addr learned my addr 172.21.15.22:0/3298020981 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d7f59e640 1 --2- 172.21.15.22:0/3298020981 >> v2:172.21.15.31:3300/0 conn(0x7f4d80070cd0 0x7f4d8006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:23.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d77fff640 1 -- 172.21.15.22:0/3298020981 >> v2:172.21.15.31:3300/0 conn(0x7f4d80070cd0 msgr2=0x7f4d8006da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:23.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d77fff640 1 --2- 172.21.15.22:0/3298020981 >> v2:172.21.15.31:3300/0 conn(0x7f4d80070cd0 0x7f4d8006da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d77fff640 1 -- 172.21.15.22:0/3298020981 >> v1:172.21.15.22:6789/0 conn(0x7f4d80160970 legacy=0x7f4d800b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:23.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d77fff640 1 -- 172.21.15.22:0/3298020981 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800b26e0 con 0x7f4d80070780 2023-11-24T06:12:23.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.397+0000 7f4d7f59e640 1 --2- 172.21.15.22:0/3298020981 >> v2:172.21.15.31:3300/0 conn(0x7f4d80070cd0 0x7f4d8006da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:23.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.399+0000 7f4d77fff640 1 --2- 172.21.15.22:0/3298020981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80070780 0x7f4d8006d520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d80072910 tx=0x7f4d6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c444f56e0589959c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:23.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.399+0000 7f4d7e59c640 1 -- 172.21.15.22:0/3298020981 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6802e070 con 0x7f4d80070780 2023-11-24T06:12:23.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.399+0000 7f4d7e59c640 1 -- 172.21.15.22:0/3298020981 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d680315a0 con 0x7f4d80070780 2023-11-24T06:12:23.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.399+0000 7f4d7e59c640 1 -- 172.21.15.22:0/3298020981 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68031930 con 0x7f4d80070780 2023-11-24T06:12:23.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.399+0000 7f4d8507c640 1 -- 172.21.15.22:0/3298020981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80070780 msgr2=0x7f4d8006d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:23.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.399+0000 7f4d8507c640 1 --2- 172.21.15.22:0/3298020981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80070780 0x7f4d8006d520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d80072910 tx=0x7f4d6802b840 comp rx=0 tx=0).stop 2023-11-24T06:12:23.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.400+0000 7f4d8507c640 1 -- 172.21.15.22:0/3298020981 shutdown_connections 2023-11-24T06:12:23.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.400+0000 7f4d8507c640 1 --2- 172.21.15.22:0/3298020981 >> v2:172.21.15.31:3300/0 conn(0x7f4d80070cd0 0x7f4d8006da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.400+0000 7f4d8507c640 1 --2- 172.21.15.22:0/3298020981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80070780 0x7f4d8006d520 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.400+0000 7f4d8507c640 1 -- 172.21.15.22:0/3298020981 >> 172.21.15.22:0/3298020981 conn(0x7f4d800b0d80 msgr2=0x7f4d800b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:23.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.400+0000 7f4d8507c640 1 -- 172.21.15.22:0/3298020981 shutdown_connections 2023-11-24T06:12:23.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.400+0000 7f4d8507c640 1 -- 172.21.15.22:0/3298020981 wait complete. 2023-11-24T06:12:23.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.401+0000 7f4d8507c640 1 Processor -- start 2023-11-24T06:12:23.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.402+0000 7f4d8507c640 1 -- start start 2023-11-24T06:12:23.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.402+0000 7f4d8507c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d80070780 0x7f4d801538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:23.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.402+0000 7f4d8507c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d80070cd0 0x7f4d801551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:23.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.402+0000 7f4d8507c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80160970 0x7f4d80155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:23.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d8507c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80157460 con 0x7f4d80160970 2023-11-24T06:12:23.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d8507c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8015c040 con 0x7f4d80070cd0 2023-11-24T06:12:23.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d8507c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8015b710 con 0x7f4d80070780 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80160970 0x7f4d80155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80160970 0x7f4d80155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54910/0 (socket says 172.21.15.22:54910) 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7f59e640 1 -- 172.21.15.22:0/3527942010 learned_addr learned my addr 172.21.15.22:0/3527942010 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7ed9d640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d80070780 0x7f4d801538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d77fff640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d80070cd0 0x7f4d801551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7f59e640 1 -- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d80070780 msgr2=0x7f4d801538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7f59e640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d80070780 0x7f4d801538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7f59e640 1 -- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d80070cd0 msgr2=0x7f4d801551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7f59e640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d80070cd0 0x7f4d801551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7f59e640 1 -- 172.21.15.22:0/3527942010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d68009400 con 0x7f4d80160970 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d7ed9d640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d80070780 0x7f4d801538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.403+0000 7f4d77fff640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d80070cd0 0x7f4d801551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:23.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.404+0000 7f4d7f59e640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80160970 0x7f4d80155720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800cef0 tx=0x7f4d7800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:23.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.404+0000 7f4d777fe640 1 -- 172.21.15.22:0/3527942010 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800d840 con 0x7f4d80160970 2023-11-24T06:12:23.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.404+0000 7f4d777fe640 1 -- 172.21.15.22:0/3527942010 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7800d9c0 con 0x7f4d80160970 2023-11-24T06:12:23.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.404+0000 7f4d777fe640 1 -- 172.21.15.22:0/3527942010 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800dd70 con 0x7f4d80160970 2023-11-24T06:12:23.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.404+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8015b9f0 con 0x7f4d80160970 2023-11-24T06:12:23.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.404+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d80153e00 con 0x7f4d80160970 2023-11-24T06:12:23.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.405+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d80074770 con 0x7f4d80160970 2023-11-24T06:12:23.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.406+0000 7f4d777fe640 1 -- 172.21.15.22:0/3527942010 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d7801e3b0 con 0x7f4d80160970 2023-11-24T06:12:23.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.407+0000 7f4d777fe640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4d6006ae40 0x7f4d6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:23.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.407+0000 7f4d777fe640 1 -- 172.21.15.22:0/3527942010 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d7808a190 con 0x7f4d80160970 2023-11-24T06:12:23.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.407+0000 7f4d7ed9d640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4d6006ae40 0x7f4d6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:23.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.408+0000 7f4d7ed9d640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4d6006ae40 0x7f4d6006d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d70007fd0 tx=0x7f4d70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:23.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.411+0000 7f4d777fe640 1 -- 172.21.15.22:0/3527942010 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d78055260 con 0x7f4d80160970 2023-11-24T06:12:23.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.650+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d801575a0 con 0x7f4d80160970 2023-11-24T06:12:23.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.651+0000 7f4d777fe640 1 -- 172.21.15.22:0/3527942010 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f4d78058880 con 0x7f4d80160970 2023-11-24T06:12:23.655 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:23.655 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2596011389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2596011389},{"type":"v1","addr":"172.21.15.22:6837","nonce":2596011389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1715395658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1715395658},{"type":"v1","addr":"172.21.15.31:6834","nonce":1715395658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2020783180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2020783180},{"type":"v1","addr":"172.21.15.31:6835","nonce":2020783180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:12:00.092195+0000","modified":"2023-11-24T06:12:03.157366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/4189980327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":4189980327},{"type":"v1","addr":"172.21.15.22:6835","nonce":4189980327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:12:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-11-24T06:12:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4d6006ae40 msgr2=0x7f4d6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4d6006ae40 0x7f4d6006d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d70007fd0 tx=0x7f4d70009040 comp rx=0 tx=0).stop 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80160970 msgr2=0x7f4d80155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80160970 0x7f4d80155720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800cef0 tx=0x7f4d7800a710 comp rx=0 tx=0).stop 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 shutdown_connections 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4d6006ae40 0x7f4d6006d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d80160970 0x7f4d80155720 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d80070cd0 0x7f4d801551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 --2- 172.21.15.22:0/3527942010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d80070780 0x7f4d801538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.653+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 >> 172.21.15.22:0/3527942010 conn(0x7f4d800b0d80 msgr2=0x7f4d80072130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.654+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 shutdown_connections 2023-11-24T06:12:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:23.654+0000 7f4d8507c640 1 -- 172.21.15.22:0/3527942010 wait complete. 2023-11-24T06:12:24.078 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:12:00.092195+0000', 'modified': '2023-11-24T06:12:03.157366+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6835/4189980327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6834', 'nonce': 4189980327}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 4189980327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:12:24.078 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:12:24.078 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-24T06:12:24.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.305+0000 7f85b9dcf640 1 Processor -- start 2023-11-24T06:12:24.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.305+0000 7f85b9dcf640 1 -- start start 2023-11-24T06:12:24.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b9dcf640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f85b40cf710 0x7f85b40cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b9dcf640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b40d04b0 con 0x7f85b40d1670 2023-11-24T06:12:24.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b9dcf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b40cdb80 con 0x7f85b415d5d0 2023-11-24T06:12:24.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b9dcf640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b40ce4e0 con 0x7f85b40cf710 2023-11-24T06:12:24.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f85b40cf710 0x7f85b40cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b95ce640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f85b40d1670 0x7f85b40d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56790/0 (socket says 172.21.15.22:56790) 2023-11-24T06:12:24.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b95ce640 1 -- 172.21.15.22:0/3735770916 learned_addr learned my addr 172.21.15.22:0/3735770916 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:24.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b3fff640 1 -- 172.21.15.22:0/3735770916 >> v1:172.21.15.31:6789/0 conn(0x7f85b415d5d0 legacy=0x7f85b40ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b3fff640 1 -- 172.21.15.22:0/3735770916 >> v1:172.21.15.22:6789/0 conn(0x7f85b40d1670 legacy=0x7f85b40d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b3fff640 1 -- 172.21.15.22:0/3735770916 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40d01d0 con 0x7f85b40cf710 2023-11-24T06:12:24.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.307+0000 7f85b37fe640 1 -- 172.21.15.22:0/3735770916 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923138224 0 0) 0x7f85b40d04b0 con 0x7f85b40d1670 2023-11-24T06:12:24.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.308+0000 7f85b3fff640 1 --2- 172.21.15.22:0/3735770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b40cf710 0x7f85b40cfb70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f85a80097a0 tx=0x7f85a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd14a5d57911d9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.308+0000 7f85b37fe640 1 -- 172.21.15.22:0/3735770916 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a802e070 con 0x7f85b40cf710 2023-11-24T06:12:24.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.308+0000 7f85b37fe640 1 -- 172.21.15.22:0/3735770916 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a80315a0 con 0x7f85b40cf710 2023-11-24T06:12:24.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.308+0000 7f85b37fe640 1 -- 172.21.15.22:0/3735770916 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8031930 con 0x7f85b40cf710 2023-11-24T06:12:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.309+0000 7f85b9dcf640 1 -- 172.21.15.22:0/3735770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b40cf710 msgr2=0x7f85b40cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.309+0000 7f85b9dcf640 1 --2- 172.21.15.22:0/3735770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b40cf710 0x7f85b40cfb70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f85a80097a0 tx=0x7f85a802b840 comp rx=0 tx=0).stop 2023-11-24T06:12:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.309+0000 7f85b9dcf640 1 -- 172.21.15.22:0/3735770916 shutdown_connections 2023-11-24T06:12:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.309+0000 7f85b9dcf640 1 --2- 172.21.15.22:0/3735770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b40cf710 0x7f85b40cfb70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.309+0000 7f85b9dcf640 1 -- 172.21.15.22:0/3735770916 >> 172.21.15.22:0/3735770916 conn(0x7f85b409c3d0 msgr2=0x7f85b40d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.309+0000 7f85b9dcf640 1 -- 172.21.15.22:0/3735770916 shutdown_connections 2023-11-24T06:12:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.309+0000 7f85b9dcf640 1 -- 172.21.15.22:0/3735770916 wait complete. 2023-11-24T06:12:24.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.311+0000 7f85b9dcf640 1 Processor -- start 2023-11-24T06:12:24.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.311+0000 7f85b9dcf640 1 -- start start 2023-11-24T06:12:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.312+0000 7f85b9dcf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85b40cf710 0x7f85b4157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.312+0000 7f85b9dcf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85b40d1670 0x7f85b40ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.312+0000 7f85b9dcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b415d5d0 0x7f85b40c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.312+0000 7f85b9dcf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40cf010 con 0x7f85b415d5d0 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.312+0000 7f85b9dcf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b415d9b0 con 0x7f85b40d1670 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.312+0000 7f85b9dcf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b415e810 con 0x7f85b40cf710 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.312+0000 7f85b95ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b415d5d0 0x7f85b40c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.312+0000 7f85b95ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b415d5d0 0x7f85b40c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54936/0 (socket says 172.21.15.22:54936) 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.312+0000 7f85b95ce640 1 -- 172.21.15.22:0/637662150 learned_addr learned my addr 172.21.15.22:0/637662150 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b3fff640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85b40d1670 0x7f85b40ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85b40cf710 0x7f85b4157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b95ce640 1 -- 172.21.15.22:0/637662150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85b40cf710 msgr2=0x7f85b4157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b95ce640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85b40cf710 0x7f85b4157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b95ce640 1 -- 172.21.15.22:0/637662150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85b40d1670 msgr2=0x7f85b40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b95ce640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85b40d1670 0x7f85b40ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b95ce640 1 -- 172.21.15.22:0/637662150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8009400 con 0x7f85b415d5d0 2023-11-24T06:12:24.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b95ce640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b415d5d0 0x7f85b40c9120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c480 tx=0x7f85ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b17fa640 1 -- 172.21.15.22:0/637662150 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0074e0 con 0x7f85b415d5d0 2023-11-24T06:12:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.313+0000 7f85b17fa640 1 -- 172.21.15.22:0/637662150 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac007660 con 0x7f85b415d5d0 2023-11-24T06:12:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.314+0000 7f85b17fa640 1 -- 172.21.15.22:0/637662150 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac004a20 con 0x7f85b415d5d0 2023-11-24T06:12:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.314+0000 7f85b9dcf640 1 -- 172.21.15.22:0/637662150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b415dc00 con 0x7f85b415d5d0 2023-11-24T06:12:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.314+0000 7f85b9dcf640 1 -- 172.21.15.22:0/637662150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b415e1c0 con 0x7f85b415d5d0 2023-11-24T06:12:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.316+0000 7f85b17fa640 1 -- 172.21.15.22:0/637662150 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85ac004b80 con 0x7f85b415d5d0 2023-11-24T06:12:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.317+0000 7f85b17fa640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f85a006ae40 0x7f85a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.317+0000 7f85b17fa640 1 -- 172.21.15.22:0/637662150 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85ac0887f0 con 0x7f85b415d5d0 2023-11-24T06:12:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.317+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f85a006ae40 0x7f85a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.318+0000 7f85bdbc6740 1 Processor -- start 2023-11-24T06:12:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.318+0000 7f85bdbc6740 1 -- start start 2023-11-24T06:12:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.318+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f85a006ae40 0x7f85a006d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009f20 tx=0x7f85a40094d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 0x56145a569450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a568270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5ac730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145a4c7880 con 0x56145a563d70 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145a4d6ae0 con 0x56145a5687b0 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x56145a4d41d0 con 0x56145a569070 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a568270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a568270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54950/0 (socket says 172.21.15.22:54950) 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b3fff640 1 -- 172.21.15.22:0/3685817190 learned_addr learned my addr 172.21.15.22:0/3685817190 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b3fff640 1 -- 172.21.15.22:0/3685817190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 msgr2=0x56145a569450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/3685817190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 0x56145a569450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b95ce640 1 --2- 172.21.15.22:0/3685817190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b3fff640 1 --2- 172.21.15.22:0/3685817190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 0x56145a569450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b3fff640 1 -- 172.21.15.22:0/3685817190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 msgr2=0x56145a5ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b3fff640 1 --2- 172.21.15.22:0/3685817190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.319+0000 7f85b3fff640 1 -- 172.21.15.22:0/3685817190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56145a497860 con 0x56145a563d70 2023-11-24T06:12:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.320+0000 7f85b3fff640 1 --2- 172.21.15.22:0/3685817190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a568270 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f85a80098c0 tx=0x7f85a8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3eefe2f4f5e196 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.320+0000 7f859a7fc640 1 -- 172.21.15.22:0/3685817190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8041070 con 0x56145a563d70 2023-11-24T06:12:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.320+0000 7f859a7fc640 1 -- 172.21.15.22:0/3685817190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8004270 con 0x56145a563d70 2023-11-24T06:12:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.320+0000 7f859a7fc640 1 -- 172.21.15.22:0/3685817190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8031710 con 0x56145a563d70 2023-11-24T06:12:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.321+0000 7f85bdbc6740 1 -- 172.21.15.22:0/3685817190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 msgr2=0x56145a568270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.321+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/3685817190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a568270 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f85a80098c0 tx=0x7f85a8030000 comp rx=0 tx=0).stop 2023-11-24T06:12:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.321+0000 7f85bdbc6740 1 -- 172.21.15.22:0/3685817190 shutdown_connections 2023-11-24T06:12:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.321+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/3685817190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.321+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/3685817190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a568270 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.321+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/3685817190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 0x56145a569450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.321+0000 7f85bdbc6740 1 -- 172.21.15.22:0/3685817190 >> 172.21.15.22:0/3685817190 conn(0x56145a52ac70 msgr2=0x56145a5aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.321+0000 7f85bdbc6740 1 -- 172.21.15.22:0/3685817190 shutdown_connections 2023-11-24T06:12:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.321+0000 7f85bdbc6740 1 -- 172.21.15.22:0/3685817190 wait complete. 2023-11-24T06:12:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.322+0000 7f85bdbc6740 1 -- start start 2023-11-24T06:12:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.322+0000 7f85bdbc6740 1 Processor -- start 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a563d70 0x56145a585230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a569070 0x56145a58b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145a4cfac0 con 0x56145a569070 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145a46c2f0 con 0x56145a5687b0 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x56145a489c70 con 0x56145a563d70 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85bdbc6740 10 client.0 _ll_register_callbacks cb 0x56145a48e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85b95ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a569070 0x56145a58b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85b95ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a569070 0x56145a58b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54956/0 (socket says 172.21.15.22:54956) 2023-11-24T06:12:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85b95ce640 1 -- 172.21.15.22:0/193882257 learned_addr learned my addr 172.21.15.22:0/193882257 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.323+0000 7f85b3fff640 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a563d70 0x56145a585230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85b95ce640 1 -- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a563d70 msgr2=0x56145a585230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85b95ce640 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a563d70 0x56145a585230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85b95ce640 1 -- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 msgr2=0x56145a5b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85b95ce640 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85b95ce640 1 -- 172.21.15.22:0/193882257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b40d01d0 con 0x56145a569070 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a563d70 0x56145a585230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85b3fff640 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85b95ce640 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a569070 0x56145a58b740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00ce40 tx=0x7f85ac057c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7227b0134e949d7a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85937fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85937fe640 1 -- 172.21.15.22:0/193882257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac05f5c0 con 0x56145a569070 2023-11-24T06:12:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85937fe640 1 -- 172.21.15.22:0/193882257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85ac05b6a0 con 0x56145a569070 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85bdbc6740 1 -- 172.21.15.22:0/193882257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56145a4c8aa0 con 0x56145a569070 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85937fe640 1 -- 172.21.15.22:0/193882257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85ac05f850 con 0x56145a569070 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85bdbc6740 10 client.4692 fetch_fsmap learned FSMap version 8 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.324+0000 7f85bdbc6740 1 -- 172.21.15.22:0/193882257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56145a4ce140 con 0x56145a569070 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.325+0000 7f85937fe640 1 -- 172.21.15.22:0/193882257 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac072030 con 0x56145a569070 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.325+0000 7f85937fe640 1 -- 172.21.15.22:0/193882257 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f85ac05b150 con 0x56145a569070 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.325+0000 7f85bdbc6740 10 client.4692 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.325+0000 7f85bdbc6740 10 client.4692 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.325+0000 7f85bdbc6740 20 client.4692 populate_metadata read hostname 'smithi022' 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.325+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] conn(0x56145a589890 0x56145a587920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.325+0000 7f85bdbc6740 4 client.4692 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.325+0000 7f85bdbc6740 1 -- 172.21.15.22:0/193882257 --> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56145a4c87c0 con 0x56145a589890 2023-11-24T06:12:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.325+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] conn(0x56145a589890 0x56145a587920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.326+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] conn(0x56145a589890 0x56145a587920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3586edb584d85a server_cookie=d0474c49b0a90fe0 in_seq=0 out_seq=0 2023-11-24T06:12:24.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.326+0000 7f85937fe640 10 client.4692 ms_handle_connect on v2:172.21.15.22:6834/4189980327 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.326+0000 7f85937fe640 1 -- 172.21.15.22:0/193882257 <== mds.0 v2:172.21.15.22:6834/4189980327 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56145a4c87c0 con 0x56145a589890 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.326+0000 7f85937fe640 10 client.4692 handle_command_reply: tid=0 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 client.4692 shutdown 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 -- 172.21.15.22:0/193882257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a569070 msgr2=0x56145a58b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a569070 0x56145a58b740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00ce40 tx=0x7f85ac057c50 comp rx=0 tx=0).stop 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 -- 172.21.15.22:0/193882257 shutdown_connections 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] conn(0x56145a589890 0x56145a587920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a569070 0x56145a58b740 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/193882257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a563d70 0x56145a585230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 -- 172.21.15.22:0/193882257 >> 172.21.15.22:0/193882257 conn(0x56145a52ac70 msgr2=0x56145a5af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:24.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85937fe640 0 client.4692 ms_handle_reset on v2:172.21.15.22:6834/4189980327 2023-11-24T06:12:24.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 -- 172.21.15.22:0/193882257 shutdown_connections 2023-11-24T06:12:24.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 1 -- 172.21.15.22:0/193882257 wait complete. 2023-11-24T06:12:24.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.327+0000 7f85bdbc6740 20 client.4692 trim_cache size 0 max 16384 2023-11-24T06:12:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.345+0000 7f85bdbc6740 1 Processor -- start 2023-11-24T06:12:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.345+0000 7f85bdbc6740 1 -- start start 2023-11-24T06:12:24.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.345+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a590840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.345+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a5687b0 0x56145a5aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.345+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a569070 0x56145a5af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.345+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145a232f20 con 0x56145a563d70 2023-11-24T06:12:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.345+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145a564a30 con 0x56145a569070 2023-11-24T06:12:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.345+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x56145a5c1600 con 0x56145a5687b0 2023-11-24T06:12:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b8dcd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a590840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b8dcd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a590840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54964/0 (socket says 172.21.15.22:54964) 2023-11-24T06:12:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b8dcd640 1 -- 172.21.15.22:0/1004887780 learned_addr learned my addr 172.21.15.22:0/1004887780 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b95ce640 1 --2- 172.21.15.22:0/1004887780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a569070 0x56145a5af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b3fff640 1 --2- 172.21.15.22:0/1004887780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a5687b0 0x56145a5aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b8dcd640 1 -- 172.21.15.22:0/1004887780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a5687b0 msgr2=0x56145a5aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/1004887780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a5687b0 0x56145a5aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b8dcd640 1 -- 172.21.15.22:0/1004887780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a569070 msgr2=0x56145a5af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/1004887780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a569070 0x56145a5af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.346+0000 7f85b8dcd640 1 -- 172.21.15.22:0/1004887780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56145a46bb80 con 0x56145a563d70 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/1004887780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a590840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009fd0 tx=0x7f85a4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb7d7940076c48b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f859affd640 1 -- 172.21.15.22:0/1004887780 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a401c040 con 0x56145a563d70 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f859affd640 1 -- 172.21.15.22:0/1004887780 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a4025070 con 0x56145a563d70 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f859affd640 1 -- 172.21.15.22:0/1004887780 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4011070 con 0x56145a563d70 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f85bdbc6740 1 -- 172.21.15.22:0/1004887780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 msgr2=0x56145a590840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/1004887780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a590840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009fd0 tx=0x7f85a4015000 comp rx=0 tx=0).stop 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f85bdbc6740 1 -- 172.21.15.22:0/1004887780 shutdown_connections 2023-11-24T06:12:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/1004887780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a569070 0x56145a5af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/1004887780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a5687b0 0x56145a5aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/1004887780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a590840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.347+0000 7f85bdbc6740 1 -- 172.21.15.22:0/1004887780 >> 172.21.15.22:0/1004887780 conn(0x56145a52ac70 msgr2=0x56145a569450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.348+0000 7f85bdbc6740 1 -- 172.21.15.22:0/1004887780 shutdown_connections 2023-11-24T06:12:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.348+0000 7f85bdbc6740 1 -- 172.21.15.22:0/1004887780 wait complete. 2023-11-24T06:12:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.348+0000 7f85bdbc6740 1 -- start start 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.348+0000 7f85bdbc6740 1 Processor -- start 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.349+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a58b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.349+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5888e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.349+0000 7f85bdbc6740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 0x56145a61b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.349+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145a58b8d0 con 0x56145a563d70 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.349+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145a5c8150 con 0x56145a5687b0 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.349+0000 7f85bdbc6740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x56145a586860 con 0x56145a569070 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85bdbc6740 10 client.0 _ll_register_callbacks cb 0x7f85ac007ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b8dcd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a58b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b8dcd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a58b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54980/0 (socket says 172.21.15.22:54980) 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b8dcd640 1 -- 172.21.15.22:0/570245016 learned_addr learned my addr 172.21.15.22:0/570245016 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b3fff640 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b95ce640 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 0x56145a61b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b8dcd640 1 -- 172.21.15.22:0/570245016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 msgr2=0x56145a61b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 0x56145a61b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b8dcd640 1 -- 172.21.15.22:0/570245016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 msgr2=0x56145a5888e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5888e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b8dcd640 1 -- 172.21.15.22:0/570245016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a4009680 con 0x56145a563d70 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85b8dcd640 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a58b390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f85a4025350 tx=0x7f85a4004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588ba02b8b53f07f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.350+0000 7f85937fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85937fe640 1 -- 172.21.15.22:0/570245016 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4003970 con 0x56145a563d70 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85937fe640 1 -- 172.21.15.22:0/570245016 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85a401c070 con 0x56145a563d70 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85bdbc6740 1 -- 172.21.15.22:0/570245016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56145a5b0390 con 0x56145a563d70 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85937fe640 1 -- 172.21.15.22:0/570245016 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85a4003ad0 con 0x56145a563d70 2023-11-24T06:12:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85bdbc6740 10 client.4698 fetch_fsmap learned FSMap version 8 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85bdbc6740 1 -- 172.21.15.22:0/570245016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56145a491170 con 0x56145a563d70 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85937fe640 1 -- 172.21.15.22:0/570245016 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a403b030 con 0x56145a563d70 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85937fe640 1 -- 172.21.15.22:0/570245016 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f85a4003c30 con 0x56145a563d70 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85bdbc6740 10 client.4698 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85bdbc6740 10 client.4698 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85bdbc6740 20 client.4698 populate_metadata read hostname 'smithi022' 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] conn(0x56145a5858f0 0x56145a585cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85bdbc6740 4 client.4698 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.351+0000 7f85bdbc6740 1 -- 172.21.15.22:0/570245016 --> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f85a8004270 con 0x56145a5858f0 2023-11-24T06:12:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.352+0000 7f85b3fff640 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] conn(0x56145a5858f0 0x56145a585cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.352+0000 7f85b3fff640 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] conn(0x56145a5858f0 0x56145a585cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b250cbaee3b1534 server_cookie=d3244f609d2204c in_seq=0 out_seq=0 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.352+0000 7f85937fe640 10 client.4698 ms_handle_connect on v2:172.21.15.22:6834/4189980327 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85937fe640 1 -- 172.21.15.22:0/570245016 <== mds.0 v2:172.21.15.22:6834/4189980327 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x7f85a8004270 con 0x56145a5858f0 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85937fe640 10 client.4698 handle_command_reply: tid=0 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 client.4698 shutdown 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 -- 172.21.15.22:0/570245016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 msgr2=0x56145a58b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a58b390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f85a4025350 tx=0x7f85a4004a00 comp rx=0 tx=0).stop 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 -- 172.21.15.22:0/570245016 shutdown_connections 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.22:6834/4189980327,v1:172.21.15.22:6835/4189980327] conn(0x56145a5858f0 0x56145a585cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56145a569070 0x56145a61b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56145a5687b0 0x56145a5888e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 --2- 172.21.15.22:0/570245016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56145a563d70 0x56145a58b390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85937fe640 0 client.4698 ms_handle_reset on v2:172.21.15.22:6834/4189980327 2023-11-24T06:12:24.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 -- 172.21.15.22:0/570245016 >> 172.21.15.22:0/570245016 conn(0x56145a52ac70 msgr2=0x56145a55f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:24.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 -- 172.21.15.22:0/570245016 shutdown_connections 2023-11-24T06:12:24.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 1 -- 172.21.15.22:0/570245016 wait complete. 2023-11-24T06:12:24.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.353+0000 7f85bdbc6740 20 client.4698 trim_cache size 0 max 16384 2023-11-24T06:12:24.361 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:12:24.361 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d0664f6f-6758-42fa-85ad-04f9384b4bc8", 2023-11-24T06:12:24.361 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-11-24T06:12:24.361 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4269, 2023-11-24T06:12:24.361 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-11-24T06:12:24.362 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-11-24T06:12:24.362 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-11-24T06:12:24.362 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 23.72560696, 2023-11-24T06:12:24.362 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 8, 2023-11-24T06:12:24.362 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 22, 2023-11-24T06:12:24.362 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 22, 2023-11-24T06:12:24.362 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 28.928550156 2023-11-24T06:12:24.362 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:12:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 -- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f85a006ae40 msgr2=0x7f85a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f85a006ae40 0x7f85a006d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009f20 tx=0x7f85a40094d0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 -- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b415d5d0 msgr2=0x7f85b40c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b415d5d0 0x7f85b40c9120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c480 tx=0x7f85ac00c940 comp rx=0 tx=0).stop 2023-11-24T06:12:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 -- 172.21.15.22:0/637662150 shutdown_connections 2023-11-24T06:12:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f85a006ae40 0x7f85a006d300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b415d5d0 0x7f85b40c9120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85b40d1670 0x7f85b40ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 --2- 172.21.15.22:0/637662150 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85b40cf710 0x7f85b4157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 -- 172.21.15.22:0/637662150 >> 172.21.15.22:0/637662150 conn(0x7f85b409c3d0 msgr2=0x7f85b406b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:24.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 -- 172.21.15.22:0/637662150 shutdown_connections 2023-11-24T06:12:24.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.354+0000 7f85b9dcf640 1 -- 172.21.15.22:0/637662150 wait complete. 2023-11-24T06:12:24.375 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-24T06:12:24.395 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-24T06:12:24.395 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-24T06:12:24.395 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-24T06:12:24.395 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:12:24.396 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:24.396 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-24T06:12:24.396 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:12:24.396 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T06:12:24.396 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-24T06:12:24.396 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:12:24.396 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:24.396 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-24T06:12:24.396 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:12:24.396 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T06:12:24.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:24.397 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-11-24T06:12:24.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:24.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2023-11-24T06:12:24.545 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2023-11-24T06:12:24.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:12:24.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:24.548 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-24T06:12:24.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:24.613 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2023-11-24T06:12:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2023-11-24T06:12:24.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:12:24.729 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-24T06:12:24.729 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:12:24.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.959+0000 7f64bae6d640 1 Processor -- start 2023-11-24T06:12:24.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.960+0000 7f64bae6d640 1 -- start start 2023-11-24T06:12:24.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.961+0000 7f64bae6d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f64b413dfd0 0x7f64b415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.961+0000 7f64bae6d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b40cf050 0x7f64b40cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.961+0000 7f64bae6d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b40ce7c0 con 0x7f64b406c130 2023-11-24T06:12:24.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.961+0000 7f64bae6d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b40cfa10 con 0x7f64b413dfd0 2023-11-24T06:12:24.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.961+0000 7f64bae6d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4140900 con 0x7f64b40cf050 2023-11-24T06:12:24.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.962+0000 7f64b9e6b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f64b413dfd0 0x7f64b415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.962+0000 7f64ba66c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f64b406c130 0x7f64b406c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56798/0 (socket says 172.21.15.22:56798) 2023-11-24T06:12:24.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.962+0000 7f64ba66c640 1 -- 172.21.15.22:0/2568154732 learned_addr learned my addr 172.21.15.22:0/2568154732 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:24.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.962+0000 7f64b966a640 1 --2- 172.21.15.22:0/2568154732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b40cf050 0x7f64b40cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.962+0000 7f64b9e6b640 1 -- 172.21.15.22:0/2568154732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b40cf050 msgr2=0x7f64b40cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:24.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.962+0000 7f64b9e6b640 1 --2- 172.21.15.22:0/2568154732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b40cf050 0x7f64b40cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.962+0000 7f64b9e6b640 1 -- 172.21.15.22:0/2568154732 >> v1:172.21.15.22:6789/0 conn(0x7f64b406c130 legacy=0x7f64b406c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.963+0000 7f64b9e6b640 1 -- 172.21.15.22:0/2568154732 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b415fa70 con 0x7f64b413dfd0 2023-11-24T06:12:24.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.963+0000 7f64b8e69640 1 -- 172.21.15.22:0/2568154732 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872548608 0 0) 0x7f64b40ce7c0 con 0x7f64b406c130 2023-11-24T06:12:24.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.964+0000 7f64b9e6b640 1 --2- 172.21.15.22:0/2568154732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b413dfd0 0x7f64b415be70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f64b00097a0 tx=0x7f64b002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ea4d05dd26b7fa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.964+0000 7f64b8e69640 1 -- 172.21.15.22:0/2568154732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b002d040 con 0x7f64b413dfd0 2023-11-24T06:12:24.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.964+0000 7f64b8e69640 1 -- 172.21.15.22:0/2568154732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b0031810 con 0x7f64b413dfd0 2023-11-24T06:12:24.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.964+0000 7f64b8e69640 1 -- 172.21.15.22:0/2568154732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0031ba0 con 0x7f64b413dfd0 2023-11-24T06:12:24.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.965+0000 7f64bae6d640 1 -- 172.21.15.22:0/2568154732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b413dfd0 msgr2=0x7f64b415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.965+0000 7f64bae6d640 1 --2- 172.21.15.22:0/2568154732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b413dfd0 0x7f64b415be70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f64b00097a0 tx=0x7f64b002b8b0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.965+0000 7f64bae6d640 1 -- 172.21.15.22:0/2568154732 shutdown_connections 2023-11-24T06:12:24.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.965+0000 7f64bae6d640 1 --2- 172.21.15.22:0/2568154732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b40cf050 0x7f64b40cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.965+0000 7f64bae6d640 1 --2- 172.21.15.22:0/2568154732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b413dfd0 0x7f64b415be70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.965+0000 7f64bae6d640 1 -- 172.21.15.22:0/2568154732 >> 172.21.15.22:0/2568154732 conn(0x7f64b406a860 msgr2=0x7f64b406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:24.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.965+0000 7f64bae6d640 1 -- 172.21.15.22:0/2568154732 shutdown_connections 2023-11-24T06:12:24.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.965+0000 7f64bae6d640 1 -- 172.21.15.22:0/2568154732 wait complete. 2023-11-24T06:12:24.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.967+0000 7f64bae6d640 1 Processor -- start 2023-11-24T06:12:24.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.967+0000 7f64bae6d640 1 -- start start 2023-11-24T06:12:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64bae6d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b406c130 0x7f64b41552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64bae6d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b40cf050 0x7f64b41566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64bae6d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64b413dfd0 0x7f64b415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64bae6d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b41562a0 con 0x7f64b40cf050 2023-11-24T06:12:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64bae6d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4155810 con 0x7f64b413dfd0 2023-11-24T06:12:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64bae6d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b415d800 con 0x7f64b406c130 2023-11-24T06:12:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64b966a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b40cf050 0x7f64b41566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64b966a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b40cf050 0x7f64b41566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54988/0 (socket says 172.21.15.22:54988) 2023-11-24T06:12:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64b966a640 1 -- 172.21.15.22:0/3023443659 learned_addr learned my addr 172.21.15.22:0/3023443659 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64b966a640 1 -- 172.21.15.22:0/3023443659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b406c130 msgr2=0x7f64b41552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64b966a640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b406c130 0x7f64b41552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64b966a640 1 -- 172.21.15.22:0/3023443659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64b413dfd0 msgr2=0x7f64b415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64b966a640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64b413dfd0 0x7f64b415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.968+0000 7f64b966a640 1 -- 172.21.15.22:0/3023443659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b0009400 con 0x7f64b40cf050 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.969+0000 7f64b966a640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b40cf050 0x7f64b41566c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f64a400d830 tx=0x7f64a400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.969+0000 7f64aa7fc640 1 -- 172.21.15.22:0/3023443659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a400b6c0 con 0x7f64b40cf050 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.969+0000 7f64aa7fc640 1 -- 172.21.15.22:0/3023443659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a400b820 con 0x7f64b40cf050 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.969+0000 7f64aa7fc640 1 -- 172.21.15.22:0/3023443659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a400bbb0 con 0x7f64b40cf050 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.969+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b415dae0 con 0x7f64b40cf050 2023-11-24T06:12:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.969+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b4155ec0 con 0x7f64b40cf050 2023-11-24T06:12:24.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.970+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b4156510 con 0x7f64b40cf050 2023-11-24T06:12:24.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.971+0000 7f64aa7fc640 1 -- 172.21.15.22:0/3023443659 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f64a401e460 con 0x7f64b40cf050 2023-11-24T06:12:24.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.972+0000 7f64aa7fc640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f649806ae90 0x7f649806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:24.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.972+0000 7f64aa7fc640 1 -- 172.21.15.22:0/3023443659 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64a4089db0 con 0x7f64b40cf050 2023-11-24T06:12:24.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.973+0000 7f64b9e6b640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f649806ae90 0x7f649806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:24.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.973+0000 7f64b9e6b640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f649806ae90 0x7f649806d350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64b0036000 tx=0x7f64b0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:24.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:24.977+0000 7f64aa7fc640 1 -- 172.21.15.22:0/3023443659 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f64a408e070 con 0x7f64b40cf050 2023-11-24T06:12:25.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.208+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64b404e840 con 0x7f64b40cf050 2023-11-24T06:12:25.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.209+0000 7f64aa7fc640 1 -- 172.21.15.22:0/3023443659 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64a4054e40 con 0x7f64b40cf050 2023-11-24T06:12:25.212 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:12:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.211+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f649806ae90 msgr2=0x7f649806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.211+0000 7f64bae6d640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f649806ae90 0x7f649806d350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64b0036000 tx=0x7f64b0030000 comp rx=0 tx=0).stop 2023-11-24T06:12:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.211+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b40cf050 msgr2=0x7f64b41566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.211+0000 7f64bae6d640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b40cf050 0x7f64b41566c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f64a400d830 tx=0x7f64a400dcf0 comp rx=0 tx=0).stop 2023-11-24T06:12:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.212+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 shutdown_connections 2023-11-24T06:12:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.212+0000 7f64bae6d640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f649806ae90 0x7f649806d350 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.212+0000 7f64bae6d640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64b413dfd0 0x7f64b415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.212+0000 7f64bae6d640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b40cf050 0x7f64b41566c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.212+0000 7f64bae6d640 1 --2- 172.21.15.22:0/3023443659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64b406c130 0x7f64b41552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.212+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 >> 172.21.15.22:0/3023443659 conn(0x7f64b406a860 msgr2=0x7f64b40cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.212+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 shutdown_connections 2023-11-24T06:12:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:25.212+0000 7f64bae6d640 1 -- 172.21.15.22:0/3023443659 wait complete. 2023-11-24T06:12:25.235 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:12:25.235 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:12:25.235 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-11-24T06:12:25.235 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:12:25.235 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:25.235 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:12:25.235 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:12:25.235 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:12:25.235 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:12:25.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:25.236 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-11-24T06:12:25.291 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:12:25.291 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:12:25.291 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:12:25.291 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:25.291 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-11-24T06:12:25.291 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:25.291 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:25.291 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:25.291 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42265sec preferred_lft 42265sec 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:25.292 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-11-24T06:12:25.293 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T06:12:25.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:25.294 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:12:25.294 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:12:25.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2023-11-24T06:12:25.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2023-11-24T06:12:25.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2023-11-24T06:12:25.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T06:12:25.294 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:12:25.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:25.798 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:12:25.880 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-11-24T06:12:25.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:25.884 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-11-24T06:12:25.943 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-11-24T06:12:25.943 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:12:25.943 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:12:25.943 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:12:25.943 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:12:25.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:25.944 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:12:25.944 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:12:25.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:12:25.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:12:25.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:12:25.945 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:12:26.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:26.715 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-11-24T06:12:26.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:26.762 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2023-11-24T06:12:26.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:26.854 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:12:26.854 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:12:26.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:26.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-24T06:12:26.855 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:12:26.993 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-24T06:12:26.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:26.994 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:12:26.994 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:12:26.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-24T06:12:26.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T06:12:26.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-24T06:12:26.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-24T06:12:26.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-24T06:12:26.994 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:12:27.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:27.270 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:12:27.270 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:12:27.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-11-24T06:12:27.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T06:12:27.270 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:12:27.434 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T06:12:27.434 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:12:27.434 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:27.481 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:12:27.481 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:12:27.482 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:27.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:12:27.666 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:12:27.718 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:12:27.718 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:12:27.719 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:12:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:12:27.721 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:12:27.721 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:12:27.721 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:27.721 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:27.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:27.722 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:12:27.767 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T06:12:27.768 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T06:12:27.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:12:27.893 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:12:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:12:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:12:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:12:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:12:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:12:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:12:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:12:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:12:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:27.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:27.941 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:12:28.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:2023-11-24T06:12:28.012+0000 7f7651c0f480 -1 init, newargv = 0x55fc49ecca60 newargc=15 2023-11-24T06:12:28.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[95937]: starting ceph client 2023-11-24T06:12:28.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[95937]: starting fuse 2023-11-24T06:12:28.029 INFO:teuthology.orchestra.run.smithi022.stdout:41 2023-11-24T06:12:28.029 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T06:12:28.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:12:28.030 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2023-11-24T06:12:28.030 DEBUG:teuthology.orchestra.run.smithi022:> import re 2023-11-24T06:12:28.030 DEBUG:teuthology.orchestra.run.smithi022:> import os 2023-11-24T06:12:28.030 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:12:28.031 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:12:28.032 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:12:28.032 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2023-11-24T06:12:28.032 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2023-11-24T06:12:28.032 DEBUG:teuthology.orchestra.run.smithi022:> return f 2023-11-24T06:12:28.032 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:12:28.032 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:12:28.032 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.0")) 2023-11-24T06:12:28.032 DEBUG:teuthology.orchestra.run.smithi022:> ' 2023-11-24T06:12:28.222 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.0.95937.asok 2023-11-24T06:12:28.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:12:28.238 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.95937.asok 2023-11-24T06:12:28.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:28.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.95937.asok status 2023-11-24T06:12:28.468 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:12:28.468 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2023-11-24T06:12:28.468 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:12:28.468 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:12:28.468 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "0", 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "95937", 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/" 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4713, 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 4713 2023-11-24T06:12:28.469 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4290518609 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4290518609 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:12:28.470 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.4713 192.168.0.1:0/4290518609", 2023-11-24T06:12:28.471 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.1:0/4290518609", 2023-11-24T06:12:28.471 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 1, 2023-11-24T06:12:28.471 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 8, 2023-11-24T06:12:28.471 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 22, 2023-11-24T06:12:28.471 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:12:28.471 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2023-11-24T06:12:28.471 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2023-11-24T06:12:28.471 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:12:28.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:12:28.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.706+0000 7f77ca413640 1 Processor -- start 2023-11-24T06:12:28.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.707+0000 7f77ca413640 1 -- start start 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.708+0000 7f77ca413640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f77c4157770 0x7f77c406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.708+0000 7f77ca413640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f77c406d080 0x7f77c415d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.708+0000 7f77ca413640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c415ddb0 0x7f77c40ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.708+0000 7f77ca413640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c406d500 con 0x7f77c406d080 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.708+0000 7f77ca413640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c4161670 con 0x7f77c4157770 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.708+0000 7f77ca413640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c415e610 con 0x7f77c415ddb0 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.709+0000 7f77c8c10640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f77c406d080 0x7f77c415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.709+0000 7f77c8c10640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f77c406d080 0x7f77c415d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55004/0 (socket says 172.21.15.22:55004) 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.709+0000 7f77c8c10640 1 -- 172.21.15.22:0/3046603535 learned_addr learned my addr 172.21.15.22:0/3046603535 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:28.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.709+0000 7f77c9c12640 1 --2- 172.21.15.22:0/3046603535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c415ddb0 0x7f77c40ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:28.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.709+0000 7f77c9411640 1 --2- 172.21.15.22:0/3046603535 >> v2:172.21.15.31:3300/0 conn(0x7f77c4157770 0x7f77c406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:28.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.710+0000 7f77c8c10640 1 -- 172.21.15.22:0/3046603535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c415ddb0 msgr2=0x7f77c40ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:28.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.710+0000 7f77c8c10640 1 --2- 172.21.15.22:0/3046603535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c415ddb0 0x7f77c40ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.710+0000 7f77c8c10640 1 -- 172.21.15.22:0/3046603535 >> v2:172.21.15.31:3300/0 conn(0x7f77c4157770 msgr2=0x7f77c406cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:28.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.710+0000 7f77c8c10640 1 --2- 172.21.15.22:0/3046603535 >> v2:172.21.15.31:3300/0 conn(0x7f77c4157770 0x7f77c406cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.710+0000 7f77c8c10640 1 -- 172.21.15.22:0/3046603535 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4160d40 con 0x7f77c406d080 2023-11-24T06:12:28.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.710+0000 7f77c9411640 1 --2- 172.21.15.22:0/3046603535 >> v2:172.21.15.31:3300/0 conn(0x7f77c4157770 0x7f77c406cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:28.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.711+0000 7f77c8c10640 1 --2- 172.21.15.22:0/3046603535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c406d080 0x7f77c415d870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77c40adb70 tx=0x7f77b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668318cdb798054c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:28.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.712+0000 7f77bbfff640 1 -- 172.21.15.22:0/3046603535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4031870 con 0x7f77c406d080 2023-11-24T06:12:28.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.712+0000 7f77bbfff640 1 -- 172.21.15.22:0/3046603535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b40319d0 con 0x7f77c406d080 2023-11-24T06:12:28.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.712+0000 7f77bbfff640 1 -- 172.21.15.22:0/3046603535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4031d60 con 0x7f77c406d080 2023-11-24T06:12:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.712+0000 7f77ca413640 1 -- 172.21.15.22:0/3046603535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c406d080 msgr2=0x7f77c415d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.712+0000 7f77ca413640 1 --2- 172.21.15.22:0/3046603535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c406d080 0x7f77c415d870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77c40adb70 tx=0x7f77b402b910 comp rx=0 tx=0).stop 2023-11-24T06:12:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.713+0000 7f77ca413640 1 -- 172.21.15.22:0/3046603535 shutdown_connections 2023-11-24T06:12:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.713+0000 7f77ca413640 1 --2- 172.21.15.22:0/3046603535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c415ddb0 0x7f77c40ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.713+0000 7f77ca413640 1 --2- 172.21.15.22:0/3046603535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c406d080 0x7f77c415d870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.713+0000 7f77ca413640 1 --2- 172.21.15.22:0/3046603535 >> v2:172.21.15.31:3300/0 conn(0x7f77c4157770 0x7f77c406cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.713+0000 7f77ca413640 1 -- 172.21.15.22:0/3046603535 >> 172.21.15.22:0/3046603535 conn(0x7f77c406a860 msgr2=0x7f77c406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.713+0000 7f77ca413640 1 -- 172.21.15.22:0/3046603535 shutdown_connections 2023-11-24T06:12:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.713+0000 7f77ca413640 1 -- 172.21.15.22:0/3046603535 wait complete. 2023-11-24T06:12:28.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.715+0000 7f77ca413640 1 Processor -- start 2023-11-24T06:12:28.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.715+0000 7f77ca413640 1 -- start start 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.716+0000 7f77ca413640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c406d080 0x7f77c4160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.716+0000 7f77ca413640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c4157770 0x7f77c414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.716+0000 7f77ca413640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c415ddb0 0x7f77c4154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.716+0000 7f77ca413640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c41608b0 con 0x7f77c415ddb0 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.716+0000 7f77ca413640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c415ebf0 con 0x7f77c4157770 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.716+0000 7f77ca413640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c415eed0 con 0x7f77c406d080 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.716+0000 7f77c9c12640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c415ddb0 0x7f77c4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c9c12640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c415ddb0 0x7f77c4154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55006/0 (socket says 172.21.15.22:55006) 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c9c12640 1 -- 172.21.15.22:0/661045303 learned_addr learned my addr 172.21.15.22:0/661045303 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c9411640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c406d080 0x7f77c4160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:28.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c8c10640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c4157770 0x7f77c414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:28.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c9c12640 1 -- 172.21.15.22:0/661045303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c406d080 msgr2=0x7f77c4160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:28.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c9c12640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c406d080 0x7f77c4160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c9c12640 1 -- 172.21.15.22:0/661045303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c4157770 msgr2=0x7f77c414b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:28.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c9c12640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c4157770 0x7f77c414b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c9c12640 1 -- 172.21.15.22:0/661045303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b40094d0 con 0x7f77c415ddb0 2023-11-24T06:12:28.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.717+0000 7f77c9c12640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c415ddb0 0x7f77c4154000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00efc0 tx=0x7f77bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:28.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.718+0000 7f77b9ffb640 1 -- 172.21.15.22:0/661045303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc009ba0 con 0x7f77c415ddb0 2023-11-24T06:12:28.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.718+0000 7f77b9ffb640 1 -- 172.21.15.22:0/661045303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc00f040 con 0x7f77c415ddb0 2023-11-24T06:12:28.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.718+0000 7f77b9ffb640 1 -- 172.21.15.22:0/661045303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0146c0 con 0x7f77c415ddb0 2023-11-24T06:12:28.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.718+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c415f1b0 con 0x7f77c415ddb0 2023-11-24T06:12:28.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.718+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c415f770 con 0x7f77c415ddb0 2023-11-24T06:12:28.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.719+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c404e840 con 0x7f77c415ddb0 2023-11-24T06:12:28.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.720+0000 7f77b9ffb640 1 -- 172.21.15.22:0/661045303 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77bc014820 con 0x7f77c415ddb0 2023-11-24T06:12:28.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.721+0000 7f77b9ffb640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77a806ae40 0x7f77a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:28.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.721+0000 7f77b9ffb640 1 -- 172.21.15.22:0/661045303 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77bc08a000 con 0x7f77c415ddb0 2023-11-24T06:12:28.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.721+0000 7f77c9411640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77a806ae40 0x7f77a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:28.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.722+0000 7f77c9411640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77a806ae40 0x7f77a806d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f77c0006fd0 tx=0x7f77c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:28.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.726+0000 7f77b9ffb640 1 -- 172.21.15.22:0/661045303 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77bc055140 con 0x7f77c415ddb0 2023-11-24T06:12:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.960+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f77c4071680 con 0x7f77c415ddb0 2023-11-24T06:12:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.960+0000 7f77b9ffb640 1 -- 172.21.15.22:0/661045303 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f77bc058760 con 0x7f77c415ddb0 2023-11-24T06:12:28.963 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:12:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77a806ae40 msgr2=0x7f77a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77a806ae40 0x7f77a806d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f77c0006fd0 tx=0x7f77c0008040 comp rx=0 tx=0).stop 2023-11-24T06:12:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c415ddb0 msgr2=0x7f77c4154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c415ddb0 0x7f77c4154000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00efc0 tx=0x7f77bc00c490 comp rx=0 tx=0).stop 2023-11-24T06:12:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 shutdown_connections 2023-11-24T06:12:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77a806ae40 0x7f77a806d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77c415ddb0 0x7f77c4154000 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77c4157770 0x7f77c414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 --2- 172.21.15.22:0/661045303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77c406d080 0x7f77c4160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 >> 172.21.15.22:0/661045303 conn(0x7f77c406a860 msgr2=0x7f77c4155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 shutdown_connections 2023-11-24T06:12:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:28.963+0000 7f77ca413640 1 -- 172.21.15.22:0/661045303 wait complete. 2023-11-24T06:12:28.985 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:12:28.985 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:12:28.985 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-11-24T06:12:28.985 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-24T06:12:28.986 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T06:12:28.986 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:12:28.986 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:12:28.986 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:12:28.986 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-24T06:12:28.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:28.986 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-11-24T06:12:29.041 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:12:29.041 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:12:29.042 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42261sec preferred_lft 42261sec 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:12:29.043 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 42:17:0d:d1:91:32 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:29.044 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:12:29.044 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.044 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::5c65:45ff:fef2:bf3b/64 scope link 2023-11-24T06:12:29.044 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.044 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:12:29.044 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 42:17:0d:d1:91:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:29.044 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::4017:dff:fed1:9132/64 scope link 2023-11-24T06:12:29.044 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:29.045 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:12:29.140 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-11-24T06:12:29.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:29.145 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-11-24T06:12:29.204 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-11-24T06:12:29.204 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:12:29.205 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:12:29.205 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:12:29.205 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:12:29.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:29.205 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:12:29.205 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:12:29.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:12:29.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:12:29.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:12:29.206 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:12:29.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:29.397 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-11-24T06:12:29.453 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:12:29.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:29.454 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2023-11-24T06:12:29.507 INFO:teuthology.orchestra.run.smithi022.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-24T06:12:29.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:29.509 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:12:29.509 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:12:29.509 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:12:29.509 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-24T06:12:29.509 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:12:29.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:29.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T06:12:29.761 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:12:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:12:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:12:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-11-24T06:12:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.762 INFO:teuthology.orchestra.run.smithi022.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:12:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether b6:09:f2:d2:e5:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:12:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:12:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::b409:f2ff:fed2:e561/64 scope link 2023-11-24T06:12:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:29.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T06:12:29.870 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether b6:09:f2:d2:e5:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::b409:f2ff:fed2:e561/64 scope link 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:29.876 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-24T06:12:29.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:29.876 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:12:29.876 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:12:29.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-24T06:12:29.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T06:12:29.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-24T06:12:29.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-24T06:12:29.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-24T06:12:29.877 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:12:30.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:30.167 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:12:30.168 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:12:30.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.1 up 2023-11-24T06:12:30.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T06:12:30.168 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:12:30.357 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-24T06:12:30.357 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:12:30.357 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-24T06:12:30.413 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-24T06:12:30.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:12:30.413 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-24T06:12:30.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:12:30.573 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:12:30.634 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:12:30.635 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:12:30.636 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:12:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:12:30.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:30.638 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:12:30.693 INFO:teuthology.orchestra.run.smithi022.stdout:41 2023-11-24T06:12:30.693 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-24T06:12:30.693 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-24T06:12:30.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:12:30.780 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:12:30.821 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:12:30.822 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:12:30.822 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:12:30.822 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:12:30.822 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:12:30.822 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:12:30.823 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:12:30.823 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:12:30.823 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:12:30.823 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:12:30.823 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:12:30.823 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:12:30.824 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:12:30.824 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:12:30.824 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:12:30.824 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:12:30.824 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:12:30.824 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:12:30.825 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:12:30.825 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:12:30.825 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:12:30.825 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:12:30.825 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:12:30.825 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:12:30.825 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:12:30.826 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:12:30.826 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:12:30.826 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:12:30.826 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:12:30.826 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:30.826 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:12:30.827 INFO:teuthology.orchestra.run.smithi022.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:30.827 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:12:30.827 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:12:30.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:30.829 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:12:30.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi022.stderr:2023-11-24T06:12:30.891+0000 7fd3b7e6a480 -1 init, newargv = 0x564f92f9dde0 newargc=15 2023-11-24T06:12:30.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi022.stderr:ceph-fuse[96431]: starting ceph client 2023-11-24T06:12:30.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi022.stderr:ceph-fuse[96431]: starting fuse 2023-11-24T06:12:30.917 INFO:teuthology.orchestra.run.smithi022.stdout:41 2023-11-24T06:12:30.917 INFO:teuthology.orchestra.run.smithi022.stdout:42 2023-11-24T06:12:30.917 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 42] 2023-11-24T06:12:30.917 DEBUG:teuthology.orchestra.run.smithi022:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:12:30.917 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2023-11-24T06:12:30.917 DEBUG:teuthology.orchestra.run.smithi022:> import re 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> import os 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2023-11-24T06:12:30.918 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> return f 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.2")) 2023-11-24T06:12:30.919 DEBUG:teuthology.orchestra.run.smithi022:> ' 2023-11-24T06:12:31.120 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.2.96431.asok 2023-11-24T06:12:31.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:12:31.137 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.96431.asok 2023-11-24T06:12:31.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:31.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.96431.asok status 2023-11-24T06:12:31.386 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:12:31.386 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2023-11-24T06:12:31.386 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:12:31.386 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:12:31.386 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "2", 2023-11-24T06:12:31.386 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "96431", 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/" 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4725, 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 4725 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:12:31.387 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.2:0", 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1311978069 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.2:0", 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1311978069 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.4725 192.168.0.2:0/1311978069", 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.2:0/1311978069", 2023-11-24T06:12:31.388 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 1, 2023-11-24T06:12:31.389 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 8, 2023-11-24T06:12:31.389 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 22, 2023-11-24T06:12:31.389 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:12:31.389 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2023-11-24T06:12:31.389 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2023-11-24T06:12:31.389 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:12:31.402 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:12:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.626+0000 7faced8f1640 1 Processor -- start 2023-11-24T06:12:31.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.626+0000 7faced8f1640 1 -- start start 2023-11-24T06:12:31.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.627+0000 7faced8f1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7face80d14a0 0x7face80d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:31.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.627+0000 7faced8f1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 0x7face80b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:31.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.627+0000 7faced8f1640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face80cf0c0 con 0x7face815d5b0 2023-11-24T06:12:31.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.627+0000 7faced8f1640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80b01b0 con 0x7face80d14a0 2023-11-24T06:12:31.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.627+0000 7faced8f1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face815d990 con 0x7face80b0640 2023-11-24T06:12:31.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.628+0000 7face7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7face80d14a0 0x7face80d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:31.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.628+0000 7facec8ef640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7face815d5b0 0x7face80d3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47036/0 (socket says 172.21.15.22:47036) 2023-11-24T06:12:31.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.628+0000 7facec8ef640 1 -- 172.21.15.22:0/1101588525 learned_addr learned my addr 172.21.15.22:0/1101588525 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.628+0000 7faced0f0640 1 --2- 172.21.15.22:0/1101588525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 0x7face80b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.628+0000 7face77fe640 1 -- 172.21.15.22:0/1101588525 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715582539 0 0) 0x7face80cf0c0 con 0x7face815d5b0 2023-11-24T06:12:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.628+0000 7face7fff640 1 -- 172.21.15.22:0/1101588525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 msgr2=0x7face80b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.628+0000 7face7fff640 1 --2- 172.21.15.22:0/1101588525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 0x7face80b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.628+0000 7face7fff640 1 -- 172.21.15.22:0/1101588525 >> v1:172.21.15.22:6789/0 conn(0x7face815d5b0 legacy=0x7face80d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.628+0000 7face7fff640 1 -- 172.21.15.22:0/1101588525 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80d1e40 con 0x7face80d14a0 2023-11-24T06:12:31.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.630+0000 7face7fff640 1 --2- 172.21.15.22:0/1101588525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face80d14a0 0x7face80d1900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7facdc0097a0 tx=0x7facdc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d9b14a18a7db71 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:31.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.630+0000 7face77fe640 1 -- 172.21.15.22:0/1101588525 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc031830 con 0x7face80d14a0 2023-11-24T06:12:31.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.630+0000 7face77fe640 1 -- 172.21.15.22:0/1101588525 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc031990 con 0x7face80d14a0 2023-11-24T06:12:31.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.630+0000 7face77fe640 1 -- 172.21.15.22:0/1101588525 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc031d20 con 0x7face80d14a0 2023-11-24T06:12:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.630+0000 7faced8f1640 1 -- 172.21.15.22:0/1101588525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face80d14a0 msgr2=0x7face80d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.630+0000 7faced8f1640 1 --2- 172.21.15.22:0/1101588525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face80d14a0 0x7face80d1900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7facdc0097a0 tx=0x7facdc02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.631+0000 7faced8f1640 1 -- 172.21.15.22:0/1101588525 shutdown_connections 2023-11-24T06:12:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.631+0000 7faced8f1640 1 --2- 172.21.15.22:0/1101588525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face80d14a0 0x7face80d1900 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.631+0000 7faced8f1640 1 --2- 172.21.15.22:0/1101588525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 0x7face80b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.631+0000 7faced8f1640 1 -- 172.21.15.22:0/1101588525 >> 172.21.15.22:0/1101588525 conn(0x7face809c3b0 msgr2=0x7face80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.631+0000 7faced8f1640 1 -- 172.21.15.22:0/1101588525 shutdown_connections 2023-11-24T06:12:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.631+0000 7faced8f1640 1 -- 172.21.15.22:0/1101588525 wait complete. 2023-11-24T06:12:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.632+0000 7faced8f1640 1 Processor -- start 2023-11-24T06:12:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.633+0000 7faced8f1640 1 -- start start 2023-11-24T06:12:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7faced8f1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 0x7face80c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7faced8f1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7face80d14a0 0x7face815eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7faced8f1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face815d5b0 0x7face80b7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7faced8f1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80b8070 con 0x7face815d5b0 2023-11-24T06:12:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7faced8f1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80b8350 con 0x7face80d14a0 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7faced8f1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80c8f50 con 0x7face80b0640 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7faced0f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face815d5b0 0x7face80b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7faced0f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face815d5b0 0x7face80b7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60030/0 (socket says 172.21.15.22:60030) 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7faced0f0640 1 -- 172.21.15.22:0/791898991 learned_addr learned my addr 172.21.15.22:0/791898991 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7face7fff640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7face80d14a0 0x7face815eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.634+0000 7facec8ef640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 0x7face80c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7faced0f0640 1 -- 172.21.15.22:0/791898991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 msgr2=0x7face80c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7faced0f0640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 0x7face80c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7faced0f0640 1 -- 172.21.15.22:0/791898991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7face80d14a0 msgr2=0x7face815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7faced0f0640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7face80d14a0 0x7face815eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7faced0f0640 1 -- 172.21.15.22:0/791898991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc009400 con 0x7face815d5b0 2023-11-24T06:12:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7faced0f0640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face815d5b0 0x7face80b7160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7face000d5d0 tx=0x7face000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7face57fa640 1 -- 172.21.15.22:0/791898991 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face00125f0 con 0x7face815d5b0 2023-11-24T06:12:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7face57fa640 1 -- 172.21.15.22:0/791898991 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face0012770 con 0x7face815d5b0 2023-11-24T06:12:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7face57fa640 1 -- 172.21.15.22:0/791898991 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0012b20 con 0x7face815d5b0 2023-11-24T06:12:31.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face80c9230 con 0x7face815d5b0 2023-11-24T06:12:31.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.635+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face81523f0 con 0x7face815d5b0 2023-11-24T06:12:31.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.637+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face804e840 con 0x7face815d5b0 2023-11-24T06:12:31.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.638+0000 7face57fa640 1 -- 172.21.15.22:0/791898991 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7face0012c80 con 0x7face815d5b0 2023-11-24T06:12:31.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.639+0000 7face57fa640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7facd406af40 0x7facd406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:31.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.639+0000 7face57fa640 1 -- 172.21.15.22:0/791898991 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7face0089a70 con 0x7face815d5b0 2023-11-24T06:12:31.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.639+0000 7facec8ef640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7facd406af40 0x7facd406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:31.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.640+0000 7facec8ef640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7facd406af40 0x7facd406d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7facd80012e0 tx=0x7facd8007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.644+0000 7face57fa640 1 -- 172.21.15.22:0/791898991 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7face0054b10 con 0x7face815d5b0 2023-11-24T06:12:31.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.876+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7face80678d0 con 0x7face815d5b0 2023-11-24T06:12:31.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.877+0000 7face57fa640 1 -- 172.21.15.22:0/791898991 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7face0058130 con 0x7face815d5b0 2023-11-24T06:12:31.880 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.879+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7facd406af40 msgr2=0x7facd406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.879+0000 7faced8f1640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7facd406af40 0x7facd406d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7facd80012e0 tx=0x7facd8007ed0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face815d5b0 msgr2=0x7face80b7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face815d5b0 0x7face80b7160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7face000d5d0 tx=0x7face000da90 comp rx=0 tx=0).stop 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 shutdown_connections 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7facd406af40 0x7facd406d400 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7face815d5b0 0x7face80b7160 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7face80d14a0 0x7face815eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 --2- 172.21.15.22:0/791898991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7face80b0640 0x7face80c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 >> 172.21.15.22:0/791898991 conn(0x7face809c3b0 msgr2=0x7face806b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:31.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 shutdown_connections 2023-11-24T06:12:31.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:31.880+0000 7faced8f1640 1 -- 172.21.15.22:0/791898991 wait complete. 2023-11-24T06:12:31.900 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:12:31.900 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:12:31.900 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-11-24T06:12:31.900 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:12:31.900 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:31.901 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:12:31.901 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:12:31.901 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:12:31.901 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:12:31.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:31.901 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-11-24T06:12:31.966 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:12:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:12:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:12:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:31.966 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-11-24T06:12:31.967 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42249sec preferred_lft 42249sec 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-11-24T06:12:31.969 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T06:12:31.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:31.969 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:12:31.969 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:12:31.969 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2023-11-24T06:12:31.969 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2023-11-24T06:12:31.969 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2023-11-24T06:12:31.969 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T06:12:31.970 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:12:32.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:32.476 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:12:32.552 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-11-24T06:12:32.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:32.556 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-11-24T06:12:32.613 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-11-24T06:12:32.613 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:12:32.614 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:12:32.614 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:12:32.614 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:12:32.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:32.615 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:12:32.615 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:12:32.615 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:12:32.615 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:12:32.616 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:12:32.616 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:12:33.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:33.345 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-24T06:12:33.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:33.393 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2023-11-24T06:12:33.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:33.441 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:12:33.441 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:12:33.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:33.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-24T06:12:33.441 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:12:33.637 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-24T06:12:33.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:33.637 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:12:33.638 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:12:33.638 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-24T06:12:33.638 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T06:12:33.638 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-24T06:12:33.638 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-24T06:12:33.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-24T06:12:33.639 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:12:33.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:33.933 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:12:33.933 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:12:33.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-11-24T06:12:33.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T06:12:33.933 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:12:34.081 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T06:12:34.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:12:34.081 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:34.127 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:12:34.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:12:34.128 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:34.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:12:34.325 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:12:34.381 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:12:34.381 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:12:34.381 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:12:34.381 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:12:34.381 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:12:34.381 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:12:34.381 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:12:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:34.383 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:34.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:34.384 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:12:34.434 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T06:12:34.434 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T06:12:34.439 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:12:34.513 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:12:34.559 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:12:34.560 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:12:34.561 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:12:34.562 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:12:34.562 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:12:34.562 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:12:34.562 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:12:34.562 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:34.562 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:34.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:34.563 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:12:34.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:2023-11-24T06:12:34.687+0000 7f1171dff480 -1 init, newargv = 0x55accdfcab40 newargc=15 2023-11-24T06:12:34.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[94052]: starting ceph client 2023-11-24T06:12:34.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[94052]: starting fuse 2023-11-24T06:12:35.710 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:12:35.819 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:12:35.882 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:12:35.883 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:12:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:12:35.885 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:12:35.885 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:12:35.885 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:12:35.885 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:12:35.885 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:12:35.885 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:35.885 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:35.885 INFO:teuthology.orchestra.run.smithi031.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:35.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:35.886 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:12:35.944 INFO:teuthology.orchestra.run.smithi031.stdout:41 2023-11-24T06:12:35.944 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> import re 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2023-11-24T06:12:35.945 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> return f 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.1")) 2023-11-24T06:12:35.946 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-11-24T06:12:36.135 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.1.94052.asok 2023-11-24T06:12:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:12:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:12:36.153 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.94052.asok 2023-11-24T06:12:36.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:36.154 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.94052.asok status 2023-11-24T06:12:36.399 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "1", 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "94052", 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2023-11-24T06:12:36.400 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4549, 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4549 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 432478755 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:12:36.401 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 432478755 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4549 192.168.0.1:0/432478755", 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/432478755", 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 8, 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 22, 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2023-11-24T06:12:36.402 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-24T06:12:36.415 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:12:36.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.649+0000 7f84a673c640 1 Processor -- start 2023-11-24T06:12:36.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.650+0000 7f84a673c640 1 -- start start 2023-11-24T06:12:36.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.651+0000 7f84a673c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f84a006d520 0x7f84a006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:36.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.651+0000 7f84a673c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f84a00abff0 0x7f84a015f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.651+0000 7f84a673c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a015c360 con 0x7f84a00ad720 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.651+0000 7f84a673c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a00b41a0 con 0x7f84a00abff0 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.651+0000 7f84a673c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a006de40 con 0x7f84a006d520 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.652+0000 7f849f7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f84a00ad720 0x7f84a015ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47046/0 (socket says 172.21.15.22:47046) 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.652+0000 7f849f7fe640 1 -- 172.21.15.22:0/2558126668 learned_addr learned my addr 172.21.15.22:0/2558126668 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.652+0000 7f84a4cd9640 1 --2- 172.21.15.22:0/2558126668 >> v2:172.21.15.22:3300/0 conn(0x7f84a00abff0 0x7f84a015f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.652+0000 7f849ffff640 1 --2- 172.21.15.22:0/2558126668 >> v2:172.21.15.31:3300/0 conn(0x7f84a006d520 0x7f84a006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.652+0000 7f84a4cd9640 1 -- 172.21.15.22:0/2558126668 >> v2:172.21.15.31:3300/0 conn(0x7f84a006d520 msgr2=0x7f84a006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.652+0000 7f84a4cd9640 1 --2- 172.21.15.22:0/2558126668 >> v2:172.21.15.31:3300/0 conn(0x7f84a006d520 0x7f84a006d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.652+0000 7f84a4cd9640 1 -- 172.21.15.22:0/2558126668 >> v1:172.21.15.22:6789/0 conn(0x7f84a00ad720 legacy=0x7f84a015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.652+0000 7f84a4cd9640 1 -- 172.21.15.22:0/2558126668 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a015ba30 con 0x7f84a00abff0 2023-11-24T06:12:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.652+0000 7f849effd640 1 -- 172.21.15.22:0/2558126668 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406807491 0 0) 0x7f84a015c360 con 0x7f84a00ad720 2023-11-24T06:12:36.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.653+0000 7f84a4cd9640 1 --2- 172.21.15.22:0/2558126668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 0x7f84a015f3e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f84a006c070 tx=0x7f849802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760c0c9c49f17c12 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:36.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.654+0000 7f849effd640 1 -- 172.21.15.22:0/2558126668 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849802cc80 con 0x7f84a00abff0 2023-11-24T06:12:36.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.654+0000 7f849effd640 1 -- 172.21.15.22:0/2558126668 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849802cde0 con 0x7f84a00abff0 2023-11-24T06:12:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.654+0000 7f849effd640 1 -- 172.21.15.22:0/2558126668 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498034660 con 0x7f84a00abff0 2023-11-24T06:12:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.654+0000 7f84a673c640 1 -- 172.21.15.22:0/2558126668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 msgr2=0x7f84a015f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.654+0000 7f84a673c640 1 --2- 172.21.15.22:0/2558126668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 0x7f84a015f3e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f84a006c070 tx=0x7f849802bed0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.655+0000 7f84a673c640 1 -- 172.21.15.22:0/2558126668 shutdown_connections 2023-11-24T06:12:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.655+0000 7f84a673c640 1 --2- 172.21.15.22:0/2558126668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 0x7f84a015f3e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.655+0000 7f84a673c640 1 --2- 172.21.15.22:0/2558126668 >> v2:172.21.15.31:3300/0 conn(0x7f84a006d520 0x7f84a006d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.655+0000 7f84a673c640 1 -- 172.21.15.22:0/2558126668 >> 172.21.15.22:0/2558126668 conn(0x7f84a00b0d80 msgr2=0x7f84a00b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.655+0000 7f84a673c640 1 -- 172.21.15.22:0/2558126668 shutdown_connections 2023-11-24T06:12:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.655+0000 7f84a673c640 1 -- 172.21.15.22:0/2558126668 wait complete. 2023-11-24T06:12:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.657+0000 7f84a673c640 1 Processor -- start 2023-11-24T06:12:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.657+0000 7f84a673c640 1 -- start start 2023-11-24T06:12:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.658+0000 7f84a673c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84a006d520 0x7f84a01472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.658+0000 7f84a673c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 0x7f84a01eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.658+0000 7f84a673c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a00ad720 0x7f84a0159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.658+0000 7f84a673c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a01546e0 con 0x7f84a00abff0 2023-11-24T06:12:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.658+0000 7f84a673c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a01477f0 con 0x7f84a00ad720 2023-11-24T06:12:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.658+0000 7f84a673c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00cdb70 con 0x7f84a006d520 2023-11-24T06:12:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.658+0000 7f849f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 0x7f84a01eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.658+0000 7f849f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 0x7f84a01eeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60050/0 (socket says 172.21.15.22:60050) 2023-11-24T06:12:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.658+0000 7f849f7fe640 1 -- 172.21.15.22:0/1982193613 learned_addr learned my addr 172.21.15.22:0/1982193613 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:36.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849ffff640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84a006d520 0x7f84a01472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f84a4cd9640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a00ad720 0x7f84a0159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849f7fe640 1 -- 172.21.15.22:0/1982193613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84a006d520 msgr2=0x7f84a01472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849f7fe640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84a006d520 0x7f84a01472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849f7fe640 1 -- 172.21.15.22:0/1982193613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a00ad720 msgr2=0x7f84a0159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849f7fe640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a00ad720 0x7f84a0159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849f7fe640 1 -- 172.21.15.22:0/1982193613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498009a70 con 0x7f84a00abff0 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f84a4cd9640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a00ad720 0x7f84a0159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849f7fe640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 0x7f84a01eeec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8494010b60 tx=0x7f849400e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849cff9640 1 -- 172.21.15.22:0/1982193613 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400ed40 con 0x7f84a00abff0 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849cff9640 1 -- 172.21.15.22:0/1982193613 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849400b0d0 con 0x7f84a00abff0 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f849cff9640 1 -- 172.21.15.22:0/1982193613 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400eea0 con 0x7f84a00abff0 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.659+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a0153d40 con 0x7f84a00abff0 2023-11-24T06:12:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.660+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a0154300 con 0x7f84a00abff0 2023-11-24T06:12:36.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.661+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a015b6a0 con 0x7f84a00abff0 2023-11-24T06:12:36.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.662+0000 7f849cff9640 1 -- 172.21.15.22:0/1982193613 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f849400b440 con 0x7f84a00abff0 2023-11-24T06:12:36.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.663+0000 7f849cff9640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f848c06ae40 0x7f848c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:36.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.663+0000 7f849cff9640 1 -- 172.21.15.22:0/1982193613 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f849408d1f0 con 0x7f84a00abff0 2023-11-24T06:12:36.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.663+0000 7f849ffff640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f848c06ae40 0x7f848c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:36.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.664+0000 7f849ffff640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f848c06ae40 0x7f848c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8490006fd0 tx=0x7f8490008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:36.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.668+0000 7f849cff9640 1 -- 172.21.15.22:0/1982193613 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f84940582b0 con 0x7f84a00abff0 2023-11-24T06:12:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.899+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84a0154820 con 0x7f84a00abff0 2023-11-24T06:12:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.900+0000 7f849cff9640 1 -- 172.21.15.22:0/1982193613 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f849405b8d0 con 0x7f84a00abff0 2023-11-24T06:12:36.903 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:12:36.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f848c06ae40 msgr2=0x7f848c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:36.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f848c06ae40 0x7f848c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8490006fd0 tx=0x7f8490008040 comp rx=0 tx=0).stop 2023-11-24T06:12:36.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 msgr2=0x7f84a01eeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:36.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 0x7f84a01eeec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8494010b60 tx=0x7f849400e430 comp rx=0 tx=0).stop 2023-11-24T06:12:36.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 shutdown_connections 2023-11-24T06:12:36.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f848c06ae40 0x7f848c06d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a00ad720 0x7f84a0159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84a00abff0 0x7f84a01eeec0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 --2- 172.21.15.22:0/1982193613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84a006d520 0x7f84a01472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:36.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 >> 172.21.15.22:0/1982193613 conn(0x7f84a00b0d80 msgr2=0x7f84a015c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:36.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 shutdown_connections 2023-11-24T06:12:36.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:36.902+0000 7f84a673c640 1 -- 172.21.15.22:0/1982193613 wait complete. 2023-11-24T06:12:36.922 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:12:36.922 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:12:36.922 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-11-24T06:12:36.922 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-24T06:12:36.922 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T06:12:36.922 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:12:36.922 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:12:36.922 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:12:36.923 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-24T06:12:36.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:36.923 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-11-24T06:12:36.987 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-11-24T06:12:36.988 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42244sec preferred_lft 42244sec 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:5c:4a:a6:48:09 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:12:36.989 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:36.990 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c062:1fff:fe91:be78/64 scope link 2023-11-24T06:12:36.990 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:36.990 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:12:36.990 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:5c:4a:a6:48:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:36.990 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c45c:4aff:fea6:4809/64 scope link 2023-11-24T06:12:36.990 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:36.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:36.991 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:12:37.091 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-11-24T06:12:37.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:37.096 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-11-24T06:12:37.153 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-11-24T06:12:37.153 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:12:37.153 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:12:37.153 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:12:37.154 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:12:37.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:37.155 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:12:37.155 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:12:37.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:12:37.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:12:37.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:12:37.155 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:12:37.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:37.354 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-24T06:12:37.409 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:12:37.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:37.411 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2023-11-24T06:12:37.466 INFO:teuthology.orchestra.run.smithi031.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-24T06:12:37.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:37.468 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:12:37.468 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:12:37.468 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:12:37.468 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-24T06:12:37.468 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:12:37.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:37.619 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T06:12:37.719 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:12:37.719 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:12:37.719 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:12:37.719 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:37.720 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-24T06:12:37.720 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:37.720 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:12:37.720 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether b6:5a:0a:81:93:0b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:12:37.720 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:12:37.720 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:37.720 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b45a:aff:fe81:930b/64 scope link 2023-11-24T06:12:37.720 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:37.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:37.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T06:12:37.822 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether b6:5a:0a:81:93:0b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::b45a:aff:fe81:930b/64 scope link 2023-11-24T06:12:37.823 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:12:37.827 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-24T06:12:37.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:37.827 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:12:37.827 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:12:37.828 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-24T06:12:37.828 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T06:12:37.828 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-24T06:12:37.828 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-24T06:12:37.828 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-24T06:12:37.828 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:12:38.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:38.093 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:12:38.093 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:12:38.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.1 up 2023-11-24T06:12:38.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T06:12:38.093 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:12:38.271 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-24T06:12:38.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:12:38.272 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-24T06:12:38.326 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-24T06:12:38.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:12:38.326 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-24T06:12:38.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:12:38.472 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:12:38.529 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:12:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:12:38.531 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:12:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:12:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:12:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:12:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:12:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:12:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:12:38.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:38.533 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:12:38.588 INFO:teuthology.orchestra.run.smithi031.stdout:41 2023-11-24T06:12:38.588 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-24T06:12:38.588 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-24T06:12:38.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:12:38.675 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:12:38.719 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:12:38.719 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:12:38.719 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:12:38.719 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:12:38.719 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:12:38.719 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:12:38.720 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:12:38.721 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:38.722 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:12:38.722 INFO:teuthology.orchestra.run.smithi031.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:38.722 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:12:38.722 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:12:38.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:38.723 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:12:38.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi031.stderr:2023-11-24T06:12:38.793+0000 7ff986c42480 -1 init, newargv = 0x5560f0ed0cf0 newargc=15 2023-11-24T06:12:38.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi031.stderr:ceph-fuse[94556]: starting ceph client 2023-11-24T06:12:38.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi031.stderr:ceph-fuse[94556]: starting fuse 2023-11-24T06:12:38.814 INFO:teuthology.orchestra.run.smithi031.stdout:41 2023-11-24T06:12:38.814 INFO:teuthology.orchestra.run.smithi031.stdout:42 2023-11-24T06:12:38.814 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 42] 2023-11-24T06:12:38.814 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:12:38.814 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2023-11-24T06:12:38.814 DEBUG:teuthology.orchestra.run.smithi031:> import re 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:12:38.815 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> return f 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.3")) 2023-11-24T06:12:38.816 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-11-24T06:12:39.019 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.3.94556.asok 2023-11-24T06:12:39.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:12:39.038 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.94556.asok 2023-11-24T06:12:39.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:39.038 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.94556.asok status 2023-11-24T06:12:39.290 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-24T06:12:39.290 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2023-11-24T06:12:39.290 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:12:39.290 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:12:39.290 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "3", 2023-11-24T06:12:39.290 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2023-11-24T06:12:39.290 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-24T06:12:39.290 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "94556", 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4454, 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4454 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:12:39.291 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.2:0", 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1791858568 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.2:0", 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1791858568 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4454 192.168.0.2:0/1791858568", 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.2:0/1791858568", 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 8, 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 22, 2023-11-24T06:12:39.292 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:12:39.293 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2023-11-24T06:12:39.293 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2023-11-24T06:12:39.293 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-24T06:12:39.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:39.305 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2023-11-24T06:12:39.305 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:39.371 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2023-11-24T06:12:39.372 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:39.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:39.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:39.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:39.478 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2023-11-24T06:12:39.478 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-24T06:12:39.540 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2023-11-24T06:12:39.541 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-24T06:12:39.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:39.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-24T06:12:39.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:39.651 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2023-11-24T06:12:39.651 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:39.717 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2023-11-24T06:12:39.717 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:39.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:39.718 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:12:39.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:39.819 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2023-11-24T06:12:39.819 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-24T06:12:39.878 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2023-11-24T06:12:39.878 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-24T06:12:39.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:39.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-24T06:12:39.983 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-24T06:12:39.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.229+0000 7f5a24b4e640 1 Processor -- start 2023-11-24T06:12:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.229+0000 7f5a24b4e640 1 -- start start 2023-11-24T06:12:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.231+0000 7f5a24b4e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a2013dfd0 0x7f5a2015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.231+0000 7f5a24b4e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5a200cf050 0x7f5a200cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.231+0000 7f5a24b4e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a2006c130 0x7f5a2006c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.231+0000 7f5a24b4e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a200cfa10 con 0x7f5a200cf050 2023-11-24T06:12:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.231+0000 7f5a24b4e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2015fa70 con 0x7f5a2006c130 2023-11-24T06:12:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.231+0000 7f5a24b4e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2015ee60 con 0x7f5a2013dfd0 2023-11-24T06:12:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.231+0000 7f5a1effd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5a200cf050 0x7f5a200cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.231+0000 7f5a1effd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5a200cf050 0x7f5a200cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60052/0 (socket says 172.21.15.22:60052) 2023-11-24T06:12:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.231+0000 7f5a1effd640 1 -- 172.21.15.22:0/1772857755 learned_addr learned my addr 172.21.15.22:0/1772857755 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.232+0000 7f5a1f7fe640 1 --2- 172.21.15.22:0/1772857755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a2013dfd0 0x7f5a2015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.232+0000 7f5a1ffff640 1 --2- 172.21.15.22:0/1772857755 >> v2:172.21.15.31:3300/0 conn(0x7f5a2006c130 0x7f5a2006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.232+0000 7f5a1effd640 1 -- 172.21.15.22:0/1772857755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a2013dfd0 msgr2=0x7f5a2015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.232+0000 7f5a1effd640 1 --2- 172.21.15.22:0/1772857755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a2013dfd0 0x7f5a2015be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.232+0000 7f5a1effd640 1 -- 172.21.15.22:0/1772857755 >> v2:172.21.15.31:3300/0 conn(0x7f5a2006c130 msgr2=0x7f5a2006c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.232+0000 7f5a1effd640 1 --2- 172.21.15.22:0/1772857755 >> v2:172.21.15.31:3300/0 conn(0x7f5a2006c130 0x7f5a2006c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.232+0000 7f5a1effd640 1 -- 172.21.15.22:0/1772857755 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2015f140 con 0x7f5a200cf050 2023-11-24T06:12:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.232+0000 7f5a1ffff640 1 --2- 172.21.15.22:0/1772857755 >> v2:172.21.15.31:3300/0 conn(0x7f5a2006c130 0x7f5a2006c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.233+0000 7f5a1effd640 1 --2- 172.21.15.22:0/1772857755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a200cf050 0x7f5a200cf4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a2006d520 tx=0x7f5a1402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69a2e7e6e5f98af server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.233+0000 7f5a1e7fc640 1 -- 172.21.15.22:0/1772857755 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14031870 con 0x7f5a200cf050 2023-11-24T06:12:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.233+0000 7f5a1e7fc640 1 -- 172.21.15.22:0/1772857755 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a140319d0 con 0x7f5a200cf050 2023-11-24T06:12:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.233+0000 7f5a1e7fc640 1 -- 172.21.15.22:0/1772857755 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14031d60 con 0x7f5a200cf050 2023-11-24T06:12:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.234+0000 7f5a24b4e640 1 -- 172.21.15.22:0/1772857755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a200cf050 msgr2=0x7f5a200cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.234+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/1772857755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a200cf050 0x7f5a200cf4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a2006d520 tx=0x7f5a1402b910 comp rx=0 tx=0).stop 2023-11-24T06:12:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.234+0000 7f5a24b4e640 1 -- 172.21.15.22:0/1772857755 shutdown_connections 2023-11-24T06:12:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.234+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/1772857755 >> v2:172.21.15.31:3300/0 conn(0x7f5a2006c130 0x7f5a2006c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.234+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/1772857755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a200cf050 0x7f5a200cf4d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.234+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/1772857755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a2013dfd0 0x7f5a2015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.234+0000 7f5a24b4e640 1 -- 172.21.15.22:0/1772857755 >> 172.21.15.22:0/1772857755 conn(0x7f5a2006a860 msgr2=0x7f5a2006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.234+0000 7f5a24b4e640 1 -- 172.21.15.22:0/1772857755 shutdown_connections 2023-11-24T06:12:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.234+0000 7f5a24b4e640 1 -- 172.21.15.22:0/1772857755 wait complete. 2023-11-24T06:12:40.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.237+0000 7f5a24b4e640 1 Processor -- start 2023-11-24T06:12:40.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.237+0000 7f5a24b4e640 1 -- start start 2023-11-24T06:12:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.238+0000 7f5a24b4e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a2006c130 0x7f5a20155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.238+0000 7f5a24b4e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a200cf050 0x7f5a20156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.238+0000 7f5a24b4e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a2013dfd0 0x7f5a2013c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.238+0000 7f5a24b4e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20158880 con 0x7f5a2006c130 2023-11-24T06:12:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.238+0000 7f5a24b4e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a201557b0 con 0x7f5a2013dfd0 2023-11-24T06:12:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.238+0000 7f5a24b4e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2013ab00 con 0x7f5a200cf050 2023-11-24T06:12:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.238+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a2006c130 0x7f5a20155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.238+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a2006c130 0x7f5a20155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60064/0 (socket says 172.21.15.22:60064) 2023-11-24T06:12:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.238+0000 7f5a1f7fe640 1 -- 172.21.15.22:0/3568103436 learned_addr learned my addr 172.21.15.22:0/3568103436 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a1effd640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a200cf050 0x7f5a20156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a1f7fe640 1 -- 172.21.15.22:0/3568103436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a200cf050 msgr2=0x7f5a20156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a1f7fe640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a200cf050 0x7f5a20156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a1f7fe640 1 -- 172.21.15.22:0/3568103436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a2013dfd0 msgr2=0x7f5a2013c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a1f7fe640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a2013dfd0 0x7f5a2013c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a1f7fe640 1 -- 172.21.15.22:0/3568103436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140094d0 con 0x7f5a2006c130 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a1f7fe640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a2006c130 0x7f5a20155270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000c7f0 tx=0x7f5a1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a07fff640 1 -- 172.21.15.22:0/3568103436 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10004220 con 0x7f5a2006c130 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a07fff640 1 -- 172.21.15.22:0/3568103436 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a10004380 con 0x7f5a2006c130 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.239+0000 7f5a07fff640 1 -- 172.21.15.22:0/3568103436 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10007840 con 0x7f5a2006c130 2023-11-24T06:12:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.240+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2013ade0 con 0x7f5a2006c130 2023-11-24T06:12:40.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.240+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2013b3a0 con 0x7f5a2006c130 2023-11-24T06:12:40.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.241+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2004e840 con 0x7f5a2006c130 2023-11-24T06:12:40.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.242+0000 7f5a07fff640 1 -- 172.21.15.22:0/3568103436 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a10007bb0 con 0x7f5a2006c130 2023-11-24T06:12:40.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.243+0000 7f5a07fff640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5a0c06ae40 0x7f5a0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.244+0000 7f5a07fff640 1 -- 172.21.15.22:0/3568103436 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a10089570 con 0x7f5a2006c130 2023-11-24T06:12:40.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.244+0000 7f5a1effd640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5a0c06ae40 0x7f5a0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.245+0000 7f5a1effd640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5a0c06ae40 0x7f5a0c06d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5a14036000 tx=0x7f5a1403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:40.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.248+0000 7f5a07fff640 1 -- 172.21.15.22:0/3568103436 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a10054580 con 0x7f5a2006c130 2023-11-24T06:12:40.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.451+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a200ce9a0 con 0x7f5a2006c130 2023-11-24T06:12:40.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.454+0000 7f5a07fff640 1 -- 172.21.15.22:0/3568103436 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f5a10007e60 con 0x7f5a2006c130 2023-11-24T06:12:40.457 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:40.457 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:01.374181+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5a0c06ae40 msgr2=0x7f5a0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5a0c06ae40 0x7f5a0c06d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5a14036000 tx=0x7f5a1403c040 comp rx=0 tx=0).stop 2023-11-24T06:12:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a2006c130 msgr2=0x7f5a20155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a2006c130 0x7f5a20155270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000c7f0 tx=0x7f5a1000ccb0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 shutdown_connections 2023-11-24T06:12:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5a0c06ae40 0x7f5a0c06d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a2013dfd0 0x7f5a2013c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a200cf050 0x7f5a20156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 --2- 172.21.15.22:0/3568103436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a2006c130 0x7f5a20155270 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 >> 172.21.15.22:0/3568103436 conn(0x7f5a2006a860 msgr2=0x7f5a2015aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:40.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 shutdown_connections 2023-11-24T06:12:40.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.457+0000 7f5a24b4e640 1 -- 172.21.15.22:0/3568103436 wait complete. 2023-11-24T06:12:40.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:40.479 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:40.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.714+0000 7f16c7fff640 1 Processor -- start 2023-11-24T06:12:40.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.714+0000 7f16c7fff640 1 -- start start 2023-11-24T06:12:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16c81435d0 0x7f16c8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16c80b4140 0x7f16c8070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c7fff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c8070d40 con 0x7f16c81439b0 2023-11-24T06:12:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c7fff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c8071020 con 0x7f16c81435d0 2023-11-24T06:12:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c7fff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c8071300 con 0x7f16c80b4140 2023-11-24T06:12:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c6ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16c81435d0 0x7f16c8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c6ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16c81435d0 0x7f16c8071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60076/0 (socket says 172.21.15.22:60076) 2023-11-24T06:12:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c6ffd640 1 -- 172.21.15.22:0/9445772 learned_addr learned my addr 172.21.15.22:0/9445772 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c67fc640 1 --1- 172.21.15.22:0/9445772 >> v1:172.21.15.22:6789/0 conn(0x7f16c81439b0 0x7f16c80b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47048/0 (socket says 172.21.15.22:47048) 2023-11-24T06:12:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.716+0000 7f16c77fe640 1 --2- 172.21.15.22:0/9445772 >> v2:172.21.15.31:3300/0 conn(0x7f16c80b4140 0x7f16c8070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.717+0000 7f16c6ffd640 1 -- 172.21.15.22:0/9445772 >> v2:172.21.15.31:3300/0 conn(0x7f16c80b4140 msgr2=0x7f16c8070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.717+0000 7f16c6ffd640 1 --2- 172.21.15.22:0/9445772 >> v2:172.21.15.31:3300/0 conn(0x7f16c80b4140 0x7f16c8070050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.717+0000 7f16c6ffd640 1 -- 172.21.15.22:0/9445772 >> v1:172.21.15.22:6789/0 conn(0x7f16c81439b0 legacy=0x7f16c80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.717+0000 7f16c6ffd640 1 -- 172.21.15.22:0/9445772 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80715e0 con 0x7f16c81435d0 2023-11-24T06:12:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.717+0000 7f16c5ffb640 1 -- 172.21.15.22:0/9445772 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555763215 0 0) 0x7f16c8070d40 con 0x7f16c81439b0 2023-11-24T06:12:40.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.718+0000 7f16c6ffd640 1 --2- 172.21.15.22:0/9445772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81435d0 0x7f16c8071de0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16c80b4790 tx=0x7f16b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377914757e78c6aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:40.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.718+0000 7f16c5ffb640 1 -- 172.21.15.22:0/9445772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b802ca80 con 0x7f16c81435d0 2023-11-24T06:12:40.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.718+0000 7f16c5ffb640 1 -- 172.21.15.22:0/9445772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b802cbe0 con 0x7f16c81435d0 2023-11-24T06:12:40.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.718+0000 7f16c5ffb640 1 -- 172.21.15.22:0/9445772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80343f0 con 0x7f16c81435d0 2023-11-24T06:12:40.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.719+0000 7f16c7fff640 1 -- 172.21.15.22:0/9445772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81435d0 msgr2=0x7f16c8071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.719+0000 7f16c7fff640 1 --2- 172.21.15.22:0/9445772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81435d0 0x7f16c8071de0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16c80b4790 tx=0x7f16b802bee0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.719+0000 7f16c7fff640 1 -- 172.21.15.22:0/9445772 shutdown_connections 2023-11-24T06:12:40.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.719+0000 7f16c7fff640 1 --2- 172.21.15.22:0/9445772 >> v2:172.21.15.31:3300/0 conn(0x7f16c80b4140 0x7f16c8070050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.719+0000 7f16c7fff640 1 --2- 172.21.15.22:0/9445772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81435d0 0x7f16c8071de0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.719+0000 7f16c7fff640 1 -- 172.21.15.22:0/9445772 >> 172.21.15.22:0/9445772 conn(0x7f16c80cec10 msgr2=0x7f16c80cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:40.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.719+0000 7f16c7fff640 1 -- 172.21.15.22:0/9445772 shutdown_connections 2023-11-24T06:12:40.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.719+0000 7f16c7fff640 1 -- 172.21.15.22:0/9445772 wait complete. 2023-11-24T06:12:40.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.721+0000 7f16c7fff640 1 Processor -- start 2023-11-24T06:12:40.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.721+0000 7f16c7fff640 1 -- start start 2023-11-24T06:12:40.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16c80b4140 0x7f16c815caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16c81435d0 0x7f16c80a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81439b0 0x7f16c80ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c7fff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80ae3e0 con 0x7f16c81439b0 2023-11-24T06:12:40.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c7fff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80acdf0 con 0x7f16c81435d0 2023-11-24T06:12:40.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c7fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8140840 con 0x7f16c80b4140 2023-11-24T06:12:40.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81439b0 0x7f16c80ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81439b0 0x7f16c80ab5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60078/0 (socket says 172.21.15.22:60078) 2023-11-24T06:12:40.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c77fe640 1 -- 172.21.15.22:0/2280217242 learned_addr learned my addr 172.21.15.22:0/2280217242 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.722+0000 7f16c6ffd640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16c80b4140 0x7f16c815caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16c77fe640 1 -- 172.21.15.22:0/2280217242 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16c80b4140 msgr2=0x7f16c815caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16c77fe640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16c80b4140 0x7f16c815caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16c77fe640 1 -- 172.21.15.22:0/2280217242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16c81435d0 msgr2=0x7f16c80a8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16c77fe640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16c81435d0 0x7f16c80a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16c77fe640 1 -- 172.21.15.22:0/2280217242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b8009b30 con 0x7f16c81439b0 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16c77fe640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81439b0 0x7f16c80ab5e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f16c000d800 tx=0x7f16c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16bf7fe640 1 -- 172.21.15.22:0/2280217242 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000b6c0 con 0x7f16c81439b0 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16bf7fe640 1 -- 172.21.15.22:0/2280217242 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c000b840 con 0x7f16c81439b0 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16bf7fe640 1 -- 172.21.15.22:0/2280217242 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000bbf0 con 0x7f16c81439b0 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c8140b20 con 0x7f16c81439b0 2023-11-24T06:12:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.723+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c81410e0 con 0x7f16c81439b0 2023-11-24T06:12:40.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.724+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c804e840 con 0x7f16c81439b0 2023-11-24T06:12:40.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.725+0000 7f16bf7fe640 1 -- 172.21.15.22:0/2280217242 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16c000bd50 con 0x7f16c81439b0 2023-11-24T06:12:40.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.726+0000 7f16bf7fe640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f16a806ae40 0x7f16a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:40.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.726+0000 7f16bf7fe640 1 -- 172.21.15.22:0/2280217242 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16c0089bb0 con 0x7f16c81439b0 2023-11-24T06:12:40.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.727+0000 7f16c6ffd640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f16a806ae40 0x7f16a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:40.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.727+0000 7f16c6ffd640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f16a806ae40 0x7f16a806d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f16b8035000 tx=0x7f16b8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:40.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.731+0000 7f16bf7fe640 1 -- 172.21.15.22:0/2280217242 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16c0054c50 con 0x7f16c81439b0 2023-11-24T06:12:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.925+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16c80b1640 con 0x7f16c81439b0 2023-11-24T06:12:40.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.926+0000 7f16bf7fe640 1 -- 172.21.15.22:0/2280217242 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16c0058270 con 0x7f16c81439b0 2023-11-24T06:12:40.929 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f16a806ae40 msgr2=0x7f16a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f16a806ae40 0x7f16a806d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f16b8035000 tx=0x7f16b8030000 comp rx=0 tx=0).stop 2023-11-24T06:12:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81439b0 msgr2=0x7f16c80ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81439b0 0x7f16c80ab5e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f16c000d800 tx=0x7f16c000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 shutdown_connections 2023-11-24T06:12:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f16a806ae40 0x7f16a806d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16c81439b0 0x7f16c80ab5e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16c81435d0 0x7f16c80a8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 --2- 172.21.15.22:0/2280217242 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16c80b4140 0x7f16c815caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 >> 172.21.15.22:0/2280217242 conn(0x7f16c80cec10 msgr2=0x7f16c80b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 shutdown_connections 2023-11-24T06:12:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:40.929+0000 7f16c7fff640 1 -- 172.21.15.22:0/2280217242 wait complete. 2023-11-24T06:12:40.952 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:41.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.175+0000 7f9c6080e640 1 Processor -- start 2023-11-24T06:12:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.175+0000 7f9c6080e640 1 -- start start 2023-11-24T06:12:41.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.176+0000 7f9c6080e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c5c160bd0 0x7f9c5c0b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.176+0000 7f9c6080e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c5c0b3210 0x7f9c5c167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.176+0000 7f9c6080e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c0b23e0 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.176+0000 7f9c6080e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cdc70 con 0x7f9c5c160bd0 2023-11-24T06:12:41.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.176+0000 7f9c6080e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b2870 con 0x7f9c5c0b3210 2023-11-24T06:12:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.176+0000 7f9c5a59c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c5c160bd0 0x7f9c5c0b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.177+0000 7f9c5a59c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c5c160bd0 0x7f9c5c0b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52998/0 (socket says 172.21.15.22:52998) 2023-11-24T06:12:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.177+0000 7f9c5a59c640 1 -- 172.21.15.22:0/2448420367 learned_addr learned my addr 172.21.15.22:0/2448420367 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.177+0000 7f9c5a59c640 1 -- 172.21.15.22:0/2448420367 >> v2:172.21.15.31:3300/0 conn(0x7f9c5c0b3210 msgr2=0x7f9c5c167290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.177+0000 7f9c5a59c640 1 --2- 172.21.15.22:0/2448420367 >> v2:172.21.15.31:3300/0 conn(0x7f9c5c0b3210 0x7f9c5c167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.177+0000 7f9c5a59c640 1 -- 172.21.15.22:0/2448420367 >> v1:172.21.15.31:6789/0 conn(0x7f9c5c0b48d0 legacy=0x7f9c5c0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.177+0000 7f9c5a59c640 1 -- 172.21.15.22:0/2448420367 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c0d41b0 con 0x7f9c5c160bd0 2023-11-24T06:12:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.178+0000 7f9c5a59c640 1 --2- 172.21.15.22:0/2448420367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c160bd0 0x7f9c5c0b1ea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0d2e10 tx=0x7f9c4c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b27e6254480580 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.179+0000 7f9c5959a640 1 -- 172.21.15.22:0/2448420367 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c02c9f0 con 0x7f9c5c160bd0 2023-11-24T06:12:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.179+0000 7f9c5959a640 1 -- 172.21.15.22:0/2448420367 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c02cb50 con 0x7f9c5c160bd0 2023-11-24T06:12:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.179+0000 7f9c5959a640 1 -- 172.21.15.22:0/2448420367 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c0343f0 con 0x7f9c5c160bd0 2023-11-24T06:12:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.179+0000 7f9c6080e640 1 -- 172.21.15.22:0/2448420367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c160bd0 msgr2=0x7f9c5c0b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.179+0000 7f9c6080e640 1 --2- 172.21.15.22:0/2448420367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c160bd0 0x7f9c5c0b1ea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0d2e10 tx=0x7f9c4c02be50 comp rx=0 tx=0).stop 2023-11-24T06:12:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.180+0000 7f9c6080e640 1 -- 172.21.15.22:0/2448420367 shutdown_connections 2023-11-24T06:12:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.180+0000 7f9c6080e640 1 --2- 172.21.15.22:0/2448420367 >> v2:172.21.15.31:3300/0 conn(0x7f9c5c0b3210 0x7f9c5c167290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.180+0000 7f9c6080e640 1 --2- 172.21.15.22:0/2448420367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c160bd0 0x7f9c5c0b1ea0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.180+0000 7f9c6080e640 1 -- 172.21.15.22:0/2448420367 >> 172.21.15.22:0/2448420367 conn(0x7f9c5c09c5a0 msgr2=0x7f9c5c0d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.180+0000 7f9c6080e640 1 -- 172.21.15.22:0/2448420367 shutdown_connections 2023-11-24T06:12:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.180+0000 7f9c6080e640 1 -- 172.21.15.22:0/2448420367 wait complete. 2023-11-24T06:12:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.181+0000 7f9c6080e640 1 Processor -- start 2023-11-24T06:12:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.182+0000 7f9c6080e640 1 -- start start 2023-11-24T06:12:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c6080e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c5c0b3210 0x7f9c5c0b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c6080e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c0b48d0 0x7f9c5c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c6080e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c5c160bd0 0x7f9c5c0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c6080e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b8070 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c6080e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b73f0 con 0x7f9c5c0b3210 2023-11-24T06:12:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c6080e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b76d0 con 0x7f9c5c160bd0 2023-11-24T06:12:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c59d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c0b48d0 0x7f9c5c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c59d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c0b48d0 0x7f9c5c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53006/0 (socket says 172.21.15.22:53006) 2023-11-24T06:12:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c59d9b640 1 -- 172.21.15.22:0/4266361193 learned_addr learned my addr 172.21.15.22:0/4266361193 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c59d9b640 1 -- 172.21.15.22:0/4266361193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c5c160bd0 msgr2=0x7f9c5c0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.183+0000 7f9c5ad9d640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c5c160bd0 0x7f9c5c0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c59d9b640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c5c160bd0 0x7f9c5c0cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c59d9b640 1 -- 172.21.15.22:0/4266361193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c5c0b3210 msgr2=0x7f9c5c0b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c5a59c640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c5c0b3210 0x7f9c5c0b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c59d9b640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c5c0b3210 0x7f9c5c0b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c59d9b640 1 -- 172.21.15.22:0/4266361193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009b30 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c59d9b640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c0b48d0 0x7f9c5c15d430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c3c0 tx=0x7f9c4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c52ffd640 1 -- 172.21.15.22:0/4266361193 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44016070 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c52ffd640 1 -- 172.21.15.22:0/4266361193 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44007020 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c52ffd640 1 -- 172.21.15.22:0/4266361193 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440073d0 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c0b79b0 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.184+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c15d970 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.185+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c0a1210 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.187+0000 7f9c52ffd640 1 -- 172.21.15.22:0/4266361193 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c44007530 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.187+0000 7f9c52ffd640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c3c06ae40 0x7f9c3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.188+0000 7f9c52ffd640 1 -- 172.21.15.22:0/4266361193 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c44088ec0 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.188+0000 7f9c5a59c640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c3c06ae40 0x7f9c3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.189+0000 7f9c5a59c640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c3c06ae40 0x7f9c3c06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c035000 tx=0x7f9c4c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.193+0000 7f9c52ffd640 1 -- 172.21.15.22:0/4266361193 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c44053f60 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.387+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c5c04e920 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.388+0000 7f9c52ffd640 1 -- 172.21.15.22:0/4266361193 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c44057580 con 0x7f9c5c0b48d0 2023-11-24T06:12:41.391 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c3c06ae40 msgr2=0x7f9c3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c3c06ae40 0x7f9c3c06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c035000 tx=0x7f9c4c030000 comp rx=0 tx=0).stop 2023-11-24T06:12:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c0b48d0 msgr2=0x7f9c5c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c0b48d0 0x7f9c5c15d430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c3c0 tx=0x7f9c4400c880 comp rx=0 tx=0).stop 2023-11-24T06:12:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 shutdown_connections 2023-11-24T06:12:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c3c06ae40 0x7f9c3c06d300 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c035000 tx=0x7f9c4c030000 comp rx=0 tx=0).stop 2023-11-24T06:12:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c5c160bd0 0x7f9c5c0cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5c0b48d0 0x7f9c5c15d430 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 --2- 172.21.15.22:0/4266361193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c5c0b3210 0x7f9c5c0b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 >> 172.21.15.22:0/4266361193 conn(0x7f9c5c09c5a0 msgr2=0x7f9c5c0d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:41.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 shutdown_connections 2023-11-24T06:12:41.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.392+0000 7f9c6080e640 1 -- 172.21.15.22:0/4266361193 wait complete. 2023-11-24T06:12:41.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:41.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.637+0000 7f045dae1640 1 Processor -- start 2023-11-24T06:12:41.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.637+0000 7f045dae1640 1 -- start start 2023-11-24T06:12:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.639+0000 7f045dae1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04580b2eb0 0x7f04581618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.639+0000 7f045dae1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580714e0 0x7f045815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.639+0000 7f045dae1640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04580b3290 con 0x7f045815d800 2023-11-24T06:12:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.639+0000 7f045dae1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045815e350 con 0x7f04580b2eb0 2023-11-24T06:12:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.639+0000 7f045dae1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045815e630 con 0x7f04580714e0 2023-11-24T06:12:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.639+0000 7f0457fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f045815d800 0x7f0458070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49870/0 (socket says 172.21.15.22:49870) 2023-11-24T06:12:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.639+0000 7f0457fff640 1 -- 172.21.15.22:0/3609722688 learned_addr learned my addr 172.21.15.22:0/3609722688 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f045d2e0640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580714e0 0x7f045815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f045cadf640 1 --2- 172.21.15.22:0/3609722688 >> v2:172.21.15.31:3300/0 conn(0x7f04580b2eb0 0x7f04581618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502405479 0 0) 0x7f04580b3290 con 0x7f045815d800 2023-11-24T06:12:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0448003520 con 0x7f045815d800 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 857101141 0 0) 0x7f0448003520 con 0x7f045815d800 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580714e0 msgr2=0x7f045815dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580714e0 0x7f045815dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 >> v2:172.21.15.31:3300/0 conn(0x7f04580b2eb0 msgr2=0x7f04581618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 --2- 172.21.15.22:0/3609722688 >> v2:172.21.15.31:3300/0 conn(0x7f04580b2eb0 0x7f04581618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458160df0 con 0x7f045815d800 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f0444001670 con 0x7f045815d800 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 >> v1:172.21.15.22:6789/0 conn(0x7f045815d800 legacy=0x7f0458070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.640+0000 7f04577fe640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04480039e0 0x7f0448003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f04577fe640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04480047c0 0x7f0448004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f04577fe640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580714e0 0x7f0448005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045815e350 con 0x7f04480047c0 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045815e630 con 0x7f04480039e0 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044800b9d0 con 0x7f04580714e0 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f0457fff640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04480047c0 0x7f0448004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f0457fff640 1 -- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580714e0 msgr2=0x7f0448005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f045d2e0640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580714e0 0x7f0448005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f0457fff640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580714e0 0x7f0448005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f0457fff640 1 -- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04480039e0 msgr2=0x7f0448003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f045cadf640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04480039e0 0x7f0448003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f0457fff640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04480039e0 0x7f0448003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.641+0000 7f0457fff640 1 -- 172.21.15.22:0/3609722688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448003520 con 0x7f04480047c0 2023-11-24T06:12:41.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.643+0000 7f0457fff640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04480047c0 0x7f0448004c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f044400c190 tx=0x7f04480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752d50f48f88449d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:41.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.643+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444005ad0 con 0x7f04480047c0 2023-11-24T06:12:41.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.643+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0444005c30 con 0x7f04480047c0 2023-11-24T06:12:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.643+0000 7f04577fe640 1 -- 172.21.15.22:0/3609722688 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044402c810 con 0x7f04480047c0 2023-11-24T06:12:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.643+0000 7f045dae1640 1 -- 172.21.15.22:0/3609722688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04480047c0 msgr2=0x7f0448004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.643+0000 7f045dae1640 1 --2- 172.21.15.22:0/3609722688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04480047c0 0x7f0448004c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f044400c190 tx=0x7f04480057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.643+0000 7f045d2e0640 1 -- 172.21.15.22:0/3609722688 reap_dead start 2023-11-24T06:12:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.644+0000 7f045dae1640 1 -- 172.21.15.22:0/3609722688 shutdown_connections 2023-11-24T06:12:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.644+0000 7f045dae1640 1 -- 172.21.15.22:0/3609722688 >> 172.21.15.22:0/3609722688 conn(0x7f04580b15c0 msgr2=0x7f04580b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.644+0000 7f045dae1640 1 -- 172.21.15.22:0/3609722688 shutdown_connections 2023-11-24T06:12:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.644+0000 7f045dae1640 1 -- 172.21.15.22:0/3609722688 wait complete. 2023-11-24T06:12:41.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.645+0000 7f045dae1640 1 Processor -- start 2023-11-24T06:12:41.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.645+0000 7f045dae1640 1 -- start start 2023-11-24T06:12:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.646+0000 7f045dae1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04480047c0 0x7f04581470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.646+0000 7f045dae1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04580cc9c0 0x7f04580cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.646+0000 7f045dae1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580ad7a0 0x7f04580adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.646+0000 7f045dae1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04580ae160 con 0x7f04580cc9c0 2023-11-24T06:12:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.646+0000 7f045dae1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04580cd990 con 0x7f04480047c0 2023-11-24T06:12:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.646+0000 7f045dae1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04580cdc70 con 0x7f04580ad7a0 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f0457fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04580cc9c0 0x7f04580cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f0457fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04580cc9c0 0x7f04580cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53032/0 (socket says 172.21.15.22:53032) 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f0457fff640 1 -- 172.21.15.22:0/3508338744 learned_addr learned my addr 172.21.15.22:0/3508338744 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f045d2e0640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580ad7a0 0x7f04580adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f045cadf640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04480047c0 0x7f04581470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f0457fff640 1 -- 172.21.15.22:0/3508338744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580ad7a0 msgr2=0x7f04580adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f0457fff640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580ad7a0 0x7f04580adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f0457fff640 1 -- 172.21.15.22:0/3508338744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04480047c0 msgr2=0x7f04581470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f0457fff640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04480047c0 0x7f04581470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.647+0000 7f0457fff640 1 -- 172.21.15.22:0/3508338744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04580cdf50 con 0x7f04580cc9c0 2023-11-24T06:12:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.648+0000 7f0457fff640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04580cc9c0 0x7f04580cd090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f044402c3b0 tx=0x7f0444000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:41.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.648+0000 7f04557fa640 1 -- 172.21.15.22:0/3508338744 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444039070 con 0x7f04580cc9c0 2023-11-24T06:12:41.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.648+0000 7f04557fa640 1 -- 172.21.15.22:0/3508338744 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044402cc20 con 0x7f04580cc9c0 2023-11-24T06:12:41.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.648+0000 7f04557fa640 1 -- 172.21.15.22:0/3508338744 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044403c040 con 0x7f04580cc9c0 2023-11-24T06:12:41.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.648+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04580ce230 con 0x7f04580cc9c0 2023-11-24T06:12:41.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.648+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04580cea30 con 0x7f04580cc9c0 2023-11-24T06:12:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.650+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04580cddb0 con 0x7f04580cc9c0 2023-11-24T06:12:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.650+0000 7f04557fa640 1 -- 172.21.15.22:0/3508338744 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0444032070 con 0x7f04580cc9c0 2023-11-24T06:12:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.651+0000 7f04557fa640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f043c06ae70 0x7f043c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.651+0000 7f04557fa640 1 -- 172.21.15.22:0/3508338744 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f04440aaa20 con 0x7f04580cc9c0 2023-11-24T06:12:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.652+0000 7f045cadf640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f043c06ae70 0x7f043c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.652+0000 7f045cadf640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f043c06ae70 0x7f043c06d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f044c009a90 tx=0x7f044c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:41.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.655+0000 7f04557fa640 1 -- 172.21.15.22:0/3508338744 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04580cddb0 con 0x7f04580cc9c0 2023-11-24T06:12:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.848+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04580cddb0 con 0x7f04580cc9c0 2023-11-24T06:12:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.849+0000 7f04557fa640 1 -- 172.21.15.22:0/3508338744 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04580cddb0 con 0x7f04580cc9c0 2023-11-24T06:12:41.852 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:41.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f043c06ae70 msgr2=0x7f043c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f043c06ae70 0x7f043c06d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f044c009a90 tx=0x7f044c008040 comp rx=0 tx=0).stop 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04580cc9c0 msgr2=0x7f04580cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04580cc9c0 0x7f04580cd090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f044402c3b0 tx=0x7f0444000fe0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 shutdown_connections 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f043c06ae70 0x7f043c06d330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04580ad7a0 0x7f04580adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04580cc9c0 0x7f04580cd090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 --2- 172.21.15.22:0/3508338744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04480047c0 0x7f04581470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.851+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 >> 172.21.15.22:0/3508338744 conn(0x7f04580b15c0 msgr2=0x7f0458070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.852+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 shutdown_connections 2023-11-24T06:12:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:41.852+0000 7f045dae1640 1 -- 172.21.15.22:0/3508338744 wait complete. 2023-11-24T06:12:41.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:42.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.084+0000 7fdf2bfff640 1 Processor -- start 2023-11-24T06:12:42.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.084+0000 7fdf2bfff640 1 -- start start 2023-11-24T06:12:42.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.086+0000 7fdf2bfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdf2c13dfd0 0x7fdf2c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.086+0000 7fdf2bfff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c0ce7c0 con 0x7fdf2c0cf500 2023-11-24T06:12:42.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.086+0000 7fdf2bfff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c140900 con 0x7fdf2c0cf050 2023-11-24T06:12:42.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.086+0000 7fdf2bfff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c06cf50 con 0x7fdf2c13dfd0 2023-11-24T06:12:42.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.086+0000 7fdf2affd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdf2c13dfd0 0x7fdf2c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.086+0000 7fdf2b7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdf2c0cf500 0x7fdf2c06c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49876/0 (socket says 172.21.15.22:49876) 2023-11-24T06:12:42.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.087+0000 7fdf2b7fe640 1 -- 172.21.15.22:0/3669400093 learned_addr learned my addr 172.21.15.22:0/3669400093 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:42.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.087+0000 7fdf29ffb640 1 -- 172.21.15.22:0/3669400093 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600536915 0 0) 0x7fdf2c0ce7c0 con 0x7fdf2c0cf500 2023-11-24T06:12:42.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.087+0000 7fdf29ffb640 1 -- 172.21.15.22:0/3669400093 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf14003520 con 0x7fdf2c0cf500 2023-11-24T06:12:42.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.087+0000 7fdf2affd640 1 -- 172.21.15.22:0/3669400093 >> v1:172.21.15.31:6789/0 conn(0x7fdf2c0cf050 legacy=0x7fdf2c06c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.087+0000 7fdf2affd640 1 -- 172.21.15.22:0/3669400093 >> v1:172.21.15.22:6789/0 conn(0x7fdf2c0cf500 legacy=0x7fdf2c06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.087+0000 7fdf2affd640 1 -- 172.21.15.22:0/3669400093 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c15fa70 con 0x7fdf2c13dfd0 2023-11-24T06:12:42.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.089+0000 7fdf2affd640 1 --2- 172.21.15.22:0/3669400093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c13dfd0 0x7fdf2c15be70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0097a0 tx=0x7fdf1c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3665052ceada411a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:42.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf29ffb640 1 -- 172.21.15.22:0/3669400093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c030610 con 0x7fdf2c13dfd0 2023-11-24T06:12:42.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf29ffb640 1 -- 172.21.15.22:0/3669400093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c030770 con 0x7fdf2c13dfd0 2023-11-24T06:12:42.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf29ffb640 1 -- 172.21.15.22:0/3669400093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c030b00 con 0x7fdf2c13dfd0 2023-11-24T06:12:42.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf2bfff640 1 -- 172.21.15.22:0/3669400093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c13dfd0 msgr2=0x7fdf2c15be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf2bfff640 1 --2- 172.21.15.22:0/3669400093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c13dfd0 0x7fdf2c15be70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0097a0 tx=0x7fdf1c02b960 comp rx=0 tx=0).stop 2023-11-24T06:12:42.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf2bfff640 1 -- 172.21.15.22:0/3669400093 shutdown_connections 2023-11-24T06:12:42.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf2bfff640 1 --2- 172.21.15.22:0/3669400093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c13dfd0 0x7fdf2c15be70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf2bfff640 1 -- 172.21.15.22:0/3669400093 >> 172.21.15.22:0/3669400093 conn(0x7fdf2c06a860 msgr2=0x7fdf2c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:42.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf2bfff640 1 -- 172.21.15.22:0/3669400093 shutdown_connections 2023-11-24T06:12:42.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.090+0000 7fdf2bfff640 1 -- 172.21.15.22:0/3669400093 wait complete. 2023-11-24T06:12:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.092+0000 7fdf2bfff640 1 Processor -- start 2023-11-24T06:12:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.092+0000 7fdf2bfff640 1 -- start start 2023-11-24T06:12:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.093+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c0cf050 0x7fdf2c1f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.093+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf2c0cf500 0x7fdf2c0ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.093+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf2c13c7d0 0x7fdf2c0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.093+0000 7fdf2bfff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0705e0 con 0x7fdf2c0cf050 2023-11-24T06:12:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.093+0000 7fdf2bfff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0b3a80 con 0x7fdf2c13c7d0 2023-11-24T06:12:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.093+0000 7fdf2bfff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c15ac80 con 0x7fdf2c0cf500 2023-11-24T06:12:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c0cf050 0x7fdf2c1f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c0cf050 0x7fdf2c1f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53046/0 (socket says 172.21.15.22:53046) 2023-11-24T06:12:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2affd640 1 -- 172.21.15.22:0/1049920456 learned_addr learned my addr 172.21.15.22:0/1049920456 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2a7fc640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf2c0cf500 0x7fdf2c0ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2b7fe640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf2c13c7d0 0x7fdf2c0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2affd640 1 -- 172.21.15.22:0/1049920456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf2c0cf500 msgr2=0x7fdf2c0ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2affd640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf2c0cf500 0x7fdf2c0ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2affd640 1 -- 172.21.15.22:0/1049920456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf2c13c7d0 msgr2=0x7fdf2c0adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2affd640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf2c13c7d0 0x7fdf2c0adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.094+0000 7fdf2affd640 1 -- 172.21.15.22:0/1049920456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c009400 con 0x7fdf2c0cf050 2023-11-24T06:12:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.095+0000 7fdf2affd640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c0cf050 0x7fdf2c1f2ce0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c02bf70 tx=0x7fdf1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.095+0000 7fdf13fff640 1 -- 172.21.15.22:0/1049920456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c03e040 con 0x7fdf2c0cf050 2023-11-24T06:12:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.095+0000 7fdf13fff640 1 -- 172.21.15.22:0/1049920456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c039c10 con 0x7fdf2c0cf050 2023-11-24T06:12:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.095+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c15a6c0 con 0x7fdf2c0cf050 2023-11-24T06:12:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.095+0000 7fdf13fff640 1 -- 172.21.15.22:0/1049920456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c030e10 con 0x7fdf2c0cf050 2023-11-24T06:12:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.095+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c070200 con 0x7fdf2c0cf050 2023-11-24T06:12:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.096+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c04e840 con 0x7fdf2c0cf050 2023-11-24T06:12:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.097+0000 7fdf13fff640 1 -- 172.21.15.22:0/1049920456 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf1c0423e0 con 0x7fdf2c0cf050 2023-11-24T06:12:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.098+0000 7fdf13fff640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdf1806ae40 0x7fdf1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.098+0000 7fdf13fff640 1 -- 172.21.15.22:0/1049920456 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fdf1c0ab790 con 0x7fdf2c0cf050 2023-11-24T06:12:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.098+0000 7fdf2a7fc640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdf1806ae40 0x7fdf1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.099+0000 7fdf2a7fc640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdf1806ae40 0x7fdf1806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c15e860 tx=0x7fdf20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.103+0000 7fdf13fff640 1 -- 172.21.15.22:0/1049920456 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf1c0767a0 con 0x7fdf2c0cf050 2023-11-24T06:12:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.299+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf2c156fd0 con 0x7fdf2c0cf050 2023-11-24T06:12:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.302+0000 7fdf13fff640 1 -- 172.21.15.22:0/1049920456 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16753 (secure 0 0 0) 0x7fdf1c079dc0 con 0x7fdf2c0cf050 2023-11-24T06:12:42.306 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:42.306 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:41.387729+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.304+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdf1806ae40 msgr2=0x7fdf1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.304+0000 7fdf2bfff640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdf1806ae40 0x7fdf1806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c15e860 tx=0x7fdf20009040 comp rx=0 tx=0).stop 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.304+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c0cf050 msgr2=0x7fdf2c1f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.304+0000 7fdf2bfff640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c0cf050 0x7fdf2c1f2ce0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c02bf70 tx=0x7fdf1c004730 comp rx=0 tx=0).stop 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.305+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 shutdown_connections 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.305+0000 7fdf2bfff640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdf1806ae40 0x7fdf1806d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.305+0000 7fdf2bfff640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf2c13c7d0 0x7fdf2c0adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.305+0000 7fdf2bfff640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdf2c0cf500 0x7fdf2c0ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.305+0000 7fdf2bfff640 1 --2- 172.21.15.22:0/1049920456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf2c0cf050 0x7fdf2c1f2ce0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.305+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 >> 172.21.15.22:0/1049920456 conn(0x7fdf2c06a860 msgr2=0x7fdf2c13f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.305+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 shutdown_connections 2023-11-24T06:12:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.305+0000 7fdf2bfff640 1 -- 172.21.15.22:0/1049920456 wait complete. 2023-11-24T06:12:42.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:42.326 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.557+0000 7fea832ee640 1 Processor -- start 2023-11-24T06:12:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.557+0000 7fea832ee640 1 -- start start 2023-11-24T06:12:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.558+0000 7fea832ee640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fea7c160bd0 0x7fea7c0b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.558+0000 7fea832ee640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fea7c0b48d0 0x7fea7c0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.558+0000 7fea832ee640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b3040 0x7fea7c166280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.558+0000 7fea832ee640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7c0cdc70 con 0x7fea7c0b48d0 2023-11-24T06:12:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.558+0000 7fea832ee640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7c0b2870 con 0x7fea7c160bd0 2023-11-24T06:12:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.558+0000 7fea832ee640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0b23e0 con 0x7fea7c0b3040 2023-11-24T06:12:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea80889640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fea7c0b48d0 0x7fea7c0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea80889640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fea7c0b48d0 0x7fea7c0b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53054/0 (socket says 172.21.15.22:53054) 2023-11-24T06:12:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea80889640 1 -- 172.21.15.22:0/3721563522 learned_addr learned my addr 172.21.15.22:0/3721563522 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea8188b640 1 --2- 172.21.15.22:0/3721563522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b3040 0x7fea7c166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea8108a640 1 --2- 172.21.15.22:0/3721563522 >> v2:172.21.15.31:3300/0 conn(0x7fea7c160bd0 0x7fea7c0b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea80889640 1 -- 172.21.15.22:0/3721563522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b3040 msgr2=0x7fea7c166280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea80889640 1 --2- 172.21.15.22:0/3721563522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b3040 0x7fea7c166280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea80889640 1 -- 172.21.15.22:0/3721563522 >> v2:172.21.15.31:3300/0 conn(0x7fea7c160bd0 msgr2=0x7fea7c0b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea80889640 1 --2- 172.21.15.22:0/3721563522 >> v2:172.21.15.31:3300/0 conn(0x7fea7c160bd0 0x7fea7c0b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.559+0000 7fea80889640 1 -- 172.21.15.22:0/3721563522 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c0d41b0 con 0x7fea7c0b48d0 2023-11-24T06:12:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.560+0000 7fea80889640 1 --2- 172.21.15.22:0/3721563522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c0b48d0 0x7fea7c0b2b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0cda60 tx=0x7fea6802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a0e3b1a90747f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.561+0000 7fea7bfff640 1 -- 172.21.15.22:0/3721563522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea680317e0 con 0x7fea7c0b48d0 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.561+0000 7fea7bfff640 1 -- 172.21.15.22:0/3721563522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea68031940 con 0x7fea7c0b48d0 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.561+0000 7fea7bfff640 1 -- 172.21.15.22:0/3721563522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea68031cd0 con 0x7fea7c0b48d0 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.561+0000 7fea832ee640 1 -- 172.21.15.22:0/3721563522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c0b48d0 msgr2=0x7fea7c0b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.561+0000 7fea832ee640 1 --2- 172.21.15.22:0/3721563522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c0b48d0 0x7fea7c0b2b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0cda60 tx=0x7fea6802b880 comp rx=0 tx=0).stop 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.561+0000 7fea832ee640 1 -- 172.21.15.22:0/3721563522 shutdown_connections 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.561+0000 7fea832ee640 1 --2- 172.21.15.22:0/3721563522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b3040 0x7fea7c166280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.561+0000 7fea832ee640 1 --2- 172.21.15.22:0/3721563522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c0b48d0 0x7fea7c0b2b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.561+0000 7fea832ee640 1 --2- 172.21.15.22:0/3721563522 >> v2:172.21.15.31:3300/0 conn(0x7fea7c160bd0 0x7fea7c0b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.562+0000 7fea832ee640 1 -- 172.21.15.22:0/3721563522 >> 172.21.15.22:0/3721563522 conn(0x7fea7c09c5a0 msgr2=0x7fea7c0d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.562+0000 7fea832ee640 1 -- 172.21.15.22:0/3721563522 shutdown_connections 2023-11-24T06:12:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.562+0000 7fea832ee640 1 -- 172.21.15.22:0/3721563522 wait complete. 2023-11-24T06:12:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.563+0000 7fea832ee640 1 Processor -- start 2023-11-24T06:12:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.564+0000 7fea832ee640 1 -- start start 2023-11-24T06:12:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea832ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea7c0b3040 0x7fea7c0ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea832ee640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b48d0 0x7fea7c14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea832ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c160bd0 0x7fea7c14d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea832ee640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c150370 con 0x7fea7c160bd0 2023-11-24T06:12:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea832ee640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0c7ed0 con 0x7fea7c0b3040 2023-11-24T06:12:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea832ee640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0cd1f0 con 0x7fea7c0b48d0 2023-11-24T06:12:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea8188b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c160bd0 0x7fea7c14d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea8188b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c160bd0 0x7fea7c14d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53066/0 (socket says 172.21.15.22:53066) 2023-11-24T06:12:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea8188b640 1 -- 172.21.15.22:0/3910257147 learned_addr learned my addr 172.21.15.22:0/3910257147 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:42.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea8108a640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea7c0b3040 0x7fea7c0ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea80889640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b48d0 0x7fea7c14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea8188b640 1 -- 172.21.15.22:0/3910257147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b48d0 msgr2=0x7fea7c14d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.565+0000 7fea8188b640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b48d0 0x7fea7c14d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.566+0000 7fea8188b640 1 -- 172.21.15.22:0/3910257147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea7c0b3040 msgr2=0x7fea7c0ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.566+0000 7fea8188b640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea7c0b3040 0x7fea7c0ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.566+0000 7fea8188b640 1 -- 172.21.15.22:0/3910257147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680094d0 con 0x7fea7c160bd0 2023-11-24T06:12:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.566+0000 7fea8188b640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c160bd0 0x7fea7c14d800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea7400d830 tx=0x7fea7400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.566+0000 7fea79ffb640 1 -- 172.21.15.22:0/3910257147 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea740096c0 con 0x7fea7c160bd0 2023-11-24T06:12:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.566+0000 7fea79ffb640 1 -- 172.21.15.22:0/3910257147 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea74009840 con 0x7fea7c160bd0 2023-11-24T06:12:42.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.566+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7c0cd4d0 con 0x7fea7c160bd0 2023-11-24T06:12:42.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.566+0000 7fea79ffb640 1 -- 172.21.15.22:0/3910257147 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74009bf0 con 0x7fea7c160bd0 2023-11-24T06:12:42.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.566+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c0cd7b0 con 0x7fea7c160bd0 2023-11-24T06:12:42.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.568+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7c0c8380 con 0x7fea7c160bd0 2023-11-24T06:12:42.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.568+0000 7fea79ffb640 1 -- 172.21.15.22:0/3910257147 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea74014410 con 0x7fea7c160bd0 2023-11-24T06:12:42.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.569+0000 7fea79ffb640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6006ae40 0x7fea6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:42.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.570+0000 7fea79ffb640 1 -- 172.21.15.22:0/3910257147 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fea7408a020 con 0x7fea7c160bd0 2023-11-24T06:12:42.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.570+0000 7fea8108a640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6006ae40 0x7fea6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:42.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.571+0000 7fea8108a640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6006ae40 0x7fea6006d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea700099c0 tx=0x7fea70003990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:42.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.574+0000 7fea79ffb640 1 -- 172.21.15.22:0/3910257147 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea74054fa0 con 0x7fea7c160bd0 2023-11-24T06:12:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.768+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea7c0a1210 con 0x7fea7c160bd0 2023-11-24T06:12:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.769+0000 7fea79ffb640 1 -- 172.21.15.22:0/3910257147 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea740180a0 con 0x7fea7c160bd0 2023-11-24T06:12:42.772 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:42.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6006ae40 msgr2=0x7fea6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6006ae40 0x7fea6006d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea700099c0 tx=0x7fea70003990 comp rx=0 tx=0).stop 2023-11-24T06:12:42.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c160bd0 msgr2=0x7fea7c14d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:42.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c160bd0 0x7fea7c14d800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea7400d830 tx=0x7fea7400dcf0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 shutdown_connections 2023-11-24T06:12:42.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6006ae40 0x7fea6006d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c160bd0 0x7fea7c14d800 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea7c0b48d0 0x7fea7c14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 --2- 172.21.15.22:0/3910257147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea7c0b3040 0x7fea7c0ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.771+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 >> 172.21.15.22:0/3910257147 conn(0x7fea7c09c5a0 msgr2=0x7fea7c0b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.772+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 shutdown_connections 2023-11-24T06:12:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:42.772+0000 7fea832ee640 1 -- 172.21.15.22:0/3910257147 wait complete. 2023-11-24T06:12:42.794 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:43.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.023+0000 7faff5809640 1 Processor -- start 2023-11-24T06:12:43.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.024+0000 7faff5809640 1 -- start start 2023-11-24T06:12:43.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.025+0000 7faff5809640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faff00d1d90 0x7faff00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.025+0000 7faff5809640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faff00d0fa0 0x7faff00b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.025+0000 7faff5809640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff00c6bf0 con 0x7faff015d3b0 2023-11-24T06:12:43.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.025+0000 7faff5809640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff00d13f0 con 0x7faff00d0fa0 2023-11-24T06:12:43.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.025+0000 7faff5809640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff00cedc0 con 0x7faff00d1d90 2023-11-24T06:12:43.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.025+0000 7faff4807640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faff015d3b0 0x7faff00d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49890/0 (socket says 172.21.15.22:49890) 2023-11-24T06:12:43.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.025+0000 7faff4807640 1 -- 172.21.15.22:0/3770649083 learned_addr learned my addr 172.21.15.22:0/3770649083 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:43.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.025+0000 7faff5008640 1 --2- 172.21.15.22:0/3770649083 >> v2:172.21.15.22:3300/0 conn(0x7faff00d0fa0 0x7faff00b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.026+0000 7fafeffff640 1 --2- 172.21.15.22:0/3770649083 >> v2:172.21.15.31:3300/0 conn(0x7faff00d1d90 0x7faff00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.026+0000 7fafef7fe640 1 -- 172.21.15.22:0/3770649083 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734363508 0 0) 0x7faff00c6bf0 con 0x7faff015d3b0 2023-11-24T06:12:43.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.026+0000 7fafef7fe640 1 -- 172.21.15.22:0/3770649083 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafdc003520 con 0x7faff015d3b0 2023-11-24T06:12:43.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.026+0000 7faff5008640 1 -- 172.21.15.22:0/3770649083 >> v2:172.21.15.31:3300/0 conn(0x7faff00d1d90 msgr2=0x7faff00ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:43.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.026+0000 7faff5008640 1 --2- 172.21.15.22:0/3770649083 >> v2:172.21.15.31:3300/0 conn(0x7faff00d1d90 0x7faff00ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.026+0000 7faff5008640 1 -- 172.21.15.22:0/3770649083 >> v1:172.21.15.22:6789/0 conn(0x7faff015d3b0 legacy=0x7faff00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.026+0000 7faff5008640 1 -- 172.21.15.22:0/3770649083 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00c6e40 con 0x7faff00d0fa0 2023-11-24T06:12:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.027+0000 7faff5008640 1 --2- 172.21.15.22:0/3770649083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff00d0fa0 0x7faff00b3ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faff00ca100 tx=0x7fafe802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971a6dc833d3bbff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.027+0000 7fafef7fe640 1 -- 172.21.15.22:0/3770649083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe802e070 con 0x7faff00d0fa0 2023-11-24T06:12:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.027+0000 7fafef7fe640 1 -- 172.21.15.22:0/3770649083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80315a0 con 0x7faff00d0fa0 2023-11-24T06:12:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.027+0000 7fafef7fe640 1 -- 172.21.15.22:0/3770649083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8031930 con 0x7faff00d0fa0 2023-11-24T06:12:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.028+0000 7faff5809640 1 -- 172.21.15.22:0/3770649083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff00d0fa0 msgr2=0x7faff00b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.028+0000 7faff5809640 1 --2- 172.21.15.22:0/3770649083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff00d0fa0 0x7faff00b3ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faff00ca100 tx=0x7fafe802b840 comp rx=0 tx=0).stop 2023-11-24T06:12:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.028+0000 7faff5809640 1 -- 172.21.15.22:0/3770649083 shutdown_connections 2023-11-24T06:12:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.028+0000 7faff5809640 1 --2- 172.21.15.22:0/3770649083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff00d0fa0 0x7faff00b3ca0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.028+0000 7faff5809640 1 --2- 172.21.15.22:0/3770649083 >> v2:172.21.15.31:3300/0 conn(0x7faff00d1d90 0x7faff00ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.028+0000 7faff5809640 1 -- 172.21.15.22:0/3770649083 >> 172.21.15.22:0/3770649083 conn(0x7faff00d30a0 msgr2=0x7faff00d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.028+0000 7faff5809640 1 -- 172.21.15.22:0/3770649083 shutdown_connections 2023-11-24T06:12:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.028+0000 7faff5809640 1 -- 172.21.15.22:0/3770649083 wait complete. 2023-11-24T06:12:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.030+0000 7faff5809640 1 Processor -- start 2023-11-24T06:12:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.030+0000 7faff5809640 1 -- start start 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.031+0000 7faff5809640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faff00d0fa0 0x7faff00b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.031+0000 7faff5809640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faff00d1d90 0x7faff01601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.031+0000 7faff5809640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff015d3b0 0x7faff01503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.031+0000 7faff5809640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff015eed0 con 0x7faff015d3b0 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.031+0000 7faff5809640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff015f120 con 0x7faff00d0fa0 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.031+0000 7faff5809640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff015f400 con 0x7faff00d1d90 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.031+0000 7faff5008640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff015d3b0 0x7faff01503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.031+0000 7faff5008640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff015d3b0 0x7faff01503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53092/0 (socket says 172.21.15.22:53092) 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.031+0000 7faff5008640 1 -- 172.21.15.22:0/1733947696 learned_addr learned my addr 172.21.15.22:0/1733947696 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.032+0000 7fafeffff640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faff00d1d90 0x7faff01601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.032+0000 7faff5008640 1 -- 172.21.15.22:0/1733947696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faff00d1d90 msgr2=0x7faff01601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.032+0000 7faff5008640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faff00d1d90 0x7faff01601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.032+0000 7faff5008640 1 -- 172.21.15.22:0/1733947696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faff00d0fa0 msgr2=0x7faff00b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.032+0000 7faff5008640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faff00d0fa0 0x7faff00b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.032+0000 7faff5008640 1 -- 172.21.15.22:0/1733947696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8009400 con 0x7faff015d3b0 2023-11-24T06:12:43.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.032+0000 7faff5008640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff015d3b0 0x7faff01503e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009890 tx=0x7fafe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:43.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.032+0000 7fafed7fa640 1 -- 172.21.15.22:0/1733947696 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8032840 con 0x7faff015d3b0 2023-11-24T06:12:43.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.033+0000 7fafed7fa640 1 -- 172.21.15.22:0/1733947696 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80329a0 con 0x7faff015d3b0 2023-11-24T06:12:43.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.033+0000 7fafed7fa640 1 -- 172.21.15.22:0/1733947696 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8032d30 con 0x7faff015d3b0 2023-11-24T06:12:43.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.033+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff015f6e0 con 0x7faff015d3b0 2023-11-24T06:12:43.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.033+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff015fca0 con 0x7faff015d3b0 2023-11-24T06:12:43.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.034+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff015fec0 con 0x7faff015d3b0 2023-11-24T06:12:43.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.035+0000 7fafed7fa640 1 -- 172.21.15.22:0/1733947696 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafe804e430 con 0x7faff015d3b0 2023-11-24T06:12:43.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.036+0000 7fafed7fa640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fafd006ae40 0x7fafd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.036+0000 7fafed7fa640 1 -- 172.21.15.22:0/1733947696 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fafe80ab5b0 con 0x7faff015d3b0 2023-11-24T06:12:43.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.036+0000 7faff4807640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fafd006ae40 0x7fafd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.037+0000 7faff4807640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fafd006ae40 0x7fafd006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafe0002000 tx=0x7fafe00015f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:43.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.040+0000 7fafed7fa640 1 -- 172.21.15.22:0/1733947696 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafe8076530 con 0x7faff015d3b0 2023-11-24T06:12:43.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.231+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faff004e840 con 0x7faff015d3b0 2023-11-24T06:12:43.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.232+0000 7fafed7fa640 1 -- 172.21.15.22:0/1733947696 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafe8079b50 con 0x7faff015d3b0 2023-11-24T06:12:43.235 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:43.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.234+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fafd006ae40 msgr2=0x7fafd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fafd006ae40 0x7fafd006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafe0002000 tx=0x7fafe00015f0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff015d3b0 msgr2=0x7faff01503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff015d3b0 0x7faff01503e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009890 tx=0x7fafe80046c0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 shutdown_connections 2023-11-24T06:12:43.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fafd006ae40 0x7fafd006d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faff015d3b0 0x7faff01503e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faff00d1d90 0x7faff01601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 --2- 172.21.15.22:0/1733947696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faff00d0fa0 0x7faff00b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 >> 172.21.15.22:0/1733947696 conn(0x7faff00d30a0 msgr2=0x7faff00c8640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:43.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 shutdown_connections 2023-11-24T06:12:43.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.235+0000 7faff5809640 1 -- 172.21.15.22:0/1733947696 wait complete. 2023-11-24T06:12:43.255 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:43.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.483+0000 7fd62f59e640 1 Processor -- start 2023-11-24T06:12:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.483+0000 7fd62f59e640 1 -- start start 2023-11-24T06:12:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.484+0000 7fd62f59e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6301439b0 0x7fd630070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.484+0000 7fd62f59e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd630070d40 con 0x7fd6301435d0 2023-11-24T06:12:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.484+0000 7fd62f59e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd630071020 con 0x7fd6300b4140 2023-11-24T06:12:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.484+0000 7fd62f59e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd630071300 con 0x7fd6301439b0 2023-11-24T06:12:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.484+0000 7fd62e59c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd6301435d0 0x7fd6300b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49896/0 (socket says 172.21.15.22:49896) 2023-11-24T06:12:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.484+0000 7fd62e59c640 1 -- 172.21.15.22:0/4279628637 learned_addr learned my addr 172.21.15.22:0/4279628637 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.484+0000 7fd62ed9d640 1 --2- 172.21.15.22:0/4279628637 >> v2:172.21.15.22:3300/0 conn(0x7fd6301439b0 0x7fd630070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.485+0000 7fd62ed9d640 1 -- 172.21.15.22:0/4279628637 >> v1:172.21.15.31:6789/0 conn(0x7fd6300b4140 legacy=0x7fd630070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.485+0000 7fd62ed9d640 1 -- 172.21.15.22:0/4279628637 >> v1:172.21.15.22:6789/0 conn(0x7fd6301435d0 legacy=0x7fd6300b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.485+0000 7fd62ed9d640 1 -- 172.21.15.22:0/4279628637 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6300715e0 con 0x7fd6301439b0 2023-11-24T06:12:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.486+0000 7fd62ed9d640 1 --2- 172.21.15.22:0/4279628637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301439b0 0x7fd630070760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd6280097a0 tx=0x7fd62802da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b81853a9a9fcd0d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:43.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.486+0000 7fd62d59a640 1 -- 172.21.15.22:0/4279628637 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628031870 con 0x7fd6301439b0 2023-11-24T06:12:43.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.487+0000 7fd62d59a640 1 -- 172.21.15.22:0/4279628637 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6280319d0 con 0x7fd6301439b0 2023-11-24T06:12:43.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.487+0000 7fd62d59a640 1 -- 172.21.15.22:0/4279628637 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628031d60 con 0x7fd6301439b0 2023-11-24T06:12:43.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.487+0000 7fd62f59e640 1 -- 172.21.15.22:0/4279628637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301439b0 msgr2=0x7fd630070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.487+0000 7fd62f59e640 1 --2- 172.21.15.22:0/4279628637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301439b0 0x7fd630070760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd6280097a0 tx=0x7fd62802da50 comp rx=0 tx=0).stop 2023-11-24T06:12:43.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.487+0000 7fd62f59e640 1 -- 172.21.15.22:0/4279628637 shutdown_connections 2023-11-24T06:12:43.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.487+0000 7fd62f59e640 1 --2- 172.21.15.22:0/4279628637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301439b0 0x7fd630070760 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.487+0000 7fd62f59e640 1 -- 172.21.15.22:0/4279628637 >> 172.21.15.22:0/4279628637 conn(0x7fd6300cec10 msgr2=0x7fd6300cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:43.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.487+0000 7fd62f59e640 1 -- 172.21.15.22:0/4279628637 shutdown_connections 2023-11-24T06:12:43.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.487+0000 7fd62f59e640 1 -- 172.21.15.22:0/4279628637 wait complete. 2023-11-24T06:12:43.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.489+0000 7fd62f59e640 1 Processor -- start 2023-11-24T06:12:43.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.489+0000 7fd62f59e640 1 -- start start 2023-11-24T06:12:43.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.490+0000 7fd62f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300b4140 0x7fd6301f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.490+0000 7fd62f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301435d0 0x7fd6300ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.490+0000 7fd62f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6301439b0 0x7fd63013e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.490+0000 7fd62f59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63013a470 con 0x7fd6301435d0 2023-11-24T06:12:43.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.490+0000 7fd62f59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6301f6a60 con 0x7fd6300b4140 2023-11-24T06:12:43.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.490+0000 7fd62f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6301f6d00 con 0x7fd6301439b0 2023-11-24T06:12:43.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.490+0000 7fd62dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301435d0 0x7fd6300ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd62dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301435d0 0x7fd6300ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53116/0 (socket says 172.21.15.22:53116) 2023-11-24T06:12:43.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd62dd9b640 1 -- 172.21.15.22:0/2293967881 learned_addr learned my addr 172.21.15.22:0/2293967881 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd62ed9d640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6301439b0 0x7fd63013e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd62dd9b640 1 -- 172.21.15.22:0/2293967881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6301439b0 msgr2=0x7fd63013e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd62dd9b640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6301439b0 0x7fd63013e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd62dd9b640 1 -- 172.21.15.22:0/2293967881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300b4140 msgr2=0x7fd6301f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd62dd9b640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300b4140 0x7fd6301f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd62dd9b640 1 -- 172.21.15.22:0/2293967881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd628009400 con 0x7fd6301435d0 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd62dd9b640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301435d0 0x7fd6300ce230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c7c0 tx=0x7fd61800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.491+0000 7fd626ffd640 1 -- 172.21.15.22:0/2293967881 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61800aa50 con 0x7fd6301435d0 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.492+0000 7fd626ffd640 1 -- 172.21.15.22:0/2293967881 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61800abb0 con 0x7fd6301435d0 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.492+0000 7fd626ffd640 1 -- 172.21.15.22:0/2293967881 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618012420 con 0x7fd6301435d0 2023-11-24T06:12:43.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.492+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6301f6fe0 con 0x7fd6301435d0 2023-11-24T06:12:43.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.492+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6301f75a0 con 0x7fd6301435d0 2023-11-24T06:12:43.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.493+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63004e840 con 0x7fd6301435d0 2023-11-24T06:12:43.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.494+0000 7fd626ffd640 1 -- 172.21.15.22:0/2293967881 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd618012580 con 0x7fd6301435d0 2023-11-24T06:12:43.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.495+0000 7fd626ffd640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd61006ae40 0x7fd61006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.495+0000 7fd626ffd640 1 -- 172.21.15.22:0/2293967881 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd6180896b0 con 0x7fd6301435d0 2023-11-24T06:12:43.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.495+0000 7fd62e59c640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd61006ae40 0x7fd61006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.496+0000 7fd62e59c640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd61006ae40 0x7fd61006d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd6200015f0 tx=0x7fd620007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:43.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.499+0000 7fd626ffd640 1 -- 172.21.15.22:0/2293967881 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd618054630 con 0x7fd6301435d0 2023-11-24T06:12:43.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.694+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6300aca10 con 0x7fd6301435d0 2023-11-24T06:12:43.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.695+0000 7fd626ffd640 1 -- 172.21.15.22:0/2293967881 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd618057c50 con 0x7fd6301435d0 2023-11-24T06:12:43.698 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd61006ae40 msgr2=0x7fd61006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd61006ae40 0x7fd61006d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd6200015f0 tx=0x7fd620007a40 comp rx=0 tx=0).stop 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301435d0 msgr2=0x7fd6300ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301435d0 0x7fd6300ce230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c7c0 tx=0x7fd61800cc80 comp rx=0 tx=0).stop 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 shutdown_connections 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd61006ae40 0x7fd61006d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6301439b0 0x7fd63013e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6301435d0 0x7fd6300ce230 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 --2- 172.21.15.22:0/2293967881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300b4140 0x7fd6301f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 >> 172.21.15.22:0/2293967881 conn(0x7fd6300cec10 msgr2=0x7fd6300b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 shutdown_connections 2023-11-24T06:12:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.698+0000 7fd62f59e640 1 -- 172.21.15.22:0/2293967881 wait complete. 2023-11-24T06:12:43.720 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:43.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.946+0000 7feb329be640 1 Processor -- start 2023-11-24T06:12:43.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.946+0000 7feb329be640 1 -- start start 2023-11-24T06:12:43.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.948+0000 7feb329be640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 0x7feb2c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.948+0000 7feb329be640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7feb2c0abff0 0x7feb2c15f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.948+0000 7feb329be640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c15c360 con 0x7feb2c0ad720 2023-11-24T06:12:43.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.948+0000 7feb329be640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c0b41a0 con 0x7feb2c0abff0 2023-11-24T06:12:43.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.948+0000 7feb329be640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c06de40 con 0x7feb2c06d520 2023-11-24T06:12:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.948+0000 7feb30f5b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7feb2c0abff0 0x7feb2c15f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.948+0000 7feb30f5b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7feb2c0abff0 0x7feb2c15f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53128/0 (socket says 172.21.15.22:53128) 2023-11-24T06:12:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.948+0000 7feb30f5b640 1 -- 172.21.15.22:0/343982970 learned_addr learned my addr 172.21.15.22:0/343982970 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.949+0000 7feb2bfff640 1 --2- 172.21.15.22:0/343982970 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 0x7feb2c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.949+0000 7feb30f5b640 1 -- 172.21.15.22:0/343982970 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 msgr2=0x7feb2c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.949+0000 7feb30f5b640 1 --2- 172.21.15.22:0/343982970 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 0x7feb2c06d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.949+0000 7feb30f5b640 1 -- 172.21.15.22:0/343982970 >> v1:172.21.15.31:6789/0 conn(0x7feb2c0ad720 legacy=0x7feb2c15ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.949+0000 7feb30f5b640 1 -- 172.21.15.22:0/343982970 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c15ba30 con 0x7feb2c0abff0 2023-11-24T06:12:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.949+0000 7feb2bfff640 1 --2- 172.21.15.22:0/343982970 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 0x7feb2c06d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.950+0000 7feb30f5b640 1 --2- 172.21.15.22:0/343982970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0abff0 0x7feb2c15f3e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb24009e50 tx=0x7feb2402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca81308aa532897 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.950+0000 7feb2b7fe640 1 -- 172.21.15.22:0/343982970 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2402ca70 con 0x7feb2c0abff0 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.950+0000 7feb2b7fe640 1 -- 172.21.15.22:0/343982970 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2402cbd0 con 0x7feb2c0abff0 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.950+0000 7feb2b7fe640 1 -- 172.21.15.22:0/343982970 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb240343f0 con 0x7feb2c0abff0 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.951+0000 7feb329be640 1 -- 172.21.15.22:0/343982970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0abff0 msgr2=0x7feb2c15f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.951+0000 7feb329be640 1 --2- 172.21.15.22:0/343982970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0abff0 0x7feb2c15f3e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb24009e50 tx=0x7feb2402bed0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.951+0000 7feb329be640 1 -- 172.21.15.22:0/343982970 shutdown_connections 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.951+0000 7feb329be640 1 --2- 172.21.15.22:0/343982970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0abff0 0x7feb2c15f3e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.951+0000 7feb329be640 1 --2- 172.21.15.22:0/343982970 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 0x7feb2c06d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.951+0000 7feb329be640 1 -- 172.21.15.22:0/343982970 >> 172.21.15.22:0/343982970 conn(0x7feb2c0b0d80 msgr2=0x7feb2c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.951+0000 7feb329be640 1 -- 172.21.15.22:0/343982970 shutdown_connections 2023-11-24T06:12:43.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.951+0000 7feb329be640 1 -- 172.21.15.22:0/343982970 wait complete. 2023-11-24T06:12:43.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.953+0000 7feb329be640 1 Processor -- start 2023-11-24T06:12:43.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.953+0000 7feb329be640 1 -- start start 2023-11-24T06:12:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.954+0000 7feb329be640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 0x7feb2c147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.954+0000 7feb329be640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2c0abff0 0x7feb2c0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.954+0000 7feb329be640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0ad720 0x7feb2c0ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.954+0000 7feb329be640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c147840 con 0x7feb2c0ad720 2023-11-24T06:12:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.954+0000 7feb329be640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0cb730 con 0x7feb2c0abff0 2023-11-24T06:12:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.954+0000 7feb329be640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0cae90 con 0x7feb2c06d520 2023-11-24T06:12:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.954+0000 7feb30f5b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0ad720 0x7feb2c0ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.954+0000 7feb30f5b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0ad720 0x7feb2c0ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53144/0 (socket says 172.21.15.22:53144) 2023-11-24T06:12:43.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.954+0000 7feb30f5b640 1 -- 172.21.15.22:0/2310706482 learned_addr learned my addr 172.21.15.22:0/2310706482 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb2bfff640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 0x7feb2c147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb23fff640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2c0abff0 0x7feb2c0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb30f5b640 1 -- 172.21.15.22:0/2310706482 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 msgr2=0x7feb2c147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb30f5b640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 0x7feb2c147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb30f5b640 1 -- 172.21.15.22:0/2310706482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2c0abff0 msgr2=0x7feb2c0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb30f5b640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2c0abff0 0x7feb2c0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb30f5b640 1 -- 172.21.15.22:0/2310706482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24009b30 con 0x7feb2c0ad720 2023-11-24T06:12:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb23fff640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2c0abff0 0x7feb2c0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb30f5b640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0ad720 0x7feb2c0ca880 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feb24036040 tx=0x7feb24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb297fa640 1 -- 172.21.15.22:0/2310706482 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2403e450 con 0x7feb2c0ad720 2023-11-24T06:12:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb297fa640 1 -- 172.21.15.22:0/2310706482 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2403e5d0 con 0x7feb2c0ad720 2023-11-24T06:12:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb297fa640 1 -- 172.21.15.22:0/2310706482 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2403e980 con 0x7feb2c0ad720 2023-11-24T06:12:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.955+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2c0cb170 con 0x7feb2c0ad720 2023-11-24T06:12:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.956+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c15c890 con 0x7feb2c0ad720 2023-11-24T06:12:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.957+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2c06dfd0 con 0x7feb2c0ad720 2023-11-24T06:12:43.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.958+0000 7feb297fa640 1 -- 172.21.15.22:0/2310706482 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb2403eae0 con 0x7feb2c0ad720 2023-11-24T06:12:43.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.958+0000 7feb297fa640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7feb0c06ae40 0x7feb0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:43.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.959+0000 7feb297fa640 1 -- 172.21.15.22:0/2310706482 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7feb240ac600 con 0x7feb2c0ad720 2023-11-24T06:12:43.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.959+0000 7feb2bfff640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7feb0c06ae40 0x7feb0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:43.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.959+0000 7feb2bfff640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7feb0c06ae40 0x7feb0c06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feb1c008850 tx=0x7feb1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:43.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:43.963+0000 7feb297fa640 1 -- 172.21.15.22:0/2310706482 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb24077630 con 0x7feb2c0ad720 2023-11-24T06:12:44.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.158+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb2c074770 con 0x7feb2c0ad720 2023-11-24T06:12:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.162+0000 7feb297fa640 1 -- 172.21.15.22:0/2310706482 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7feb2407ac50 con 0x7feb2c0ad720 2023-11-24T06:12:44.165 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:44.165 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7feb0c06ae40 msgr2=0x7feb0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7feb0c06ae40 0x7feb0c06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feb1c008850 tx=0x7feb1c008040 comp rx=0 tx=0).stop 2023-11-24T06:12:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0ad720 msgr2=0x7feb2c0ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0ad720 0x7feb2c0ca880 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feb24036040 tx=0x7feb24004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 shutdown_connections 2023-11-24T06:12:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7feb0c06ae40 0x7feb0c06d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb2c0ad720 0x7feb2c0ca880 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2c0abff0 0x7feb2c0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 --2- 172.21.15.22:0/2310706482 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb2c06d520 0x7feb2c147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.164+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 >> 172.21.15.22:0/2310706482 conn(0x7feb2c0b0d80 msgr2=0x7feb2c0af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.165+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 shutdown_connections 2023-11-24T06:12:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.165+0000 7feb329be640 1 -- 172.21.15.22:0/2310706482 wait complete. 2023-11-24T06:12:44.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:44.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:44.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.421+0000 7f9a71cda640 1 Processor -- start 2023-11-24T06:12:44.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.421+0000 7f9a71cda640 1 -- start start 2023-11-24T06:12:44.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.422+0000 7f9a71cda640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c160b10 0x7f9a6c06e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.422+0000 7f9a71cda640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c071780 con 0x7f9a6c072280 2023-11-24T06:12:44.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.422+0000 7f9a71cda640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c0711c0 con 0x7f9a6c06cad0 2023-11-24T06:12:44.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.422+0000 7f9a71cda640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0b2320 con 0x7f9a6c160b10 2023-11-24T06:12:44.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.423+0000 7f9a6affd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9a6c072280 0x7f9a6c06c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49904/0 (socket says 172.21.15.22:49904) 2023-11-24T06:12:44.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.423+0000 7f9a6affd640 1 -- 172.21.15.22:0/3028633347 learned_addr learned my addr 172.21.15.22:0/3028633347 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:44.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.423+0000 7f9a6b7fe640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c160b10 0x7f9a6c06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.423+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438877561 0 0) 0x7f9a6c071780 con 0x7f9a6c072280 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.423+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a58003520 con 0x7f9a6c072280 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2257419484 0 0) 0x7f9a58003520 con 0x7f9a6c072280 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c160b10 msgr2=0x7f9a6c06e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c160b10 0x7f9a6c06e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 >> v1:172.21.15.31:6789/0 conn(0x7f9a6c06cad0 legacy=0x7f9a6c0b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0714a0 con 0x7f9a6c072280 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f9a540019f0 con 0x7f9a6c072280 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 >> v1:172.21.15.22:6789/0 conn(0x7f9a6c072280 legacy=0x7f9a6c06c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c160b10 0x7f9a580039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a58003f20 0x7f9a580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a58004d00 0x7f9a58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0b2320 con 0x7f9a58003f20 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5800bb10 con 0x7f9a58004d00 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5800bcd0 con 0x7f9a6c160b10 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.424+0000 7f9a6affd640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a58003f20 0x7f9a580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.425+0000 7f9a6b7fe640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c160b10 0x7f9a580039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.425+0000 7f9a6bfff640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a58004d00 0x7f9a58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.425+0000 7f9a6affd640 1 -- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c160b10 msgr2=0x7f9a580039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.425+0000 7f9a6affd640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c160b10 0x7f9a580039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.425+0000 7f9a6affd640 1 -- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a58004d00 msgr2=0x7f9a58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.425+0000 7f9a6affd640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a58004d00 0x7f9a58005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.425+0000 7f9a6affd640 1 -- 172.21.15.22:0/3028633347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a58003520 con 0x7f9a58003f20 2023-11-24T06:12:44.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.428+0000 7f9a6affd640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a58003f20 0x7f9a580047c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400a830 tx=0x7f9a580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ff28c0599da5e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.429+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a540072d0 con 0x7f9a58003f20 2023-11-24T06:12:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.429+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5402f070 con 0x7f9a58003f20 2023-11-24T06:12:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.429+0000 7f9a6a7fc640 1 -- 172.21.15.22:0/3028633347 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a540076b0 con 0x7f9a58003f20 2023-11-24T06:12:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.430+0000 7f9a71cda640 1 -- 172.21.15.22:0/3028633347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a58003f20 msgr2=0x7f9a580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.430+0000 7f9a71cda640 1 --2- 172.21.15.22:0/3028633347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a58003f20 0x7f9a580047c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400a830 tx=0x7f9a580057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.430+0000 7f9a6bfff640 1 -- 172.21.15.22:0/3028633347 reap_dead start 2023-11-24T06:12:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.430+0000 7f9a71cda640 1 -- 172.21.15.22:0/3028633347 shutdown_connections 2023-11-24T06:12:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.430+0000 7f9a71cda640 1 -- 172.21.15.22:0/3028633347 >> 172.21.15.22:0/3028633347 conn(0x7f9a6c0b0ba0 msgr2=0x7f9a6c0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.430+0000 7f9a71cda640 1 -- 172.21.15.22:0/3028633347 shutdown_connections 2023-11-24T06:12:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.430+0000 7f9a71cda640 1 -- 172.21.15.22:0/3028633347 wait complete. 2023-11-24T06:12:44.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.432+0000 7f9a71cda640 1 Processor -- start 2023-11-24T06:12:44.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.432+0000 7f9a71cda640 1 -- start start 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.433+0000 7f9a71cda640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a58003f20 0x7f9a6c0cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.433+0000 7f9a71cda640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c09aaf0 0x7f9a6c09af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.433+0000 7f9a71cda640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6c0cdbb0 0x7f9a6c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.433+0000 7f9a71cda640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0cb270 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.433+0000 7f9a71cda640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c09b4b0 con 0x7f9a58003f20 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.433+0000 7f9a71cda640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0cacb0 con 0x7f9a6c09aaf0 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6c0cdbb0 0x7f9a6c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6c0cdbb0 0x7f9a6c0ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53154/0 (socket says 172.21.15.22:53154) 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6bfff640 1 -- 172.21.15.22:0/3610606384 learned_addr learned my addr 172.21.15.22:0/3610606384 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6affd640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c09aaf0 0x7f9a6c09af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6b7fe640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a58003f20 0x7f9a6c0cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6bfff640 1 -- 172.21.15.22:0/3610606384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c09aaf0 msgr2=0x7f9a6c09af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6bfff640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c09aaf0 0x7f9a6c09af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6bfff640 1 -- 172.21.15.22:0/3610606384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a58003f20 msgr2=0x7f9a6c0cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6bfff640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a58003f20 0x7f9a6c0cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6bfff640 1 -- 172.21.15.22:0/3610606384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0caf90 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.434+0000 7f9a6bfff640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6c0cdbb0 0x7f9a6c0ce060 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0aeae0 tx=0x7f9a6400d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.435+0000 7f9a63fff640 1 -- 172.21.15.22:0/3610606384 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400b070 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.435+0000 7f9a63fff640 1 -- 172.21.15.22:0/3610606384 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a640054e0 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.435+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c09a5d0 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.435+0000 7f9a63fff640 1 -- 172.21.15.22:0/3610606384 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64003810 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.435+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c0cbf80 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.436+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c0cc1a0 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.437+0000 7f9a63fff640 1 -- 172.21.15.22:0/3610606384 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a64003970 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.438+0000 7f9a63fff640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a4c06ae70 0x7f9a4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.438+0000 7f9a63fff640 1 -- 172.21.15.22:0/3610606384 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9a64088d60 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.438+0000 7f9a6b7fe640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a4c06ae70 0x7f9a4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.439+0000 7f9a6b7fe640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a4c06ae70 0x7f9a4c06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009a10 tx=0x7f9a5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.443+0000 7f9a63fff640 1 -- 172.21.15.22:0/3610606384 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a6c0cc1a0 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.637+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a6c0cc1a0 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.638+0000 7f9a63fff640 1 -- 172.21.15.22:0/3610606384 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a6c0cc1a0 con 0x7f9a6c0cdbb0 2023-11-24T06:12:44.641 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:44.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a4c06ae70 msgr2=0x7f9a4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a4c06ae70 0x7f9a4c06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009a10 tx=0x7f9a5c008040 comp rx=0 tx=0).stop 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6c0cdbb0 msgr2=0x7f9a6c0ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6c0cdbb0 0x7f9a6c0ce060 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0aeae0 tx=0x7f9a6400d890 comp rx=0 tx=0).stop 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 shutdown_connections 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a4c06ae70 0x7f9a4c06d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6c0cdbb0 0x7f9a6c0ce060 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a6c09aaf0 0x7f9a6c09af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 --2- 172.21.15.22:0/3610606384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a58003f20 0x7f9a6c0cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.641+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 >> 172.21.15.22:0/3610606384 conn(0x7f9a6c0b0ba0 msgr2=0x7f9a6c070490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.642+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 shutdown_connections 2023-11-24T06:12:44.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.642+0000 7f9a71cda640 1 -- 172.21.15.22:0/3610606384 wait complete. 2023-11-24T06:12:44.662 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:44.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.884+0000 7f02913ef640 1 Processor -- start 2023-11-24T06:12:44.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.884+0000 7f02913ef640 1 -- start start 2023-11-24T06:12:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.885+0000 7f02913ef640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c0b4140 0x7f028c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.885+0000 7f02913ef640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f028c1439b0 0x7f028c070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.885+0000 7f02913ef640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028c070d40 con 0x7f028c1435d0 2023-11-24T06:12:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.885+0000 7f02913ef640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028c071020 con 0x7f028c1439b0 2023-11-24T06:12:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.885+0000 7f02913ef640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028c071300 con 0x7f028c0b4140 2023-11-24T06:12:44.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.886+0000 7f0283fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c0b4140 0x7f028c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.886+0000 7f0283fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c0b4140 0x7f028c071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:53910/0 (socket says 172.21.15.22:53910) 2023-11-24T06:12:44.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.886+0000 7f0283fff640 1 -- 172.21.15.22:0/3658814636 learned_addr learned my addr 172.21.15.22:0/3658814636 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:44.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.886+0000 7f0290bee640 1 --2- 172.21.15.22:0/3658814636 >> v2:172.21.15.31:3300/0 conn(0x7f028c1439b0 0x7f028c070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.887+0000 7f0290bee640 1 -- 172.21.15.22:0/3658814636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c0b4140 msgr2=0x7f028c071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:44.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.887+0000 7f0290bee640 1 --2- 172.21.15.22:0/3658814636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c0b4140 0x7f028c071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.887+0000 7f0290bee640 1 -- 172.21.15.22:0/3658814636 >> v1:172.21.15.31:6789/0 conn(0x7f028c1435d0 legacy=0x7f028c0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.887+0000 7f0290bee640 1 -- 172.21.15.22:0/3658814636 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c0715e0 con 0x7f028c1439b0 2023-11-24T06:12:44.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.887+0000 7f0283fff640 1 --2- 172.21.15.22:0/3658814636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c0b4140 0x7f028c071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:12:44.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.888+0000 7f0290bee640 1 --2- 172.21.15.22:0/3658814636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c1439b0 0x7f028c070050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f028400bd40 tx=0x7f028402de50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12ff73e5362645fb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:44.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f028b7fe640 1 -- 172.21.15.22:0/3658814636 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028402ec00 con 0x7f028c1439b0 2023-11-24T06:12:44.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f028b7fe640 1 -- 172.21.15.22:0/3658814636 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028402ed60 con 0x7f028c1439b0 2023-11-24T06:12:44.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f028b7fe640 1 -- 172.21.15.22:0/3658814636 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284036660 con 0x7f028c1439b0 2023-11-24T06:12:44.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f02913ef640 1 -- 172.21.15.22:0/3658814636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c1439b0 msgr2=0x7f028c070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f02913ef640 1 --2- 172.21.15.22:0/3658814636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c1439b0 0x7f028c070050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f028400bd40 tx=0x7f028402de50 comp rx=0 tx=0).stop 2023-11-24T06:12:44.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f02913ef640 1 -- 172.21.15.22:0/3658814636 shutdown_connections 2023-11-24T06:12:44.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f02913ef640 1 --2- 172.21.15.22:0/3658814636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c1439b0 0x7f028c070050 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f02913ef640 1 --2- 172.21.15.22:0/3658814636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c0b4140 0x7f028c071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f02913ef640 1 -- 172.21.15.22:0/3658814636 >> 172.21.15.22:0/3658814636 conn(0x7f028c0cec10 msgr2=0x7f028c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:44.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f02913ef640 1 -- 172.21.15.22:0/3658814636 shutdown_connections 2023-11-24T06:12:44.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.889+0000 7f02913ef640 1 -- 172.21.15.22:0/3658814636 wait complete. 2023-11-24T06:12:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.891+0000 7f02913ef640 1 Processor -- start 2023-11-24T06:12:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.891+0000 7f02913ef640 1 -- start start 2023-11-24T06:12:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.892+0000 7f02913ef640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c0b4140 0x7f028c13fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.892+0000 7f02913ef640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c1435d0 0x7f028c1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.892+0000 7f02913ef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f028c1439b0 0x7f028c13cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.892+0000 7f02913ef640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c13d460 con 0x7f028c1439b0 2023-11-24T06:12:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.892+0000 7f02913ef640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c13ff60 con 0x7f028c0b4140 2023-11-24T06:12:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.892+0000 7f02913ef640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028c13ab90 con 0x7f028c1435d0 2023-11-24T06:12:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f0290bee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f028c1439b0 0x7f028c13cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f0290bee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f028c1439b0 0x7f028c13cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53156/0 (socket says 172.21.15.22:53156) 2023-11-24T06:12:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f0290bee640 1 -- 172.21.15.22:0/1855988362 learned_addr learned my addr 172.21.15.22:0/1855988362 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f0283fff640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c1435d0 0x7f028c1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f028bfff640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c0b4140 0x7f028c13fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f0290bee640 1 -- 172.21.15.22:0/1855988362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c1435d0 msgr2=0x7f028c1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f0290bee640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c1435d0 0x7f028c1597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f0290bee640 1 -- 172.21.15.22:0/1855988362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c0b4140 msgr2=0x7f028c13fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f0290bee640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c0b4140 0x7f028c13fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f0290bee640 1 -- 172.21.15.22:0/1855988362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740094d0 con 0x7f028c1439b0 2023-11-24T06:12:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.893+0000 7f028bfff640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c0b4140 0x7f028c13fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.894+0000 7f0290bee640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f028c1439b0 0x7f028c13cb30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0284039040 tx=0x7f0284004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.894+0000 7f02897fa640 1 -- 172.21.15.22:0/1855988362 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284041670 con 0x7f028c1439b0 2023-11-24T06:12:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.894+0000 7f02897fa640 1 -- 172.21.15.22:0/1855988362 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02840417d0 con 0x7f028c1439b0 2023-11-24T06:12:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.894+0000 7f02897fa640 1 -- 172.21.15.22:0/1855988362 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284041b80 con 0x7f028c1439b0 2023-11-24T06:12:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.894+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028400ba70 con 0x7f028c1439b0 2023-11-24T06:12:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.894+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028c13b150 con 0x7f028c1439b0 2023-11-24T06:12:44.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.896+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028c04e840 con 0x7f028c1439b0 2023-11-24T06:12:44.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.896+0000 7f02897fa640 1 -- 172.21.15.22:0/1855988362 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f028403d070 con 0x7f028c1439b0 2023-11-24T06:12:44.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.897+0000 7f02897fa640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f026c06ae40 0x7f026c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:44.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.897+0000 7f02897fa640 1 -- 172.21.15.22:0/1855988362 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f02840ac2c0 con 0x7f028c1439b0 2023-11-24T06:12:44.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.898+0000 7f028bfff640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f026c06ae40 0x7f026c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:44.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.899+0000 7f028bfff640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f026c06ae40 0x7f026c06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f027c000f60 tx=0x7f027c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:44.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:44.902+0000 7f02897fa640 1 -- 172.21.15.22:0/1855988362 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0284077490 con 0x7f028c1439b0 2023-11-24T06:12:45.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.098+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f028c15b000 con 0x7f028c1439b0 2023-11-24T06:12:45.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.099+0000 7f02897fa640 1 -- 172.21.15.22:0/1855988362 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f028400b450 con 0x7f028c1439b0 2023-11-24T06:12:45.102 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:45.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.101+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f026c06ae40 msgr2=0x7f026c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.101+0000 7f02913ef640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f026c06ae40 0x7f026c06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f027c000f60 tx=0x7f027c009040 comp rx=0 tx=0).stop 2023-11-24T06:12:45.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.101+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f028c1439b0 msgr2=0x7f028c13cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.101+0000 7f02913ef640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f028c1439b0 0x7f028c13cb30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0284039040 tx=0x7f0284004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:45.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.102+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 shutdown_connections 2023-11-24T06:12:45.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.102+0000 7f02913ef640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f026c06ae40 0x7f026c06d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.102+0000 7f02913ef640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f028c1439b0 0x7f028c13cb30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.102+0000 7f02913ef640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f028c1435d0 0x7f028c1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.102+0000 7f02913ef640 1 --2- 172.21.15.22:0/1855988362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f028c0b4140 0x7f028c13fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.102+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 >> 172.21.15.22:0/1855988362 conn(0x7f028c0cec10 msgr2=0x7f028c13efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:45.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.102+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 shutdown_connections 2023-11-24T06:12:45.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.102+0000 7f02913ef640 1 -- 172.21.15.22:0/1855988362 wait complete. 2023-11-24T06:12:45.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:45.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.349+0000 7fe0a7fff640 1 Processor -- start 2023-11-24T06:12:45.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.349+0000 7fe0a7fff640 1 -- start start 2023-11-24T06:12:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.351+0000 7fe0a7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0a80d1d90 0x7fe0a80ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.351+0000 7fe0a7fff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80c6bf0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.351+0000 7fe0a7fff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80d13f0 con 0x7fe0a80d0fa0 2023-11-24T06:12:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.351+0000 7fe0a7fff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a80cedc0 con 0x7fe0a80d1d90 2023-11-24T06:12:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.351+0000 7fe0a67fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0a80d1d90 0x7fe0a80ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.352+0000 7fe0a6ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe0a815d3b0 0x7fe0a80d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49914/0 (socket says 172.21.15.22:49914) 2023-11-24T06:12:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.352+0000 7fe0a6ffd640 1 -- 172.21.15.22:0/3116100979 learned_addr learned my addr 172.21.15.22:0/3116100979 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.352+0000 7fe0a67fc640 1 -- 172.21.15.22:0/3116100979 >> v1:172.21.15.31:6789/0 conn(0x7fe0a80d0fa0 legacy=0x7fe0a80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.352+0000 7fe0a67fc640 1 -- 172.21.15.22:0/3116100979 >> v1:172.21.15.22:6789/0 conn(0x7fe0a815d3b0 legacy=0x7fe0a80d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.352+0000 7fe0a67fc640 1 -- 172.21.15.22:0/3116100979 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80c6e40 con 0x7fe0a80d1d90 2023-11-24T06:12:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.352+0000 7fe0a5ffb640 1 -- 172.21.15.22:0/3116100979 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097242196 0 0) 0x7fe0a80c6bf0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.353+0000 7fe0a67fc640 1 --2- 172.21.15.22:0/3116100979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a80d1d90 0x7fe0a80ce6c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0097a0 tx=0x7fe09c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f968d5173d5c7143 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a5ffb640 1 -- 172.21.15.22:0/3116100979 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c02e070 con 0x7fe0a80d1d90 2023-11-24T06:12:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a5ffb640 1 -- 172.21.15.22:0/3116100979 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c0315a0 con 0x7fe0a80d1d90 2023-11-24T06:12:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a5ffb640 1 -- 172.21.15.22:0/3116100979 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c031930 con 0x7fe0a80d1d90 2023-11-24T06:12:45.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a7fff640 1 -- 172.21.15.22:0/3116100979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a80d1d90 msgr2=0x7fe0a80ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a7fff640 1 --2- 172.21.15.22:0/3116100979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a80d1d90 0x7fe0a80ce6c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0097a0 tx=0x7fe09c02b840 comp rx=0 tx=0).stop 2023-11-24T06:12:45.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a7fff640 1 -- 172.21.15.22:0/3116100979 shutdown_connections 2023-11-24T06:12:45.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a7fff640 1 --2- 172.21.15.22:0/3116100979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a80d1d90 0x7fe0a80ce6c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a7fff640 1 -- 172.21.15.22:0/3116100979 >> 172.21.15.22:0/3116100979 conn(0x7fe0a80d30a0 msgr2=0x7fe0a80d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:45.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a7fff640 1 -- 172.21.15.22:0/3116100979 shutdown_connections 2023-11-24T06:12:45.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.354+0000 7fe0a7fff640 1 -- 172.21.15.22:0/3116100979 wait complete. 2023-11-24T06:12:45.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.356+0000 7fe0a7fff640 1 Processor -- start 2023-11-24T06:12:45.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.356+0000 7fe0a7fff640 1 -- start start 2023-11-24T06:12:45.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.357+0000 7fe0a7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0a80d0fa0 0x7fe0a80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.357+0000 7fe0a7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a80d1d90 0x7fe0a81525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.357+0000 7fe0a7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a815d3b0 0x7fe0a80cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.357+0000 7fe0a7fff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80a0580 con 0x7fe0a815d3b0 2023-11-24T06:12:45.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.357+0000 7fe0a7fff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a809f900 con 0x7fe0a80d1d90 2023-11-24T06:12:45.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.357+0000 7fe0a7fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a809fbe0 con 0x7fe0a80d0fa0 2023-11-24T06:12:45.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.357+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a815d3b0 0x7fe0a80cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a815d3b0 0x7fe0a80cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53184/0 (socket says 172.21.15.22:53184) 2023-11-24T06:12:45.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a77fe640 1 -- 172.21.15.22:0/1971164350 learned_addr learned my addr 172.21.15.22:0/1971164350 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:45.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a77fe640 1 -- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0a80d0fa0 msgr2=0x7fe0a80a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a6ffd640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0a80d0fa0 0x7fe0a80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a67fc640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a80d1d90 0x7fe0a81525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a77fe640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0a80d0fa0 0x7fe0a80a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a77fe640 1 -- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a80d1d90 msgr2=0x7fe0a81525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a77fe640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a80d1d90 0x7fe0a81525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a77fe640 1 -- 172.21.15.22:0/1971164350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c009400 con 0x7fe0a815d3b0 2023-11-24T06:12:45.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a6ffd640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0a80d0fa0 0x7fe0a80a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:45.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a67fc640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a80d1d90 0x7fe0a81525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:45.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.358+0000 7fe0a77fe640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a815d3b0 0x7fe0a80cc340 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000c410 tx=0x7fe0a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:45.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.359+0000 7fe08ffff640 1 -- 172.21.15.22:0/1971164350 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0011790 con 0x7fe0a815d3b0 2023-11-24T06:12:45.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.359+0000 7fe08ffff640 1 -- 172.21.15.22:0/1971164350 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a00118f0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.359+0000 7fe08ffff640 1 -- 172.21.15.22:0/1971164350 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0011ce0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.359+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a809fec0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.359+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a8152b00 con 0x7fe0a815d3b0 2023-11-24T06:12:45.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.360+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a80a06c0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.361+0000 7fe08ffff640 1 -- 172.21.15.22:0/1971164350 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0a001c460 con 0x7fe0a815d3b0 2023-11-24T06:12:45.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.362+0000 7fe08ffff640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe09406ae40 0x7fe09406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.362+0000 7fe08ffff640 1 -- 172.21.15.22:0/1971164350 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe0a00893e0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.362+0000 7fe0a6ffd640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe09406ae40 0x7fe09406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.363+0000 7fe0a6ffd640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe09406ae40 0x7fe09406d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe098007fd0 tx=0x7fe098009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:45.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.367+0000 7fe08ffff640 1 -- 172.21.15.22:0/1971164350 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe0a80a06c0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.563+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0a80a06c0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.564+0000 7fe08ffff640 1 -- 172.21.15.22:0/1971164350 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0a80a06c0 con 0x7fe0a815d3b0 2023-11-24T06:12:45.567 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:45.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe09406ae40 msgr2=0x7fe09406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe09406ae40 0x7fe09406d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe098007fd0 tx=0x7fe098009040 comp rx=0 tx=0).stop 2023-11-24T06:12:45.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a815d3b0 msgr2=0x7fe0a80cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a815d3b0 0x7fe0a80cc340 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000c410 tx=0x7fe0a000c8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 shutdown_connections 2023-11-24T06:12:45.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe09406ae40 0x7fe09406d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a815d3b0 0x7fe0a80cc340 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a80d1d90 0x7fe0a81525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 --2- 172.21.15.22:0/1971164350 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0a80d0fa0 0x7fe0a80a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.567+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 >> 172.21.15.22:0/1971164350 conn(0x7fe0a80d30a0 msgr2=0x7fe0a80d1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:45.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.568+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 shutdown_connections 2023-11-24T06:12:45.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.568+0000 7fe0a7fff640 1 -- 172.21.15.22:0/1971164350 wait complete. 2023-11-24T06:12:45.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:45.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.816+0000 7f27e8600640 1 Processor -- start 2023-11-24T06:12:45.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.816+0000 7f27e8600640 1 -- start start 2023-11-24T06:12:45.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.818+0000 7f27e8600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f27e00719c0 0x7f27e00ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.818+0000 7f27e8600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00ad510 con 0x7f27e006d520 2023-11-24T06:12:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.818+0000 7f27e8600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00acc50 con 0x7f27e0161930 2023-11-24T06:12:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.818+0000 7f27e8600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e0071e60 con 0x7f27e00719c0 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.818+0000 7f27e6b9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f27e006d520 0x7f27e006d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49928/0 (socket says 172.21.15.22:49928) 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.818+0000 7f27e6b9d640 1 -- 172.21.15.22:0/2008830467 learned_addr learned my addr 172.21.15.22:0/2008830467 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e5b9b640 1 --2- 172.21.15.22:0/2008830467 >> v2:172.21.15.31:3300/0 conn(0x7f27e00719c0 0x7f27e00ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905889889 0 0) 0x7f27e00ad510 con 0x7f27e006d520 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27cc003520 con 0x7f27e006d520 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3811348367 0 0) 0x7f27cc003520 con 0x7f27e006d520 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 >> v2:172.21.15.31:3300/0 conn(0x7f27e00719c0 msgr2=0x7f27e00ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 --2- 172.21.15.22:0/2008830467 >> v2:172.21.15.31:3300/0 conn(0x7f27e00719c0 0x7f27e00ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 >> v1:172.21.15.31:6789/0 conn(0x7f27e0161930 legacy=0x7f27e00ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e00acec0 con 0x7f27e006d520 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f27d80019f0 con 0x7f27e006d520 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 >> v1:172.21.15.22:6789/0 conn(0x7f27e006d520 legacy=0x7f27e006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27cc0047c0 0x7f27cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc005180 0x7f27cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0071e60 con 0x7f27cc003970 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc00c020 con 0x7f27cc005180 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.819+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc00c1e0 con 0x7f27cc0047c0 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.820+0000 7f27e639c640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.820+0000 7f27e6b9d640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc005180 0x7f27cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.820+0000 7f27e5b9b640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27cc0047c0 0x7f27cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.820+0000 7f27e639c640 1 -- 172.21.15.22:0/2008830467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27cc0047c0 msgr2=0x7f27cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.820+0000 7f27e639c640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27cc0047c0 0x7f27cc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.820+0000 7f27e639c640 1 -- 172.21.15.22:0/2008830467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc005180 msgr2=0x7f27cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.820+0000 7f27e639c640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27cc005180 0x7f27cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.820+0000 7f27e639c640 1 -- 172.21.15.22:0/2008830467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc003520 con 0x7f27cc003970 2023-11-24T06:12:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.820+0000 7f27e6b9d640 1 -- 172.21.15.22:0/2008830467 reap_dead start 2023-11-24T06:12:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.821+0000 7f27e639c640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27cc003d90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f27dc001750 tx=0x7f27cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c5744b6197ad43 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0052d0 con 0x7f27cc003970 2023-11-24T06:12:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc02e050 con 0x7f27cc003970 2023-11-24T06:12:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e539a640 1 -- 172.21.15.22:0/2008830467 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc003830 con 0x7f27cc003970 2023-11-24T06:12:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e8600640 1 -- 172.21.15.22:0/2008830467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 msgr2=0x7f27cc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e8600640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27cc003d90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f27dc001750 tx=0x7f27cc0057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e8600640 1 -- 172.21.15.22:0/2008830467 shutdown_connections 2023-11-24T06:12:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e8600640 1 --2- 172.21.15.22:0/2008830467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27cc003d90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e8600640 1 -- 172.21.15.22:0/2008830467 >> 172.21.15.22:0/2008830467 conn(0x7f27e00b0d80 msgr2=0x7f27e00b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e8600640 1 -- 172.21.15.22:0/2008830467 shutdown_connections 2023-11-24T06:12:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.822+0000 7f27e8600640 1 -- 172.21.15.22:0/2008830467 wait complete. 2023-11-24T06:12:45.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.824+0000 7f27e8600640 1 Processor -- start 2023-11-24T06:12:45.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.824+0000 7f27e8600640 1 -- start start 2023-11-24T06:12:45.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.825+0000 7f27e8600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27e01501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.825+0000 7f27e8600640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27e01f7730 0x7f27e015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.825+0000 7f27e8600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27e015ea10 0x7f27e0160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.825+0000 7f27e8600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00cd4c0 con 0x7f27cc003970 2023-11-24T06:12:45.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.825+0000 7f27e8600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e015f320 con 0x7f27e015ea10 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.825+0000 7f27e8600640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00ccbf0 con 0x7f27e01f7730 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e639c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27e01501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e639c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27e01501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53202/0 (socket says 172.21.15.22:53202) 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e639c640 1 -- 172.21.15.22:0/1496110715 learned_addr learned my addr 172.21.15.22:0/1496110715 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e6b9d640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27e015ea10 0x7f27e0160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e5b9b640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27e01f7730 0x7f27e015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e639c640 1 -- 172.21.15.22:0/1496110715 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27e01f7730 msgr2=0x7f27e015e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e639c640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27e01f7730 0x7f27e015e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e639c640 1 -- 172.21.15.22:0/1496110715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27e015ea10 msgr2=0x7f27e0160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e639c640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27e015ea10 0x7f27e0160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e639c640 1 -- 172.21.15.22:0/1496110715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e015f040 con 0x7f27cc003970 2023-11-24T06:12:45.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e6b9d640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27e015ea10 0x7f27e0160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:45.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.826+0000 7f27e639c640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27e01501d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f27dc005040 tx=0x7f27dc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:45.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.827+0000 7f27d6ffd640 1 -- 172.21.15.22:0/1496110715 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0076c0 con 0x7f27cc003970 2023-11-24T06:12:45.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.827+0000 7f27d6ffd640 1 -- 172.21.15.22:0/1496110715 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc007a30 con 0x7f27cc003970 2023-11-24T06:12:45.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.827+0000 7f27d6ffd640 1 -- 172.21.15.22:0/1496110715 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc006be0 con 0x7f27cc003970 2023-11-24T06:12:45.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.827+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e00cce00 con 0x7f27cc003970 2023-11-24T06:12:45.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.827+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e015ac00 con 0x7f27cc003970 2023-11-24T06:12:45.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.828+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e0074770 con 0x7f27cc003970 2023-11-24T06:12:45.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.829+0000 7f27d6ffd640 1 -- 172.21.15.22:0/1496110715 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27dc006d40 con 0x7f27cc003970 2023-11-24T06:12:45.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.830+0000 7f27d6ffd640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27c406ae40 0x7f27c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:45.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.830+0000 7f27d6ffd640 1 -- 172.21.15.22:0/1496110715 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f27dc0ab7a0 con 0x7f27cc003970 2023-11-24T06:12:45.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.830+0000 7f27e5b9b640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27c406ae40 0x7f27c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:45.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.831+0000 7f27e5b9b640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27c406ae40 0x7f27c406d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f27e015dee0 tx=0x7f27d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:45.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:45.834+0000 7f27d6ffd640 1 -- 172.21.15.22:0/1496110715 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27dc076840 con 0x7f27cc003970 2023-11-24T06:12:46.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.031+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27e00717a0 con 0x7f27cc003970 2023-11-24T06:12:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.033+0000 7f27d6ffd640 1 -- 172.21.15.22:0/1496110715 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f27dc079e60 con 0x7f27cc003970 2023-11-24T06:12:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:46.037 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.036+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27c406ae40 msgr2=0x7f27c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.036+0000 7f27e8600640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27c406ae40 0x7f27c406d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f27e015dee0 tx=0x7f27d0008040 comp rx=0 tx=0).stop 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.036+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 msgr2=0x7f27e01501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.036+0000 7f27e8600640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27e01501d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f27dc005040 tx=0x7f27dc001120 comp rx=0 tx=0).stop 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.037+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 shutdown_connections 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.037+0000 7f27e8600640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27c406ae40 0x7f27c406d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.037+0000 7f27e8600640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27e015ea10 0x7f27e0160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.037+0000 7f27e8600640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27e01f7730 0x7f27e015e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.037+0000 7f27e8600640 1 --2- 172.21.15.22:0/1496110715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27cc003970 0x7f27e01501d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.037+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 >> 172.21.15.22:0/1496110715 conn(0x7f27e00b0d80 msgr2=0x7f27e00b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.037+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 shutdown_connections 2023-11-24T06:12:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.037+0000 7f27e8600640 1 -- 172.21.15.22:0/1496110715 wait complete. 2023-11-24T06:12:46.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:46.058 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:46.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.267+0000 7fca5cc7c640 1 Processor -- start 2023-11-24T06:12:46.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.267+0000 7fca5cc7c640 1 -- start start 2023-11-24T06:12:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.268+0000 7fca5cc7c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca5815b350 0x7fca580abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca5cc7c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca5809cb30 0x7fca580b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca5cc7c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca580adb60 0x7fca580adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca5cc7c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5815b730 con 0x7fca5815b350 2023-11-24T06:12:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca5cc7c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580ac740 con 0x7fca580adb60 2023-11-24T06:12:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca5cc7c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580ac460 con 0x7fca5809cb30 2023-11-24T06:12:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca5659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca5815b350 0x7fca580abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca5659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca5815b350 0x7fca580abe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53204/0 (socket says 172.21.15.22:53204) 2023-11-24T06:12:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca5659c640 1 -- 172.21.15.22:0/1252843504 learned_addr learned my addr 172.21.15.22:0/1252843504 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca56d9d640 1 --2- 172.21.15.22:0/1252843504 >> v2:172.21.15.31:3300/0 conn(0x7fca580adb60 0x7fca580adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.269+0000 7fca55d9b640 1 --2- 172.21.15.22:0/1252843504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca5809cb30 0x7fca580b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.270+0000 7fca5659c640 1 -- 172.21.15.22:0/1252843504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca5809cb30 msgr2=0x7fca580b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.270+0000 7fca5659c640 1 --2- 172.21.15.22:0/1252843504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca5809cb30 0x7fca580b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.270+0000 7fca5659c640 1 -- 172.21.15.22:0/1252843504 >> v2:172.21.15.31:3300/0 conn(0x7fca580adb60 msgr2=0x7fca580adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.270+0000 7fca5659c640 1 --2- 172.21.15.22:0/1252843504 >> v2:172.21.15.31:3300/0 conn(0x7fca580adb60 0x7fca580adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.270+0000 7fca5659c640 1 -- 172.21.15.22:0/1252843504 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580b2a50 con 0x7fca5815b350 2023-11-24T06:12:46.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.271+0000 7fca5659c640 1 --2- 172.21.15.22:0/1252843504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 0x7fca580abe80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca58072730 tx=0x7fca4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e202d20ec651dda8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:46.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.271+0000 7fca5559a640 1 -- 172.21.15.22:0/1252843504 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4802ca70 con 0x7fca5815b350 2023-11-24T06:12:46.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5559a640 1 -- 172.21.15.22:0/1252843504 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4802cbd0 con 0x7fca5815b350 2023-11-24T06:12:46.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5559a640 1 -- 172.21.15.22:0/1252843504 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca480343f0 con 0x7fca5815b350 2023-11-24T06:12:46.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5cc7c640 1 -- 172.21.15.22:0/1252843504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 msgr2=0x7fca580abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/1252843504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 0x7fca580abe80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca58072730 tx=0x7fca4802bed0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5cc7c640 1 -- 172.21.15.22:0/1252843504 shutdown_connections 2023-11-24T06:12:46.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/1252843504 >> v2:172.21.15.31:3300/0 conn(0x7fca580adb60 0x7fca580adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/1252843504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca5809cb30 0x7fca580b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/1252843504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 0x7fca580abe80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5cc7c640 1 -- 172.21.15.22:0/1252843504 >> 172.21.15.22:0/1252843504 conn(0x7fca580b0ba0 msgr2=0x7fca580b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:46.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5cc7c640 1 -- 172.21.15.22:0/1252843504 shutdown_connections 2023-11-24T06:12:46.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.272+0000 7fca5cc7c640 1 -- 172.21.15.22:0/1252843504 wait complete. 2023-11-24T06:12:46.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.274+0000 7fca5cc7c640 1 Processor -- start 2023-11-24T06:12:46.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.274+0000 7fca5cc7c640 1 -- start start 2023-11-24T06:12:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.275+0000 7fca5cc7c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca5809cb30 0x7fca58144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.275+0000 7fca5cc7c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca580adb60 0x7fca58070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.275+0000 7fca5cc7c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 0x7fca580709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.275+0000 7fca5cc7c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58158370 con 0x7fca5815b350 2023-11-24T06:12:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.275+0000 7fca5cc7c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca581585c0 con 0x7fca5809cb30 2023-11-24T06:12:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.275+0000 7fca5cc7c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca581588a0 con 0x7fca580adb60 2023-11-24T06:12:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca56d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 0x7fca580709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca56d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 0x7fca580709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53216/0 (socket says 172.21.15.22:53216) 2023-11-24T06:12:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca56d9d640 1 -- 172.21.15.22:0/2551674126 learned_addr learned my addr 172.21.15.22:0/2551674126 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca55d9b640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca580adb60 0x7fca58070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca5659c640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca5809cb30 0x7fca58144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca56d9d640 1 -- 172.21.15.22:0/2551674126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca580adb60 msgr2=0x7fca58070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca56d9d640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca580adb60 0x7fca58070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca56d9d640 1 -- 172.21.15.22:0/2551674126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca5809cb30 msgr2=0x7fca58144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca56d9d640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca5809cb30 0x7fca58144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.276+0000 7fca56d9d640 1 -- 172.21.15.22:0/2551674126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48009b30 con 0x7fca5815b350 2023-11-24T06:12:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.277+0000 7fca56d9d640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 0x7fca580709d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca5000d800 tx=0x7fca5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.277+0000 7fca4effd640 1 -- 172.21.15.22:0/2551674126 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5000b6c0 con 0x7fca5815b350 2023-11-24T06:12:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.277+0000 7fca4effd640 1 -- 172.21.15.22:0/2551674126 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000b840 con 0x7fca5815b350 2023-11-24T06:12:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.277+0000 7fca4effd640 1 -- 172.21.15.22:0/2551674126 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5000bbf0 con 0x7fca5815b350 2023-11-24T06:12:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.277+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca58158b80 con 0x7fca5815b350 2023-11-24T06:12:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.277+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5809a410 con 0x7fca5815b350 2023-11-24T06:12:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.278+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca581590a0 con 0x7fca5815b350 2023-11-24T06:12:46.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.279+0000 7fca4effd640 1 -- 172.21.15.22:0/2551674126 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca5000bd50 con 0x7fca5815b350 2023-11-24T06:12:46.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.280+0000 7fca4effd640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca3806ae40 0x7fca3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.280+0000 7fca4effd640 1 -- 172.21.15.22:0/2551674126 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fca50089cd0 con 0x7fca5815b350 2023-11-24T06:12:46.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.280+0000 7fca5659c640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca3806ae40 0x7fca3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.281+0000 7fca5659c640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca3806ae40 0x7fca3806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca48035000 tx=0x7fca48030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:46.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.284+0000 7fca4effd640 1 -- 172.21.15.22:0/2551674126 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca581590a0 con 0x7fca5815b350 2023-11-24T06:12:46.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.481+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca581590a0 con 0x7fca5815b350 2023-11-24T06:12:46.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.482+0000 7fca4effd640 1 -- 172.21.15.22:0/2551674126 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca581590a0 con 0x7fca5815b350 2023-11-24T06:12:46.485 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.484+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca3806ae40 msgr2=0x7fca3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.484+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca3806ae40 0x7fca3806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca48035000 tx=0x7fca48030000 comp rx=0 tx=0).stop 2023-11-24T06:12:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.484+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 msgr2=0x7fca580709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.484+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 0x7fca580709d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca5000d800 tx=0x7fca5000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.485+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 shutdown_connections 2023-11-24T06:12:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.485+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca3806ae40 0x7fca3806d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.485+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca5815b350 0x7fca580709d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.485+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca580adb60 0x7fca58070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.485+0000 7fca5cc7c640 1 --2- 172.21.15.22:0/2551674126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca5809cb30 0x7fca58144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.485+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 >> 172.21.15.22:0/2551674126 conn(0x7fca580b0ba0 msgr2=0x7fca5809bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:46.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.485+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 shutdown_connections 2023-11-24T06:12:46.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.485+0000 7fca5cc7c640 1 -- 172.21.15.22:0/2551674126 wait complete. 2023-11-24T06:12:46.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.717+0000 7f731562d640 1 Processor -- start 2023-11-24T06:12:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.717+0000 7f731562d640 1 -- start start 2023-11-24T06:12:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.718+0000 7f731562d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7310160bd0 0x7f73100b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.718+0000 7f731562d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100b23e0 con 0x7f73100b3210 2023-11-24T06:12:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.719+0000 7f731562d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100d41b0 con 0x7f73100b48d0 2023-11-24T06:12:46.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.719+0000 7f731562d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73100cdc70 con 0x7f7310160bd0 2023-11-24T06:12:46.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.719+0000 7f730f7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f73100b3210 0x7f7310167290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49934/0 (socket says 172.21.15.22:49934) 2023-11-24T06:12:46.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.719+0000 7f730f7fe640 1 -- 172.21.15.22:0/3726845809 learned_addr learned my addr 172.21.15.22:0/3726845809 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:46.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.719+0000 7f730effd640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7310160bd0 0x7f73100b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.719+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053247386 0 0) 0x7f73100b23e0 con 0x7f73100b3210 2023-11-24T06:12:46.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.719+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72fc003520 con 0x7f73100b3210 2023-11-24T06:12:46.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171117420 0 0) 0x7f72fc003520 con 0x7f73100b3210 2023-11-24T06:12:46.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7310160bd0 msgr2=0x7f73100b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7310160bd0 0x7f73100b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 >> v1:172.21.15.31:6789/0 conn(0x7f73100b48d0 legacy=0x7f73100b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310160fb0 con 0x7f73100b3210 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f7308001670 con 0x7f73100b3210 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 >> v1:172.21.15.22:6789/0 conn(0x7f73100b3210 legacy=0x7f7310167290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72fc0039a0 0x7f72fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72fc0047c0 0x7f72fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7310160bd0 0x7f72fc0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100cdc70 con 0x7f72fc0039a0 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc00ba90 con 0x7f72fc0047c0 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc00bc50 con 0x7f7310160bd0 2023-11-24T06:12:46.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730effd640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72fc0039a0 0x7f72fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730effd640 1 -- 172.21.15.22:0/3726845809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7310160bd0 msgr2=0x7f72fc0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:46.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730effd640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7310160bd0 0x7f72fc0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730effd640 1 -- 172.21.15.22:0/3726845809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72fc0047c0 msgr2=0x7f72fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:46.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730effd640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72fc0047c0 0x7f72fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.720+0000 7f730effd640 1 -- 172.21.15.22:0/3726845809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc003520 con 0x7f72fc0039a0 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.721+0000 7f730effd640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72fc0039a0 0x7f72fc003da0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7300009fc0 tx=0x7f72fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed25696631c36edf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730002cc60 con 0x7f72fc0039a0 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000f040 con 0x7f72fc0039a0 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f730dffb640 1 -- 172.21.15.22:0/3726845809 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300034440 con 0x7f72fc0039a0 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f731562d640 1 -- 172.21.15.22:0/3726845809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72fc0039a0 msgr2=0x7f72fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f731562d640 1 --2- 172.21.15.22:0/3726845809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72fc0039a0 0x7f72fc003da0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7300009fc0 tx=0x7f72fc0057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f730f7fe640 1 -- 172.21.15.22:0/3726845809 reap_dead start 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f731562d640 1 -- 172.21.15.22:0/3726845809 shutdown_connections 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f731562d640 1 -- 172.21.15.22:0/3726845809 >> 172.21.15.22:0/3726845809 conn(0x7f731009c5a0 msgr2=0x7f73100d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f731562d640 1 -- 172.21.15.22:0/3726845809 shutdown_connections 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.722+0000 7f731562d640 1 -- 172.21.15.22:0/3726845809 wait complete. 2023-11-24T06:12:46.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.724+0000 7f731562d640 1 Processor -- start 2023-11-24T06:12:46.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.724+0000 7f731562d640 1 -- start start 2023-11-24T06:12:46.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.725+0000 7f731562d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72fc0039a0 0x7f73100c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.725+0000 7f731562d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f731015a370 0x7f73100b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.725+0000 7f731562d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73100cee00 0x7f73100cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.725+0000 7f731562d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100cf7d0 con 0x7f731015a370 2023-11-24T06:12:46.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.725+0000 7f731562d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100c8130 con 0x7f72fc0039a0 2023-11-24T06:12:46.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.725+0000 7f731562d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731015a7f0 con 0x7f73100cee00 2023-11-24T06:12:46.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.725+0000 7f730e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f731015a370 0x7f73100b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f731015a370 0x7f73100b89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53236/0 (socket says 172.21.15.22:53236) 2023-11-24T06:12:46.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730e7fc640 1 -- 172.21.15.22:0/3655403195 learned_addr learned my addr 172.21.15.22:0/3655403195 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730effd640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72fc0039a0 0x7f73100c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730f7fe640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73100cee00 0x7f73100cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730e7fc640 1 -- 172.21.15.22:0/3655403195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73100cee00 msgr2=0x7f73100cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730e7fc640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73100cee00 0x7f73100cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730e7fc640 1 -- 172.21.15.22:0/3655403195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72fc0039a0 msgr2=0x7f73100c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730e7fc640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72fc0039a0 0x7f73100c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730e7fc640 1 -- 172.21.15.22:0/3655403195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100c7450 con 0x7f731015a370 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730f7fe640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73100cee00 0x7f73100cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f730e7fc640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f731015a370 0x7f73100b89b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c780 tx=0x7f72f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:46.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.726+0000 7f73077fe640 1 -- 172.21.15.22:0/3655403195 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8005270 con 0x7f731015a370 2023-11-24T06:12:46.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.727+0000 7f73077fe640 1 -- 172.21.15.22:0/3655403195 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f80053d0 con 0x7f731015a370 2023-11-24T06:12:46.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.727+0000 7f73077fe640 1 -- 172.21.15.22:0/3655403195 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800a880 con 0x7f731015a370 2023-11-24T06:12:46.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.727+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73100c7730 con 0x7f731015a370 2023-11-24T06:12:46.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.727+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73100c7cf0 con 0x7f731015a370 2023-11-24T06:12:46.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.728+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73100c7f10 con 0x7f731015a370 2023-11-24T06:12:46.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.729+0000 7f73077fe640 1 -- 172.21.15.22:0/3655403195 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72f800a9e0 con 0x7f731015a370 2023-11-24T06:12:46.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.730+0000 7f73077fe640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72f006ae40 0x7f72f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:46.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.730+0000 7f73077fe640 1 -- 172.21.15.22:0/3655403195 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f72f8088a50 con 0x7f731015a370 2023-11-24T06:12:46.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.730+0000 7f730effd640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72f006ae40 0x7f72f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:46.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.731+0000 7f730effd640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72f006ae40 0x7f72f006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7300036000 tx=0x7f730002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.734+0000 7f73077fe640 1 -- 172.21.15.22:0/3655403195 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72f8053a70 con 0x7f731015a370 2023-11-24T06:12:46.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.928+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73100c82a0 con 0x7f731015a370 2023-11-24T06:12:46.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.929+0000 7f73077fe640 1 -- 172.21.15.22:0/3655403195 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73100c82a0 con 0x7f731015a370 2023-11-24T06:12:46.932 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:46.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72f006ae40 msgr2=0x7f72f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72f006ae40 0x7f72f006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7300036000 tx=0x7f730002e000 comp rx=0 tx=0).stop 2023-11-24T06:12:46.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f731015a370 msgr2=0x7f73100b89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:46.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f731015a370 0x7f73100b89b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c780 tx=0x7f72f800cc40 comp rx=0 tx=0).stop 2023-11-24T06:12:46.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 shutdown_connections 2023-11-24T06:12:46.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72f006ae40 0x7f72f006d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73100cee00 0x7f73100cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f731015a370 0x7f73100b89b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 --2- 172.21.15.22:0/3655403195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72fc0039a0 0x7f73100c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 >> 172.21.15.22:0/3655403195 conn(0x7f731009c5a0 msgr2=0x7f73100b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 shutdown_connections 2023-11-24T06:12:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:46.932+0000 7f731562d640 1 -- 172.21.15.22:0/3655403195 wait complete. 2023-11-24T06:12:46.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:47.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.179+0000 7ff7f6f47640 1 Processor -- start 2023-11-24T06:12:47.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.179+0000 7ff7f6f47640 1 -- start start 2023-11-24T06:12:47.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.180+0000 7ff7f6f47640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff7f015d3b0 0x7ff7f00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.180+0000 7ff7f6f47640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7f00d0fa0 0x7ff7f00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.180+0000 7ff7f6f47640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7f00d1bc0 0x7ff7f00b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.180+0000 7ff7f6f47640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00c6bf0 con 0x7ff7f015d3b0 2023-11-24T06:12:47.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.180+0000 7ff7f6f47640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00d1ff0 con 0x7ff7f00d0fa0 2023-11-24T06:12:47.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.180+0000 7ff7f6f47640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00d1430 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5f45640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff7f015d3b0 0x7ff7f00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5f45640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff7f015d3b0 0x7ff7f00ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53244/0 (socket says 172.21.15.22:53244) 2023-11-24T06:12:47.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5f45640 1 -- 172.21.15.22:0/4282514265 learned_addr learned my addr 172.21.15.22:0/4282514265 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:47.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5f45640 1 -- 172.21.15.22:0/4282514265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7f00d1bc0 msgr2=0x7ff7f00b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:47.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5f45640 1 --2- 172.21.15.22:0/4282514265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7f00d1bc0 0x7ff7f00b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5f45640 1 -- 172.21.15.22:0/4282514265 >> v2:172.21.15.31:3300/0 conn(0x7ff7f00d0fa0 msgr2=0x7ff7f00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:47.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5744640 1 --2- 172.21.15.22:0/4282514265 >> v2:172.21.15.31:3300/0 conn(0x7ff7f00d0fa0 0x7ff7f00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5f45640 1 --2- 172.21.15.22:0/4282514265 >> v2:172.21.15.31:3300/0 conn(0x7ff7f00d0fa0 0x7ff7f00d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5f45640 1 -- 172.21.15.22:0/4282514265 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00cedc0 con 0x7ff7f015d3b0 2023-11-24T06:12:47.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.181+0000 7ff7f5744640 1 --2- 172.21.15.22:0/4282514265 >> v2:172.21.15.31:3300/0 conn(0x7ff7f00d0fa0 0x7ff7f00d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:47.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.182+0000 7ff7f5f45640 1 --2- 172.21.15.22:0/4282514265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f015d3b0 0x7ff7f00ce6c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7f008c4a0 tx=0x7ff7ec02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3116db7ce2ee257 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:47.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f4f43640 1 -- 172.21.15.22:0/4282514265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec02c9e0 con 0x7ff7f015d3b0 2023-11-24T06:12:47.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f4f43640 1 -- 172.21.15.22:0/4282514265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec02cb40 con 0x7ff7f015d3b0 2023-11-24T06:12:47.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f4f43640 1 -- 172.21.15.22:0/4282514265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec0343f0 con 0x7ff7f015d3b0 2023-11-24T06:12:47.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f6f47640 1 -- 172.21.15.22:0/4282514265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f015d3b0 msgr2=0x7ff7f00ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/4282514265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f015d3b0 0x7ff7f00ce6c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7f008c4a0 tx=0x7ff7ec02be40 comp rx=0 tx=0).stop 2023-11-24T06:12:47.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f6f47640 1 -- 172.21.15.22:0/4282514265 shutdown_connections 2023-11-24T06:12:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/4282514265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7f00d1bc0 0x7ff7f00b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/4282514265 >> v2:172.21.15.31:3300/0 conn(0x7ff7f00d0fa0 0x7ff7f00d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/4282514265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f015d3b0 0x7ff7f00ce6c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f6f47640 1 -- 172.21.15.22:0/4282514265 >> 172.21.15.22:0/4282514265 conn(0x7ff7f00d30a0 msgr2=0x7ff7f00d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f6f47640 1 -- 172.21.15.22:0/4282514265 shutdown_connections 2023-11-24T06:12:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.183+0000 7ff7f6f47640 1 -- 172.21.15.22:0/4282514265 wait complete. 2023-11-24T06:12:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.185+0000 7ff7f6f47640 1 Processor -- start 2023-11-24T06:12:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.185+0000 7ff7f6f47640 1 -- start start 2023-11-24T06:12:47.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.186+0000 7ff7f6f47640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7f00d0fa0 0x7ff7f014b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.186+0000 7ff7f6f47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f00d1bc0 0x7ff7f00d3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.186+0000 7ff7f6f47640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7f015d3b0 0x7ff7f00d39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.186+0000 7ff7f6f47640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01e62e0 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.186+0000 7ff7f6f47640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01e65c0 con 0x7ff7f015d3b0 2023-11-24T06:12:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.186+0000 7ff7f6f47640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01e68a0 con 0x7ff7f00d0fa0 2023-11-24T06:12:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5744640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f00d1bc0 0x7ff7f00d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5744640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f00d1bc0 0x7ff7f00d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53248/0 (socket says 172.21.15.22:53248) 2023-11-24T06:12:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5744640 1 -- 172.21.15.22:0/3695633929 learned_addr learned my addr 172.21.15.22:0/3695633929 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5f45640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7f00d0fa0 0x7ff7f014b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f6746640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7f015d3b0 0x7ff7f00d39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5744640 1 -- 172.21.15.22:0/3695633929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7f00d0fa0 msgr2=0x7ff7f014b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5744640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7f00d0fa0 0x7ff7f014b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5744640 1 -- 172.21.15.22:0/3695633929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7f015d3b0 msgr2=0x7ff7f00d39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5744640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7f015d3b0 0x7ff7f00d39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5744640 1 -- 172.21.15.22:0/3695633929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec009b30 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.187+0000 7ff7f5744640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f00d1bc0 0x7ff7f00d3480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c7f0 tx=0x7ff7e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.188+0000 7ff7e67fc640 1 -- 172.21.15.22:0/3695633929 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0007820 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.188+0000 7ff7e67fc640 1 -- 172.21.15.22:0/3695633929 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e0007980 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.188+0000 7ff7e67fc640 1 -- 172.21.15.22:0/3695633929 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0007cf0 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.188+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f01e92a0 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.188+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f014b8b0 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.189+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f004e840 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.190+0000 7ff7e67fc640 1 -- 172.21.15.22:0/3695633929 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7e00113f0 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.191+0000 7ff7e67fc640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff7d406ae70 0x7ff7d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.191+0000 7ff7e67fc640 1 -- 172.21.15.22:0/3695633929 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff7e0089950 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.191+0000 7ff7f5f45640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff7d406ae70 0x7ff7d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.192+0000 7ff7f5f45640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff7d406ae70 0x7ff7d406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec035000 tx=0x7ff7ec030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:47.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.195+0000 7ff7e67fc640 1 -- 172.21.15.22:0/3695633929 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff7e0054960 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.389+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7f00c8d40 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.390+0000 7ff7e67fc640 1 -- 172.21.15.22:0/3695633929 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff7e001f0a0 con 0x7ff7f00d1bc0 2023-11-24T06:12:47.393 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:47.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff7d406ae70 msgr2=0x7ff7d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff7d406ae70 0x7ff7d406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec035000 tx=0x7ff7ec030000 comp rx=0 tx=0).stop 2023-11-24T06:12:47.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f00d1bc0 msgr2=0x7ff7f00d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f00d1bc0 0x7ff7f00d3480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c7f0 tx=0x7ff7e000ccb0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 shutdown_connections 2023-11-24T06:12:47.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff7d406ae70 0x7ff7d406d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7f015d3b0 0x7ff7f00d39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7f00d1bc0 0x7ff7f00d3480 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 --2- 172.21.15.22:0/3695633929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7f00d0fa0 0x7ff7f014b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.393+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 >> 172.21.15.22:0/3695633929 conn(0x7ff7f00d30a0 msgr2=0x7ff7f006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:47.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.394+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 shutdown_connections 2023-11-24T06:12:47.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.394+0000 7ff7f6f47640 1 -- 172.21.15.22:0/3695633929 wait complete. 2023-11-24T06:12:47.473 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2023-11-24T06:12:47.473 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T06:12:47.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:47.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.703+0000 7f7f82f73640 1 Processor -- start 2023-11-24T06:12:47.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.703+0000 7f7f82f73640 1 -- start start 2023-11-24T06:12:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.704+0000 7f7f82f73640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f7c13dfd0 0x7f7f7c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.705+0000 7f7f82f73640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7f7c0cf050 0x7f7f7c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.705+0000 7f7f82f73640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7c0ce7c0 con 0x7f7f7c06c130 2023-11-24T06:12:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.705+0000 7f7f82f73640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7c0cfa10 con 0x7f7f7c0cf050 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.705+0000 7f7f82f73640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c140900 con 0x7f7f7c13dfd0 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.705+0000 7f7f81770640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7f7c0cf050 0x7f7f7c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.705+0000 7f7f82772640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7f7c06c130 0x7f7f7c06c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49936/0 (socket says 172.21.15.22:49936) 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.705+0000 7f7f81770640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7f7c0cf050 0x7f7f7c0cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53264/0 (socket says 172.21.15.22:53264) 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.705+0000 7f7f82772640 1 -- 172.21.15.22:0/578189535 learned_addr learned my addr 172.21.15.22:0/578189535 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.705+0000 7f7f81f71640 1 --2- 172.21.15.22:0/578189535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f7c13dfd0 0x7f7f7c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.706+0000 7f7f81770640 1 -- 172.21.15.22:0/578189535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f7c13dfd0 msgr2=0x7f7f7c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.706+0000 7f7f81770640 1 --2- 172.21.15.22:0/578189535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f7c13dfd0 0x7f7f7c15be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.706+0000 7f7f81770640 1 -- 172.21.15.22:0/578189535 >> v1:172.21.15.22:6789/0 conn(0x7f7f7c06c130 legacy=0x7f7f7c06c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.706+0000 7f7f81770640 1 -- 172.21.15.22:0/578189535 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c15fa70 con 0x7f7f7c0cf050 2023-11-24T06:12:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.707+0000 7f7f81770640 1 --2- 172.21.15.22:0/578189535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 0x7f7f7c0cf4d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0097a0 tx=0x7f7f6c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a79502f9b4625d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.707+0000 7f7f80f6f640 1 -- 172.21.15.22:0/578189535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c02d040 con 0x7f7f7c0cf050 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.707+0000 7f7f80f6f640 1 -- 172.21.15.22:0/578189535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c031810 con 0x7f7f7c0cf050 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.707+0000 7f7f80f6f640 1 -- 172.21.15.22:0/578189535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c031ba0 con 0x7f7f7c0cf050 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.708+0000 7f7f82f73640 1 -- 172.21.15.22:0/578189535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 msgr2=0x7f7f7c0cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.708+0000 7f7f82f73640 1 --2- 172.21.15.22:0/578189535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 0x7f7f7c0cf4d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0097a0 tx=0x7f7f6c02b8b0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.708+0000 7f7f82f73640 1 -- 172.21.15.22:0/578189535 shutdown_connections 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.708+0000 7f7f82f73640 1 --2- 172.21.15.22:0/578189535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 0x7f7f7c0cf4d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.708+0000 7f7f82f73640 1 --2- 172.21.15.22:0/578189535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f7c13dfd0 0x7f7f7c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.708+0000 7f7f82f73640 1 -- 172.21.15.22:0/578189535 >> 172.21.15.22:0/578189535 conn(0x7f7f7c06a860 msgr2=0x7f7f7c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.708+0000 7f7f82f73640 1 -- 172.21.15.22:0/578189535 shutdown_connections 2023-11-24T06:12:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.708+0000 7f7f82f73640 1 -- 172.21.15.22:0/578189535 wait complete. 2023-11-24T06:12:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.709+0000 7f7f82f73640 1 Processor -- start 2023-11-24T06:12:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.710+0000 7f7f82f73640 1 -- start start 2023-11-24T06:12:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f82f73640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f7c06c130 0x7f7f7c155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f82f73640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 0x7f7f7c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f82f73640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f7c13dfd0 0x7f7f7c15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f82f73640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c155d80 con 0x7f7f7c0cf050 2023-11-24T06:12:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f82f73640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c156060 con 0x7f7f7c06c130 2023-11-24T06:12:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f82f73640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c156340 con 0x7f7f7c13dfd0 2023-11-24T06:12:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81770640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 0x7f7f7c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81770640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 0x7f7f7c156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53272/0 (socket says 172.21.15.22:53272) 2023-11-24T06:12:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81770640 1 -- 172.21.15.22:0/799423987 learned_addr learned my addr 172.21.15.22:0/799423987 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81f71640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f7c06c130 0x7f7f7c155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81770640 1 -- 172.21.15.22:0/799423987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f7c13dfd0 msgr2=0x7f7f7c15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81770640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f7c13dfd0 0x7f7f7c15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81770640 1 -- 172.21.15.22:0/799423987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f7c06c130 msgr2=0x7f7f7c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81770640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f7c06c130 0x7f7f7c155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81770640 1 -- 172.21.15.22:0/799423987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c009400 con 0x7f7f7c0cf050 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.711+0000 7f7f81f71640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f7c06c130 0x7f7f7c155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.712+0000 7f7f81770640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 0x7f7f7c156e20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0098c0 tx=0x7f7f6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.712+0000 7f7f727fc640 1 -- 172.21.15.22:0/799423987 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c03ad60 con 0x7f7f7c0cf050 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.712+0000 7f7f727fc640 1 -- 172.21.15.22:0/799423987 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c044400 con 0x7f7f7c0cf050 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.712+0000 7f7f727fc640 1 -- 172.21.15.22:0/799423987 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0447b0 con 0x7f7f7c0cf050 2023-11-24T06:12:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.712+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c156620 con 0x7f7f7c0cf050 2023-11-24T06:12:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.712+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c1556b0 con 0x7f7f7c0cf050 2023-11-24T06:12:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.714+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c156b40 con 0x7f7f7c0cf050 2023-11-24T06:12:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.714+0000 7f7f727fc640 1 -- 172.21.15.22:0/799423987 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f6c04d440 con 0x7f7f7c0cf050 2023-11-24T06:12:47.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.715+0000 7f7f727fc640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f6006ae70 0x7f7f6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:47.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.715+0000 7f7f727fc640 1 -- 172.21.15.22:0/799423987 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7f6c0abac0 con 0x7f7f7c0cf050 2023-11-24T06:12:47.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.716+0000 7f7f81f71640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f6006ae70 0x7f7f6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:47.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.716+0000 7f7f81f71640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f6006ae70 0x7f7f6006d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f78006fd0 tx=0x7f7f78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:47.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.720+0000 7f7f727fc640 1 -- 172.21.15.22:0/799423987 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f7c156b40 con 0x7f7f7c0cf050 2023-11-24T06:12:47.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.917+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f7c156b40 con 0x7f7f7c0cf050 2023-11-24T06:12:47.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.919+0000 7f7f727fc640 1 -- 172.21.15.22:0/799423987 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f7f7c156b40 con 0x7f7f7c0cf050 2023-11-24T06:12:47.922 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:47.922 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f6006ae70 msgr2=0x7f7f6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f6006ae70 0x7f7f6006d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f78006fd0 tx=0x7f7f78008040 comp rx=0 tx=0).stop 2023-11-24T06:12:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 msgr2=0x7f7f7c156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 0x7f7f7c156e20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0098c0 tx=0x7f7f6c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 shutdown_connections 2023-11-24T06:12:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f6006ae70 0x7f7f6006d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f7c13dfd0 0x7f7f7c15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f7c0cf050 0x7f7f7c156e20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 --2- 172.21.15.22:0/799423987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f7c06c130 0x7f7f7c155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 >> 172.21.15.22:0/799423987 conn(0x7f7f7c06a860 msgr2=0x7f7f7c15a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 shutdown_connections 2023-11-24T06:12:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:47.922+0000 7f7f82f73640 1 -- 172.21.15.22:0/799423987 wait complete. 2023-11-24T06:12:47.943 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:47.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.174+0000 7ff5a5d6c640 1 Processor -- start 2023-11-24T06:12:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.174+0000 7ff5a5d6c640 1 -- start start 2023-11-24T06:12:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.176+0000 7ff5a5d6c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5a01595a0 0x7ff5a006d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.176+0000 7ff5a5d6c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a006a7e0 con 0x7ff5a0070990 2023-11-24T06:12:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.176+0000 7ff5a5d6c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a006a4e0 con 0x7ff5a00c45b0 2023-11-24T06:12:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.176+0000 7ff5a5d6c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a006ddc0 con 0x7ff5a01595a0 2023-11-24T06:12:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.176+0000 7ff5a556b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff5a0070990 0x7ff5a00c9b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49942/0 (socket says 172.21.15.22:49942) 2023-11-24T06:12:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.176+0000 7ff5a556b640 1 -- 172.21.15.22:0/2347491694 learned_addr learned my addr 172.21.15.22:0/2347491694 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff5a4d6a640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5a01595a0 0x7ff5a006d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954303238 0 0) 0x7ff5a006a7e0 con 0x7ff5a0070990 2023-11-24T06:12:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff590003520 con 0x7ff5a0070990 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341866739 0 0) 0x7ff590003520 con 0x7ff5a0070990 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5a01595a0 msgr2=0x7ff5a006d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5a01595a0 0x7ff5a006d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 >> v1:172.21.15.31:6789/0 conn(0x7ff5a00c45b0 legacy=0x7ff5a006ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00c4b70 con 0x7ff5a0070990 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7ff5980019f0 con 0x7ff5a0070990 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 >> v1:172.21.15.22:6789/0 conn(0x7ff5a0070990 legacy=0x7ff5a00c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5a01595a0 0x7ff590003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff590003fe0 0x7ff5900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.177+0000 7ff59f7fe640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff590004d00 0x7ff590005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a006ddc0 con 0x7ff590004d00 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000bb40 con 0x7ff590003fe0 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000bd00 con 0x7ff5a01595a0 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff5a556b640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff590004d00 0x7ff590005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff5a4d6a640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5a01595a0 0x7ff590003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff59ffff640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff590003fe0 0x7ff5900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff5a556b640 1 -- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5a01595a0 msgr2=0x7ff590003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff5a556b640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5a01595a0 0x7ff590003a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff5a556b640 1 -- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff590003fe0 msgr2=0x7ff5900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff5a556b640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff590003fe0 0x7ff5900047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.178+0000 7ff5a556b640 1 -- 172.21.15.22:0/2347491694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590003520 con 0x7ff590004d00 2023-11-24T06:12:48.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.179+0000 7ff5a556b640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff590004d00 0x7ff590005180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff59800a370 tx=0x7ff5900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e35ef83d5292f64 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:48.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598036630 con 0x7ff590004d00 2023-11-24T06:12:48.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff598031070 con 0x7ff590004d00 2023-11-24T06:12:48.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff59f7fe640 1 -- 172.21.15.22:0/2347491694 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598036a50 con 0x7ff590004d00 2023-11-24T06:12:48.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/2347491694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff590004d00 msgr2=0x7ff590005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff5a5d6c640 1 --2- 172.21.15.22:0/2347491694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff590004d00 0x7ff590005180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff59800a370 tx=0x7ff5900057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff5a556b640 1 -- 172.21.15.22:0/2347491694 reap_dead start 2023-11-24T06:12:48.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/2347491694 shutdown_connections 2023-11-24T06:12:48.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/2347491694 >> 172.21.15.22:0/2347491694 conn(0x7ff5a00cf500 msgr2=0x7ff5a00cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:48.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/2347491694 shutdown_connections 2023-11-24T06:12:48.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.180+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/2347491694 wait complete. 2023-11-24T06:12:48.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.182+0000 7ff5a5d6c640 1 Processor -- start 2023-11-24T06:12:48.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.182+0000 7ff5a5d6c640 1 -- start start 2023-11-24T06:12:48.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.183+0000 7ff5a5d6c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff590004d00 0x7ff5a0157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.183+0000 7ff5a5d6c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a014b0e0 0x7ff5a015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.183+0000 7ff5a5d6c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a00ca9e0 0x7ff5a00cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.183+0000 7ff5a5d6c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00cb3d0 con 0x7ff5a014b0e0 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.183+0000 7ff5a5d6c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01f31d0 con 0x7ff5a00ca9e0 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff5a5d6c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00b3410 con 0x7ff590004d00 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff59ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a014b0e0 0x7ff5a015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff59ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a014b0e0 0x7ff5a015b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53298/0 (socket says 172.21.15.22:53298) 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff59ffff640 1 -- 172.21.15.22:0/513208072 learned_addr learned my addr 172.21.15.22:0/513208072 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff5a556b640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a00ca9e0 0x7ff5a00cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff5a4d6a640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff590004d00 0x7ff5a0157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff59ffff640 1 -- 172.21.15.22:0/513208072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff590004d00 msgr2=0x7ff5a0157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff59ffff640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff590004d00 0x7ff5a0157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff59ffff640 1 -- 172.21.15.22:0/513208072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a00ca9e0 msgr2=0x7ff5a00cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff59ffff640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a00ca9e0 0x7ff5a00cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff59ffff640 1 -- 172.21.15.22:0/513208072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00b2ae0 con 0x7ff5a014b0e0 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.184+0000 7ff5a4d6a640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff590004d00 0x7ff5a0157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.185+0000 7ff59ffff640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a014b0e0 0x7ff5a015b7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00d540 tx=0x7ff58c00da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.185+0000 7ff59d7fa640 1 -- 172.21.15.22:0/513208072 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c005480 con 0x7ff5a014b0e0 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.185+0000 7ff59d7fa640 1 -- 172.21.15.22:0/513208072 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c003610 con 0x7ff5a014b0e0 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.185+0000 7ff59d7fa640 1 -- 172.21.15.22:0/513208072 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c003980 con 0x7ff5a014b0e0 2023-11-24T06:12:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.185+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a00b2dc0 con 0x7ff5a014b0e0 2023-11-24T06:12:48.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.185+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a015bce0 con 0x7ff5a014b0e0 2023-11-24T06:12:48.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.186+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a00ce750 con 0x7ff5a014b0e0 2023-11-24T06:12:48.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.187+0000 7ff59d7fa640 1 -- 172.21.15.22:0/513208072 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff58c003ae0 con 0x7ff5a014b0e0 2023-11-24T06:12:48.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.188+0000 7ff59d7fa640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff58406ae40 0x7ff58406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.188+0000 7ff59d7fa640 1 -- 172.21.15.22:0/513208072 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff58c089610 con 0x7ff5a014b0e0 2023-11-24T06:12:48.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.189+0000 7ff5a4d6a640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff58406ae40 0x7ff58406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.189+0000 7ff5a4d6a640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff58406ae40 0x7ff58406d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff59400aa60 tx=0x7ff594008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:48.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.193+0000 7ff59d7fa640 1 -- 172.21.15.22:0/513208072 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff58c054590 con 0x7ff5a014b0e0 2023-11-24T06:12:48.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.386+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5a004e840 con 0x7ff5a014b0e0 2023-11-24T06:12:48.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.387+0000 7ff59d7fa640 1 -- 172.21.15.22:0/513208072 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff58c057bb0 con 0x7ff5a014b0e0 2023-11-24T06:12:48.391 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff58406ae40 msgr2=0x7ff58406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff58406ae40 0x7ff58406d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff59400aa60 tx=0x7ff594008040 comp rx=0 tx=0).stop 2023-11-24T06:12:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a014b0e0 msgr2=0x7ff5a015b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a014b0e0 0x7ff5a015b7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00d540 tx=0x7ff58c00da00 comp rx=0 tx=0).stop 2023-11-24T06:12:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 shutdown_connections 2023-11-24T06:12:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff58406ae40 0x7ff58406d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a00ca9e0 0x7ff5a00cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a014b0e0 0x7ff5a015b7a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 --2- 172.21.15.22:0/513208072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff590004d00 0x7ff5a0157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 >> 172.21.15.22:0/513208072 conn(0x7ff5a00cf500 msgr2=0x7ff5a00ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 shutdown_connections 2023-11-24T06:12:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.390+0000 7ff5a5d6c640 1 -- 172.21.15.22:0/513208072 wait complete. 2023-11-24T06:12:48.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:48.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.632+0000 7f53f3168640 1 Processor -- start 2023-11-24T06:12:48.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.633+0000 7f53f3168640 1 -- start start 2023-11-24T06:12:48.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.634+0000 7f53f3168640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53ec161b80 0x7f53ec06b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.634+0000 7f53f3168640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f53ec06b990 0x7f53ec06cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.635+0000 7f53f3168640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ec161ff0 con 0x7f53ec15d3c0 2023-11-24T06:12:48.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.635+0000 7f53f3168640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec06bdc0 con 0x7f53ec161b80 2023-11-24T06:12:48.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.635+0000 7f53f3168640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec0b3ff0 con 0x7f53ec06b990 2023-11-24T06:12:48.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.635+0000 7f53ebfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53ec161b80 0x7f53ec06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.635+0000 7f53ebfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53ec161b80 0x7f53ec06b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53302/0 (socket says 172.21.15.22:53302) 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.635+0000 7f53ebfff640 1 -- 172.21.15.22:0/4224558076 learned_addr learned my addr 172.21.15.22:0/4224558076 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.635+0000 7f53f1705640 1 --2- 172.21.15.22:0/4224558076 >> v2:172.21.15.31:3300/0 conn(0x7f53ec06b990 0x7f53ec06cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.636+0000 7f53ebfff640 1 -- 172.21.15.22:0/4224558076 >> v2:172.21.15.31:3300/0 conn(0x7f53ec06b990 msgr2=0x7f53ec06cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.636+0000 7f53ebfff640 1 --2- 172.21.15.22:0/4224558076 >> v2:172.21.15.31:3300/0 conn(0x7f53ec06b990 0x7f53ec06cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.636+0000 7f53ebfff640 1 -- 172.21.15.22:0/4224558076 >> v1:172.21.15.22:6789/0 conn(0x7f53ec15d3c0 legacy=0x7f53ec0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.636+0000 7f53ebfff640 1 -- 172.21.15.22:0/4224558076 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0b3270 con 0x7f53ec161b80 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.637+0000 7f53ebfff640 1 --2- 172.21.15.22:0/4224558076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec161b80 0x7f53ec06b450 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0b3c90 tx=0x7f53d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64d49be3f179b59 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.637+0000 7f53eb7fe640 1 -- 172.21.15.22:0/4224558076 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8030860 con 0x7f53ec161b80 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.637+0000 7f53eb7fe640 1 -- 172.21.15.22:0/4224558076 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d80309c0 con 0x7f53ec161b80 2023-11-24T06:12:48.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.637+0000 7f53eb7fe640 1 -- 172.21.15.22:0/4224558076 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8030d50 con 0x7f53ec161b80 2023-11-24T06:12:48.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.638+0000 7f53f3168640 1 -- 172.21.15.22:0/4224558076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec161b80 msgr2=0x7f53ec06b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.638+0000 7f53f3168640 1 --2- 172.21.15.22:0/4224558076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec161b80 0x7f53ec06b450 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0b3c90 tx=0x7f53d802b9a0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.638+0000 7f53f3168640 1 -- 172.21.15.22:0/4224558076 shutdown_connections 2023-11-24T06:12:48.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.638+0000 7f53f3168640 1 --2- 172.21.15.22:0/4224558076 >> v2:172.21.15.31:3300/0 conn(0x7f53ec06b990 0x7f53ec06cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.638+0000 7f53f3168640 1 --2- 172.21.15.22:0/4224558076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec161b80 0x7f53ec06b450 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.638+0000 7f53f3168640 1 -- 172.21.15.22:0/4224558076 >> 172.21.15.22:0/4224558076 conn(0x7f53ec0cfd60 msgr2=0x7f53ec070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:48.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.638+0000 7f53f3168640 1 -- 172.21.15.22:0/4224558076 shutdown_connections 2023-11-24T06:12:48.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.638+0000 7f53f3168640 1 -- 172.21.15.22:0/4224558076 wait complete. 2023-11-24T06:12:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.640+0000 7f53f3168640 1 Processor -- start 2023-11-24T06:12:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.640+0000 7f53f3168640 1 -- start start 2023-11-24T06:12:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.641+0000 7f53f3168640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53ec06b990 0x7f53ec1f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.641+0000 7f53f3168640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec15d3c0 0x7f53ec14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.641+0000 7f53f3168640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53ec161b80 0x7f53ec06de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.641+0000 7f53f3168640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec1f7cc0 con 0x7f53ec15d3c0 2023-11-24T06:12:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.641+0000 7f53f3168640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec1f6d30 con 0x7f53ec06b990 2023-11-24T06:12:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.641+0000 7f53f3168640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec14b050 con 0x7f53ec161b80 2023-11-24T06:12:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.641+0000 7f53ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec15d3c0 0x7f53ec14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.641+0000 7f53ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec15d3c0 0x7f53ec14a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53308/0 (socket says 172.21.15.22:53308) 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.641+0000 7f53ebfff640 1 -- 172.21.15.22:0/3942675020 learned_addr learned my addr 172.21.15.22:0/3942675020 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53f0f04640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53ec06b990 0x7f53ec1f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53f1705640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53ec161b80 0x7f53ec06de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53ebfff640 1 -- 172.21.15.22:0/3942675020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53ec161b80 msgr2=0x7f53ec06de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53ebfff640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53ec161b80 0x7f53ec06de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53ebfff640 1 -- 172.21.15.22:0/3942675020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53ec06b990 msgr2=0x7f53ec1f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53ebfff640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53ec06b990 0x7f53ec1f7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53ebfff640 1 -- 172.21.15.22:0/3942675020 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80094d0 con 0x7f53ec15d3c0 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53f0f04640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53ec06b990 0x7f53ec1f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53ebfff640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec15d3c0 0x7f53ec14a5d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f53d8000c00 tx=0x7f53d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53e97fa640 1 -- 172.21.15.22:0/3942675020 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8039b50 con 0x7f53ec15d3c0 2023-11-24T06:12:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53e97fa640 1 -- 172.21.15.22:0/3942675020 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d8039cb0 con 0x7f53ec15d3c0 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53e97fa640 1 -- 172.21.15.22:0/3942675020 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8043650 con 0x7f53ec15d3c0 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.642+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec14b330 con 0x7f53ec15d3c0 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.643+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec1f7260 con 0x7f53ec15d3c0 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.644+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ec1f7450 con 0x7f53ec15d3c0 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.645+0000 7f53e97fa640 1 -- 172.21.15.22:0/3942675020 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53d804c3b0 con 0x7f53ec15d3c0 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.646+0000 7f53e97fa640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53d006aec0 0x7f53d006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.646+0000 7f53e97fa640 1 -- 172.21.15.22:0/3942675020 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f53d80abc90 con 0x7f53ec15d3c0 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.646+0000 7f53f0f04640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53d006aec0 0x7f53d006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.646+0000 7f53f0f04640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53d006aec0 0x7f53d006d380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f53e0001680 tx=0x7f53e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:48.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.650+0000 7f53e97fa640 1 -- 172.21.15.22:0/3942675020 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f53d8076c90 con 0x7f53ec15d3c0 2023-11-24T06:12:48.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.846+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53ec072620 con 0x7f53ec15d3c0 2023-11-24T06:12:48.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.847+0000 7f53e97fa640 1 -- 172.21.15.22:0/3942675020 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53d807a2b0 con 0x7f53ec15d3c0 2023-11-24T06:12:48.850 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53d006aec0 msgr2=0x7f53d006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53d006aec0 0x7f53d006d380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f53e0001680 tx=0x7f53e0009040 comp rx=0 tx=0).stop 2023-11-24T06:12:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec15d3c0 msgr2=0x7f53ec14a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec15d3c0 0x7f53ec14a5d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f53d8000c00 tx=0x7f53d8004730 comp rx=0 tx=0).stop 2023-11-24T06:12:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 shutdown_connections 2023-11-24T06:12:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f53d006aec0 0x7f53d006d380 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53ec161b80 0x7f53ec06de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ec15d3c0 0x7f53ec14a5d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 --2- 172.21.15.22:0/3942675020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53ec06b990 0x7f53ec1f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:48.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 >> 172.21.15.22:0/3942675020 conn(0x7f53ec0cfd60 msgr2=0x7f53ec0ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:48.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 shutdown_connections 2023-11-24T06:12:48.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:48.850+0000 7f53f3168640 1 -- 172.21.15.22:0/3942675020 wait complete. 2023-11-24T06:12:48.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:49.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.100+0000 7fc9d5547640 1 Processor -- start 2023-11-24T06:12:49.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.100+0000 7fc9d5547640 1 -- start start 2023-11-24T06:12:49.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.102+0000 7fc9d5547640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d015f270 0x7fc9d00cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.102+0000 7fc9d5547640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc9d006d9e0 0x7fc9d00cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.102+0000 7fc9d5547640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d015f930 con 0x7fc9d0144770 2023-11-24T06:12:49.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.102+0000 7fc9d5547640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00b43b0 con 0x7fc9d006d9e0 2023-11-24T06:12:49.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.102+0000 7fc9d5547640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b3b10 con 0x7fc9d015f270 2023-11-24T06:12:49.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.103+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d015f270 0x7fc9d00cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.103+0000 7fc9cffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc9d0144770 0x7fc9d015eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:57874/0 (socket says 172.21.15.22:57874) 2023-11-24T06:12:49.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.103+0000 7fc9d4d46640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc9d006d9e0 0x7fc9d00cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.103+0000 7fc9cffff640 1 -- 172.21.15.22:0/3072033748 learned_addr learned my addr 172.21.15.22:0/3072033748 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:49.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.104+0000 7fc9d4d46640 1 -- 172.21.15.22:0/3072033748 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d015f270 msgr2=0x7fc9d00cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:49.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.104+0000 7fc9d4d46640 1 --2- 172.21.15.22:0/3072033748 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d015f270 0x7fc9d00cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.104+0000 7fc9d4d46640 1 -- 172.21.15.22:0/3072033748 >> v1:172.21.15.31:6789/0 conn(0x7fc9d0144770 legacy=0x7fc9d015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:49.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.104+0000 7fc9d4d46640 1 -- 172.21.15.22:0/3072033748 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00b3df0 con 0x7fc9d006d9e0 2023-11-24T06:12:49.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.105+0000 7fc9d4d46640 1 --2- 172.21.15.22:0/3072033748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9d006d9e0 0x7fc9d00cd9e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009d90 tx=0x7fc9c802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fd62a3dab9dd98 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:49.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9cf7fe640 1 -- 172.21.15.22:0/3072033748 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c802cc60 con 0x7fc9d006d9e0 2023-11-24T06:12:49.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9cf7fe640 1 -- 172.21.15.22:0/3072033748 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c802cdc0 con 0x7fc9d006d9e0 2023-11-24T06:12:49.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9cf7fe640 1 -- 172.21.15.22:0/3072033748 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8034660 con 0x7fc9d006d9e0 2023-11-24T06:12:49.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9d5547640 1 -- 172.21.15.22:0/3072033748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9d006d9e0 msgr2=0x7fc9d00cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:49.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9d5547640 1 --2- 172.21.15.22:0/3072033748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9d006d9e0 0x7fc9d00cd9e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009d90 tx=0x7fc9c802beb0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9d5547640 1 -- 172.21.15.22:0/3072033748 shutdown_connections 2023-11-24T06:12:49.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9d5547640 1 --2- 172.21.15.22:0/3072033748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9d006d9e0 0x7fc9d00cd9e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9d5547640 1 --2- 172.21.15.22:0/3072033748 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d015f270 0x7fc9d00cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9d5547640 1 -- 172.21.15.22:0/3072033748 >> 172.21.15.22:0/3072033748 conn(0x7fc9d00cec10 msgr2=0x7fc9d00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:49.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.106+0000 7fc9d5547640 1 -- 172.21.15.22:0/3072033748 shutdown_connections 2023-11-24T06:12:49.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.107+0000 7fc9d5547640 1 -- 172.21.15.22:0/3072033748 wait complete. 2023-11-24T06:12:49.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.108+0000 7fc9d5547640 1 Processor -- start 2023-11-24T06:12:49.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.108+0000 7fc9d5547640 1 -- start start 2023-11-24T06:12:49.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.109+0000 7fc9d5547640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d006d9e0 0x7fc9d00ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.109+0000 7fc9d5547640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0144770 0x7fc9d013a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.109+0000 7fc9d5547640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9d015f270 0x7fc9d00aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.109+0000 7fc9d5547640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d013ab30 con 0x7fc9d0144770 2023-11-24T06:12:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.109+0000 7fc9d5547640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00acde0 con 0x7fc9d015f270 2023-11-24T06:12:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.109+0000 7fc9d5547640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00ad0c0 con 0x7fc9d006d9e0 2023-11-24T06:12:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0144770 0x7fc9d013a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0144770 0x7fc9d013a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53316/0 (socket says 172.21.15.22:53316) 2023-11-24T06:12:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9c7fff640 1 -- 172.21.15.22:0/2996818354 learned_addr learned my addr 172.21.15.22:0/2996818354 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9cffff640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d006d9e0 0x7fc9d00ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9d4d46640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9d015f270 0x7fc9d00aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9c7fff640 1 -- 172.21.15.22:0/2996818354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d006d9e0 msgr2=0x7fc9d00ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9c7fff640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d006d9e0 0x7fc9d00ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9c7fff640 1 -- 172.21.15.22:0/2996818354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9d015f270 msgr2=0x7fc9d00aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:49.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9c7fff640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9d015f270 0x7fc9d00aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.110+0000 7fc9c7fff640 1 -- 172.21.15.22:0/2996818354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8009a70 con 0x7fc9d0144770 2023-11-24T06:12:49.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.111+0000 7fc9c7fff640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0144770 0x7fc9d013a5f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800e870 tx=0x7fc9b800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:49.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.111+0000 7fc9cd7fa640 1 -- 172.21.15.22:0/2996818354 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80094f0 con 0x7fc9d0144770 2023-11-24T06:12:49.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.111+0000 7fc9cd7fa640 1 -- 172.21.15.22:0/2996818354 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b800c940 con 0x7fc9d0144770 2023-11-24T06:12:49.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.111+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d00ad3a0 con 0x7fc9d0144770 2023-11-24T06:12:49.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.111+0000 7fc9cd7fa640 1 -- 172.21.15.22:0/2996818354 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800ccf0 con 0x7fc9d0144770 2023-11-24T06:12:49.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.111+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d00ad960 con 0x7fc9d0144770 2023-11-24T06:12:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.112+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d004e840 con 0x7fc9d0144770 2023-11-24T06:12:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.113+0000 7fc9cd7fa640 1 -- 172.21.15.22:0/2996818354 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9b8013470 con 0x7fc9d0144770 2023-11-24T06:12:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.114+0000 7fc9cd7fa640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc9b006ae40 0x7fc9b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.114+0000 7fc9cd7fa640 1 -- 172.21.15.22:0/2996818354 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc9b80898e0 con 0x7fc9d0144770 2023-11-24T06:12:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.114+0000 7fc9cffff640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc9b006ae40 0x7fc9b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.115+0000 7fc9cffff640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc9b006ae40 0x7fc9b006d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0005880 tx=0x7fc9c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.119+0000 7fc9cd7fa640 1 -- 172.21.15.22:0/2996818354 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9b80547e0 con 0x7fc9d0144770 2023-11-24T06:12:49.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.313+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9d00b2460 con 0x7fc9d0144770 2023-11-24T06:12:49.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.314+0000 7fc9cd7fa640 1 -- 172.21.15.22:0/2996818354 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9b8057e00 con 0x7fc9d0144770 2023-11-24T06:12:49.316 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:49.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.316+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc9b006ae40 msgr2=0x7fc9b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.316+0000 7fc9d5547640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc9b006ae40 0x7fc9b006d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0005880 tx=0x7fc9c0009040 comp rx=0 tx=0).stop 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.316+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0144770 msgr2=0x7fc9d013a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.316+0000 7fc9d5547640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0144770 0x7fc9d013a5f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800e870 tx=0x7fc9b800ed30 comp rx=0 tx=0).stop 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.317+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 shutdown_connections 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.317+0000 7fc9d5547640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc9b006ae40 0x7fc9b006d300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.317+0000 7fc9d5547640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9d015f270 0x7fc9d00aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.317+0000 7fc9d5547640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0144770 0x7fc9d013a5f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.317+0000 7fc9d5547640 1 --2- 172.21.15.22:0/2996818354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9d006d9e0 0x7fc9d00ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.317+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 >> 172.21.15.22:0/2996818354 conn(0x7fc9d00cec10 msgr2=0x7fc9d00b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.317+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 shutdown_connections 2023-11-24T06:12:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.317+0000 7fc9d5547640 1 -- 172.21.15.22:0/2996818354 wait complete. 2023-11-24T06:12:49.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-11-24T06:12:49.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.555+0000 7fe229fbc640 1 Processor -- start 2023-11-24T06:12:49.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.556+0000 7fe229fbc640 1 -- start start 2023-11-24T06:12:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.558+0000 7fe229fbc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe22413dfd0 0x7fe22415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.558+0000 7fe229fbc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 0x7fe2240cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.558+0000 7fe229fbc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe22406c130 0x7fe22406c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.558+0000 7fe229fbc640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2240cfa10 con 0x7fe22406c130 2023-11-24T06:12:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.558+0000 7fe229fbc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22415fa70 con 0x7fe22413dfd0 2023-11-24T06:12:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.558+0000 7fe229fbc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22415ee60 con 0x7fe2240cf050 2023-11-24T06:12:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.558+0000 7fe2297bb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe22406c130 0x7fe22406c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.558+0000 7fe2297bb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe22406c130 0x7fe22406c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53322/0 (socket says 172.21.15.22:53322) 2023-11-24T06:12:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.558+0000 7fe2297bb640 1 -- 172.21.15.22:0/3393791971 learned_addr learned my addr 172.21.15.22:0/3393791971 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:49.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.559+0000 7fe223fff640 1 --2- 172.21.15.22:0/3393791971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 0x7fe2240cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.559+0000 7fe2297bb640 1 -- 172.21.15.22:0/3393791971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 msgr2=0x7fe2240cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:49.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.559+0000 7fe228fba640 1 --2- 172.21.15.22:0/3393791971 >> v2:172.21.15.31:3300/0 conn(0x7fe22413dfd0 0x7fe22415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.559+0000 7fe2297bb640 1 --2- 172.21.15.22:0/3393791971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 0x7fe2240cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.559+0000 7fe2297bb640 1 -- 172.21.15.22:0/3393791971 >> v2:172.21.15.31:3300/0 conn(0x7fe22413dfd0 msgr2=0x7fe22415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:49.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.559+0000 7fe2297bb640 1 --2- 172.21.15.22:0/3393791971 >> v2:172.21.15.31:3300/0 conn(0x7fe22413dfd0 0x7fe22415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.559+0000 7fe2297bb640 1 -- 172.21.15.22:0/3393791971 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22415f140 con 0x7fe22406c130 2023-11-24T06:12:49.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.559+0000 7fe223fff640 1 --2- 172.21.15.22:0/3393791971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 0x7fe2240cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:49.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.560+0000 7fe2297bb640 1 --2- 172.21.15.22:0/3393791971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22406c130 0x7fe22406c580 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe2240cfc10 tx=0x7fe21c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfe8aa7cc8a69c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.560+0000 7fe2237fe640 1 -- 172.21.15.22:0/3393791971 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c02ca70 con 0x7fe22406c130 2023-11-24T06:12:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.560+0000 7fe2237fe640 1 -- 172.21.15.22:0/3393791971 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c02cbd0 con 0x7fe22406c130 2023-11-24T06:12:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.560+0000 7fe2237fe640 1 -- 172.21.15.22:0/3393791971 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0343f0 con 0x7fe22406c130 2023-11-24T06:12:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.561+0000 7fe229fbc640 1 -- 172.21.15.22:0/3393791971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22406c130 msgr2=0x7fe22406c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.561+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3393791971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22406c130 0x7fe22406c580 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe2240cfc10 tx=0x7fe21c02bed0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.561+0000 7fe229fbc640 1 -- 172.21.15.22:0/3393791971 shutdown_connections 2023-11-24T06:12:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.561+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3393791971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22406c130 0x7fe22406c580 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.561+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3393791971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 0x7fe2240cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.561+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3393791971 >> v2:172.21.15.31:3300/0 conn(0x7fe22413dfd0 0x7fe22415be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.561+0000 7fe229fbc640 1 -- 172.21.15.22:0/3393791971 >> 172.21.15.22:0/3393791971 conn(0x7fe22406a860 msgr2=0x7fe22406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.561+0000 7fe229fbc640 1 -- 172.21.15.22:0/3393791971 shutdown_connections 2023-11-24T06:12:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.561+0000 7fe229fbc640 1 -- 172.21.15.22:0/3393791971 wait complete. 2023-11-24T06:12:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.563+0000 7fe229fbc640 1 Processor -- start 2023-11-24T06:12:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.563+0000 7fe229fbc640 1 -- start start 2023-11-24T06:12:49.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.564+0000 7fe229fbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe22406c130 0x7fe22415db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.564+0000 7fe229fbc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 0x7fe22413c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.564+0000 7fe229fbc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22413dfd0 0x7fe22413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.564+0000 7fe229fbc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe224070200 con 0x7fe22413dfd0 2023-11-24T06:12:49.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.564+0000 7fe229fbc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240704e0 con 0x7fe22406c130 2023-11-24T06:12:49.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.564+0000 7fe229fbc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240707c0 con 0x7fe2240cf050 2023-11-24T06:12:49.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.564+0000 7fe2297bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22413dfd0 0x7fe22413cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.564+0000 7fe2297bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22413dfd0 0x7fe22413cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53324/0 (socket says 172.21.15.22:53324) 2023-11-24T06:12:49.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.564+0000 7fe2297bb640 1 -- 172.21.15.22:0/3051863337 learned_addr learned my addr 172.21.15.22:0/3051863337 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:49.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe223fff640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 0x7fe22413c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe228fba640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe22406c130 0x7fe22415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe2297bb640 1 -- 172.21.15.22:0/3051863337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 msgr2=0x7fe22413c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe2297bb640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 0x7fe22413c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe2297bb640 1 -- 172.21.15.22:0/3051863337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe22406c130 msgr2=0x7fe22415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe2297bb640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe22406c130 0x7fe22415db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe2297bb640 1 -- 172.21.15.22:0/3051863337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c009b30 con 0x7fe22413dfd0 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe2297bb640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22413dfd0 0x7fe22413cae0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe21c036040 tx=0x7fe21c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe2217fa640 1 -- 172.21.15.22:0/3051863337 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c009510 con 0x7fe22413dfd0 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe2217fa640 1 -- 172.21.15.22:0/3051863337 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c03e450 con 0x7fe22413dfd0 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe2217fa640 1 -- 172.21.15.22:0/3051863337 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c03e800 con 0x7fe22413dfd0 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.565+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe224070aa0 con 0x7fe22413dfd0 2023-11-24T06:12:49.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.566+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22415e040 con 0x7fe22413dfd0 2023-11-24T06:12:49.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.567+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22415e1d0 con 0x7fe22413dfd0 2023-11-24T06:12:49.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.568+0000 7fe2217fa640 1 -- 172.21.15.22:0/3051863337 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe21c03e960 con 0x7fe22413dfd0 2023-11-24T06:12:49.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.568+0000 7fe2217fa640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe20806ae90 0x7fe20806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:49.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.569+0000 7fe2217fa640 1 -- 172.21.15.22:0/3051863337 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe21c0ac4e0 con 0x7fe22413dfd0 2023-11-24T06:12:49.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.569+0000 7fe228fba640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe20806ae90 0x7fe20806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:49.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.569+0000 7fe228fba640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe20806ae90 0x7fe20806d350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe21800b740 tx=0x7fe218008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:49.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.574+0000 7fe2217fa640 1 -- 172.21.15.22:0/3051863337 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe21c077740 con 0x7fe22413dfd0 2023-11-24T06:12:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:49.837+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7fe224070f60 con 0x7fe22413dfd0 2023-11-24T06:12:50.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.463+0000 7fe2217fa640 1 -- 172.21.15.22:0/3051863337 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe21c07ad60 con 0x7fe22413dfd0 2023-11-24T06:12:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.466+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe20806ae90 msgr2=0x7fe20806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.466+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe20806ae90 0x7fe20806d350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe21800b740 tx=0x7fe218008040 comp rx=0 tx=0).stop 2023-11-24T06:12:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.466+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22413dfd0 msgr2=0x7fe22413cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.466+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22413dfd0 0x7fe22413cae0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe21c036040 tx=0x7fe21c004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.467+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 shutdown_connections 2023-11-24T06:12:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.467+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe20806ae90 0x7fe20806d350 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.467+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe22413dfd0 0x7fe22413cae0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.467+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2240cf050 0x7fe22413c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.467+0000 7fe229fbc640 1 --2- 172.21.15.22:0/3051863337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe22406c130 0x7fe22415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.467+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 >> 172.21.15.22:0/3051863337 conn(0x7fe22406a860 msgr2=0x7fe22415aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:50.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.467+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 shutdown_connections 2023-11-24T06:12:50.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.467+0000 7fe229fbc640 1 -- 172.21.15.22:0/3051863337 wait complete. 2023-11-24T06:12:50.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:12:50.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:12:50.541 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:12:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.714+0000 7f36eb990640 1 Processor -- start 2023-11-24T06:12:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.714+0000 7f36eb990640 1 -- start start 2023-11-24T06:12:50.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.716+0000 7f36eb990640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e415b350 0x7f36e40abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:50.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.716+0000 7f36eb990640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36e409cb30 0x7f36e40b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:50.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.716+0000 7f36eb990640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e415b730 con 0x7f36e40adb60 2023-11-24T06:12:50.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.716+0000 7f36eb990640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e40ac740 con 0x7f36e409cb30 2023-11-24T06:12:50.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.716+0000 7f36eb990640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40ac460 con 0x7f36e415b350 2023-11-24T06:12:50.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.716+0000 7f36e8f2b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36e409cb30 0x7f36e40b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.716+0000 7f36e8f2b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36e409cb30 0x7f36e40b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53336/0 (socket says 172.21.15.22:53336) 2023-11-24T06:12:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.716+0000 7f36e8f2b640 1 -- 172.21.15.22:0/2576275221 learned_addr learned my addr 172.21.15.22:0/2576275221 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.717+0000 7f36e972c640 1 --2- 172.21.15.22:0/2576275221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e415b350 0x7f36e40abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.717+0000 7f36e8f2b640 1 -- 172.21.15.22:0/2576275221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e415b350 msgr2=0x7f36e40abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:50.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.717+0000 7f36e8f2b640 1 --2- 172.21.15.22:0/2576275221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e415b350 0x7f36e40abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.717+0000 7f36e8f2b640 1 -- 172.21.15.22:0/2576275221 >> v1:172.21.15.31:6789/0 conn(0x7f36e40adb60 legacy=0x7f36e40adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:50.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.717+0000 7f36e8f2b640 1 -- 172.21.15.22:0/2576275221 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40b2a50 con 0x7f36e409cb30 2023-11-24T06:12:50.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.717+0000 7f36dbfff640 1 -- 172.21.15.22:0/2576275221 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221831988 0 0) 0x7f36dc001490 con 0x7f36e40adb60 2023-11-24T06:12:50.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.718+0000 7f36e8f2b640 1 --2- 172.21.15.22:0/2576275221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e409cb30 0x7f36e40b3530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8f97dc46387daf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:50.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.719+0000 7f36dbfff640 1 -- 172.21.15.22:0/2576275221 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4030840 con 0x7f36e409cb30 2023-11-24T06:12:50.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.719+0000 7f36dbfff640 1 -- 172.21.15.22:0/2576275221 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d40309a0 con 0x7f36e409cb30 2023-11-24T06:12:50.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.719+0000 7f36dbfff640 1 -- 172.21.15.22:0/2576275221 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4030d30 con 0x7f36e409cb30 2023-11-24T06:12:50.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.719+0000 7f36eb990640 1 -- 172.21.15.22:0/2576275221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e409cb30 msgr2=0x7f36e40b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:50.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.719+0000 7f36eb990640 1 --2- 172.21.15.22:0/2576275221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e409cb30 0x7f36e40b3530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402b980 comp rx=0 tx=0).stop 2023-11-24T06:12:50.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.720+0000 7f36eb990640 1 -- 172.21.15.22:0/2576275221 shutdown_connections 2023-11-24T06:12:50.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.720+0000 7f36eb990640 1 --2- 172.21.15.22:0/2576275221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e409cb30 0x7f36e40b3530 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.720+0000 7f36eb990640 1 --2- 172.21.15.22:0/2576275221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e415b350 0x7f36e40abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.720+0000 7f36eb990640 1 -- 172.21.15.22:0/2576275221 >> 172.21.15.22:0/2576275221 conn(0x7f36e40b0ba0 msgr2=0x7f36e40b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:50.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.720+0000 7f36eb990640 1 -- 172.21.15.22:0/2576275221 shutdown_connections 2023-11-24T06:12:50.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.720+0000 7f36eb990640 1 -- 172.21.15.22:0/2576275221 wait complete. 2023-11-24T06:12:50.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.722+0000 7f36eb990640 1 Processor -- start 2023-11-24T06:12:50.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.722+0000 7f36eb990640 1 -- start start 2023-11-24T06:12:50.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.723+0000 7f36eb990640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e409cb30 0x7f36e414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:50.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.723+0000 7f36eb990640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e40adb60 0x7f36e4137650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:50.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.723+0000 7f36eb990640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e415b350 0x7f36e4135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.723+0000 7f36eb990640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4137230 con 0x7f36e415b350 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.723+0000 7f36eb990640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e41365b0 con 0x7f36e409cb30 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.723+0000 7f36eb990640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4136890 con 0x7f36e40adb60 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.723+0000 7f36e9f2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e415b350 0x7f36e4135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.723+0000 7f36e9f2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e415b350 0x7f36e4135c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53340/0 (socket says 172.21.15.22:53340) 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.723+0000 7f36e9f2d640 1 -- 172.21.15.22:0/2394716771 learned_addr learned my addr 172.21.15.22:0/2394716771 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36e972c640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e409cb30 0x7f36e414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36e8f2b640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e40adb60 0x7f36e4137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36e9f2d640 1 -- 172.21.15.22:0/2394716771 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e40adb60 msgr2=0x7f36e4137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36e9f2d640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e40adb60 0x7f36e4137650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36e9f2d640 1 -- 172.21.15.22:0/2394716771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e409cb30 msgr2=0x7f36e414fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:50.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36e9f2d640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e409cb30 0x7f36e414fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36e9f2d640 1 -- 172.21.15.22:0/2394716771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40094d0 con 0x7f36e415b350 2023-11-24T06:12:50.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36e9f2d640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e415b350 0x7f36e4135c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0016f0 tx=0x7f36dc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:50.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36d9ffb640 1 -- 172.21.15.22:0/2394716771 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc003da0 con 0x7f36e415b350 2023-11-24T06:12:50.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.724+0000 7f36d9ffb640 1 -- 172.21.15.22:0/2394716771 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc005070 con 0x7f36e415b350 2023-11-24T06:12:50.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.725+0000 7f36d9ffb640 1 -- 172.21.15.22:0/2394716771 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0054a0 con 0x7f36e415b350 2023-11-24T06:12:50.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.725+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e4136b70 con 0x7f36e415b350 2023-11-24T06:12:50.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.725+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e41361c0 con 0x7f36e415b350 2023-11-24T06:12:50.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.726+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e4137370 con 0x7f36e415b350 2023-11-24T06:12:50.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.727+0000 7f36d9ffb640 1 -- 172.21.15.22:0/2394716771 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36dc005600 con 0x7f36e415b350 2023-11-24T06:12:50.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.728+0000 7f36d9ffb640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36c806ae40 0x7f36c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:50.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.728+0000 7f36d9ffb640 1 -- 172.21.15.22:0/2394716771 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f36dc088d30 con 0x7f36e415b350 2023-11-24T06:12:50.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.728+0000 7f36e972c640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36c806ae40 0x7f36c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:50.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.729+0000 7f36e972c640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36c806ae40 0x7f36c806d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f36e00079a0 tx=0x7f36e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:50.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.732+0000 7f36d9ffb640 1 -- 172.21.15.22:0/2394716771 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36e4137370 con 0x7f36e415b350 2023-11-24T06:12:50.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.927+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f36e415b730 con 0x7f36e415b350 2023-11-24T06:12:50.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.934+0000 7f36d9ffb640 1 -- 172.21.15.22:0/2394716771 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36e415b730 con 0x7f36e415b350 2023-11-24T06:12:50.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.937+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36c806ae40 msgr2=0x7f36c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:50.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.937+0000 7f36eb990640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36c806ae40 0x7f36c806d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f36e00079a0 tx=0x7f36e0008040 comp rx=0 tx=0).stop 2023-11-24T06:12:50.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.937+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e415b350 msgr2=0x7f36e4135c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.937+0000 7f36eb990640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e415b350 0x7f36e4135c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0016f0 tx=0x7f36dc00cc70 comp rx=0 tx=0).stop 2023-11-24T06:12:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.938+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 shutdown_connections 2023-11-24T06:12:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.938+0000 7f36eb990640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36c806ae40 0x7f36c806d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.938+0000 7f36eb990640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e415b350 0x7f36e4135c80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.938+0000 7f36eb990640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36e40adb60 0x7f36e4137650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.938+0000 7f36eb990640 1 --2- 172.21.15.22:0/2394716771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e409cb30 0x7f36e414fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.938+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 >> 172.21.15.22:0/2394716771 conn(0x7f36e40b0ba0 msgr2=0x7f36e40afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.938+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 shutdown_connections 2023-11-24T06:12:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:50.938+0000 7f36eb990640 1 -- 172.21.15.22:0/2394716771 wait complete. 2023-11-24T06:12:50.958 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:12:50.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:12:51.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:12:51.202 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:12:51.202 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:12:51.203 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:12:51.265 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:12:51.266 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:12:51.323 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:51.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.535+0000 7f43a6e59640 1 Processor -- start 2023-11-24T06:12:51.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.536+0000 7f43a6e59640 1 -- start start 2023-11-24T06:12:51.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.537+0000 7f43a6e59640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f43a0143570 0x7f43a00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:51.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.537+0000 7f43a6e59640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a015e6b0 0x7f43a00cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:51.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.537+0000 7f43a6e59640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a0071700 con 0x7f43a0143950 2023-11-24T06:12:51.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.537+0000 7f43a6e59640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a015b410 con 0x7f43a0143570 2023-11-24T06:12:51.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.537+0000 7f43a6e59640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a015b130 con 0x7f43a015e6b0 2023-11-24T06:12:51.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.537+0000 7f43a5656640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f43a0143950 0x7f43a015a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33860/0 (socket says 172.21.15.22:33860) 2023-11-24T06:12:51.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.537+0000 7f43a5656640 1 -- 172.21.15.22:0/4074658727 learned_addr learned my addr 172.21.15.22:0/4074658727 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:51.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.538+0000 7f43a6658640 1 --2- 172.21.15.22:0/4074658727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a015e6b0 0x7f43a00cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:51.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.538+0000 7f43a5e57640 1 --2- 172.21.15.22:0/4074658727 >> v2:172.21.15.31:3300/0 conn(0x7f43a0143570 0x7f43a00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:51.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.538+0000 7f43a4e55640 1 -- 172.21.15.22:0/4074658727 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195196933 0 0) 0x7f4390001110 con 0x7f43a0143950 2023-11-24T06:12:51.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.538+0000 7f43a4e55640 1 -- 172.21.15.22:0/4074658727 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f438c003520 con 0x7f43a0143950 2023-11-24T06:12:51.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.538+0000 7f43a6658640 1 -- 172.21.15.22:0/4074658727 >> v2:172.21.15.31:3300/0 conn(0x7f43a0143570 msgr2=0x7f43a00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:51.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.538+0000 7f43a6658640 1 --2- 172.21.15.22:0/4074658727 >> v2:172.21.15.31:3300/0 conn(0x7f43a0143570 0x7f43a00cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.538+0000 7f43a6658640 1 -- 172.21.15.22:0/4074658727 >> v1:172.21.15.22:6789/0 conn(0x7f43a0143950 legacy=0x7f43a015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:51.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.538+0000 7f43a6658640 1 -- 172.21.15.22:0/4074658727 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a015dbd0 con 0x7f43a015e6b0 2023-11-24T06:12:51.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.539+0000 7f43a6658640 1 --2- 172.21.15.22:0/4074658727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a015e6b0 0x7f43a00cf590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f43980097a0 tx=0x7f439802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c4c942a9e1fa4f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:51.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.540+0000 7f43a4e55640 1 -- 172.21.15.22:0/4074658727 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398031780 con 0x7f43a015e6b0 2023-11-24T06:12:51.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.540+0000 7f43a4e55640 1 -- 172.21.15.22:0/4074658727 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43980318e0 con 0x7f43a015e6b0 2023-11-24T06:12:51.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.540+0000 7f43a4e55640 1 -- 172.21.15.22:0/4074658727 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398031c70 con 0x7f43a015e6b0 2023-11-24T06:12:51.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.541+0000 7f43a6e59640 1 -- 172.21.15.22:0/4074658727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a015e6b0 msgr2=0x7f43a00cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:51.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.541+0000 7f43a6e59640 1 --2- 172.21.15.22:0/4074658727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a015e6b0 0x7f43a00cf590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f43980097a0 tx=0x7f439802b820 comp rx=0 tx=0).stop 2023-11-24T06:12:51.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.541+0000 7f43a6e59640 1 -- 172.21.15.22:0/4074658727 shutdown_connections 2023-11-24T06:12:51.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.541+0000 7f43a6e59640 1 --2- 172.21.15.22:0/4074658727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a015e6b0 0x7f43a00cf590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.541+0000 7f43a6e59640 1 --2- 172.21.15.22:0/4074658727 >> v2:172.21.15.31:3300/0 conn(0x7f43a0143570 0x7f43a00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.541+0000 7f43a6e59640 1 -- 172.21.15.22:0/4074658727 >> 172.21.15.22:0/4074658727 conn(0x7f43a006a860 msgr2=0x7f43a006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:51.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.541+0000 7f43a6e59640 1 -- 172.21.15.22:0/4074658727 shutdown_connections 2023-11-24T06:12:51.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.541+0000 7f43a6e59640 1 -- 172.21.15.22:0/4074658727 wait complete. 2023-11-24T06:12:51.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.543+0000 7f43a6e59640 1 Processor -- start 2023-11-24T06:12:51.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.543+0000 7f43a6e59640 1 -- start start 2023-11-24T06:12:51.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a6e59640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a0143570 0x7f43a00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:51.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a6e59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0143950 0x7f43a013f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:51.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a6e59640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43a015e6b0 0x7f43a014e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a6e59640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00c9610 con 0x7f43a0143950 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a6e59640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00c98f0 con 0x7f43a015e6b0 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a6e59640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00c9bd0 con 0x7f43a0143570 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a5656640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0143950 0x7f43a013f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a5656640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0143950 0x7f43a013f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37034/0 (socket says 172.21.15.22:37034) 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a5656640 1 -- 172.21.15.22:0/2587280491 learned_addr learned my addr 172.21.15.22:0/2587280491 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a5e57640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a0143570 0x7f43a00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.544+0000 7f43a6658640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43a015e6b0 0x7f43a014e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43a5656640 1 -- 172.21.15.22:0/2587280491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a0143570 msgr2=0x7f43a00c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43a5656640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a0143570 0x7f43a00c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43a5656640 1 -- 172.21.15.22:0/2587280491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43a015e6b0 msgr2=0x7f43a014e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43a5656640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43a015e6b0 0x7f43a014e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43a5656640 1 -- 172.21.15.22:0/2587280491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4398009400 con 0x7f43a0143950 2023-11-24T06:12:51.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43a5656640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0143950 0x7f43a013f050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f439000c430 tx=0x7f439000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:51.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43967fc640 1 -- 172.21.15.22:0/2587280491 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390005ce0 con 0x7f43a0143950 2023-11-24T06:12:51.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43967fc640 1 -- 172.21.15.22:0/2587280491 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4390005e40 con 0x7f43a0143950 2023-11-24T06:12:51.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43967fc640 1 -- 172.21.15.22:0/2587280491 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43900072f0 con 0x7f43a0143950 2023-11-24T06:12:51.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.545+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a00c9eb0 con 0x7f43a0143950 2023-11-24T06:12:51.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.546+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a013f590 con 0x7f43a0143950 2023-11-24T06:12:51.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.547+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a00ca3d0 con 0x7f43a0143950 2023-11-24T06:12:51.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.548+0000 7f43967fc640 1 -- 172.21.15.22:0/2587280491 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4390007510 con 0x7f43a0143950 2023-11-24T06:12:51.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.549+0000 7f43967fc640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f438406ae90 0x7f438406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:51.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.549+0000 7f43967fc640 1 -- 172.21.15.22:0/2587280491 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f4390088b30 con 0x7f43a0143950 2023-11-24T06:12:51.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.549+0000 7f43a5e57640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f438406ae90 0x7f438406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:51.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.550+0000 7f43a5e57640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f438406ae90 0x7f438406d350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f439c011340 tx=0x7f439c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:51.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.554+0000 7f43967fc640 1 -- 172.21.15.22:0/2587280491 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43a00ca3d0 con 0x7f43a0143950 2023-11-24T06:12:51.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.752+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43a0071700 con 0x7f43a0143950 2023-11-24T06:12:51.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.755+0000 7f43967fc640 1 -- 172.21.15.22:0/2587280491 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f43a0071700 con 0x7f43a0143950 2023-11-24T06:12:51.758 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:51.758 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f438406ae90 msgr2=0x7f438406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f438406ae90 0x7f438406d350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f439c011340 tx=0x7f439c00b040 comp rx=0 tx=0).stop 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0143950 msgr2=0x7f43a013f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0143950 0x7f43a013f050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f439000c430 tx=0x7f439000c8f0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 shutdown_connections 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f438406ae90 0x7f438406d350 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43a015e6b0 0x7f43a014e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0143950 0x7f43a013f050 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 --2- 172.21.15.22:0/2587280491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f43a0143570 0x7f43a00c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 >> 172.21.15.22:0/2587280491 conn(0x7f43a006a860 msgr2=0x7f43a006ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:51.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 shutdown_connections 2023-11-24T06:12:51.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:51.758+0000 7f43a6e59640 1 -- 172.21.15.22:0/2587280491 wait complete. 2023-11-24T06:12:51.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:51.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:52.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.009+0000 7f2441a3d640 1 Processor -- start 2023-11-24T06:12:52.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.010+0000 7f2441a3d640 1 -- start start 2023-11-24T06:12:52.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.011+0000 7f2441a3d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 0x7f243c0b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.011+0000 7f2441a3d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243c0b23e0 con 0x7f243c160bd0 2023-11-24T06:12:52.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.011+0000 7f2441a3d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243c0d41b0 con 0x7f243c0b48d0 2023-11-24T06:12:52.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.011+0000 7f2441a3d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0cdc70 con 0x7f243c0b3210 2023-11-24T06:12:52.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.011+0000 7f243affd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f243c160bd0 0x7f243c0b2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33872/0 (socket says 172.21.15.22:33872) 2023-11-24T06:12:52.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.011+0000 7f243affd640 1 -- 172.21.15.22:0/1874835205 learned_addr learned my addr 172.21.15.22:0/1874835205 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:52.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.012+0000 7f243b7fe640 1 --2- 172.21.15.22:0/1874835205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 0x7f243c0b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.012+0000 7f2439ffb640 1 -- 172.21.15.22:0/1874835205 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475122688 0 0) 0x7f243c0b23e0 con 0x7f243c160bd0 2023-11-24T06:12:52.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.012+0000 7f2439ffb640 1 -- 172.21.15.22:0/1874835205 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2428003520 con 0x7f243c160bd0 2023-11-24T06:12:52.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.012+0000 7f243b7fe640 1 -- 172.21.15.22:0/1874835205 >> v1:172.21.15.31:6789/0 conn(0x7f243c0b48d0 legacy=0x7f243c165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.012+0000 7f243b7fe640 1 -- 172.21.15.22:0/1874835205 >> v1:172.21.15.22:6789/0 conn(0x7f243c160bd0 legacy=0x7f243c0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.012+0000 7f243b7fe640 1 -- 172.21.15.22:0/1874835205 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c160fb0 con 0x7f243c0b3210 2023-11-24T06:12:52.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.014+0000 7f243b7fe640 1 --2- 172.21.15.22:0/1874835205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 0x7f243c0b1ea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f24340097d0 tx=0x7f243402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5d83e4cb86630fa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:52.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.014+0000 7f2439ffb640 1 -- 172.21.15.22:0/1874835205 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243402d040 con 0x7f243c0b3210 2023-11-24T06:12:52.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.014+0000 7f2439ffb640 1 -- 172.21.15.22:0/1874835205 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434031810 con 0x7f243c0b3210 2023-11-24T06:12:52.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.014+0000 7f2439ffb640 1 -- 172.21.15.22:0/1874835205 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434031ba0 con 0x7f243c0b3210 2023-11-24T06:12:52.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.015+0000 7f2441a3d640 1 -- 172.21.15.22:0/1874835205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 msgr2=0x7f243c0b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.015+0000 7f2441a3d640 1 --2- 172.21.15.22:0/1874835205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 0x7f243c0b1ea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f24340097d0 tx=0x7f243402b8b0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.015+0000 7f2441a3d640 1 -- 172.21.15.22:0/1874835205 shutdown_connections 2023-11-24T06:12:52.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.015+0000 7f2441a3d640 1 --2- 172.21.15.22:0/1874835205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 0x7f243c0b1ea0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.015+0000 7f2441a3d640 1 -- 172.21.15.22:0/1874835205 >> 172.21.15.22:0/1874835205 conn(0x7f243c09c5a0 msgr2=0x7f243c0d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:52.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.015+0000 7f2441a3d640 1 -- 172.21.15.22:0/1874835205 shutdown_connections 2023-11-24T06:12:52.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.015+0000 7f2441a3d640 1 -- 172.21.15.22:0/1874835205 wait complete. 2023-11-24T06:12:52.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.017+0000 7f2441a3d640 1 Processor -- start 2023-11-24T06:12:52.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.018+0000 7f2441a3d640 1 -- start start 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f2441a3d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 0x7f243c1586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f2441a3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f243c0b48d0 0x7f243c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f2441a3d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f243c160bd0 0x7f243c0b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f2441a3d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c158c00 con 0x7f243c160bd0 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f2441a3d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0b71e0 con 0x7f243c0b48d0 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f2441a3d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0b8790 con 0x7f243c0b3210 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f243b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f243c160bd0 0x7f243c0b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f243affd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 0x7f243c1586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f243b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f243c160bd0 0x7f243c0b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37044/0 (socket says 172.21.15.22:37044) 2023-11-24T06:12:52.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.019+0000 7f243b7fe640 1 -- 172.21.15.22:0/1246749444 learned_addr learned my addr 172.21.15.22:0/1246749444 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:52.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f243a7fc640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f243c0b48d0 0x7f243c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f243b7fe640 1 -- 172.21.15.22:0/1246749444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 msgr2=0x7f243c1586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f243b7fe640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 0x7f243c1586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f243b7fe640 1 -- 172.21.15.22:0/1246749444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f243c0b48d0 msgr2=0x7f243c0b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f243b7fe640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f243c0b48d0 0x7f243c0b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f243b7fe640 1 -- 172.21.15.22:0/1246749444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434009400 con 0x7f243c160bd0 2023-11-24T06:12:52.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f243b7fe640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f243c160bd0 0x7f243c0b63a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f24340097d0 tx=0x7f24340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:52.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f2433fff640 1 -- 172.21.15.22:0/1246749444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243403ace0 con 0x7f243c160bd0 2023-11-24T06:12:52.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f2433fff640 1 -- 172.21.15.22:0/1246749444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243403ae60 con 0x7f243c160bd0 2023-11-24T06:12:52.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f2433fff640 1 -- 172.21.15.22:0/1246749444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434042630 con 0x7f243c160bd0 2023-11-24T06:12:52.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.020+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243c0b6f00 con 0x7f243c160bd0 2023-11-24T06:12:52.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.021+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243c0b8420 con 0x7f243c160bd0 2023-11-24T06:12:52.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.022+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243c0b7fa0 con 0x7f243c160bd0 2023-11-24T06:12:52.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.023+0000 7f2433fff640 1 -- 172.21.15.22:0/1246749444 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f243404b3b0 con 0x7f243c160bd0 2023-11-24T06:12:52.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.024+0000 7f2433fff640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f241c06ae40 0x7f241c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.024+0000 7f2433fff640 1 -- 172.21.15.22:0/1246749444 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f24340ab7f0 con 0x7f243c160bd0 2023-11-24T06:12:52.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.024+0000 7f243affd640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f241c06ae40 0x7f241c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.025+0000 7f243affd640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f241c06ae40 0x7f241c06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f242c001560 tx=0x7f242c0019f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:52.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.029+0000 7f2433fff640 1 -- 172.21.15.22:0/1246749444 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f243c0b7fa0 con 0x7f243c160bd0 2023-11-24T06:12:52.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.222+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f243c0b7fa0 con 0x7f243c160bd0 2023-11-24T06:12:52.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.223+0000 7f2433fff640 1 -- 172.21.15.22:0/1246749444 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f243c0b7fa0 con 0x7f243c160bd0 2023-11-24T06:12:52.226 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.225+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f241c06ae40 msgr2=0x7f241c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f241c06ae40 0x7f241c06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f242c001560 tx=0x7f242c0019f0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f243c160bd0 msgr2=0x7f243c0b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f243c160bd0 0x7f243c0b63a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f24340097d0 tx=0x7f24340046c0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 shutdown_connections 2023-11-24T06:12:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f241c06ae40 0x7f241c06d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f243c160bd0 0x7f243c0b63a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f243c0b48d0 0x7f243c0b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 --2- 172.21.15.22:0/1246749444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f243c0b3210 0x7f243c1586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 >> 172.21.15.22:0/1246749444 conn(0x7f243c09c5a0 msgr2=0x7f243c0d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 shutdown_connections 2023-11-24T06:12:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.226+0000 7f2441a3d640 1 -- 172.21.15.22:0/1246749444 wait complete. 2023-11-24T06:12:52.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.476+0000 7f967f59e640 1 Processor -- start 2023-11-24T06:12:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.476+0000 7f967f59e640 1 -- start start 2023-11-24T06:12:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.478+0000 7f967f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96800b2de0 0x7f968006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.478+0000 7f967f59e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9680164d90 0x7f9680167180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.478+0000 7f967f59e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96800ad210 con 0x7f968006b1c0 2023-11-24T06:12:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.478+0000 7f967f59e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96800adab0 con 0x7f9680164d90 2023-11-24T06:12:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.478+0000 7f967f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968006cf70 con 0x7f96800b2de0 2023-11-24T06:12:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.478+0000 7f9677fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f968006b1c0 0x7f968006b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33878/0 (socket says 172.21.15.22:33878) 2023-11-24T06:12:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.478+0000 7f9677fff640 1 -- 172.21.15.22:0/92467700 learned_addr learned my addr 172.21.15.22:0/92467700 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:52.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967e59c640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96800b2de0 0x7f968006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967ed9d640 1 --2- 172.21.15.22:0/92467700 >> v2:172.21.15.31:3300/0 conn(0x7f9680164d90 0x7f9680167180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606032126 0 0) 0x7f96800ad210 con 0x7f968006b1c0 2023-11-24T06:12:52.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f966c003520 con 0x7f968006b1c0 2023-11-24T06:12:52.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2707216261 0 0) 0x7f966c003520 con 0x7f968006b1c0 2023-11-24T06:12:52.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96800b2de0 msgr2=0x7f968006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:52.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96800b2de0 0x7f968006ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 >> v2:172.21.15.31:3300/0 conn(0x7f9680164d90 msgr2=0x7f9680167180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 --2- 172.21.15.22:0/92467700 >> v2:172.21.15.31:3300/0 conn(0x7f9680164d90 0x7f9680167180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968015d610 con 0x7f968006b1c0 2023-11-24T06:12:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f9668001670 con 0x7f968006b1c0 2023-11-24T06:12:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 >> v1:172.21.15.22:6789/0 conn(0x7f968006b1c0 legacy=0x7f968006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96800b2de0 0x7f966c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c003f60 0x7f966c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f966c004d00 0x7f966c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96800adab0 con 0x7f966c004d00 2023-11-24T06:12:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968006cf70 con 0x7f966c003f60 2023-11-24T06:12:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.479+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c00b9b0 con 0x7f96800b2de0 2023-11-24T06:12:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.480+0000 7f967ed9d640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f966c004d00 0x7f966c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.480+0000 7f967e59c640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96800b2de0 0x7f966c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.480+0000 7f9677fff640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c003f60 0x7f966c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.480+0000 7f967ed9d640 1 -- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96800b2de0 msgr2=0x7f966c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.480+0000 7f967ed9d640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96800b2de0 0x7f966c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.480+0000 7f967ed9d640 1 -- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c003f60 msgr2=0x7f966c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.480+0000 7f967ed9d640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c003f60 0x7f966c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.480+0000 7f967ed9d640 1 -- 172.21.15.22:0/92467700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c003520 con 0x7f966c004d00 2023-11-24T06:12:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.480+0000 7f967e59c640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96800b2de0 0x7f966c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.481+0000 7f967ed9d640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f966c004d00 0x7f966c005180 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9678009f90 tx=0x7f966c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a17ae8c692c1f98 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.482+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967802cc20 con 0x7f966c004d00 2023-11-24T06:12:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.482+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967800f040 con 0x7f966c004d00 2023-11-24T06:12:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.482+0000 7f967dd9b640 1 -- 172.21.15.22:0/92467700 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678034440 con 0x7f966c004d00 2023-11-24T06:12:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.482+0000 7f967f59e640 1 -- 172.21.15.22:0/92467700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f966c004d00 msgr2=0x7f966c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.482+0000 7f967f59e640 1 --2- 172.21.15.22:0/92467700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f966c004d00 0x7f966c005180 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9678009f90 tx=0x7f966c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.482+0000 7f967ed9d640 1 -- 172.21.15.22:0/92467700 reap_dead start 2023-11-24T06:12:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.482+0000 7f967f59e640 1 -- 172.21.15.22:0/92467700 shutdown_connections 2023-11-24T06:12:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.482+0000 7f967f59e640 1 -- 172.21.15.22:0/92467700 >> 172.21.15.22:0/92467700 conn(0x7f96800cf550 msgr2=0x7f96800cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.483+0000 7f967f59e640 1 -- 172.21.15.22:0/92467700 shutdown_connections 2023-11-24T06:12:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.483+0000 7f967f59e640 1 -- 172.21.15.22:0/92467700 wait complete. 2023-11-24T06:12:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.484+0000 7f967f59e640 1 Processor -- start 2023-11-24T06:12:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.485+0000 7f967f59e640 1 -- start start 2023-11-24T06:12:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c004d00 0x7f968014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96801f3910 0x7f968014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9680156ba0 0x7f96801f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967f59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9680156710 con 0x7f9680156ba0 2023-11-24T06:12:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967f59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96801502d0 con 0x7f966c004d00 2023-11-24T06:12:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96801505b0 con 0x7f96801f3910 2023-11-24T06:12:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9680156ba0 0x7f96801f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9680156ba0 0x7f96801f2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37064/0 (socket says 172.21.15.22:37064) 2023-11-24T06:12:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967ed9d640 1 -- 172.21.15.22:0/919690992 learned_addr learned my addr 172.21.15.22:0/919690992 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f9677fff640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96801f3910 0x7f968014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967e59c640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c004d00 0x7f968014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967ed9d640 1 -- 172.21.15.22:0/919690992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96801f3910 msgr2=0x7f968014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967ed9d640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96801f3910 0x7f968014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967ed9d640 1 -- 172.21.15.22:0/919690992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c004d00 msgr2=0x7f968014f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.486+0000 7f967ed9d640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c004d00 0x7f968014f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.487+0000 7f967ed9d640 1 -- 172.21.15.22:0/919690992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9680150890 con 0x7f9680156ba0 2023-11-24T06:12:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.487+0000 7f967ed9d640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9680156ba0 0x7f96801f2cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9678002230 tx=0x7f9678009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.487+0000 7f9676ffd640 1 -- 172.21.15.22:0/919690992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678034d50 con 0x7f9680156ba0 2023-11-24T06:12:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.487+0000 7f9676ffd640 1 -- 172.21.15.22:0/919690992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967803e440 con 0x7f9680156ba0 2023-11-24T06:12:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.487+0000 7f9676ffd640 1 -- 172.21.15.22:0/919690992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967803e7f0 con 0x7f9680156ba0 2023-11-24T06:12:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.487+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96801563a0 con 0x7f9680156ba0 2023-11-24T06:12:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.487+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9680157020 con 0x7f9680156ba0 2023-11-24T06:12:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.489+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96800b4150 con 0x7f9680156ba0 2023-11-24T06:12:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.490+0000 7f9676ffd640 1 -- 172.21.15.22:0/919690992 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f967803e950 con 0x7f9680156ba0 2023-11-24T06:12:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.490+0000 7f9676ffd640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f966006ae40 0x7f966006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.491+0000 7f9676ffd640 1 -- 172.21.15.22:0/919690992 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f96780ab8d0 con 0x7f9680156ba0 2023-11-24T06:12:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.491+0000 7f967e59c640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f966006ae40 0x7f966006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.491+0000 7f967e59c640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f966006ae40 0x7f966006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9670009aa0 tx=0x7f9670008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.495+0000 7f9676ffd640 1 -- 172.21.15.22:0/919690992 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96780768f0 con 0x7f9680156ba0 2023-11-24T06:12:52.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.690+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f968004e840 con 0x7f9680156ba0 2023-11-24T06:12:52.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.691+0000 7f9676ffd640 1 -- 172.21.15.22:0/919690992 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9678039020 con 0x7f9680156ba0 2023-11-24T06:12:52.694 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f966006ae40 msgr2=0x7f966006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f966006ae40 0x7f966006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9670009aa0 tx=0x7f9670008040 comp rx=0 tx=0).stop 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9680156ba0 msgr2=0x7f96801f2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9680156ba0 0x7f96801f2cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9678002230 tx=0x7f9678009750 comp rx=0 tx=0).stop 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 shutdown_connections 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f966006ae40 0x7f966006d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9680156ba0 0x7f96801f2cd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96801f3910 0x7f968014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 --2- 172.21.15.22:0/919690992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c004d00 0x7f968014f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 >> 172.21.15.22:0/919690992 conn(0x7f96800cf550 msgr2=0x7f96800b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 shutdown_connections 2023-11-24T06:12:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.694+0000 7f967f59e640 1 -- 172.21.15.22:0/919690992 wait complete. 2023-11-24T06:12:52.716 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:52.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.938+0000 7f30c6ebb640 1 Processor -- start 2023-11-24T06:12:52.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.938+0000 7f30c6ebb640 1 -- start start 2023-11-24T06:12:52.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.940+0000 7f30c6ebb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30c0144770 0x7f30c015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.940+0000 7f30c6ebb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30c015f0a0 0x7f30c00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.940+0000 7f30c6ebb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c015f930 con 0x7f30c00b35a0 2023-11-24T06:12:52.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.940+0000 7f30c6ebb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c00b43b0 con 0x7f30c0144770 2023-11-24T06:12:52.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.940+0000 7f30c6ebb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c015f510 con 0x7f30c015f0a0 2023-11-24T06:12:52.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.940+0000 7f30c5eb9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30c0144770 0x7f30c015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.940+0000 7f30c56b8640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f30c00b35a0 0x7f30c006c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33880/0 (socket says 172.21.15.22:33880) 2023-11-24T06:12:52.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.940+0000 7f30c56b8640 1 -- 172.21.15.22:0/1503639876 learned_addr learned my addr 172.21.15.22:0/1503639876 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:52.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.941+0000 7f30c66ba640 1 --2- 172.21.15.22:0/1503639876 >> v2:172.21.15.31:3300/0 conn(0x7f30c015f0a0 0x7f30c00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.941+0000 7f30c5eb9640 1 -- 172.21.15.22:0/1503639876 >> v2:172.21.15.31:3300/0 conn(0x7f30c015f0a0 msgr2=0x7f30c00ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:52.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.941+0000 7f30c5eb9640 1 --2- 172.21.15.22:0/1503639876 >> v2:172.21.15.31:3300/0 conn(0x7f30c015f0a0 0x7f30c00ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.941+0000 7f30c5eb9640 1 -- 172.21.15.22:0/1503639876 >> v1:172.21.15.22:6789/0 conn(0x7f30c00b35a0 legacy=0x7f30c006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.941+0000 7f30c5eb9640 1 -- 172.21.15.22:0/1503639876 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00ce9f0 con 0x7f30c0144770 2023-11-24T06:12:52.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.942+0000 7f30c5eb9640 1 --2- 172.21.15.22:0/1503639876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c0144770 0x7f30c015eb60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30c00700e0 tx=0x7f30bc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c27f2e474d87844 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:52.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.943+0000 7f30c4eb7640 1 -- 172.21.15.22:0/1503639876 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc031830 con 0x7f30c0144770 2023-11-24T06:12:52.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.943+0000 7f30c4eb7640 1 -- 172.21.15.22:0/1503639876 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc031990 con 0x7f30c0144770 2023-11-24T06:12:52.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.943+0000 7f30c4eb7640 1 -- 172.21.15.22:0/1503639876 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc031d20 con 0x7f30c0144770 2023-11-24T06:12:52.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.943+0000 7f30c6ebb640 1 -- 172.21.15.22:0/1503639876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c0144770 msgr2=0x7f30c015eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.943+0000 7f30c6ebb640 1 --2- 172.21.15.22:0/1503639876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c0144770 0x7f30c015eb60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30c00700e0 tx=0x7f30bc02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.944+0000 7f30c6ebb640 1 -- 172.21.15.22:0/1503639876 shutdown_connections 2023-11-24T06:12:52.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.944+0000 7f30c6ebb640 1 --2- 172.21.15.22:0/1503639876 >> v2:172.21.15.31:3300/0 conn(0x7f30c015f0a0 0x7f30c00ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.944+0000 7f30c6ebb640 1 --2- 172.21.15.22:0/1503639876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c0144770 0x7f30c015eb60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.944+0000 7f30c6ebb640 1 -- 172.21.15.22:0/1503639876 >> 172.21.15.22:0/1503639876 conn(0x7f30c00cec10 msgr2=0x7f30c00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:52.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.944+0000 7f30c6ebb640 1 -- 172.21.15.22:0/1503639876 shutdown_connections 2023-11-24T06:12:52.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.944+0000 7f30c6ebb640 1 -- 172.21.15.22:0/1503639876 wait complete. 2023-11-24T06:12:52.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.945+0000 7f30c6ebb640 1 Processor -- start 2023-11-24T06:12:52.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.946+0000 7f30c6ebb640 1 -- start start 2023-11-24T06:12:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c6ebb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30c00b35a0 0x7f30c015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c6ebb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c0144770 0x7f30c01406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c6ebb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c015f0a0 0x7f30c0142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c6ebb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0142220 con 0x7f30c015f0a0 2023-11-24T06:12:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c6ebb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0141180 con 0x7f30c0144770 2023-11-24T06:12:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c6ebb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0141460 con 0x7f30c00b35a0 2023-11-24T06:12:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c66ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c015f0a0 0x7f30c0142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c66ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c015f0a0 0x7f30c0142ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37088/0 (socket says 172.21.15.22:37088) 2023-11-24T06:12:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c66ba640 1 -- 172.21.15.22:0/3085177832 learned_addr learned my addr 172.21.15.22:0/3085177832 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:52.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c66ba640 1 -- 172.21.15.22:0/3085177832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30c00b35a0 msgr2=0x7f30c015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c66ba640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30c00b35a0 0x7f30c015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c66ba640 1 -- 172.21.15.22:0/3085177832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c0144770 msgr2=0x7f30c01406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:52.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.947+0000 7f30c66ba640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c0144770 0x7f30c01406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:52.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.948+0000 7f30c66ba640 1 -- 172.21.15.22:0/3085177832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc009400 con 0x7f30c015f0a0 2023-11-24T06:12:52.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.948+0000 7f30c66ba640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c015f0a0 0x7f30c0142ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f30b8007e60 tx=0x7f30b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:52.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.948+0000 7f30b67fc640 1 -- 172.21.15.22:0/3085177832 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8014420 con 0x7f30c015f0a0 2023-11-24T06:12:52.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.948+0000 7f30b67fc640 1 -- 172.21.15.22:0/3085177832 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b80145a0 con 0x7f30c015f0a0 2023-11-24T06:12:52.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.948+0000 7f30b67fc640 1 -- 172.21.15.22:0/3085177832 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8014950 con 0x7f30c015f0a0 2023-11-24T06:12:52.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.948+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c0141740 con 0x7f30c015f0a0 2023-11-24T06:12:52.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.948+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c0141d00 con 0x7f30c015f0a0 2023-11-24T06:12:52.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.949+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c004e840 con 0x7f30c015f0a0 2023-11-24T06:12:52.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.950+0000 7f30b67fc640 1 -- 172.21.15.22:0/3085177832 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30b8014ab0 con 0x7f30c015f0a0 2023-11-24T06:12:52.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.951+0000 7f30b67fc640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f30a406ae40 0x7f30a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:52.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.951+0000 7f30b67fc640 1 -- 172.21.15.22:0/3085177832 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f30b808a070 con 0x7f30c015f0a0 2023-11-24T06:12:52.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.952+0000 7f30c5eb9640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f30a406ae40 0x7f30a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:52.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.952+0000 7f30c5eb9640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f30a406ae40 0x7f30a406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f30bc036000 tx=0x7f30bc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:52.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:52.956+0000 7f30b67fc640 1 -- 172.21.15.22:0/3085177832 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30b80bce90 con 0x7f30c015f0a0 2023-11-24T06:12:53.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.153+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30c00b2460 con 0x7f30c015f0a0 2023-11-24T06:12:53.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.153+0000 7f30b67fc640 1 -- 172.21.15.22:0/3085177832 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30b8054ff0 con 0x7f30c015f0a0 2023-11-24T06:12:53.156 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:53.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f30a406ae40 msgr2=0x7f30a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f30a406ae40 0x7f30a406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f30bc036000 tx=0x7f30bc030000 comp rx=0 tx=0).stop 2023-11-24T06:12:53.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c015f0a0 msgr2=0x7f30c0142ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c015f0a0 0x7f30c0142ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f30b8007e60 tx=0x7f30b800e4b0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 shutdown_connections 2023-11-24T06:12:53.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f30a406ae40 0x7f30a406d300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30c015f0a0 0x7f30c0142ad0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c0144770 0x7f30c01406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 --2- 172.21.15.22:0/3085177832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f30c00b35a0 0x7f30c015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 >> 172.21.15.22:0/3085177832 conn(0x7f30c00cec10 msgr2=0x7f30c00b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:53.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 shutdown_connections 2023-11-24T06:12:53.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.156+0000 7f30c6ebb640 1 -- 172.21.15.22:0/3085177832 wait complete. 2023-11-24T06:12:53.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:12:53.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.393+0000 7fe2b359e640 1 Processor -- start 2023-11-24T06:12:53.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.393+0000 7fe2b359e640 1 -- start start 2023-11-24T06:12:53.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.394+0000 7fe2b359e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2b41416f0 0x7fe2b415ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.395+0000 7fe2b359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 0x7fe2b415f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.395+0000 7fe2b359e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b4070bf0 con 0x7fe2b4141e80 2023-11-24T06:12:53.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.395+0000 7fe2b359e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b406db30 con 0x7fe2b41416f0 2023-11-24T06:12:53.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.395+0000 7fe2b359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b406d660 con 0x7fe2b406d230 2023-11-24T06:12:53.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.395+0000 7fe2b259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2b41416f0 0x7fe2b415ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.395+0000 7fe2b259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2b41416f0 0x7fe2b415ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37104/0 (socket says 172.21.15.22:37104) 2023-11-24T06:12:53.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.395+0000 7fe2b259c640 1 -- 172.21.15.22:0/3580867642 learned_addr learned my addr 172.21.15.22:0/3580867642 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:53.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.395+0000 7fe2b2d9d640 1 --2- 172.21.15.22:0/3580867642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 0x7fe2b415f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.396+0000 7fe2b259c640 1 -- 172.21.15.22:0/3580867642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 msgr2=0x7fe2b415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:53.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.396+0000 7fe2b259c640 1 --2- 172.21.15.22:0/3580867642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 0x7fe2b415f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.396+0000 7fe2b259c640 1 -- 172.21.15.22:0/3580867642 >> v1:172.21.15.31:6789/0 conn(0x7fe2b4141e80 legacy=0x7fe2b406cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:53.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.396+0000 7fe2b259c640 1 -- 172.21.15.22:0/3580867642 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b406d850 con 0x7fe2b41416f0 2023-11-24T06:12:53.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.397+0000 7fe2b259c640 1 --2- 172.21.15.22:0/3580867642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 0x7fe2b415ed50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009e50 tx=0x7fe2a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25c56afaf0f90f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:53.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.397+0000 7fe2b159a640 1 -- 172.21.15.22:0/3580867642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a402ca70 con 0x7fe2b41416f0 2023-11-24T06:12:53.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.397+0000 7fe2b159a640 1 -- 172.21.15.22:0/3580867642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a402cbd0 con 0x7fe2b41416f0 2023-11-24T06:12:53.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.397+0000 7fe2b159a640 1 -- 172.21.15.22:0/3580867642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40343f0 con 0x7fe2b41416f0 2023-11-24T06:12:53.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.398+0000 7fe2b359e640 1 -- 172.21.15.22:0/3580867642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 msgr2=0x7fe2b415ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.398+0000 7fe2b359e640 1 --2- 172.21.15.22:0/3580867642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 0x7fe2b415ed50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009e50 tx=0x7fe2a402bed0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.398+0000 7fe2b359e640 1 -- 172.21.15.22:0/3580867642 shutdown_connections 2023-11-24T06:12:53.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.398+0000 7fe2b359e640 1 --2- 172.21.15.22:0/3580867642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 0x7fe2b415f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.398+0000 7fe2b359e640 1 --2- 172.21.15.22:0/3580867642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 0x7fe2b415ed50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.398+0000 7fe2b359e640 1 -- 172.21.15.22:0/3580867642 >> 172.21.15.22:0/3580867642 conn(0x7fe2b40b0840 msgr2=0x7fe2b40b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.398+0000 7fe2b359e640 1 -- 172.21.15.22:0/3580867642 shutdown_connections 2023-11-24T06:12:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.398+0000 7fe2b359e640 1 -- 172.21.15.22:0/3580867642 wait complete. 2023-11-24T06:12:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.400+0000 7fe2b359e640 1 Processor -- start 2023-11-24T06:12:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.400+0000 7fe2b359e640 1 -- start start 2023-11-24T06:12:53.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.401+0000 7fe2b359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 0x7fe2b413f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.401+0000 7fe2b359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 0x7fe2b413cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.401+0000 7fe2b359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b4141e80 0x7fe2b415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.401+0000 7fe2b359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415c4d0 con 0x7fe2b41416f0 2023-11-24T06:12:53.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.401+0000 7fe2b359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b413db00 con 0x7fe2b4141e80 2023-11-24T06:12:53.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.401+0000 7fe2b359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b413dde0 con 0x7fe2b406d230 2023-11-24T06:12:53.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b259c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 0x7fe2b413f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 0x7fe2b413cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 0x7fe2b413cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37110/0 (socket says 172.21.15.22:37110) 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b1d9b640 1 -- 172.21.15.22:0/3897952718 learned_addr learned my addr 172.21.15.22:0/3897952718 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b259c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 0x7fe2b413f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:37608/0 (socket says 172.21.15.22:37608) 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b2d9d640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b4141e80 0x7fe2b415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b1d9b640 1 -- 172.21.15.22:0/3897952718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 msgr2=0x7fe2b413f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b1d9b640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 0x7fe2b413f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b1d9b640 1 -- 172.21.15.22:0/3897952718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b4141e80 msgr2=0x7fe2b415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b1d9b640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b4141e80 0x7fe2b415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b1d9b640 1 -- 172.21.15.22:0/3897952718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4009b30 con 0x7fe2b41416f0 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.402+0000 7fe2b1d9b640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 0x7fe2b413cfc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b3c0 tx=0x7fe29c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:53.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.403+0000 7fe2aaffd640 1 -- 172.21.15.22:0/3897952718 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c011830 con 0x7fe2b41416f0 2023-11-24T06:12:53.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.403+0000 7fe2aaffd640 1 -- 172.21.15.22:0/3897952718 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c011990 con 0x7fe2b41416f0 2023-11-24T06:12:53.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.403+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b415c770 con 0x7fe2b41416f0 2023-11-24T06:12:53.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.403+0000 7fe2aaffd640 1 -- 172.21.15.22:0/3897952718 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c011d80 con 0x7fe2b41416f0 2023-11-24T06:12:53.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.403+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b413e0c0 con 0x7fe2b41416f0 2023-11-24T06:12:53.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.404+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b40cca10 con 0x7fe2b41416f0 2023-11-24T06:12:53.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.405+0000 7fe2aaffd640 1 -- 172.21.15.22:0/3897952718 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe29c01b460 con 0x7fe2b41416f0 2023-11-24T06:12:53.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.406+0000 7fe2aaffd640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406ae70 0x7fe29406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.406+0000 7fe2aaffd640 1 -- 172.21.15.22:0/3897952718 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe29c089140 con 0x7fe2b41416f0 2023-11-24T06:12:53.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.406+0000 7fe2b259c640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406ae70 0x7fe29406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.407+0000 7fe2b259c640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406ae70 0x7fe29406d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4035000 tx=0x7fe2a4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:53.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.412+0000 7fe2aaffd640 1 -- 172.21.15.22:0/3897952718 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe29c054150 con 0x7fe2b41416f0 2023-11-24T06:12:53.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.625+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe2b415c9b0 con 0x7fe2b41416f0 2023-11-24T06:12:53.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.625+0000 7fe2aaffd640 1 -- 172.21.15.22:0/3897952718 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe2b415c9b0 con 0x7fe2b41416f0 2023-11-24T06:12:53.628 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:12:53.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406ae70 msgr2=0x7fe29406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406ae70 0x7fe29406d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4035000 tx=0x7fe2a4030000 comp rx=0 tx=0).stop 2023-11-24T06:12:53.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 msgr2=0x7fe2b413cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 0x7fe2b413cfc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b3c0 tx=0x7fe29c00b880 comp rx=0 tx=0).stop 2023-11-24T06:12:53.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 shutdown_connections 2023-11-24T06:12:53.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406ae70 0x7fe29406d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b4141e80 0x7fe2b415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b41416f0 0x7fe2b413cfc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 --2- 172.21.15.22:0/3897952718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b406d230 0x7fe2b413f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 >> 172.21.15.22:0/3897952718 conn(0x7fe2b40b0840 msgr2=0x7fe2b40ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:53.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 shutdown_connections 2023-11-24T06:12:53.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.628+0000 7fe2b359e640 1 -- 172.21.15.22:0/3897952718 wait complete. 2023-11-24T06:12:53.650 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:12:53.650 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:12:53.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:53.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.930+0000 7f99cb3a7640 1 Processor -- start 2023-11-24T06:12:53.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.930+0000 7f99cb3a7640 1 -- start start 2023-11-24T06:12:53.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.931+0000 7f99cb3a7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99c415d5b0 0x7f99c40d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.931+0000 7f99cb3a7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f99c40b1650 0x7f99c40d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.931+0000 7f99cb3a7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c40cf0c0 con 0x7f99c40d14a0 2023-11-24T06:12:53.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.931+0000 7f99cb3a7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c40b01b0 con 0x7f99c40b1650 2023-11-24T06:12:53.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.931+0000 7f99cb3a7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c415d990 con 0x7f99c415d5b0 2023-11-24T06:12:53.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.932+0000 7f99caba6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f99c40b1650 0x7f99c40d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.932+0000 7f99caba6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f99c40b1650 0x7f99c40d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37118/0 (socket says 172.21.15.22:37118) 2023-11-24T06:12:53.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.932+0000 7f99caba6640 1 -- 172.21.15.22:0/2426956612 learned_addr learned my addr 172.21.15.22:0/2426956612 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:53.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.932+0000 7f99caba6640 1 -- 172.21.15.22:0/2426956612 >> v2:172.21.15.31:3300/0 conn(0x7f99c415d5b0 msgr2=0x7f99c40d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:53.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.932+0000 7f99caba6640 1 --2- 172.21.15.22:0/2426956612 >> v2:172.21.15.31:3300/0 conn(0x7f99c415d5b0 0x7f99c40d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.932+0000 7f99caba6640 1 -- 172.21.15.22:0/2426956612 >> v1:172.21.15.31:6789/0 conn(0x7f99c40d14a0 legacy=0x7f99c40cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:53.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.932+0000 7f99caba6640 1 -- 172.21.15.22:0/2426956612 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c40d1e40 con 0x7f99c40b1650 2023-11-24T06:12:53.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.934+0000 7f99caba6640 1 --2- 172.21.15.22:0/2426956612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 0x7f99c40d1900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f99c408c9e0 tx=0x7f99bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f610047dd2f194f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:53.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.934+0000 7f99c93a3640 1 -- 172.21.15.22:0/2426956612 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc031870 con 0x7f99c40b1650 2023-11-24T06:12:53.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.934+0000 7f99c93a3640 1 -- 172.21.15.22:0/2426956612 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc0319d0 con 0x7f99c40b1650 2023-11-24T06:12:53.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.934+0000 7f99c93a3640 1 -- 172.21.15.22:0/2426956612 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc031d60 con 0x7f99c40b1650 2023-11-24T06:12:53.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.935+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2426956612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 msgr2=0x7f99c40d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.935+0000 7f99cb3a7640 1 --2- 172.21.15.22:0/2426956612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 0x7f99c40d1900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f99c408c9e0 tx=0x7f99bc02b910 comp rx=0 tx=0).stop 2023-11-24T06:12:53.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.935+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2426956612 shutdown_connections 2023-11-24T06:12:53.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.935+0000 7f99cb3a7640 1 --2- 172.21.15.22:0/2426956612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 0x7f99c40d1900 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.935+0000 7f99cb3a7640 1 --2- 172.21.15.22:0/2426956612 >> v2:172.21.15.31:3300/0 conn(0x7f99c415d5b0 0x7f99c40d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.935+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2426956612 >> 172.21.15.22:0/2426956612 conn(0x7f99c409c3b0 msgr2=0x7f99c40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:53.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.935+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2426956612 shutdown_connections 2023-11-24T06:12:53.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.935+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2426956612 wait complete. 2023-11-24T06:12:53.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.937+0000 7f99cb3a7640 1 Processor -- start 2023-11-24T06:12:53.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.937+0000 7f99cb3a7640 1 -- start start 2023-11-24T06:12:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99cb3a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 0x7f99c41f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99cb3a7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99c40d14a0 0x7f99c40cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99cb3a7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99c415d5b0 0x7f99c40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99cb3a7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c4152db0 con 0x7f99c40b1650 2023-11-24T06:12:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99cb3a7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c415e570 con 0x7f99c415d5b0 2023-11-24T06:12:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99cb3a7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40cb550 con 0x7f99c40d14a0 2023-11-24T06:12:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99ca3a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 0x7f99c41f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99ca3a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 0x7f99c41f2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37122/0 (socket says 172.21.15.22:37122) 2023-11-24T06:12:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99ca3a5640 1 -- 172.21.15.22:0/2593243321 learned_addr learned my addr 172.21.15.22:0/2593243321 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:53.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99caba6640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99c415d5b0 0x7f99c40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99ca3a5640 1 -- 172.21.15.22:0/2593243321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99c40d14a0 msgr2=0x7f99c40cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99ca3a5640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99c40d14a0 0x7f99c40cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99ca3a5640 1 -- 172.21.15.22:0/2593243321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99c415d5b0 msgr2=0x7f99c40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99ca3a5640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99c415d5b0 0x7f99c40c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.938+0000 7f99ca3a5640 1 -- 172.21.15.22:0/2593243321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0094d0 con 0x7f99c40b1650 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.939+0000 7f99ca3a5640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 0x7f99c41f2780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f99c000ba80 tx=0x7f99c000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.939+0000 7f99baffd640 1 -- 172.21.15.22:0/2593243321 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c000cc00 con 0x7f99c40b1650 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.939+0000 7f99baffd640 1 -- 172.21.15.22:0/2593243321 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c000cd80 con 0x7f99c40b1650 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.939+0000 7f99baffd640 1 -- 172.21.15.22:0/2593243321 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0014680 con 0x7f99c40b1650 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.939+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c40c7f90 con 0x7f99c40b1650 2023-11-24T06:12:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.939+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c415df20 con 0x7f99c40b1650 2023-11-24T06:12:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.940+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c404e840 con 0x7f99c40b1650 2023-11-24T06:12:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.941+0000 7f99baffd640 1 -- 172.21.15.22:0/2593243321 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99c001e440 con 0x7f99c40b1650 2023-11-24T06:12:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.942+0000 7f99baffd640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f99a806ae40 0x7f99a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.943+0000 7f99baffd640 1 -- 172.21.15.22:0/2593243321 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f99c0089710 con 0x7f99c40b1650 2023-11-24T06:12:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.943+0000 7f99c9ba4640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f99a806ae40 0x7f99a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:53.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.944+0000 7f99c9ba4640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f99a806ae40 0x7f99a806d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f99b4006fd0 tx=0x7f99b4006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:53.947+0000 7f99baffd640 1 -- 172.21.15.22:0/2593243321 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f99c0054690 con 0x7f99c40b1650 2023-11-24T06:12:54.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.142+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99c40678d0 con 0x7f99c40b1650 2023-11-24T06:12:54.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.144+0000 7f99baffd640 1 -- 172.21.15.22:0/2593243321 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f99c0057cb0 con 0x7f99c40b1650 2023-11-24T06:12:54.147 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:54.147 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.146+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f99a806ae40 msgr2=0x7f99a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.146+0000 7f99cb3a7640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f99a806ae40 0x7f99a806d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f99b4006fd0 tx=0x7f99b4006bc0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.146+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 msgr2=0x7f99c41f2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.146+0000 7f99cb3a7640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 0x7f99c41f2780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f99c000ba80 tx=0x7f99c000bf40 comp rx=0 tx=0).stop 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.147+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 shutdown_connections 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.147+0000 7f99cb3a7640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f99a806ae40 0x7f99a806d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.147+0000 7f99cb3a7640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99c415d5b0 0x7f99c40c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.147+0000 7f99cb3a7640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99c40d14a0 0x7f99c40cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.147+0000 7f99cb3a7640 1 --2- 172.21.15.22:0/2593243321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99c40b1650 0x7f99c41f2780 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.147+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 >> 172.21.15.22:0/2593243321 conn(0x7f99c409c3b0 msgr2=0x7f99c40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.147+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 shutdown_connections 2023-11-24T06:12:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.147+0000 7f99cb3a7640 1 -- 172.21.15.22:0/2593243321 wait complete. 2023-11-24T06:12:54.169 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:54.169 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:54.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.399+0000 7f56409f4640 1 Processor -- start 2023-11-24T06:12:54.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.400+0000 7f56409f4640 1 -- start start 2023-11-24T06:12:54.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.401+0000 7f56409f4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f563c144770 0x7f563c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.402+0000 7f56409f4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 0x7f563c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.402+0000 7f56409f4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c15f930 con 0x7f563c06c9d0 2023-11-24T06:12:54.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.402+0000 7f56409f4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c0b43b0 con 0x7f563c144770 2023-11-24T06:12:54.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.402+0000 7f56409f4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0b3b10 con 0x7f563c0b35a0 2023-11-24T06:12:54.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.402+0000 7f563bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f563c06c9d0 0x7f563c06ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:33006/0 (socket says 172.21.15.22:33006) 2023-11-24T06:12:54.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.402+0000 7f563bfff640 1 -- 172.21.15.22:0/83050192 learned_addr learned my addr 172.21.15.22:0/83050192 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:54.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.402+0000 7f5633fff640 1 --2- 172.21.15.22:0/83050192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 0x7f563c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.403+0000 7f563b7fe640 1 --2- 172.21.15.22:0/83050192 >> v2:172.21.15.31:3300/0 conn(0x7f563c144770 0x7f563c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.403+0000 7f5633fff640 1 -- 172.21.15.22:0/83050192 >> v2:172.21.15.31:3300/0 conn(0x7f563c144770 msgr2=0x7f563c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:54.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.403+0000 7f5633fff640 1 --2- 172.21.15.22:0/83050192 >> v2:172.21.15.31:3300/0 conn(0x7f563c144770 0x7f563c15eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.403+0000 7f5633fff640 1 -- 172.21.15.22:0/83050192 >> v1:172.21.15.31:6789/0 conn(0x7f563c06c9d0 legacy=0x7f563c06ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.403+0000 7f5633fff640 1 -- 172.21.15.22:0/83050192 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c0b3df0 con 0x7f563c0b35a0 2023-11-24T06:12:54.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.405+0000 7f5633fff640 1 --2- 172.21.15.22:0/83050192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 0x7f563c15f0a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f56240097d0 tx=0x7f562402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a8ddf6426551892 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:54.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.406+0000 7f563affd640 1 -- 172.21.15.22:0/83050192 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624031800 con 0x7f563c0b35a0 2023-11-24T06:12:54.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.406+0000 7f563affd640 1 -- 172.21.15.22:0/83050192 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624031960 con 0x7f563c0b35a0 2023-11-24T06:12:54.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.406+0000 7f563affd640 1 -- 172.21.15.22:0/83050192 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624031cf0 con 0x7f563c0b35a0 2023-11-24T06:12:54.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.407+0000 7f56409f4640 1 -- 172.21.15.22:0/83050192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 msgr2=0x7f563c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.407+0000 7f56409f4640 1 --2- 172.21.15.22:0/83050192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 0x7f563c15f0a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f56240097d0 tx=0x7f562402b8a0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.407+0000 7f56409f4640 1 -- 172.21.15.22:0/83050192 shutdown_connections 2023-11-24T06:12:54.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.407+0000 7f56409f4640 1 --2- 172.21.15.22:0/83050192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 0x7f563c15f0a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.407+0000 7f56409f4640 1 --2- 172.21.15.22:0/83050192 >> v2:172.21.15.31:3300/0 conn(0x7f563c144770 0x7f563c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.407+0000 7f56409f4640 1 -- 172.21.15.22:0/83050192 >> 172.21.15.22:0/83050192 conn(0x7f563c0cec10 msgr2=0x7f563c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:54.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.407+0000 7f56409f4640 1 -- 172.21.15.22:0/83050192 shutdown_connections 2023-11-24T06:12:54.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.407+0000 7f56409f4640 1 -- 172.21.15.22:0/83050192 wait complete. 2023-11-24T06:12:54.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.409+0000 7f56409f4640 1 Processor -- start 2023-11-24T06:12:54.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.409+0000 7f56409f4640 1 -- start start 2023-11-24T06:12:54.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.410+0000 7f56409f4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f563c06c9d0 0x7f563c15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.410+0000 7f56409f4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 0x7f563c0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.410+0000 7f56409f4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f563c144770 0x7f563c15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.410+0000 7f56409f4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0af950 con 0x7f563c144770 2023-11-24T06:12:54.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.410+0000 7f56409f4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1f71c0 con 0x7f563c06c9d0 2023-11-24T06:12:54.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.410+0000 7f56409f4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c15ae80 con 0x7f563c0b35a0 2023-11-24T06:12:54.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.410+0000 7f563bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f563c144770 0x7f563c15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.410+0000 7f563bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f563c144770 0x7f563c15d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37134/0 (socket says 172.21.15.22:37134) 2023-11-24T06:12:54.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.410+0000 7f563bfff640 1 -- 172.21.15.22:0/1231171130 learned_addr learned my addr 172.21.15.22:0/1231171130 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f563b7fe640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f563c06c9d0 0x7f563c15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f5633fff640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 0x7f563c0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f563bfff640 1 -- 172.21.15.22:0/1231171130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 msgr2=0x7f563c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f563bfff640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 0x7f563c0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f563bfff640 1 -- 172.21.15.22:0/1231171130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f563c06c9d0 msgr2=0x7f563c15a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f563bfff640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f563c06c9d0 0x7f563c15a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f563bfff640 1 -- 172.21.15.22:0/1231171130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5624009400 con 0x7f563c144770 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f563bfff640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f563c144770 0x7f563c15d6e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f563400cbc0 tx=0x7f563400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f5638ff9640 1 -- 172.21.15.22:0/1231171130 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400ad40 con 0x7f563c144770 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f5638ff9640 1 -- 172.21.15.22:0/1231171130 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5634012400 con 0x7f563c144770 2023-11-24T06:12:54.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f5638ff9640 1 -- 172.21.15.22:0/1231171130 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400aea0 con 0x7f563c144770 2023-11-24T06:12:54.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.411+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c0af010 con 0x7f563c144770 2023-11-24T06:12:54.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.412+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c1f6ee0 con 0x7f563c144770 2023-11-24T06:12:54.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.413+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c0afa90 con 0x7f563c144770 2023-11-24T06:12:54.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.414+0000 7f5638ff9640 1 -- 172.21.15.22:0/1231171130 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5634007070 con 0x7f563c144770 2023-11-24T06:12:54.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.415+0000 7f5638ff9640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f561c06ae40 0x7f561c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.415+0000 7f5638ff9640 1 -- 172.21.15.22:0/1231171130 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f56340894c0 con 0x7f563c144770 2023-11-24T06:12:54.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.416+0000 7f563b7fe640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f561c06ae40 0x7f561c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.416+0000 7f563b7fe640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f561c06ae40 0x7f561c06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f562c009a30 tx=0x7f562c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:54.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.423+0000 7f5638ff9640 1 -- 172.21.15.22:0/1231171130 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f563c0afa90 con 0x7f563c144770 2023-11-24T06:12:54.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.619+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f563c0afa90 con 0x7f563c144770 2023-11-24T06:12:54.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.620+0000 7f5638ff9640 1 -- 172.21.15.22:0/1231171130 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5634017020 con 0x7f563c144770 2023-11-24T06:12:54.624 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.623+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f561c06ae40 msgr2=0x7f561c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.623+0000 7f56409f4640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f561c06ae40 0x7f561c06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f562c009a30 tx=0x7f562c008040 comp rx=0 tx=0).stop 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.623+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f563c144770 msgr2=0x7f563c15d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.623+0000 7f56409f4640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f563c144770 0x7f563c15d6e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f563400cbc0 tx=0x7f563400a430 comp rx=0 tx=0).stop 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.624+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 shutdown_connections 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.624+0000 7f56409f4640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f561c06ae40 0x7f561c06d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.624+0000 7f56409f4640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f563c144770 0x7f563c15d6e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.624+0000 7f56409f4640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f563c0b35a0 0x7f563c0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.624+0000 7f56409f4640 1 --2- 172.21.15.22:0/1231171130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f563c06c9d0 0x7f563c15a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.624+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 >> 172.21.15.22:0/1231171130 conn(0x7f563c0cec10 msgr2=0x7f563c142580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:54.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.624+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 shutdown_connections 2023-11-24T06:12:54.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.624+0000 7f56409f4640 1 -- 172.21.15.22:0/1231171130 wait complete. 2023-11-24T06:12:54.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:54.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.873+0000 7f0b6f59e640 1 Processor -- start 2023-11-24T06:12:54.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.873+0000 7f0b6f59e640 1 -- start start 2023-11-24T06:12:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70153ea0 0x7f0b700ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6f59e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b70154280 0x7f0b7015d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6f59e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0b70070850 0x7f0b70071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6f59e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b700ce650 con 0x7f0b70154280 2023-11-24T06:12:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6f59e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7015ddd0 con 0x7f0b70070850 2023-11-24T06:12:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7015e0a0 con 0x7f0b70153ea0 2023-11-24T06:12:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6dd9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b70154280 0x7f0b7015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6dd9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b70154280 0x7f0b7015d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37150/0 (socket says 172.21.15.22:37150) 2023-11-24T06:12:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6dd9b640 1 -- 172.21.15.22:0/3491995201 learned_addr learned my addr 172.21.15.22:0/3491995201 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:54.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6ed9d640 1 --2- 172.21.15.22:0/3491995201 >> v2:172.21.15.31:3300/0 conn(0x7f0b70070850 0x7f0b70071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.875+0000 7f0b6e59c640 1 --2- 172.21.15.22:0/3491995201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70153ea0 0x7f0b700ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.876+0000 7f0b6dd9b640 1 -- 172.21.15.22:0/3491995201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70153ea0 msgr2=0x7f0b700ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:54.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.876+0000 7f0b6dd9b640 1 --2- 172.21.15.22:0/3491995201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70153ea0 0x7f0b700ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.876+0000 7f0b6dd9b640 1 -- 172.21.15.22:0/3491995201 >> v2:172.21.15.31:3300/0 conn(0x7f0b70070850 msgr2=0x7f0b70071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:54.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.876+0000 7f0b6dd9b640 1 --2- 172.21.15.22:0/3491995201 >> v2:172.21.15.31:3300/0 conn(0x7f0b70070850 0x7f0b70071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.876+0000 7f0b6dd9b640 1 -- 172.21.15.22:0/3491995201 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7015e380 con 0x7f0b70154280 2023-11-24T06:12:54.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.876+0000 7f0b6ed9d640 1 --2- 172.21.15.22:0/3491995201 >> v2:172.21.15.31:3300/0 conn(0x7f0b70070850 0x7f0b70071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:12:54.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.877+0000 7f0b6dd9b640 1 --2- 172.21.15.22:0/3491995201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 0x7f0b7015d890 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0b700acbf0 tx=0x7f0b6002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8a6ca935a1a89e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:54.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6d59a640 1 -- 172.21.15.22:0/3491995201 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6002ca70 con 0x7f0b70154280 2023-11-24T06:12:54.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6d59a640 1 -- 172.21.15.22:0/3491995201 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6002cbd0 con 0x7f0b70154280 2023-11-24T06:12:54.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6d59a640 1 -- 172.21.15.22:0/3491995201 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600343f0 con 0x7f0b70154280 2023-11-24T06:12:54.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3491995201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 msgr2=0x7f0b7015d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3491995201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 0x7f0b7015d890 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0b700acbf0 tx=0x7f0b6002bed0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3491995201 shutdown_connections 2023-11-24T06:12:54.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3491995201 >> v2:172.21.15.31:3300/0 conn(0x7f0b70070850 0x7f0b70071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3491995201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 0x7f0b7015d890 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3491995201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70153ea0 0x7f0b700ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.878+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3491995201 >> 172.21.15.22:0/3491995201 conn(0x7f0b700cec10 msgr2=0x7f0b700cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:54.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.879+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3491995201 shutdown_connections 2023-11-24T06:12:54.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.879+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3491995201 wait complete. 2023-11-24T06:12:54.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.880+0000 7f0b6f59e640 1 Processor -- start 2023-11-24T06:12:54.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.881+0000 7f0b6f59e640 1 -- start start 2023-11-24T06:12:54.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.881+0000 7f0b6f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70070850 0x7f0b7014f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.881+0000 7f0b6f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b70153ea0 0x7f0b701570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.881+0000 7f0b6f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 0x7f0b70157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6f59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70138b20 con 0x7f0b70154280 2023-11-24T06:12:54.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6f59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7014bd60 con 0x7f0b70153ea0 2023-11-24T06:12:54.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7013b340 con 0x7f0b70070850 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 0x7f0b70157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 0x7f0b70157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37166/0 (socket says 172.21.15.22:37166) 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6ed9d640 1 -- 172.21.15.22:0/3004461904 learned_addr learned my addr 172.21.15.22:0/3004461904 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6dd9b640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b70153ea0 0x7f0b701570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6e59c640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70070850 0x7f0b7014f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6ed9d640 1 -- 172.21.15.22:0/3004461904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70070850 msgr2=0x7f0b7014f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6ed9d640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70070850 0x7f0b7014f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6ed9d640 1 -- 172.21.15.22:0/3004461904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b70153ea0 msgr2=0x7f0b701570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6ed9d640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b70153ea0 0x7f0b701570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6ed9d640 1 -- 172.21.15.22:0/3004461904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009b30 con 0x7f0b70154280 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.882+0000 7f0b6dd9b640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b70153ea0 0x7f0b701570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:54.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.883+0000 7f0b6ed9d640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 0x7f0b70157610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800d5d0 tx=0x7f0b6800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:54.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.883+0000 7f0b66ffd640 1 -- 172.21.15.22:0/3004461904 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68004030 con 0x7f0b70154280 2023-11-24T06:12:54.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.883+0000 7f0b66ffd640 1 -- 172.21.15.22:0/3004461904 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b68004190 con 0x7f0b70154280 2023-11-24T06:12:54.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.883+0000 7f0b66ffd640 1 -- 172.21.15.22:0/3004461904 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68014620 con 0x7f0b70154280 2023-11-24T06:12:54.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.883+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7014d460 con 0x7f0b70154280 2023-11-24T06:12:54.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.883+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b70138460 con 0x7f0b70154280 2023-11-24T06:12:54.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.884+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b700b4e20 con 0x7f0b70154280 2023-11-24T06:12:54.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.885+0000 7f0b66ffd640 1 -- 172.21.15.22:0/3004461904 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b68014780 con 0x7f0b70154280 2023-11-24T06:12:54.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.886+0000 7f0b66ffd640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0b5006ae40 0x7f0b5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:54.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.886+0000 7f0b66ffd640 1 -- 172.21.15.22:0/3004461904 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0b68089c00 con 0x7f0b70154280 2023-11-24T06:12:54.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.886+0000 7f0b6e59c640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0b5006ae40 0x7f0b5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:54.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.887+0000 7f0b6e59c640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0b5006ae40 0x7f0b5006d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0b58006fd0 tx=0x7f0b58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:54.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:54.891+0000 7f0b66ffd640 1 -- 172.21.15.22:0/3004461904 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b68090080 con 0x7f0b70154280 2023-11-24T06:12:55.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.091+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b70138c60 con 0x7f0b70154280 2023-11-24T06:12:55.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.092+0000 7f0b66ffd640 1 -- 172.21.15.22:0/3004461904 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b70138c60 con 0x7f0b70154280 2023-11-24T06:12:55.096 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:55.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0b5006ae40 msgr2=0x7f0b5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0b5006ae40 0x7f0b5006d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0b58006fd0 tx=0x7f0b58008040 comp rx=0 tx=0).stop 2023-11-24T06:12:55.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 msgr2=0x7f0b70157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 0x7f0b70157610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800d5d0 tx=0x7f0b6800da90 comp rx=0 tx=0).stop 2023-11-24T06:12:55.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 shutdown_connections 2023-11-24T06:12:55.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0b5006ae40 0x7f0b5006d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b70154280 0x7f0b70157610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b70153ea0 0x7f0b701570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 --2- 172.21.15.22:0/3004461904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b70070850 0x7f0b7014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 >> 172.21.15.22:0/3004461904 conn(0x7f0b700cec10 msgr2=0x7f0b700ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:55.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 shutdown_connections 2023-11-24T06:12:55.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.095+0000 7f0b6f59e640 1 -- 172.21.15.22:0/3004461904 wait complete. 2023-11-24T06:12:55.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:55.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.349+0000 7fd9583ec640 1 Processor -- start 2023-11-24T06:12:55.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.349+0000 7fd9583ec640 1 -- start start 2023-11-24T06:12:55.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.351+0000 7fd9583ec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd95015d350 0x7fd9500d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.351+0000 7fd9583ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd9500d1840 0x7fd9500cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.351+0000 7fd9583ec640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9500cf240 con 0x7fd95015d730 2023-11-24T06:12:55.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.351+0000 7fd9583ec640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9500d1fb0 con 0x7fd9500d1840 2023-11-24T06:12:55.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.351+0000 7fd9583ec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500ce050 con 0x7fd95015d350 2023-11-24T06:12:55.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.351+0000 7fd955987640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd95015d730 0x7fd9500ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33888/0 (socket says 172.21.15.22:33888) 2023-11-24T06:12:55.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.351+0000 7fd955987640 1 -- 172.21.15.22:0/3895631231 learned_addr learned my addr 172.21.15.22:0/3895631231 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:55.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd956188640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd95015d350 0x7fd9500d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd956989640 1 --2- 172.21.15.22:0/3895631231 >> v2:172.21.15.31:3300/0 conn(0x7fd9500d1840 0x7fd9500cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067296311 0 0) 0x7fd9500cf240 con 0x7fd95015d730 2023-11-24T06:12:55.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd93c003520 con 0x7fd95015d730 2023-11-24T06:12:55.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1744567325 0 0) 0x7fd93c003520 con 0x7fd95015d730 2023-11-24T06:12:55.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd95015d350 msgr2=0x7fd9500d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd95015d350 0x7fd9500d3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 >> v2:172.21.15.31:3300/0 conn(0x7fd9500d1840 msgr2=0x7fd9500cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 --2- 172.21.15.22:0/3895631231 >> v2:172.21.15.31:3300/0 conn(0x7fd9500d1840 0x7fd9500cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500ce330 con 0x7fd95015d730 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fd940001670 con 0x7fd95015d730 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 >> v1:172.21.15.22:6789/0 conn(0x7fd95015d730 legacy=0x7fd9500ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c003970 0x7fd93c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd93c0047c0 0x7fd93c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd95015d350 0x7fd93c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500d1fb0 con 0x7fd93c003970 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500ce050 con 0x7fd93c0047c0 2023-11-24T06:12:55.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.352+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c00b980 con 0x7fd95015d350 2023-11-24T06:12:55.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.353+0000 7fd956188640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c003970 0x7fd93c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.353+0000 7fd955987640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd93c0047c0 0x7fd93c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.353+0000 7fd956989640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd95015d350 0x7fd93c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.353+0000 7fd956188640 1 -- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd95015d350 msgr2=0x7fd93c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:55.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.353+0000 7fd956188640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd95015d350 0x7fd93c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.353+0000 7fd956188640 1 -- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd93c0047c0 msgr2=0x7fd93c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:55.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.353+0000 7fd956188640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd93c0047c0 0x7fd93c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.353+0000 7fd956188640 1 -- 172.21.15.22:0/3895631231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c003520 con 0x7fd93c003970 2023-11-24T06:12:55.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.354+0000 7fd956188640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c003970 0x7fd93c003d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009fc0 tx=0x7fd93c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676b445448fa6e9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:55.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.355+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c02cc00 con 0x7fd93c003970 2023-11-24T06:12:55.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.355+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c00f040 con 0x7fd93c003970 2023-11-24T06:12:55.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.355+0000 7fd955186640 1 -- 172.21.15.22:0/3895631231 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c034440 con 0x7fd93c003970 2023-11-24T06:12:55.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.355+0000 7fd9583ec640 1 -- 172.21.15.22:0/3895631231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c003970 msgr2=0x7fd93c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.355+0000 7fd9583ec640 1 --2- 172.21.15.22:0/3895631231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c003970 0x7fd93c003d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009fc0 tx=0x7fd93c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.355+0000 7fd956989640 1 -- 172.21.15.22:0/3895631231 reap_dead start 2023-11-24T06:12:55.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.356+0000 7fd9583ec640 1 -- 172.21.15.22:0/3895631231 shutdown_connections 2023-11-24T06:12:55.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.356+0000 7fd9583ec640 1 -- 172.21.15.22:0/3895631231 >> 172.21.15.22:0/3895631231 conn(0x7fd95009c5c0 msgr2=0x7fd9500d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:55.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.356+0000 7fd9583ec640 1 -- 172.21.15.22:0/3895631231 shutdown_connections 2023-11-24T06:12:55.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.356+0000 7fd9583ec640 1 -- 172.21.15.22:0/3895631231 wait complete. 2023-11-24T06:12:55.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.358+0000 7fd9583ec640 1 Processor -- start 2023-11-24T06:12:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.358+0000 7fd9583ec640 1 -- start start 2023-11-24T06:12:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd9583ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd93c003970 0x7fd95015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd9583ec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd950155b60 0x7fd950155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd9583ec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950159020 0x7fd9501594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd9583ec640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9501606d0 con 0x7fd950159020 2023-11-24T06:12:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd9583ec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95015db40 con 0x7fd93c003970 2023-11-24T06:12:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd9583ec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95015dd50 con 0x7fd950155b60 2023-11-24T06:12:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd956989640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950159020 0x7fd9501594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd956989640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950159020 0x7fd9501594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37178/0 (socket says 172.21.15.22:37178) 2023-11-24T06:12:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd956989640 1 -- 172.21.15.22:0/2498708168 learned_addr learned my addr 172.21.15.22:0/2498708168 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd955987640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd950155b60 0x7fd950155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.359+0000 7fd956188640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd93c003970 0x7fd95015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd956989640 1 -- 172.21.15.22:0/2498708168 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd950155b60 msgr2=0x7fd950155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd956989640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd950155b60 0x7fd950155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd956989640 1 -- 172.21.15.22:0/2498708168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd93c003970 msgr2=0x7fd95015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd956989640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd93c003970 0x7fd95015a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd956989640 1 -- 172.21.15.22:0/2498708168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95015e030 con 0x7fd950159020 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd956989640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950159020 0x7fd9501594a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd950160fa0 tx=0x7fd948009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd946ffd640 1 -- 172.21.15.22:0/2498708168 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948004440 con 0x7fd950159020 2023-11-24T06:12:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd946ffd640 1 -- 172.21.15.22:0/2498708168 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd948003610 con 0x7fd950159020 2023-11-24T06:12:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95015e310 con 0x7fd950159020 2023-11-24T06:12:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.360+0000 7fd946ffd640 1 -- 172.21.15.22:0/2498708168 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9480039c0 con 0x7fd950159020 2023-11-24T06:12:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.361+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95015e8d0 con 0x7fd950159020 2023-11-24T06:12:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.362+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9500a1230 con 0x7fd950159020 2023-11-24T06:12:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.363+0000 7fd946ffd640 1 -- 172.21.15.22:0/2498708168 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd948003b20 con 0x7fd950159020 2023-11-24T06:12:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.364+0000 7fd946ffd640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd93406ae40 0x7fd93406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.364+0000 7fd946ffd640 1 -- 172.21.15.22:0/2498708168 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd948089510 con 0x7fd950159020 2023-11-24T06:12:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.364+0000 7fd956188640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd93406ae40 0x7fd93406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.365+0000 7fd956188640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd93406ae40 0x7fd93406d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd94c036000 tx=0x7fd94c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:55.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.369+0000 7fd946ffd640 1 -- 172.21.15.22:0/2498708168 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd948054530 con 0x7fd950159020 2023-11-24T06:12:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.567+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd95004e920 con 0x7fd950159020 2023-11-24T06:12:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.568+0000 7fd946ffd640 1 -- 172.21.15.22:0/2498708168 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd948057b50 con 0x7fd950159020 2023-11-24T06:12:55.571 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:55.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd93406ae40 msgr2=0x7fd93406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd93406ae40 0x7fd93406d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd94c036000 tx=0x7fd94c02e000 comp rx=0 tx=0).stop 2023-11-24T06:12:55.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950159020 msgr2=0x7fd9501594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950159020 0x7fd9501594a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd950160fa0 tx=0x7fd948009f90 comp rx=0 tx=0).stop 2023-11-24T06:12:55.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 shutdown_connections 2023-11-24T06:12:55.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd93406ae40 0x7fd93406d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950159020 0x7fd9501594a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd950155b60 0x7fd950155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 --2- 172.21.15.22:0/2498708168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd93c003970 0x7fd95015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 >> 172.21.15.22:0/2498708168 conn(0x7fd95009c5c0 msgr2=0x7fd95015c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:55.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 shutdown_connections 2023-11-24T06:12:55.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.571+0000 7fd9583ec640 1 -- 172.21.15.22:0/2498708168 wait complete. 2023-11-24T06:12:55.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:12:55.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.812+0000 7f1e4e127640 1 Processor -- start 2023-11-24T06:12:55.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.812+0000 7f1e4e127640 1 -- start start 2023-11-24T06:12:55.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.814+0000 7f1e4e127640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 0x7f1e48070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.814+0000 7f1e4e127640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1e480b2930 0x7f1e48160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.814+0000 7f1e4e127640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e48070a90 con 0x7f1e480b2d70 2023-11-24T06:12:55.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.814+0000 7f1e4e127640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e48070cf0 con 0x7f1e480b2930 2023-11-24T06:12:55.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.814+0000 7f1e4e127640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48070fd0 con 0x7f1e480b2550 2023-11-24T06:12:55.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.815+0000 7f1e4d926640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1e480b2d70 0x7f1e4815da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:33014/0 (socket says 172.21.15.22:33014) 2023-11-24T06:12:55.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.815+0000 7f1e4d926640 1 -- 172.21.15.22:0/3033947921 learned_addr learned my addr 172.21.15.22:0/3033947921 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:55.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.815+0000 7f1e4d125640 1 --2- 172.21.15.22:0/3033947921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 0x7f1e48070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.815+0000 7f1e4c924640 1 --2- 172.21.15.22:0/3033947921 >> v2:172.21.15.31:3300/0 conn(0x7f1e480b2930 0x7f1e48160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.816+0000 7f1e3ffff640 1 -- 172.21.15.22:0/3033947921 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818770647 0 0) 0x7f1e48070a90 con 0x7f1e480b2d70 2023-11-24T06:12:55.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.816+0000 7f1e4d125640 1 -- 172.21.15.22:0/3033947921 >> v2:172.21.15.31:3300/0 conn(0x7f1e480b2930 msgr2=0x7f1e48160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:55.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.816+0000 7f1e4d125640 1 --2- 172.21.15.22:0/3033947921 >> v2:172.21.15.31:3300/0 conn(0x7f1e480b2930 0x7f1e48160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.816+0000 7f1e4d125640 1 -- 172.21.15.22:0/3033947921 >> v1:172.21.15.31:6789/0 conn(0x7f1e480b2d70 legacy=0x7f1e4815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.816+0000 7f1e4d125640 1 -- 172.21.15.22:0/3033947921 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e480712b0 con 0x7f1e480b2550 2023-11-24T06:12:55.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.818+0000 7f1e4d125640 1 --2- 172.21.15.22:0/3033947921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 0x7f1e48070550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e440097a0 tx=0x7f1e4402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8bc36c1b67712f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:55.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.818+0000 7f1e3ffff640 1 -- 172.21.15.22:0/3033947921 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44031830 con 0x7f1e480b2550 2023-11-24T06:12:55.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.818+0000 7f1e3ffff640 1 -- 172.21.15.22:0/3033947921 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e44031990 con 0x7f1e480b2550 2023-11-24T06:12:55.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.818+0000 7f1e3ffff640 1 -- 172.21.15.22:0/3033947921 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44031d20 con 0x7f1e480b2550 2023-11-24T06:12:55.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.819+0000 7f1e4e127640 1 -- 172.21.15.22:0/3033947921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 msgr2=0x7f1e48070550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.819+0000 7f1e4e127640 1 --2- 172.21.15.22:0/3033947921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 0x7f1e48070550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e440097a0 tx=0x7f1e4402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.819+0000 7f1e4e127640 1 -- 172.21.15.22:0/3033947921 shutdown_connections 2023-11-24T06:12:55.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.819+0000 7f1e4e127640 1 --2- 172.21.15.22:0/3033947921 >> v2:172.21.15.31:3300/0 conn(0x7f1e480b2930 0x7f1e48160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.819+0000 7f1e4e127640 1 --2- 172.21.15.22:0/3033947921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 0x7f1e48070550 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.819+0000 7f1e4e127640 1 -- 172.21.15.22:0/3033947921 >> 172.21.15.22:0/3033947921 conn(0x7f1e480b0840 msgr2=0x7f1e480b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:55.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.819+0000 7f1e4e127640 1 -- 172.21.15.22:0/3033947921 shutdown_connections 2023-11-24T06:12:55.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.819+0000 7f1e4e127640 1 -- 172.21.15.22:0/3033947921 wait complete. 2023-11-24T06:12:55.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.821+0000 7f1e4e127640 1 Processor -- start 2023-11-24T06:12:55.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.821+0000 7f1e4e127640 1 -- start start 2023-11-24T06:12:55.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4e127640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 0x7f1e48153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4e127640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e480b2930 0x7f1e48155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4e127640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e480b2d70 0x7f1e481555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4e127640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4815d7e0 con 0x7f1e480b2d70 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4e127640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4815e640 con 0x7f1e480b2930 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4e127640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4815da30 con 0x7f1e480b2550 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4d926640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e480b2d70 0x7f1e481555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4d926640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e480b2d70 0x7f1e481555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37186/0 (socket says 172.21.15.22:37186) 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4d926640 1 -- 172.21.15.22:0/2224957104 learned_addr learned my addr 172.21.15.22:0/2224957104 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4d125640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 0x7f1e48153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.822+0000 7f1e4c924640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e480b2930 0x7f1e48155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e4d926640 1 -- 172.21.15.22:0/2224957104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 msgr2=0x7f1e48153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e4d926640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 0x7f1e48153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e4d926640 1 -- 172.21.15.22:0/2224957104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e480b2930 msgr2=0x7f1e48155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:55.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e4d926640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e480b2930 0x7f1e48155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:55.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e4d926640 1 -- 172.21.15.22:0/2224957104 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44009400 con 0x7f1e480b2d70 2023-11-24T06:12:55.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e4d926640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e480b2d70 0x7f1e481555c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c730 tx=0x7f1e4000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:55.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e3dffb640 1 -- 172.21.15.22:0/2224957104 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000ce40 con 0x7f1e480b2d70 2023-11-24T06:12:55.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e3dffb640 1 -- 172.21.15.22:0/2224957104 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4000a640 con 0x7f1e480b2d70 2023-11-24T06:12:55.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e3dffb640 1 -- 172.21.15.22:0/2224957104 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000aa30 con 0x7f1e480b2d70 2023-11-24T06:12:55.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.823+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4815dd10 con 0x7f1e480b2d70 2023-11-24T06:12:55.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.824+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4815e2d0 con 0x7f1e480b2d70 2023-11-24T06:12:55.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.825+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4804e840 con 0x7f1e480b2d70 2023-11-24T06:12:55.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.826+0000 7f1e3dffb640 1 -- 172.21.15.22:0/2224957104 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e4000ab90 con 0x7f1e480b2d70 2023-11-24T06:12:55.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.827+0000 7f1e3dffb640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e2c06ae40 0x7f1e2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:55.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.827+0000 7f1e3dffb640 1 -- 172.21.15.22:0/2224957104 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1e40088cc0 con 0x7f1e480b2d70 2023-11-24T06:12:55.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.827+0000 7f1e4d125640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e2c06ae40 0x7f1e2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:55.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.828+0000 7f1e4d125640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e2c06ae40 0x7f1e2c06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1e44036000 tx=0x7f1e4403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:55.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:55.832+0000 7f1e3dffb640 1 -- 172.21.15.22:0/2224957104 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e4008f080 con 0x7f1e480b2d70 2023-11-24T06:12:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.041+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1e4806d1d0 con 0x7f1e480b2d70 2023-11-24T06:12:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.042+0000 7f1e3dffb640 1 -- 172.21.15.22:0/2224957104 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1e40018070 con 0x7f1e480b2d70 2023-11-24T06:12:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:12:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e2c06ae40 msgr2=0x7f1e2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e2c06ae40 0x7f1e2c06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1e44036000 tx=0x7f1e4403c040 comp rx=0 tx=0).stop 2023-11-24T06:12:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e480b2d70 msgr2=0x7f1e481555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e480b2d70 0x7f1e481555c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c730 tx=0x7f1e4000cbf0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 shutdown_connections 2023-11-24T06:12:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e2c06ae40 0x7f1e2c06d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e480b2d70 0x7f1e481555c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e480b2930 0x7f1e48155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 --2- 172.21.15.22:0/2224957104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e480b2550 0x7f1e48153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 >> 172.21.15.22:0/2224957104 conn(0x7f1e480b0840 msgr2=0x7f1e4806d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 shutdown_connections 2023-11-24T06:12:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.045+0000 7f1e4e127640 1 -- 172.21.15.22:0/2224957104 wait complete. 2023-11-24T06:12:56.067 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2023-11-24T06:12:56.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:56.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T06:12:56.166 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:12:56.166 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:12:56.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:12:56.167 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:12:56.233 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:12:56.233 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:12:56.298 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:12:56.298 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:12:56.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:56.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.591+0000 7f60c242e640 1 Processor -- start 2023-11-24T06:12:56.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.591+0000 7f60c242e640 1 -- start start 2023-11-24T06:12:56.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.592+0000 7f60c242e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc162670 0x7f60bc0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:56.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.592+0000 7f60c242e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60bc0cf590 0x7f60bc06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:56.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.592+0000 7f60c242e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc0cf9a0 con 0x7f60bc14b1c0 2023-11-24T06:12:56.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.592+0000 7f60c242e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60bc165ca0 con 0x7f60bc0cf590 2023-11-24T06:12:56.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.592+0000 7f60c242e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc165f80 con 0x7f60bc162670 2023-11-24T06:12:56.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.593+0000 7f60c1c2d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60bc0cf590 0x7f60bc06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:56.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.593+0000 7f60c1c2d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60bc0cf590 0x7f60bc06c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37198/0 (socket says 172.21.15.22:37198) 2023-11-24T06:12:56.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.593+0000 7f60c1c2d640 1 -- 172.21.15.22:0/4110104329 learned_addr learned my addr 172.21.15.22:0/4110104329 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:56.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.593+0000 7f60c0c2b640 1 --2- 172.21.15.22:0/4110104329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc162670 0x7f60bc0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:56.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.593+0000 7f60c1c2d640 1 -- 172.21.15.22:0/4110104329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc162670 msgr2=0x7f60bc0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:56.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.593+0000 7f60c1c2d640 1 --2- 172.21.15.22:0/4110104329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc162670 0x7f60bc0cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.593+0000 7f60c1c2d640 1 -- 172.21.15.22:0/4110104329 >> v1:172.21.15.31:6789/0 conn(0x7f60bc14b1c0 legacy=0x7f60bc1651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:56.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.593+0000 7f60c1c2d640 1 -- 172.21.15.22:0/4110104329 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc161e70 con 0x7f60bc0cf590 2023-11-24T06:12:56.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.594+0000 7f60c1c2d640 1 --2- 172.21.15.22:0/4110104329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc0cf590 0x7f60bc06c640 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009e50 tx=0x7f60b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8f67179936dbed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:56.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.595+0000 7f60b3fff640 1 -- 172.21.15.22:0/4110104329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b402ca70 con 0x7f60bc0cf590 2023-11-24T06:12:56.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.595+0000 7f60b3fff640 1 -- 172.21.15.22:0/4110104329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b402cbd0 con 0x7f60bc0cf590 2023-11-24T06:12:56.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.595+0000 7f60b3fff640 1 -- 172.21.15.22:0/4110104329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b40343f0 con 0x7f60bc0cf590 2023-11-24T06:12:56.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.595+0000 7f60c242e640 1 -- 172.21.15.22:0/4110104329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc0cf590 msgr2=0x7f60bc06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:56.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.595+0000 7f60c242e640 1 --2- 172.21.15.22:0/4110104329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc0cf590 0x7f60bc06c640 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009e50 tx=0x7f60b402bed0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.596+0000 7f60c242e640 1 -- 172.21.15.22:0/4110104329 shutdown_connections 2023-11-24T06:12:56.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.596+0000 7f60c242e640 1 --2- 172.21.15.22:0/4110104329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc0cf590 0x7f60bc06c640 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.596+0000 7f60c242e640 1 --2- 172.21.15.22:0/4110104329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc162670 0x7f60bc0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.596+0000 7f60c242e640 1 -- 172.21.15.22:0/4110104329 >> 172.21.15.22:0/4110104329 conn(0x7f60bc06a860 msgr2=0x7f60bc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:56.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.596+0000 7f60c242e640 1 -- 172.21.15.22:0/4110104329 shutdown_connections 2023-11-24T06:12:56.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.596+0000 7f60c242e640 1 -- 172.21.15.22:0/4110104329 wait complete. 2023-11-24T06:12:56.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.597+0000 7f60c242e640 1 Processor -- start 2023-11-24T06:12:56.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.598+0000 7f60c242e640 1 -- start start 2023-11-24T06:12:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.598+0000 7f60c242e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc0cf590 0x7f60bc160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.598+0000 7f60c242e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc14b1c0 0x7f60bc0c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c242e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc162670 0x7f60bc0c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c242e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc161280 con 0x7f60bc162670 2023-11-24T06:12:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c242e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0ca7c0 con 0x7f60bc0cf590 2023-11-24T06:12:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c242e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0c4620 con 0x7f60bc14b1c0 2023-11-24T06:12:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c1c2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc162670 0x7f60bc0c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c1c2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc162670 0x7f60bc0c3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37212/0 (socket says 172.21.15.22:37212) 2023-11-24T06:12:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c1c2d640 1 -- 172.21.15.22:0/671843864 learned_addr learned my addr 172.21.15.22:0/671843864 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:56.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c0c2b640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc14b1c0 0x7f60bc0c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:56.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c142c640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc0cf590 0x7f60bc160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:56.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c1c2d640 1 -- 172.21.15.22:0/671843864 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc14b1c0 msgr2=0x7f60bc0c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:56.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c1c2d640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc14b1c0 0x7f60bc0c3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c1c2d640 1 -- 172.21.15.22:0/671843864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc0cf590 msgr2=0x7f60bc160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:56.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c1c2d640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc0cf590 0x7f60bc160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c1c2d640 1 -- 172.21.15.22:0/671843864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b4009b30 con 0x7f60bc162670 2023-11-24T06:12:56.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.599+0000 7f60c142c640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc0cf590 0x7f60bc160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.600+0000 7f60c1c2d640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc162670 0x7f60bc0c3ff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009e50 tx=0x7f60b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.600+0000 7f60b1ffb640 1 -- 172.21.15.22:0/671843864 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4009510 con 0x7f60bc162670 2023-11-24T06:12:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.600+0000 7f60b1ffb640 1 -- 172.21.15.22:0/671843864 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b403e450 con 0x7f60bc162670 2023-11-24T06:12:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.600+0000 7f60b1ffb640 1 -- 172.21.15.22:0/671843864 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b403e800 con 0x7f60bc162670 2023-11-24T06:12:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.600+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc0c4900 con 0x7f60bc162670 2023-11-24T06:12:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.600+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc0c4ec0 con 0x7f60bc162670 2023-11-24T06:12:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.601+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc04e840 con 0x7f60bc162670 2023-11-24T06:12:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.603+0000 7f60b1ffb640 1 -- 172.21.15.22:0/671843864 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60b403e960 con 0x7f60bc162670 2023-11-24T06:12:56.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.604+0000 7f60b1ffb640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f60a006ae40 0x7f60a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:56.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.604+0000 7f60b1ffb640 1 -- 172.21.15.22:0/671843864 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f60b40ac440 con 0x7f60bc162670 2023-11-24T06:12:56.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.604+0000 7f60c142c640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f60a006ae40 0x7f60a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:56.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.605+0000 7f60c142c640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f60a006ae40 0x7f60a006d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f60b8000f60 tx=0x7f60b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.608+0000 7f60b1ffb640 1 -- 172.21.15.22:0/671843864 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f60b4077460 con 0x7f60bc162670 2023-11-24T06:12:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.804+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60bc0ce9a0 con 0x7f60bc162670 2023-11-24T06:12:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.806+0000 7f60b1ffb640 1 -- 172.21.15.22:0/671843864 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f60b407aa80 con 0x7f60bc162670 2023-11-24T06:12:56.809 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:56.809 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:56.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f60a006ae40 msgr2=0x7f60a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:56.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f60a006ae40 0x7f60a006d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f60b8000f60 tx=0x7f60b8009040 comp rx=0 tx=0).stop 2023-11-24T06:12:56.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc162670 msgr2=0x7f60bc0c3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:56.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc162670 0x7f60bc0c3ff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009e50 tx=0x7f60b4004a40 comp rx=0 tx=0).stop 2023-11-24T06:12:56.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 shutdown_connections 2023-11-24T06:12:56.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f60a006ae40 0x7f60a006d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60bc162670 0x7f60bc0c3ff0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc14b1c0 0x7f60bc0c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 --2- 172.21.15.22:0/671843864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc0cf590 0x7f60bc160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 >> 172.21.15.22:0/671843864 conn(0x7f60bc06a860 msgr2=0x7f60bc1497c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 shutdown_connections 2023-11-24T06:12:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:56.809+0000 7f60c242e640 1 -- 172.21.15.22:0/671843864 wait complete. 2023-11-24T06:12:56.830 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:56.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:57.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.052+0000 7ff36b8da640 1 Processor -- start 2023-11-24T06:12:57.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.052+0000 7ff36b8da640 1 -- start start 2023-11-24T06:12:57.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.053+0000 7ff36b8da640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3640b48d0 0x7ff3640b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.053+0000 7ff36b8da640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff3640b3210 0x7ff364167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.054+0000 7ff36b8da640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3640b23e0 con 0x7ff364160bd0 2023-11-24T06:12:57.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.054+0000 7ff36b8da640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3640cdc70 con 0x7ff3640b3210 2023-11-24T06:12:57.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.054+0000 7ff36b8da640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3640b2870 con 0x7ff3640b48d0 2023-11-24T06:12:57.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.054+0000 7ff369e77640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff3640b3210 0x7ff364167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.054+0000 7ff369e77640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff3640b3210 0x7ff364167290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37226/0 (socket says 172.21.15.22:37226) 2023-11-24T06:12:57.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.054+0000 7ff369e77640 1 -- 172.21.15.22:0/3283793255 learned_addr learned my addr 172.21.15.22:0/3283793255 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:57.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.054+0000 7ff368e75640 1 --2- 172.21.15.22:0/3283793255 >> v2:172.21.15.31:3300/0 conn(0x7ff3640b48d0 0x7ff3640b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.055+0000 7ff369e77640 1 -- 172.21.15.22:0/3283793255 >> v2:172.21.15.31:3300/0 conn(0x7ff3640b48d0 msgr2=0x7ff3640b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:57.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.055+0000 7ff369e77640 1 --2- 172.21.15.22:0/3283793255 >> v2:172.21.15.31:3300/0 conn(0x7ff3640b48d0 0x7ff3640b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.055+0000 7ff369e77640 1 -- 172.21.15.22:0/3283793255 >> v1:172.21.15.31:6789/0 conn(0x7ff364160bd0 legacy=0x7ff3640b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.055+0000 7ff369e77640 1 -- 172.21.15.22:0/3283793255 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640d41b0 con 0x7ff3640b3210 2023-11-24T06:12:57.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.056+0000 7ff369e77640 1 --2- 172.21.15.22:0/3283793255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b3210 0x7ff364167290 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff3640d30f0 tx=0x7ff35c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30da40b2ce330227 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:57.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.056+0000 7ff363fff640 1 -- 172.21.15.22:0/3283793255 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c031870 con 0x7ff3640b3210 2023-11-24T06:12:57.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.056+0000 7ff363fff640 1 -- 172.21.15.22:0/3283793255 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c0319d0 con 0x7ff3640b3210 2023-11-24T06:12:57.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.056+0000 7ff363fff640 1 -- 172.21.15.22:0/3283793255 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c031d60 con 0x7ff3640b3210 2023-11-24T06:12:57.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.057+0000 7ff36b8da640 1 -- 172.21.15.22:0/3283793255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b3210 msgr2=0x7ff364167290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.057+0000 7ff36b8da640 1 --2- 172.21.15.22:0/3283793255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b3210 0x7ff364167290 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff3640d30f0 tx=0x7ff35c02b910 comp rx=0 tx=0).stop 2023-11-24T06:12:57.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.057+0000 7ff36b8da640 1 -- 172.21.15.22:0/3283793255 shutdown_connections 2023-11-24T06:12:57.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.057+0000 7ff36b8da640 1 --2- 172.21.15.22:0/3283793255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b3210 0x7ff364167290 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.057+0000 7ff36b8da640 1 --2- 172.21.15.22:0/3283793255 >> v2:172.21.15.31:3300/0 conn(0x7ff3640b48d0 0x7ff3640b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.057+0000 7ff36b8da640 1 -- 172.21.15.22:0/3283793255 >> 172.21.15.22:0/3283793255 conn(0x7ff36409c5a0 msgr2=0x7ff3640d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:57.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.057+0000 7ff36b8da640 1 -- 172.21.15.22:0/3283793255 shutdown_connections 2023-11-24T06:12:57.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.057+0000 7ff36b8da640 1 -- 172.21.15.22:0/3283793255 wait complete. 2023-11-24T06:12:57.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.059+0000 7ff36b8da640 1 Processor -- start 2023-11-24T06:12:57.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.059+0000 7ff36b8da640 1 -- start start 2023-11-24T06:12:57.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.060+0000 7ff36b8da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3640b3210 0x7ff3640ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.060+0000 7ff36b8da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b48d0 0x7ff36415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.060+0000 7ff36b8da640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff364160bd0 0x7ff3640cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff36b8da640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640cd8e0 con 0x7ff3640b48d0 2023-11-24T06:12:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff36b8da640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36415cb80 con 0x7ff3640b3210 2023-11-24T06:12:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff36b8da640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640c7bf0 con 0x7ff364160bd0 2023-11-24T06:12:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff368e75640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b48d0 0x7ff36415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff368e75640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b48d0 0x7ff36415c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37230/0 (socket says 172.21.15.22:37230) 2023-11-24T06:12:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff368e75640 1 -- 172.21.15.22:0/2319026494 learned_addr learned my addr 172.21.15.22:0/2319026494 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff368e75640 1 -- 172.21.15.22:0/2319026494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff364160bd0 msgr2=0x7ff3640cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff368e75640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff364160bd0 0x7ff3640cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff368e75640 1 -- 172.21.15.22:0/2319026494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3640b3210 msgr2=0x7ff3640ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff368e75640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3640b3210 0x7ff3640ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.061+0000 7ff368e75640 1 -- 172.21.15.22:0/2319026494 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0094d0 con 0x7ff3640b48d0 2023-11-24T06:12:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.062+0000 7ff368e75640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b48d0 0x7ff36415c640 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff35800d800 tx=0x7ff35800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.062+0000 7ff361ffb640 1 -- 172.21.15.22:0/2319026494 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358004030 con 0x7ff3640b48d0 2023-11-24T06:12:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.062+0000 7ff361ffb640 1 -- 172.21.15.22:0/2319026494 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358004190 con 0x7ff3640b48d0 2023-11-24T06:12:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.062+0000 7ff361ffb640 1 -- 172.21.15.22:0/2319026494 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800b6c0 con 0x7ff3640b48d0 2023-11-24T06:12:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.062+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3640cb0e0 con 0x7ff3640b48d0 2023-11-24T06:12:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.062+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3640cad20 con 0x7ff3640b48d0 2023-11-24T06:12:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.063+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3640c7a50 con 0x7ff3640b48d0 2023-11-24T06:12:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.064+0000 7ff361ffb640 1 -- 172.21.15.22:0/2319026494 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff35800b820 con 0x7ff3640b48d0 2023-11-24T06:12:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.066+0000 7ff361ffb640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff35006ae40 0x7ff35006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.066+0000 7ff361ffb640 1 -- 172.21.15.22:0/2319026494 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff358089980 con 0x7ff3640b48d0 2023-11-24T06:12:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.066+0000 7ff369676640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff35006ae40 0x7ff35006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.067+0000 7ff369676640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff35006ae40 0x7ff35006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3540012e0 tx=0x7ff354007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.071+0000 7ff361ffb640 1 -- 172.21.15.22:0/2319026494 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3640c7a50 con 0x7ff3640b48d0 2023-11-24T06:12:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.266+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3640c7a50 con 0x7ff3640b48d0 2023-11-24T06:12:57.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.267+0000 7ff361ffb640 1 -- 172.21.15.22:0/2319026494 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3640c7a50 con 0x7ff3640b48d0 2023-11-24T06:12:57.270 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:57.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff35006ae40 msgr2=0x7ff35006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff35006ae40 0x7ff35006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3540012e0 tx=0x7ff354007d30 comp rx=0 tx=0).stop 2023-11-24T06:12:57.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b48d0 msgr2=0x7ff36415c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b48d0 0x7ff36415c640 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff35800d800 tx=0x7ff35800dcc0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 shutdown_connections 2023-11-24T06:12:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff35006ae40 0x7ff35006d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff364160bd0 0x7ff3640cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b48d0 0x7ff36415c640 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 --2- 172.21.15.22:0/2319026494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3640b3210 0x7ff3640ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 >> 172.21.15.22:0/2319026494 conn(0x7ff36409c5a0 msgr2=0x7ff3640d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.270+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 shutdown_connections 2023-11-24T06:12:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.271+0000 7ff36b8da640 1 -- 172.21.15.22:0/2319026494 wait complete. 2023-11-24T06:12:57.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:57.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.521+0000 7fd711e67640 1 Processor -- start 2023-11-24T06:12:57.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.521+0000 7fd711e67640 1 -- start start 2023-11-24T06:12:57.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.523+0000 7fd711e67640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd70c15d260 0x7fd70c0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.523+0000 7fd711e67640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd70c0af1b0 0x7fd70c06a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.523+0000 7fd711e67640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c0add50 con 0x7fd70c06a980 2023-11-24T06:12:57.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.523+0000 7fd711e67640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c06ae30 con 0x7fd70c0af1b0 2023-11-24T06:12:57.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.523+0000 7fd711e67640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c06d000 con 0x7fd70c15d260 2023-11-24T06:12:57.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.523+0000 7fd703fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd70c0af1b0 0x7fd70c06a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.523+0000 7fd711666640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd70c06a980 0x7fd70c160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33904/0 (socket says 172.21.15.22:33904) 2023-11-24T06:12:57.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.523+0000 7fd711666640 1 -- 172.21.15.22:0/3057710715 learned_addr learned my addr 172.21.15.22:0/3057710715 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:57.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.524+0000 7fd710e65640 1 --2- 172.21.15.22:0/3057710715 >> v2:172.21.15.31:3300/0 conn(0x7fd70c15d260 0x7fd70c0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.524+0000 7fd703fff640 1 -- 172.21.15.22:0/3057710715 >> v2:172.21.15.31:3300/0 conn(0x7fd70c15d260 msgr2=0x7fd70c0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:57.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.524+0000 7fd703fff640 1 --2- 172.21.15.22:0/3057710715 >> v2:172.21.15.31:3300/0 conn(0x7fd70c15d260 0x7fd70c0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.524+0000 7fd703fff640 1 -- 172.21.15.22:0/3057710715 >> v1:172.21.15.22:6789/0 conn(0x7fd70c06a980 legacy=0x7fd70c160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.524+0000 7fd703fff640 1 -- 172.21.15.22:0/3057710715 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c15d7d0 con 0x7fd70c0af1b0 2023-11-24T06:12:57.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.524+0000 7fd7037fe640 1 -- 172.21.15.22:0/3057710715 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001596500 0 0) 0x7fd70c0add50 con 0x7fd70c06a980 2023-11-24T06:12:57.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.525+0000 7fd703fff640 1 --2- 172.21.15.22:0/3057710715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 0x7fd70c06a440 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd70c06cdc0 tx=0x7fd6fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1711131f67b8feeb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:57.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.525+0000 7fd7037fe640 1 -- 172.21.15.22:0/3057710715 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc031830 con 0x7fd70c0af1b0 2023-11-24T06:12:57.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.525+0000 7fd7037fe640 1 -- 172.21.15.22:0/3057710715 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc031990 con 0x7fd70c0af1b0 2023-11-24T06:12:57.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.525+0000 7fd7037fe640 1 -- 172.21.15.22:0/3057710715 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc031d20 con 0x7fd70c0af1b0 2023-11-24T06:12:57.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.526+0000 7fd711e67640 1 -- 172.21.15.22:0/3057710715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 msgr2=0x7fd70c06a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.526+0000 7fd711e67640 1 --2- 172.21.15.22:0/3057710715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 0x7fd70c06a440 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd70c06cdc0 tx=0x7fd6fc02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.526+0000 7fd711e67640 1 -- 172.21.15.22:0/3057710715 shutdown_connections 2023-11-24T06:12:57.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.526+0000 7fd711e67640 1 --2- 172.21.15.22:0/3057710715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 0x7fd70c06a440 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.526+0000 7fd711e67640 1 --2- 172.21.15.22:0/3057710715 >> v2:172.21.15.31:3300/0 conn(0x7fd70c15d260 0x7fd70c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.526+0000 7fd711e67640 1 -- 172.21.15.22:0/3057710715 >> 172.21.15.22:0/3057710715 conn(0x7fd70c0cfd80 msgr2=0x7fd70c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:57.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.526+0000 7fd711e67640 1 -- 172.21.15.22:0/3057710715 shutdown_connections 2023-11-24T06:12:57.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.526+0000 7fd711e67640 1 -- 172.21.15.22:0/3057710715 wait complete. 2023-11-24T06:12:57.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.528+0000 7fd711e67640 1 Processor -- start 2023-11-24T06:12:57.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.528+0000 7fd711e67640 1 -- start start 2023-11-24T06:12:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.529+0000 7fd711e67640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd70c06a980 0x7fd70c144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.529+0000 7fd711e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 0x7fd70c0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.529+0000 7fd711e67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd70c15d260 0x7fd70c0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.529+0000 7fd711e67640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b3c70 con 0x7fd70c0af1b0 2023-11-24T06:12:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.529+0000 7fd711e67640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b4a30 con 0x7fd70c15d260 2023-11-24T06:12:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.529+0000 7fd711e67640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b3eb0 con 0x7fd70c06a980 2023-11-24T06:12:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.529+0000 7fd703fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 0x7fd70c0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.529+0000 7fd703fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 0x7fd70c0b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37250/0 (socket says 172.21.15.22:37250) 2023-11-24T06:12:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.529+0000 7fd703fff640 1 -- 172.21.15.22:0/3549147492 learned_addr learned my addr 172.21.15.22:0/3549147492 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd711666640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd70c15d260 0x7fd70c0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd703fff640 1 -- 172.21.15.22:0/3549147492 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd70c06a980 msgr2=0x7fd70c144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd710e65640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd70c06a980 0x7fd70c144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd703fff640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd70c06a980 0x7fd70c144620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd703fff640 1 -- 172.21.15.22:0/3549147492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd70c15d260 msgr2=0x7fd70c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd703fff640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd70c15d260 0x7fd70c0b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd703fff640 1 -- 172.21.15.22:0/3549147492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc009400 con 0x7fd70c0af1b0 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd711666640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd70c15d260 0x7fd70c0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd703fff640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 0x7fd70c0b31f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc02bee0 tx=0x7fd6fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:57.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd7017fa640 1 -- 172.21.15.22:0/3549147492 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc03a6f0 con 0x7fd70c0af1b0 2023-11-24T06:12:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd7017fa640 1 -- 172.21.15.22:0/3549147492 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc03a870 con 0x7fd70c0af1b0 2023-11-24T06:12:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd7017fa640 1 -- 172.21.15.22:0/3549147492 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc03ac20 con 0x7fd70c0af1b0 2023-11-24T06:12:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.530+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0b4190 con 0x7fd70c0af1b0 2023-11-24T06:12:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.531+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c0b4750 con 0x7fd70c0af1b0 2023-11-24T06:12:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.532+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c156970 con 0x7fd70c0af1b0 2023-11-24T06:12:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.533+0000 7fd7017fa640 1 -- 172.21.15.22:0/3549147492 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6fc030380 con 0x7fd70c0af1b0 2023-11-24T06:12:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.533+0000 7fd7017fa640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd6f806ae40 0x7fd6f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.534+0000 7fd7017fa640 1 -- 172.21.15.22:0/3549147492 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd6fc0ab0b0 con 0x7fd70c0af1b0 2023-11-24T06:12:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.534+0000 7fd710e65640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd6f806ae40 0x7fd6f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.535+0000 7fd710e65640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd6f806ae40 0x7fd6f806d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd708009970 tx=0x7fd708008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.538+0000 7fd7017fa640 1 -- 172.21.15.22:0/3549147492 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6fc076030 con 0x7fd70c0af1b0 2023-11-24T06:12:57.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.734+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd70c04e840 con 0x7fd70c0af1b0 2023-11-24T06:12:57.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.735+0000 7fd7017fa640 1 -- 172.21.15.22:0/3549147492 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6fc079650 con 0x7fd70c0af1b0 2023-11-24T06:12:57.738 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:12:57.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd6f806ae40 msgr2=0x7fd6f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd6f806ae40 0x7fd6f806d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd708009970 tx=0x7fd708008040 comp rx=0 tx=0).stop 2023-11-24T06:12:57.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 msgr2=0x7fd70c0b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 0x7fd70c0b31f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc02bee0 tx=0x7fd6fc0046c0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 shutdown_connections 2023-11-24T06:12:57.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd6f806ae40 0x7fd6f806d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd70c15d260 0x7fd70c0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c0af1b0 0x7fd70c0b31f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 --2- 172.21.15.22:0/3549147492 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd70c06a980 0x7fd70c144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 >> 172.21.15.22:0/3549147492 conn(0x7fd70c0cfd80 msgr2=0x7fd70c1615b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:57.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 shutdown_connections 2023-11-24T06:12:57.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.738+0000 7fd711e67640 1 -- 172.21.15.22:0/3549147492 wait complete. 2023-11-24T06:12:57.761 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:12:57.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.983+0000 7f3e282bb640 1 Processor -- start 2023-11-24T06:12:57.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.983+0000 7f3e282bb640 1 -- start start 2023-11-24T06:12:57.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.985+0000 7f3e282bb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e2006cad0 0x7f3e2006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.985+0000 7f3e282bb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e20071780 con 0x7f3e20160b10 2023-11-24T06:12:57.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.985+0000 7f3e282bb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e200711c0 con 0x7f3e20072280 2023-11-24T06:12:57.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.985+0000 7f3e282bb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e200b2320 con 0x7f3e2006cad0 2023-11-24T06:12:57.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.986+0000 7f3e26057640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3e20160b10 0x7f3e2006c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33912/0 (socket says 172.21.15.22:33912) 2023-11-24T06:12:57.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.986+0000 7f3e26057640 1 -- 172.21.15.22:0/2636382553 learned_addr learned my addr 172.21.15.22:0/2636382553 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:57.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.986+0000 7f3e25856640 1 --2- 172.21.15.22:0/2636382553 >> v2:172.21.15.22:3300/0 conn(0x7f3e2006cad0 0x7f3e2006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.986+0000 7f3e25055640 1 -- 172.21.15.22:0/2636382553 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573357405 0 0) 0x7f3e20071780 con 0x7f3e20160b10 2023-11-24T06:12:57.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.986+0000 7f3e25055640 1 -- 172.21.15.22:0/2636382553 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e0c003520 con 0x7f3e20160b10 2023-11-24T06:12:57.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.986+0000 7f3e25856640 1 -- 172.21.15.22:0/2636382553 >> v1:172.21.15.31:6789/0 conn(0x7f3e20072280 legacy=0x7f3e200b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.986+0000 7f3e25856640 1 -- 172.21.15.22:0/2636382553 >> v1:172.21.15.22:6789/0 conn(0x7f3e20160b10 legacy=0x7f3e2006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.986+0000 7f3e25856640 1 -- 172.21.15.22:0/2636382553 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e200714a0 con 0x7f3e2006cad0 2023-11-24T06:12:57.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.988+0000 7f3e25856640 1 --2- 172.21.15.22:0/2636382553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 0x7f3e2006e420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3e100097a0 tx=0x7f3e1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410ec25cdbbacd91 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:57.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.988+0000 7f3e25055640 1 -- 172.21.15.22:0/2636382553 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10031830 con 0x7f3e2006cad0 2023-11-24T06:12:57.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.988+0000 7f3e25055640 1 -- 172.21.15.22:0/2636382553 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10031990 con 0x7f3e2006cad0 2023-11-24T06:12:57.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.988+0000 7f3e25055640 1 -- 172.21.15.22:0/2636382553 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10031d20 con 0x7f3e2006cad0 2023-11-24T06:12:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.989+0000 7f3e282bb640 1 -- 172.21.15.22:0/2636382553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 msgr2=0x7f3e2006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.989+0000 7f3e282bb640 1 --2- 172.21.15.22:0/2636382553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 0x7f3e2006e420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3e100097a0 tx=0x7f3e1002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.989+0000 7f3e282bb640 1 -- 172.21.15.22:0/2636382553 shutdown_connections 2023-11-24T06:12:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.989+0000 7f3e282bb640 1 --2- 172.21.15.22:0/2636382553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 0x7f3e2006e420 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.989+0000 7f3e282bb640 1 -- 172.21.15.22:0/2636382553 >> 172.21.15.22:0/2636382553 conn(0x7f3e200b0ba0 msgr2=0x7f3e200b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.989+0000 7f3e282bb640 1 -- 172.21.15.22:0/2636382553 shutdown_connections 2023-11-24T06:12:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.989+0000 7f3e282bb640 1 -- 172.21.15.22:0/2636382553 wait complete. 2023-11-24T06:12:57.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.991+0000 7f3e282bb640 1 Processor -- start 2023-11-24T06:12:57.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.991+0000 7f3e282bb640 1 -- start start 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e282bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 0x7f3e200cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e282bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e20072280 0x7f3e201f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e282bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e20160b10 0x7f3e20158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e282bb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e201f6430 con 0x7f3e2006cad0 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e282bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e201f33a0 con 0x7f3e20072280 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e282bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e201f3620 con 0x7f3e20160b10 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e26057640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 0x7f3e200cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e26057640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 0x7f3e200cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37278/0 (socket says 172.21.15.22:37278) 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e26057640 1 -- 172.21.15.22:0/262236315 learned_addr learned my addr 172.21.15.22:0/262236315 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e26057640 1 -- 172.21.15.22:0/262236315 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e20160b10 msgr2=0x7f3e20158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e26057640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e20160b10 0x7f3e20158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e26057640 1 -- 172.21.15.22:0/262236315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e20072280 msgr2=0x7f3e201f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e26057640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e20072280 0x7f3e201f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.992+0000 7f3e26057640 1 -- 172.21.15.22:0/262236315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e10009400 con 0x7f3e2006cad0 2023-11-24T06:12:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.993+0000 7f3e26057640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 0x7f3e200cf440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00c440 tx=0x7f3e1c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.993+0000 7f3e16ffd640 1 -- 172.21.15.22:0/262236315 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c005ce0 con 0x7f3e2006cad0 2023-11-24T06:12:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.993+0000 7f3e16ffd640 1 -- 172.21.15.22:0/262236315 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c005e40 con 0x7f3e2006cad0 2023-11-24T06:12:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.993+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e201f3900 con 0x7f3e2006cad0 2023-11-24T06:12:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.993+0000 7f3e16ffd640 1 -- 172.21.15.22:0/262236315 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0072b0 con 0x7f3e2006cad0 2023-11-24T06:12:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.993+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e201f6680 con 0x7f3e2006cad0 2023-11-24T06:12:57.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.994+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2009d200 con 0x7f3e2006cad0 2023-11-24T06:12:57.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.995+0000 7f3e16ffd640 1 -- 172.21.15.22:0/262236315 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e1c007410 con 0x7f3e2006cad0 2023-11-24T06:12:57.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.996+0000 7f3e16ffd640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e0406ae40 0x7f3e0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:57.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.996+0000 7f3e16ffd640 1 -- 172.21.15.22:0/262236315 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3e1c088d10 con 0x7f3e2006cad0 2023-11-24T06:12:57.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.997+0000 7f3e25856640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e0406ae40 0x7f3e0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:57.997+0000 7f3e25856640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e0406ae40 0x7f3e0406d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3e10036000 tx=0x7f3e10030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:58.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.001+0000 7f3e16ffd640 1 -- 172.21.15.22:0/262236315 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e1c08e020 con 0x7f3e2006cad0 2023-11-24T06:12:58.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.193+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e2006df00 con 0x7f3e2006cad0 2023-11-24T06:12:58.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.194+0000 7f3e16ffd640 1 -- 172.21.15.22:0/262236315 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e1c017020 con 0x7f3e2006cad0 2023-11-24T06:12:58.197 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:12:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e0406ae40 msgr2=0x7f3e0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e0406ae40 0x7f3e0406d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3e10036000 tx=0x7f3e10030000 comp rx=0 tx=0).stop 2023-11-24T06:12:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 msgr2=0x7f3e200cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 0x7f3e200cf440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00c440 tx=0x7f3e1c00c900 comp rx=0 tx=0).stop 2023-11-24T06:12:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 shutdown_connections 2023-11-24T06:12:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e0406ae40 0x7f3e0406d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e20160b10 0x7f3e20158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e20072280 0x7f3e201f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 --2- 172.21.15.22:0/262236315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e2006cad0 0x7f3e200cf440 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 >> 172.21.15.22:0/262236315 conn(0x7f3e200b0ba0 msgr2=0x7f3e200ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:58.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 shutdown_connections 2023-11-24T06:12:58.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.197+0000 7f3e282bb640 1 -- 172.21.15.22:0/262236315 wait complete. 2023-11-24T06:12:58.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:12:58.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.435+0000 7ff1211fb640 1 Processor -- start 2023-11-24T06:12:58.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.435+0000 7ff1211fb640 1 -- start start 2023-11-24T06:12:58.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.437+0000 7ff1211fb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff11c1416f0 0x7ff11c15ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.437+0000 7ff1211fb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff11c06d230 0x7ff11c15f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.437+0000 7ff1211fb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c070bf0 con 0x7ff11c141e80 2023-11-24T06:12:58.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.437+0000 7ff1211fb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11c06db30 con 0x7ff11c1416f0 2023-11-24T06:12:58.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.437+0000 7ff1211fb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c06d660 con 0x7ff11c06d230 2023-11-24T06:12:58.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.437+0000 7ff1137fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff11c141e80 0x7ff11c06cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33922/0 (socket says 172.21.15.22:33922) 2023-11-24T06:12:58.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.437+0000 7ff1137fe640 1 -- 172.21.15.22:0/2789317066 learned_addr learned my addr 172.21.15.22:0/2789317066 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff1209fa640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff11c06d230 0x7ff11c15f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11bfff640 1 --2- 172.21.15.22:0/2789317066 >> v2:172.21.15.31:3300/0 conn(0x7ff11c1416f0 0x7ff11c15ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409432296 0 0) 0x7ff11c070bf0 con 0x7ff11c141e80 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff108003520 con 0x7ff11c141e80 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3694991690 0 0) 0x7ff108003520 con 0x7ff11c141e80 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff11c06d230 msgr2=0x7ff11c15f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11b7fe640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff11c06d230 0x7ff11c15f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 >> v2:172.21.15.31:3300/0 conn(0x7ff11c1416f0 msgr2=0x7ff11c15ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11b7fe640 1 --2- 172.21.15.22:0/2789317066 >> v2:172.21.15.31:3300/0 conn(0x7ff11c1416f0 0x7ff11c15ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c06d850 con 0x7ff11c141e80 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.438+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7ff104001670 con 0x7ff11c141e80 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 >> v1:172.21.15.22:6789/0 conn(0x7ff11c141e80 legacy=0x7ff11c06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11b7fe640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1080039e0 0x7ff108003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11b7fe640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1080047c0 0x7ff108004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11b7fe640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff11c06d230 0x7ff108005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c06db30 con 0x7ff1080039e0 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10800b980 con 0x7ff1080047c0 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10800bb10 con 0x7ff11c06d230 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11bfff640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1080039e0 0x7ff108003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11bfff640 1 -- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff11c06d230 msgr2=0x7ff108005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11bfff640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff11c06d230 0x7ff108005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff1137fe640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1080047c0 0x7ff108004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11bfff640 1 -- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1080047c0 msgr2=0x7ff108004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:58.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11bfff640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1080047c0 0x7ff108004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff11bfff640 1 -- 172.21.15.22:0/2789317066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108003520 con 0x7ff1080039e0 2023-11-24T06:12:58.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.439+0000 7ff1137fe640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1080047c0 0x7ff108004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:58.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.440+0000 7ff11bfff640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1080039e0 0x7ff108003e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009af0 tx=0x7ff1080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25520fe847dcfaa4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:58.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.441+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c02c710 con 0x7ff1080039e0 2023-11-24T06:12:58.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.441+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c02c870 con 0x7ff1080039e0 2023-11-24T06:12:58.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.441+0000 7ff11b7fe640 1 -- 172.21.15.22:0/2789317066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c02cc00 con 0x7ff1080039e0 2023-11-24T06:12:58.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.441+0000 7ff1211fb640 1 -- 172.21.15.22:0/2789317066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1080039e0 msgr2=0x7ff108003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.441+0000 7ff1211fb640 1 --2- 172.21.15.22:0/2789317066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1080039e0 0x7ff108003e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009af0 tx=0x7ff1080057f0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.441+0000 7ff1209fa640 1 -- 172.21.15.22:0/2789317066 reap_dead start 2023-11-24T06:12:58.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.441+0000 7ff1211fb640 1 -- 172.21.15.22:0/2789317066 shutdown_connections 2023-11-24T06:12:58.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.441+0000 7ff1211fb640 1 -- 172.21.15.22:0/2789317066 >> 172.21.15.22:0/2789317066 conn(0x7ff11c0b0840 msgr2=0x7ff11c0b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:58.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.442+0000 7ff1211fb640 1 -- 172.21.15.22:0/2789317066 shutdown_connections 2023-11-24T06:12:58.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.442+0000 7ff1211fb640 1 -- 172.21.15.22:0/2789317066 wait complete. 2023-11-24T06:12:58.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.443+0000 7ff1211fb640 1 Processor -- start 2023-11-24T06:12:58.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.444+0000 7ff1211fb640 1 -- start start 2023-11-24T06:12:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1211fb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1080039e0 0x7ff11c0adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1211fb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11c13cc70 0x7ff11c136840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1211fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff11c13fee0 0x7ff11c138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1211fb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0ae230 con 0x7ff11c13fee0 2023-11-24T06:12:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1211fb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0acc50 con 0x7ff11c13cc70 2023-11-24T06:12:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1211fb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0acf30 con 0x7ff1080039e0 2023-11-24T06:12:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1209fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff11c13fee0 0x7ff11c138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1209fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff11c13fee0 0x7ff11c138a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37296/0 (socket says 172.21.15.22:37296) 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1209fa640 1 -- 172.21.15.22:0/2297372656 learned_addr learned my addr 172.21.15.22:0/2297372656 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1137fe640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11c13cc70 0x7ff11c136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff11bfff640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1080039e0 0x7ff11c0adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1209fa640 1 -- 172.21.15.22:0/2297372656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1080039e0 msgr2=0x7ff11c0adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1209fa640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1080039e0 0x7ff11c0adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1209fa640 1 -- 172.21.15.22:0/2297372656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11c13cc70 msgr2=0x7ff11c136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1209fa640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11c13cc70 0x7ff11c136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.445+0000 7ff1209fa640 1 -- 172.21.15.22:0/2297372656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c0ad210 con 0x7ff11c13fee0 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.446+0000 7ff1209fa640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff11c13fee0 0x7ff11c138a60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff11c070060 tx=0x7ff11400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.446+0000 7ff1197fa640 1 -- 172.21.15.22:0/2297372656 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114010040 con 0x7ff11c13fee0 2023-11-24T06:12:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.446+0000 7ff1197fa640 1 -- 172.21.15.22:0/2297372656 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11400bae0 con 0x7ff11c13fee0 2023-11-24T06:12:58.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.446+0000 7ff1197fa640 1 -- 172.21.15.22:0/2297372656 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11400be70 con 0x7ff11c13fee0 2023-11-24T06:12:58.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.446+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11c0ad4f0 con 0x7ff11c13fee0 2023-11-24T06:12:58.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.446+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c0ac870 con 0x7ff11c13fee0 2023-11-24T06:12:58.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.447+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11c0cc990 con 0x7ff11c13fee0 2023-11-24T06:12:58.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.449+0000 7ff1197fa640 1 -- 172.21.15.22:0/2297372656 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff11401e410 con 0x7ff11c13fee0 2023-11-24T06:12:58.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.450+0000 7ff1197fa640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff0fc06ae40 0x7ff0fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.450+0000 7ff1197fa640 1 -- 172.21.15.22:0/2297372656 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff114089a40 con 0x7ff11c13fee0 2023-11-24T06:12:58.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.450+0000 7ff11bfff640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff0fc06ae40 0x7ff0fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.451+0000 7ff11bfff640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff0fc06ae40 0x7ff0fc06d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff10c036000 tx=0x7ff10c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:58.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.455+0000 7ff1197fa640 1 -- 172.21.15.22:0/2297372656 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1140549c0 con 0x7ff11c13fee0 2023-11-24T06:12:58.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.663+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff11c0ada10 con 0x7ff11c13fee0 2023-11-24T06:12:58.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.664+0000 7ff1197fa640 1 -- 172.21.15.22:0/2297372656 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff11c0ada10 con 0x7ff11c13fee0 2023-11-24T06:12:58.667 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:12:58.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff0fc06ae40 msgr2=0x7ff0fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff0fc06ae40 0x7ff0fc06d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff10c036000 tx=0x7ff10c030000 comp rx=0 tx=0).stop 2023-11-24T06:12:58.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff11c13fee0 msgr2=0x7ff11c138a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff11c13fee0 0x7ff11c138a60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff11c070060 tx=0x7ff11400b480 comp rx=0 tx=0).stop 2023-11-24T06:12:58.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 shutdown_connections 2023-11-24T06:12:58.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff0fc06ae40 0x7ff0fc06d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff11c13fee0 0x7ff11c138a60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11c13cc70 0x7ff11c136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 --2- 172.21.15.22:0/2297372656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1080039e0 0x7ff11c0adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 >> 172.21.15.22:0/2297372656 conn(0x7ff11c0b0840 msgr2=0x7ff11c0aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:58.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 shutdown_connections 2023-11-24T06:12:58.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.667+0000 7ff1211fb640 1 -- 172.21.15.22:0/2297372656 wait complete. 2023-11-24T06:12:58.690 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:12:58.690 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:12:58.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:12:58.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.987+0000 7f0c6ffff640 1 Processor -- start 2023-11-24T06:12:58.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.987+0000 7f0c6ffff640 1 -- start start 2023-11-24T06:12:58.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.989+0000 7f0c6ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c7013dfd0 0x7f0c7015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.989+0000 7f0c6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 0x7f0c7006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:58.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.989+0000 7f0c6ffff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c700ce7c0 con 0x7f0c700cf050 2023-11-24T06:12:58.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.989+0000 7f0c6ffff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c70140900 con 0x7f0c7013dfd0 2023-11-24T06:12:58.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.989+0000 7f0c6ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7015fa70 con 0x7f0c700cf500 2023-11-24T06:12:58.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.990+0000 7f0c67fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0c700cf050 0x7f0c7006c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33928/0 (socket says 172.21.15.22:33928) 2023-11-24T06:12:58.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.990+0000 7f0c67fff640 1 -- 172.21.15.22:0/3774903662 learned_addr learned my addr 172.21.15.22:0/3774903662 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:58.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.990+0000 7f0c6f7fe640 1 --2- 172.21.15.22:0/3774903662 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 0x7f0c7006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.990+0000 7f0c6effd640 1 --2- 172.21.15.22:0/3774903662 >> v2:172.21.15.31:3300/0 conn(0x7f0c7013dfd0 0x7f0c7015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:58.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.990+0000 7f0c6e7fc640 1 -- 172.21.15.22:0/3774903662 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077952265 0 0) 0x7f0c700ce7c0 con 0x7f0c700cf050 2023-11-24T06:12:58.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.991+0000 7f0c6e7fc640 1 -- 172.21.15.22:0/3774903662 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c5c003520 con 0x7f0c700cf050 2023-11-24T06:12:58.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.991+0000 7f0c6f7fe640 1 -- 172.21.15.22:0/3774903662 >> v2:172.21.15.31:3300/0 conn(0x7f0c7013dfd0 msgr2=0x7f0c7015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:58.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.991+0000 7f0c6f7fe640 1 --2- 172.21.15.22:0/3774903662 >> v2:172.21.15.31:3300/0 conn(0x7f0c7013dfd0 0x7f0c7015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.991+0000 7f0c6f7fe640 1 -- 172.21.15.22:0/3774903662 >> v1:172.21.15.22:6789/0 conn(0x7f0c700cf050 legacy=0x7f0c7006c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.991+0000 7f0c6f7fe640 1 -- 172.21.15.22:0/3774903662 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700cf950 con 0x7f0c700cf500 2023-11-24T06:12:58.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.991+0000 7f0c6effd640 1 --2- 172.21.15.22:0/3774903662 >> v2:172.21.15.31:3300/0 conn(0x7f0c7013dfd0 0x7f0c7015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:12:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.992+0000 7f0c6f7fe640 1 --2- 172.21.15.22:0/3774903662 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 0x7f0c7006c840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009d90 tx=0x7f0c6802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff138f18bde5c50 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.993+0000 7f0c6e7fc640 1 -- 172.21.15.22:0/3774903662 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6802cc50 con 0x7f0c700cf500 2023-11-24T06:12:58.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.993+0000 7f0c6e7fc640 1 -- 172.21.15.22:0/3774903662 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6802cdb0 con 0x7f0c700cf500 2023-11-24T06:12:58.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.993+0000 7f0c6e7fc640 1 -- 172.21.15.22:0/3774903662 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68034660 con 0x7f0c700cf500 2023-11-24T06:12:58.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.993+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3774903662 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 msgr2=0x7f0c7006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:58.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.993+0000 7f0c6ffff640 1 --2- 172.21.15.22:0/3774903662 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 0x7f0c7006c840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009d90 tx=0x7f0c6802bea0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.994+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3774903662 shutdown_connections 2023-11-24T06:12:58.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.994+0000 7f0c6ffff640 1 --2- 172.21.15.22:0/3774903662 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 0x7f0c7006c840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.994+0000 7f0c6ffff640 1 --2- 172.21.15.22:0/3774903662 >> v2:172.21.15.31:3300/0 conn(0x7f0c7013dfd0 0x7f0c7015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:58.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.994+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3774903662 >> 172.21.15.22:0/3774903662 conn(0x7f0c7006a860 msgr2=0x7f0c7006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:58.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.994+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3774903662 shutdown_connections 2023-11-24T06:12:58.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.994+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3774903662 wait complete. 2023-11-24T06:12:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.996+0000 7f0c6ffff640 1 Processor -- start 2023-11-24T06:12:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.996+0000 7f0c6ffff640 1 -- start start 2023-11-24T06:12:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c700cf050 0x7f0c7015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 0x7f0c7015d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c7013dfd0 0x7f0c700b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6ffff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70158290 con 0x7f0c700cf050 2023-11-24T06:12:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6ffff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c701f1f10 con 0x7f0c7013dfd0 2023-11-24T06:12:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70157680 con 0x7f0c700cf500 2023-11-24T06:12:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c700cf050 0x7f0c7015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c700cf050 0x7f0c7015bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37312/0 (socket says 172.21.15.22:37312) 2023-11-24T06:12:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6effd640 1 -- 172.21.15.22:0/3727770128 learned_addr learned my addr 172.21.15.22:0/3727770128 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c6f7fe640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c7013dfd0 0x7f0c700b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.998+0000 7f0c67fff640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 0x7f0c7015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.999+0000 7f0c6effd640 1 -- 172.21.15.22:0/3727770128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 msgr2=0x7f0c7015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.999+0000 7f0c6effd640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 0x7f0c7015d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.999+0000 7f0c6effd640 1 -- 172.21.15.22:0/3727770128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c7013dfd0 msgr2=0x7f0c700b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.999+0000 7f0c6effd640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c7013dfd0 0x7f0c700b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.999+0000 7f0c6effd640 1 -- 172.21.15.22:0/3727770128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60009400 con 0x7f0c700cf050 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.999+0000 7f0c6effd640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c700cf050 0x7f0c7015bcf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000ebe0 tx=0x7f0c6000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.999+0000 7f0c677fe640 1 -- 172.21.15.22:0/3727770128 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60009760 con 0x7f0c700cf050 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.999+0000 7f0c677fe640 1 -- 172.21.15.22:0/3727770128 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6000cc30 con 0x7f0c700cf050 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:58.999+0000 7f0c677fe640 1 -- 172.21.15.22:0/3727770128 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000eee0 con 0x7f0c700cf050 2023-11-24T06:12:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.000+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c68009a70 con 0x7f0c700cf050 2023-11-24T06:12:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.000+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c70157c40 con 0x7f0c700cf050 2023-11-24T06:12:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.001+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7004e840 con 0x7f0c700cf050 2023-11-24T06:12:59.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.002+0000 7f0c677fe640 1 -- 172.21.15.22:0/3727770128 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c60013470 con 0x7f0c700cf050 2023-11-24T06:12:59.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.003+0000 7f0c677fe640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5006ae70 0x7f0c5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.003+0000 7f0c677fe640 1 -- 172.21.15.22:0/3727770128 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0c60089990 con 0x7f0c700cf050 2023-11-24T06:12:59.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.003+0000 7f0c67fff640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5006ae70 0x7f0c5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.004+0000 7f0c67fff640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5006ae70 0x7f0c5006d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0c701f4600 tx=0x7f0c58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:59.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.009+0000 7f0c677fe640 1 -- 172.21.15.22:0/3727770128 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c600549a0 con 0x7f0c700cf050 2023-11-24T06:12:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.205+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c700ce9a0 con 0x7f0c700cf050 2023-11-24T06:12:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.207+0000 7f0c677fe640 1 -- 172.21.15.22:0/3727770128 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f0c60017090 con 0x7f0c700cf050 2023-11-24T06:12:59.210 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:12:59.210 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.209+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5006ae70 msgr2=0x7f0c5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.209+0000 7f0c6ffff640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5006ae70 0x7f0c5006d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0c701f4600 tx=0x7f0c58009040 comp rx=0 tx=0).stop 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.209+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c700cf050 msgr2=0x7f0c7015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.209+0000 7f0c6ffff640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c700cf050 0x7f0c7015bcf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000ebe0 tx=0x7f0c6000c520 comp rx=0 tx=0).stop 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.210+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 shutdown_connections 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.210+0000 7f0c6ffff640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5006ae70 0x7f0c5006d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.210+0000 7f0c6ffff640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c7013dfd0 0x7f0c700b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.210+0000 7f0c6ffff640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c700cf500 0x7f0c7015d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.210+0000 7f0c6ffff640 1 --2- 172.21.15.22:0/3727770128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c700cf050 0x7f0c7015bcf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.210+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 >> 172.21.15.22:0/3727770128 conn(0x7f0c7006a860 msgr2=0x7f0c701596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.210+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 shutdown_connections 2023-11-24T06:12:59.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.210+0000 7f0c6ffff640 1 -- 172.21.15.22:0/3727770128 wait complete. 2023-11-24T06:12:59.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:12:59.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:12:59.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.467+0000 7f7327fbe640 1 Processor -- start 2023-11-24T06:12:59.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.468+0000 7f7327fbe640 1 -- start start 2023-11-24T06:12:59.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.469+0000 7f7327fbe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732006dc30 0x7f73200ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.470+0000 7f7327fbe640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732006d7a0 con 0x7f7320070490 2023-11-24T06:12:59.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.470+0000 7f7327fbe640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732006ce70 con 0x7f73200acd70 2023-11-24T06:12:59.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.470+0000 7f7327fbe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732015a5b0 con 0x7f732006dc30 2023-11-24T06:12:59.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.470+0000 7f732655b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7320070490 0x7f7320070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33940/0 (socket says 172.21.15.22:33940) 2023-11-24T06:12:59.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.470+0000 7f732655b640 1 -- 172.21.15.22:0/1889974177 learned_addr learned my addr 172.21.15.22:0/1889974177 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:12:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.470+0000 7f7325559640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732006dc30 0x7f73200ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.470+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465851380 0 0) 0x7f732006d7a0 con 0x7f7320070490 2023-11-24T06:12:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.470+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f730c005730 con 0x7f7320070490 2023-11-24T06:12:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4084975777 0 0) 0x7f730c005730 con 0x7f7320070490 2023-11-24T06:12:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732006dc30 msgr2=0x7f73200ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732006dc30 0x7f73200ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 >> v1:172.21.15.31:6789/0 conn(0x7f73200acd70 legacy=0x7f73200ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732006d150 con 0x7f7320070490 2023-11-24T06:12:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f73180019f0 con 0x7f7320070490 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 >> v1:172.21.15.22:6789/0 conn(0x7f7320070490 legacy=0x7f7320070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f730c005bb0 0x7f730c005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732006dc30 0x7f730c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c006f10 0x7f730c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732015a5b0 con 0x7f730c005bb0 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c00db90 con 0x7f730c006f10 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c00dd50 con 0x7f732006dc30 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.471+0000 7f7325d5a640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f730c005bb0 0x7f730c005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.472+0000 7f732655b640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c006f10 0x7f730c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.472+0000 7f7325559640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732006dc30 0x7f730c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.472+0000 7f7325d5a640 1 -- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732006dc30 msgr2=0x7f730c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:59.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.472+0000 7f7325d5a640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732006dc30 0x7f730c0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.472+0000 7f7325d5a640 1 -- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c006f10 msgr2=0x7f730c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:59.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.472+0000 7f7325d5a640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c006f10 0x7f730c007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.472+0000 7f7325d5a640 1 -- 172.21.15.22:0/1889974177 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c005730 con 0x7f730c005bb0 2023-11-24T06:12:59.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.472+0000 7f7325559640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732006dc30 0x7f730c0069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:59.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.472+0000 7f732655b640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f730c006f10 0x7f730c007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:59.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.473+0000 7f7325d5a640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f730c005bb0 0x7f730c005f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f731c001860 tx=0x7f730c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8abe191363c9eb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.473+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c033640 con 0x7f730c005bb0 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.473+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c0337c0 con 0x7f730c005bb0 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.473+0000 7f7324d58640 1 -- 172.21.15.22:0/1889974177 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c033b70 con 0x7f730c005bb0 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.474+0000 7f7327fbe640 1 -- 172.21.15.22:0/1889974177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f730c005bb0 msgr2=0x7f730c005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.474+0000 7f7327fbe640 1 --2- 172.21.15.22:0/1889974177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f730c005bb0 0x7f730c005f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f731c001860 tx=0x7f730c007a00 comp rx=0 tx=0).stop 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.474+0000 7f732655b640 1 -- 172.21.15.22:0/1889974177 reap_dead start 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.474+0000 7f7327fbe640 1 -- 172.21.15.22:0/1889974177 shutdown_connections 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.474+0000 7f7327fbe640 1 -- 172.21.15.22:0/1889974177 >> 172.21.15.22:0/1889974177 conn(0x7f73200b0ba0 msgr2=0x7f73200b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.474+0000 7f7327fbe640 1 -- 172.21.15.22:0/1889974177 shutdown_connections 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.474+0000 7f7327fbe640 1 -- 172.21.15.22:0/1889974177 wait complete. 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.476+0000 7f7327fbe640 1 Processor -- start 2023-11-24T06:12:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.476+0000 7f7327fbe640 1 -- start start 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.477+0000 7f7327fbe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f730c005bb0 0x7f73200ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.477+0000 7f7327fbe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732014baa0 0x7f7320156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.477+0000 7f7327fbe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7320071410 0x7f7320071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.477+0000 7f7327fbe640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73200ae9d0 con 0x7f7320071410 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.477+0000 7f7327fbe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73200caf60 con 0x7f732014baa0 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.477+0000 7f7327fbe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7320071dd0 con 0x7f730c005bb0 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.477+0000 7f732655b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7320071410 0x7f7320071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.477+0000 7f732655b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7320071410 0x7f7320071890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37328/0 (socket says 172.21.15.22:37328) 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.477+0000 7f732655b640 1 -- 172.21.15.22:0/3523417695 learned_addr learned my addr 172.21.15.22:0/3523417695 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f7325559640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732014baa0 0x7f7320156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f732655b640 1 -- 172.21.15.22:0/3523417695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f730c005bb0 msgr2=0x7f73200ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f7325d5a640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f730c005bb0 0x7f73200ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f732655b640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f730c005bb0 0x7f73200ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f732655b640 1 -- 172.21.15.22:0/3523417695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732014baa0 msgr2=0x7f7320156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f732655b640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732014baa0 0x7f7320156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f732655b640 1 -- 172.21.15.22:0/3523417695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320157060 con 0x7f7320071410 2023-11-24T06:12:59.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f7325559640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732014baa0 0x7f7320156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:59.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f732655b640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7320071410 0x7f7320071890 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f73200b5100 tx=0x7f731800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:59.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f73167fc640 1 -- 172.21.15.22:0/3523417695 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731800bb20 con 0x7f7320071410 2023-11-24T06:12:59.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f73167fc640 1 -- 172.21.15.22:0/3523417695 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731800bc80 con 0x7f7320071410 2023-11-24T06:12:59.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.478+0000 7f73167fc640 1 -- 172.21.15.22:0/3523417695 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318007070 con 0x7f7320071410 2023-11-24T06:12:59.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.479+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732014bf20 con 0x7f7320071410 2023-11-24T06:12:59.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.479+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7320159450 con 0x7f7320071410 2023-11-24T06:12:59.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.480+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732009d200 con 0x7f7320071410 2023-11-24T06:12:59.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.481+0000 7f73167fc640 1 -- 172.21.15.22:0/3523417695 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73180071d0 con 0x7f7320071410 2023-11-24T06:12:59.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.482+0000 7f73167fc640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f730406ae70 0x7f730406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.482+0000 7f73167fc640 1 -- 172.21.15.22:0/3523417695 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7318089b00 con 0x7f7320071410 2023-11-24T06:12:59.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.482+0000 7f7325d5a640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f730406ae70 0x7f730406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.483+0000 7f7325d5a640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f730406ae70 0x7f730406d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f731c035000 tx=0x7f731c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.486+0000 7f73167fc640 1 -- 172.21.15.22:0/3523417695 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f731808be60 con 0x7f7320071410 2023-11-24T06:12:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.679+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f732004e920 con 0x7f7320071410 2023-11-24T06:12:59.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.680+0000 7f73167fc640 1 -- 172.21.15.22:0/3523417695 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7318054a80 con 0x7f7320071410 2023-11-24T06:12:59.683 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:12:59.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.682+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f730406ae70 msgr2=0x7f730406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.682+0000 7f7327fbe640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f730406ae70 0x7f730406d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f731c035000 tx=0x7f731c009030 comp rx=0 tx=0).stop 2023-11-24T06:12:59.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.682+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7320071410 msgr2=0x7f7320071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.682+0000 7f7327fbe640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7320071410 0x7f7320071890 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f73200b5100 tx=0x7f731800b4a0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.683+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 shutdown_connections 2023-11-24T06:12:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.683+0000 7f7327fbe640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f730406ae70 0x7f730406d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.683+0000 7f7327fbe640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7320071410 0x7f7320071890 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.683+0000 7f7327fbe640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732014baa0 0x7f7320156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.683+0000 7f7327fbe640 1 --2- 172.21.15.22:0/3523417695 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f730c005bb0 0x7f73200ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.683+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 >> 172.21.15.22:0/3523417695 conn(0x7f73200b0ba0 msgr2=0x7f73200af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.683+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 shutdown_connections 2023-11-24T06:12:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.683+0000 7f7327fbe640 1 -- 172.21.15.22:0/3523417695 wait complete. 2023-11-24T06:12:59.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:12:59.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.931+0000 7f40ce716640 1 Processor -- start 2023-11-24T06:12:59.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.931+0000 7f40ce716640 1 -- start start 2023-11-24T06:12:59.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.932+0000 7f40ce716640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f40c815d350 0x7f40c80d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.932+0000 7f40ce716640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40c80d1840 0x7f40c80cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40ce716640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c80cf240 con 0x7f40c815d730 2023-11-24T06:12:59.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40ce716640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c80d1fb0 con 0x7f40c815d350 2023-11-24T06:12:59.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40ce716640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c80ce050 con 0x7f40c80d1840 2023-11-24T06:12:59.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40c7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f40c815d350 0x7f40c80d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40c7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f40c815d350 0x7f40c80d3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37330/0 (socket says 172.21.15.22:37330) 2023-11-24T06:12:59.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40c7fff640 1 -- 172.21.15.22:0/3831130619 learned_addr learned my addr 172.21.15.22:0/3831130619 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:59.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40cccb3640 1 --2- 172.21.15.22:0/3831130619 >> v2:172.21.15.31:3300/0 conn(0x7f40c80d1840 0x7f40c80cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40c7fff640 1 -- 172.21.15.22:0/3831130619 >> v2:172.21.15.31:3300/0 conn(0x7f40c80d1840 msgr2=0x7f40c80cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:59.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40c7fff640 1 --2- 172.21.15.22:0/3831130619 >> v2:172.21.15.31:3300/0 conn(0x7f40c80d1840 0x7f40c80cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40c7fff640 1 -- 172.21.15.22:0/3831130619 >> v1:172.21.15.31:6789/0 conn(0x7f40c815d730 legacy=0x7f40c80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:12:59.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40c7fff640 1 -- 172.21.15.22:0/3831130619 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c80ce330 con 0x7f40c815d350 2023-11-24T06:12:59.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.933+0000 7f40cccb3640 1 --2- 172.21.15.22:0/3831130619 >> v2:172.21.15.31:3300/0 conn(0x7f40c80d1840 0x7f40c80cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:59.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.935+0000 7f40c7fff640 1 --2- 172.21.15.22:0/3831130619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 0x7f40c80d3d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f40c8072960 tx=0x7f40b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed41602b095bd65 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:59.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.935+0000 7f40c6ffd640 1 -- 172.21.15.22:0/3831130619 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b802ca80 con 0x7f40c815d350 2023-11-24T06:12:59.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.935+0000 7f40c6ffd640 1 -- 172.21.15.22:0/3831130619 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b802cbe0 con 0x7f40c815d350 2023-11-24T06:12:59.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.935+0000 7f40c6ffd640 1 -- 172.21.15.22:0/3831130619 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b80343f0 con 0x7f40c815d350 2023-11-24T06:12:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.936+0000 7f40ce716640 1 -- 172.21.15.22:0/3831130619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 msgr2=0x7f40c80d3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.936+0000 7f40ce716640 1 --2- 172.21.15.22:0/3831130619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 0x7f40c80d3d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f40c8072960 tx=0x7f40b802bee0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.936+0000 7f40ce716640 1 -- 172.21.15.22:0/3831130619 shutdown_connections 2023-11-24T06:12:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.936+0000 7f40ce716640 1 --2- 172.21.15.22:0/3831130619 >> v2:172.21.15.31:3300/0 conn(0x7f40c80d1840 0x7f40c80cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.936+0000 7f40ce716640 1 --2- 172.21.15.22:0/3831130619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 0x7f40c80d3d30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.936+0000 7f40ce716640 1 -- 172.21.15.22:0/3831130619 >> 172.21.15.22:0/3831130619 conn(0x7f40c809c5c0 msgr2=0x7f40c80d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:12:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.936+0000 7f40ce716640 1 -- 172.21.15.22:0/3831130619 shutdown_connections 2023-11-24T06:12:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.936+0000 7f40ce716640 1 -- 172.21.15.22:0/3831130619 wait complete. 2023-11-24T06:12:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.938+0000 7f40ce716640 1 Processor -- start 2023-11-24T06:12:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.938+0000 7f40ce716640 1 -- start start 2023-11-24T06:12:59.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.939+0000 7f40ce716640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c80d1840 0x7f40c81577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.939+0000 7f40ce716640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 0x7f40c814a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.939+0000 7f40ce716640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c815d730 0x7f40c80ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.939+0000 7f40ce716640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c80cd2e0 con 0x7f40c815d350 2023-11-24T06:12:59.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.939+0000 7f40ce716640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c814ac20 con 0x7f40c80d1840 2023-11-24T06:12:59.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.939+0000 7f40ce716640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c815f450 con 0x7f40c815d730 2023-11-24T06:12:59.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.939+0000 7f40c77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 0x7f40c814a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.939+0000 7f40c77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 0x7f40c814a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37340/0 (socket says 172.21.15.22:37340) 2023-11-24T06:12:59.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.939+0000 7f40c77fe640 1 -- 172.21.15.22:0/873322027 learned_addr learned my addr 172.21.15.22:0/873322027 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c7fff640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c80d1840 0x7f40c81577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40cccb3640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c815d730 0x7f40c80ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c77fe640 1 -- 172.21.15.22:0/873322027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c815d730 msgr2=0x7f40c80ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c77fe640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c815d730 0x7f40c80ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c77fe640 1 -- 172.21.15.22:0/873322027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c80d1840 msgr2=0x7f40c81577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c77fe640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c80d1840 0x7f40c81577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c77fe640 1 -- 172.21.15.22:0/873322027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8009b30 con 0x7f40c815d350 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40cccb3640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c815d730 0x7f40c80ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c77fe640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 0x7f40c814a6e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00b3e0 tx=0x7f40bc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c4ff9640 1 -- 172.21.15.22:0/873322027 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc011830 con 0x7f40c815d350 2023-11-24T06:12:59.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c4ff9640 1 -- 172.21.15.22:0/873322027 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc0119b0 con 0x7f40c815d350 2023-11-24T06:12:59.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40c4ff9640 1 -- 172.21.15.22:0/873322027 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc011d60 con 0x7f40c815d350 2023-11-24T06:12:59.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.940+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c815f730 con 0x7f40c815d350 2023-11-24T06:12:59.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.941+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c815fcf0 con 0x7f40c815d350 2023-11-24T06:12:59.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.942+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c80b4bc0 con 0x7f40c815d350 2023-11-24T06:12:59.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.943+0000 7f40c4ff9640 1 -- 172.21.15.22:0/873322027 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40bc01a400 con 0x7f40c815d350 2023-11-24T06:12:59.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.944+0000 7f40c4ff9640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40b406ae40 0x7f40b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:12:59.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.944+0000 7f40c4ff9640 1 -- 172.21.15.22:0/873322027 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f40bc089810 con 0x7f40c815d350 2023-11-24T06:12:59.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.944+0000 7f40c7fff640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40b406ae40 0x7f40b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:12:59.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.945+0000 7f40c7fff640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40b406ae40 0x7f40b406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40b8035000 tx=0x7f40b8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:12:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:12:59.948+0000 7f40c4ff9640 1 -- 172.21.15.22:0/873322027 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40bc054830 con 0x7f40c815d350 2023-11-24T06:13:00.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.145+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40c80a1230 con 0x7f40c815d350 2023-11-24T06:13:00.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.145+0000 7f40c4ff9640 1 -- 172.21.15.22:0/873322027 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40bc0150a0 con 0x7f40c815d350 2023-11-24T06:13:00.148 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:13:00.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40b406ae40 msgr2=0x7f40b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40b406ae40 0x7f40b406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40b8035000 tx=0x7f40b8030000 comp rx=0 tx=0).stop 2023-11-24T06:13:00.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 msgr2=0x7f40c814a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 0x7f40c814a6e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00b3e0 tx=0x7f40bc00b8a0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 shutdown_connections 2023-11-24T06:13:00.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40b406ae40 0x7f40b406d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c815d730 0x7f40c80ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40c815d350 0x7f40c814a6e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 --2- 172.21.15.22:0/873322027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c80d1840 0x7f40c81577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 >> 172.21.15.22:0/873322027 conn(0x7f40c809c5c0 msgr2=0x7f40c806c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:00.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.148+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 shutdown_connections 2023-11-24T06:13:00.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.149+0000 7f40ce716640 1 -- 172.21.15.22:0/873322027 wait complete. 2023-11-24T06:13:00.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:00.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.385+0000 7f2f6f29b640 1 Processor -- start 2023-11-24T06:13:00.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.385+0000 7f2f6f29b640 1 -- start start 2023-11-24T06:13:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.386+0000 7f2f6f29b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f6815b350 0x7f2f680abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.387+0000 7f2f6f29b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6815b730 con 0x7f2f6809cb30 2023-11-24T06:13:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.387+0000 7f2f6f29b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f680ac740 con 0x7f2f680adb60 2023-11-24T06:13:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.387+0000 7f2f6f29b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f680ac460 con 0x7f2f6815b350 2023-11-24T06:13:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.387+0000 7f2f6c836640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2f6809cb30 0x7f2f680b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33948/0 (socket says 172.21.15.22:33948) 2023-11-24T06:13:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.387+0000 7f2f6c836640 1 -- 172.21.15.22:0/86962768 learned_addr learned my addr 172.21.15.22:0/86962768 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:00.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.387+0000 7f2f6d037640 1 --2- 172.21.15.22:0/86962768 >> v2:172.21.15.31:3300/0 conn(0x7f2f6815b350 0x7f2f680abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.387+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094508116 0 0) 0x7f2f58001110 con 0x7f2f6809cb30 2023-11-24T06:13:00.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f54003520 con 0x7f2f6809cb30 2023-11-24T06:13:00.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1159450076 0 0) 0x7f2f54003520 con 0x7f2f6809cb30 2023-11-24T06:13:00.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 >> v2:172.21.15.31:3300/0 conn(0x7f2f6815b350 msgr2=0x7f2f680abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:00.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 --2- 172.21.15.22:0/86962768 >> v2:172.21.15.31:3300/0 conn(0x7f2f6815b350 0x7f2f680abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 >> v1:172.21.15.31:6789/0 conn(0x7f2f680adb60 legacy=0x7f2f680adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680b2a50 con 0x7f2f6809cb30 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f2f58001800 con 0x7f2f6809cb30 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 >> v1:172.21.15.22:6789/0 conn(0x7f2f6809cb30 legacy=0x7f2f680b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f54003970 0x7f2f54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f54005180 0x7f2f5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680ac460 con 0x7f2f540047c0 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5400c020 con 0x7f2f54003970 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5400c1e0 con 0x7f2f54005180 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.388+0000 7f2f6c836640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6d037640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f54003970 0x7f2f54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6d838640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f54005180 0x7f2f5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6c836640 1 -- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f54005180 msgr2=0x7f2f5400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6c836640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f54005180 0x7f2f5400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6c836640 1 -- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f54003970 msgr2=0x7f2f54003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6c836640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f54003970 0x7f2f54003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6c836640 1 -- 172.21.15.22:0/86962768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54003520 con 0x7f2f540047c0 2023-11-24T06:13:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6d838640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f54005180 0x7f2f5400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6d037640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f54003970 0x7f2f54003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.389+0000 7f2f6d838640 1 -- 172.21.15.22:0/86962768 reap_dead start 2023-11-24T06:13:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.390+0000 7f2f6c836640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f54004c40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800c240 tx=0x7f2f540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56e33ec167031a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.391+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58005ad0 con 0x7f2f540047c0 2023-11-24T06:13:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.391+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f58005c50 con 0x7f2f540047c0 2023-11-24T06:13:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.391+0000 7f2f5ffff640 1 -- 172.21.15.22:0/86962768 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5802c8b0 con 0x7f2f540047c0 2023-11-24T06:13:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.391+0000 7f2f6f29b640 1 -- 172.21.15.22:0/86962768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 msgr2=0x7f2f54004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.391+0000 7f2f6f29b640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f54004c40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800c240 tx=0x7f2f540057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.391+0000 7f2f6f29b640 1 -- 172.21.15.22:0/86962768 shutdown_connections 2023-11-24T06:13:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.391+0000 7f2f6f29b640 1 --2- 172.21.15.22:0/86962768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f54004c40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.392+0000 7f2f6f29b640 1 -- 172.21.15.22:0/86962768 >> 172.21.15.22:0/86962768 conn(0x7f2f680b0ba0 msgr2=0x7f2f680b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.392+0000 7f2f6f29b640 1 -- 172.21.15.22:0/86962768 shutdown_connections 2023-11-24T06:13:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.392+0000 7f2f6f29b640 1 -- 172.21.15.22:0/86962768 wait complete. 2023-11-24T06:13:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.394+0000 7f2f6f29b640 1 Processor -- start 2023-11-24T06:13:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.394+0000 7f2f6f29b640 1 -- start start 2023-11-24T06:13:00.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.395+0000 7f2f6f29b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f680c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.395+0000 7f2f6f29b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f68154460 0x7f2f680c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.395+0000 7f2f6f29b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f681594d0 0x7f2f68159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.395+0000 7f2f6f29b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68159ec0 con 0x7f2f540047c0 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.395+0000 7f2f6f29b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f681554c0 con 0x7f2f681594d0 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.395+0000 7f2f6f29b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68154940 con 0x7f2f68154460 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.395+0000 7f2f6d037640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f680c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.395+0000 7f2f6d037640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f680c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37364/0 (socket says 172.21.15.22:37364) 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.395+0000 7f2f6d037640 1 -- 172.21.15.22:0/2150144834 learned_addr learned my addr 172.21.15.22:0/2150144834 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f6c836640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f68154460 0x7f2f680c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f6d037640 1 -- 172.21.15.22:0/2150144834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f68154460 msgr2=0x7f2f680c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f6d037640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f68154460 0x7f2f680c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f6d037640 1 -- 172.21.15.22:0/2150144834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f681594d0 msgr2=0x7f2f68159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f6d037640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f681594d0 0x7f2f68159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f6d037640 1 -- 172.21.15.22:0/2150144834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68154c20 con 0x7f2f540047c0 2023-11-24T06:13:00.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f6d037640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f680c8260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2f640116d0 tx=0x7f2f64011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:00.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f5dffb640 1 -- 172.21.15.22:0/2150144834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400f9c0 con 0x7f2f540047c0 2023-11-24T06:13:00.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f5dffb640 1 -- 172.21.15.22:0/2150144834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6400fb20 con 0x7f2f540047c0 2023-11-24T06:13:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.396+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f68154f00 con 0x7f2f540047c0 2023-11-24T06:13:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.397+0000 7f2f5dffb640 1 -- 172.21.15.22:0/2150144834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400feb0 con 0x7f2f540047c0 2023-11-24T06:13:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.397+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f680c87a0 con 0x7f2f540047c0 2023-11-24T06:13:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.398+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6809d200 con 0x7f2f540047c0 2023-11-24T06:13:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.399+0000 7f2f5dffb640 1 -- 172.21.15.22:0/2150144834 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f64015460 con 0x7f2f540047c0 2023-11-24T06:13:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.400+0000 7f2f5dffb640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2f4c06ae40 0x7f2f4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.400+0000 7f2f5dffb640 1 -- 172.21.15.22:0/2150144834 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2f6408a060 con 0x7f2f540047c0 2023-11-24T06:13:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.400+0000 7f2f6c836640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2f4c06ae40 0x7f2f4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.400+0000 7f2f6c836640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2f4c06ae40 0x7f2f4c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f58034000 tx=0x7f2f58009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:00.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.404+0000 7f2f5dffb640 1 -- 172.21.15.22:0/2150144834 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f640bce90 con 0x7f2f540047c0 2023-11-24T06:13:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.600+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f6804e920 con 0x7f2f540047c0 2023-11-24T06:13:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.601+0000 7f2f5dffb640 1 -- 172.21.15.22:0/2150144834 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f64058b00 con 0x7f2f540047c0 2023-11-24T06:13:00.603 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.603+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2f4c06ae40 msgr2=0x7f2f4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.603+0000 7f2f6f29b640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2f4c06ae40 0x7f2f4c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f58034000 tx=0x7f2f58009030 comp rx=0 tx=0).stop 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.603+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 msgr2=0x7f2f680c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.603+0000 7f2f6f29b640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f680c8260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2f640116d0 tx=0x7f2f64011b90 comp rx=0 tx=0).stop 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.604+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 shutdown_connections 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.604+0000 7f2f6f29b640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2f4c06ae40 0x7f2f4c06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.604+0000 7f2f6f29b640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f681594d0 0x7f2f68159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.604+0000 7f2f6f29b640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f68154460 0x7f2f680c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.604+0000 7f2f6f29b640 1 --2- 172.21.15.22:0/2150144834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f540047c0 0x7f2f680c8260 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.604+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 >> 172.21.15.22:0/2150144834 conn(0x7f2f680b0ba0 msgr2=0x7f2f680b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.604+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 shutdown_connections 2023-11-24T06:13:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.604+0000 7f2f6f29b640 1 -- 172.21.15.22:0/2150144834 wait complete. 2023-11-24T06:13:00.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:13:00.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.847+0000 7f8ba887b640 1 Processor -- start 2023-11-24T06:13:00.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.847+0000 7f8ba887b640 1 -- start start 2023-11-24T06:13:00.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba887b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8ba4161a00 0x7f8ba406e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba887b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ba415cac0 0x7f8ba415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba887b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba40cefe0 con 0x7f8ba4160f10 2023-11-24T06:13:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba887b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba40d0320 con 0x7f8ba4161a00 2023-11-24T06:13:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba887b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba40cf280 con 0x7f8ba415cac0 2023-11-24T06:13:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8ba4161a00 0x7f8ba406e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8ba4161a00 0x7f8ba406e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37376/0 (socket says 172.21.15.22:37376) 2023-11-24T06:13:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba259c640 1 -- 172.21.15.22:0/86391287 learned_addr learned my addr 172.21.15.22:0/86391287 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:00.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba359e640 1 --2- 172.21.15.22:0/86391287 >> v2:172.21.15.31:3300/0 conn(0x7f8ba415cac0 0x7f8ba415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba259c640 1 -- 172.21.15.22:0/86391287 >> v2:172.21.15.31:3300/0 conn(0x7f8ba415cac0 msgr2=0x7f8ba415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:00.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba259c640 1 --2- 172.21.15.22:0/86391287 >> v2:172.21.15.31:3300/0 conn(0x7f8ba415cac0 0x7f8ba415cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba259c640 1 -- 172.21.15.22:0/86391287 >> v1:172.21.15.31:6789/0 conn(0x7f8ba4160f10 legacy=0x7f8ba41612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:00.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba259c640 1 -- 172.21.15.22:0/86391287 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba40cf560 con 0x7f8ba4161a00 2023-11-24T06:13:00.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.849+0000 7f8ba359e640 1 --2- 172.21.15.22:0/86391287 >> v2:172.21.15.31:3300/0 conn(0x7f8ba415cac0 0x7f8ba415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.851+0000 7f8ba259c640 1 --2- 172.21.15.22:0/86391287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba4161a00 0x7f8ba406e630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4161fb0 tx=0x7f8b8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf8f9ba7dc2fdc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.851+0000 7f8ba1d9b640 1 -- 172.21.15.22:0/86391287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c031870 con 0x7f8ba4161a00 2023-11-24T06:13:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.851+0000 7f8ba1d9b640 1 -- 172.21.15.22:0/86391287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c0319d0 con 0x7f8ba4161a00 2023-11-24T06:13:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.851+0000 7f8ba1d9b640 1 -- 172.21.15.22:0/86391287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c031d60 con 0x7f8ba4161a00 2023-11-24T06:13:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.852+0000 7f8ba887b640 1 -- 172.21.15.22:0/86391287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba4161a00 msgr2=0x7f8ba406e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.852+0000 7f8ba887b640 1 --2- 172.21.15.22:0/86391287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba4161a00 0x7f8ba406e630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4161fb0 tx=0x7f8b8c02b910 comp rx=0 tx=0).stop 2023-11-24T06:13:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.852+0000 7f8ba887b640 1 -- 172.21.15.22:0/86391287 shutdown_connections 2023-11-24T06:13:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.852+0000 7f8ba887b640 1 --2- 172.21.15.22:0/86391287 >> v2:172.21.15.31:3300/0 conn(0x7f8ba415cac0 0x7f8ba415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.852+0000 7f8ba887b640 1 --2- 172.21.15.22:0/86391287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba4161a00 0x7f8ba406e630 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.852+0000 7f8ba887b640 1 -- 172.21.15.22:0/86391287 >> 172.21.15.22:0/86391287 conn(0x7f8ba40d0e50 msgr2=0x7f8ba40d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:00.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.852+0000 7f8ba887b640 1 -- 172.21.15.22:0/86391287 shutdown_connections 2023-11-24T06:13:00.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.852+0000 7f8ba887b640 1 -- 172.21.15.22:0/86391287 wait complete. 2023-11-24T06:13:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.855+0000 7f8ba887b640 1 Processor -- start 2023-11-24T06:13:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.855+0000 7f8ba887b640 1 -- start start 2023-11-24T06:13:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.856+0000 7f8ba887b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba415cac0 0x7f8ba40b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.856+0000 7f8ba887b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ba4160f10 0x7f8ba40c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.856+0000 7f8ba887b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4161a00 0x7f8ba415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.856+0000 7f8ba887b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40b5c10 con 0x7f8ba415cac0 2023-11-24T06:13:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.856+0000 7f8ba887b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40c6ef0 con 0x7f8ba4161a00 2023-11-24T06:13:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.856+0000 7f8ba887b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40b5e30 con 0x7f8ba4160f10 2023-11-24T06:13:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.856+0000 7f8ba2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba415cac0 0x7f8ba40b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.856+0000 7f8ba2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba415cac0 0x7f8ba40b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37380/0 (socket says 172.21.15.22:37380) 2023-11-24T06:13:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.856+0000 7f8ba2d9d640 1 -- 172.21.15.22:0/1010287928 learned_addr learned my addr 172.21.15.22:0/1010287928 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba259c640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ba4160f10 0x7f8ba40c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba359e640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4161a00 0x7f8ba415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba2d9d640 1 -- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ba4160f10 msgr2=0x7f8ba40c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba2d9d640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ba4160f10 0x7f8ba40c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba2d9d640 1 -- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4161a00 msgr2=0x7f8ba415c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba2d9d640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4161a00 0x7f8ba415c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba2d9d640 1 -- 172.21.15.22:0/1010287928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c0094d0 con 0x7f8ba415cac0 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba259c640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ba4160f10 0x7f8ba40c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba359e640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4161a00 0x7f8ba415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.857+0000 7f8ba2d9d640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba415cac0 0x7f8ba40b56d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400ba50 tx=0x7f8b9400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.858+0000 7f8b9b7fe640 1 -- 172.21.15.22:0/1010287928 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400cc10 con 0x7f8ba415cac0 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.858+0000 7f8b9b7fe640 1 -- 172.21.15.22:0/1010287928 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9400cd70 con 0x7f8ba415cac0 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.858+0000 7f8b9b7fe640 1 -- 172.21.15.22:0/1010287928 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94014680 con 0x7f8ba415cac0 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.858+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba40b6110 con 0x7f8ba415cac0 2023-11-24T06:13:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.858+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba40b66d0 con 0x7f8ba415cac0 2023-11-24T06:13:00.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.859+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba415d960 con 0x7f8ba415cac0 2023-11-24T06:13:00.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.860+0000 7f8b9b7fe640 1 -- 172.21.15.22:0/1010287928 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b9401d3b0 con 0x7f8ba415cac0 2023-11-24T06:13:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.862+0000 7f8b9b7fe640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b8406ae40 0x7f8b8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.862+0000 7f8b9b7fe640 1 -- 172.21.15.22:0/1010287928 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8b94089740 con 0x7f8ba415cac0 2023-11-24T06:13:00.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.862+0000 7f8ba259c640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b8406ae40 0x7f8b8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:00.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.863+0000 7f8ba259c640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b8406ae40 0x7f8b8406d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c036000 tx=0x7f8b8c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:00.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:00.868+0000 7f8b9b7fe640 1 -- 172.21.15.22:0/1010287928 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b940546c0 con 0x7f8ba415cac0 2023-11-24T06:13:01.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.082+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8ba404e840 con 0x7f8ba415cac0 2023-11-24T06:13:01.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.083+0000 7f8b9b7fe640 1 -- 172.21.15.22:0/1010287928 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8b94057ce0 con 0x7f8ba415cac0 2023-11-24T06:13:01.086 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:13:01.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b8406ae40 msgr2=0x7f8b8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:01.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b8406ae40 0x7f8b8406d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c036000 tx=0x7f8b8c008030 comp rx=0 tx=0).stop 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba415cac0 msgr2=0x7f8ba40b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba415cac0 0x7f8ba40b56d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400ba50 tx=0x7f8b9400bf10 comp rx=0 tx=0).stop 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 shutdown_connections 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b8406ae40 0x7f8b8406d300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4161a00 0x7f8ba415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8ba4160f10 0x7f8ba40c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 --2- 172.21.15.22:0/1010287928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ba415cac0 0x7f8ba40b56d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.086+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 >> 172.21.15.22:0/1010287928 conn(0x7f8ba40d0e50 msgr2=0x7f8ba41612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.087+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 shutdown_connections 2023-11-24T06:13:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.087+0000 7f8ba887b640 1 -- 172.21.15.22:0/1010287928 wait complete. 2023-11-24T06:13:01.110 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2023-11-24T06:13:01.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:01.110 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T06:13:01.225 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:13:01.225 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:13:01.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:01.225 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:13:01.295 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:13:01.295 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:01.361 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:13:01.361 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:01.421 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.645+0000 7f599e535640 1 Processor -- start 2023-11-24T06:13:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.645+0000 7f599e535640 1 -- start start 2023-11-24T06:13:01.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.647+0000 7f599e535640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f599813dfd0 0x7f599815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:01.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.647+0000 7f599e535640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59980ce7c0 con 0x7f59980cf050 2023-11-24T06:13:01.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.647+0000 7f599e535640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5998140900 con 0x7f59980cf500 2023-11-24T06:13:01.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.647+0000 7f599e535640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599806cf50 con 0x7f599813dfd0 2023-11-24T06:13:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.648+0000 7f599cd32640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f59980cf050 0x7f599806c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50680/0 (socket says 172.21.15.22:50680) 2023-11-24T06:13:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.648+0000 7f599cd32640 1 -- 172.21.15.22:0/1794451723 learned_addr learned my addr 172.21.15.22:0/1794451723 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.648+0000 7f599d533640 1 --2- 172.21.15.22:0/1794451723 >> v2:172.21.15.31:3300/0 conn(0x7f599813dfd0 0x7f599815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.648+0000 7f598ffff640 1 -- 172.21.15.22:0/1794451723 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129315124 0 0) 0x7f59980ce7c0 con 0x7f59980cf050 2023-11-24T06:13:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.648+0000 7f598ffff640 1 -- 172.21.15.22:0/1794451723 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5984003520 con 0x7f59980cf050 2023-11-24T06:13:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.648+0000 7f599d533640 1 -- 172.21.15.22:0/1794451723 >> v1:172.21.15.31:6789/0 conn(0x7f59980cf500 legacy=0x7f599806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.648+0000 7f599d533640 1 -- 172.21.15.22:0/1794451723 >> v1:172.21.15.22:6789/0 conn(0x7f59980cf050 legacy=0x7f599806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.648+0000 7f599d533640 1 -- 172.21.15.22:0/1794451723 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599815fa70 con 0x7f599813dfd0 2023-11-24T06:13:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.650+0000 7f599d533640 1 --2- 172.21.15.22:0/1794451723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599813dfd0 0x7f599815be70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59940097a0 tx=0x7f599402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64c3b94cc8676537 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:01.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.650+0000 7f598ffff640 1 -- 172.21.15.22:0/1794451723 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5994030610 con 0x7f599813dfd0 2023-11-24T06:13:01.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.650+0000 7f598ffff640 1 -- 172.21.15.22:0/1794451723 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5994030770 con 0x7f599813dfd0 2023-11-24T06:13:01.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.650+0000 7f598ffff640 1 -- 172.21.15.22:0/1794451723 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5994030ae0 con 0x7f599813dfd0 2023-11-24T06:13:01.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.651+0000 7f599e535640 1 -- 172.21.15.22:0/1794451723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599813dfd0 msgr2=0x7f599815be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:01.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.651+0000 7f599e535640 1 --2- 172.21.15.22:0/1794451723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599813dfd0 0x7f599815be70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59940097a0 tx=0x7f599402b960 comp rx=0 tx=0).stop 2023-11-24T06:13:01.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.651+0000 7f599e535640 1 -- 172.21.15.22:0/1794451723 shutdown_connections 2023-11-24T06:13:01.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.651+0000 7f599e535640 1 --2- 172.21.15.22:0/1794451723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f599813dfd0 0x7f599815be70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.651+0000 7f599e535640 1 -- 172.21.15.22:0/1794451723 >> 172.21.15.22:0/1794451723 conn(0x7f599806a860 msgr2=0x7f599806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:01.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.651+0000 7f599e535640 1 -- 172.21.15.22:0/1794451723 shutdown_connections 2023-11-24T06:13:01.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.651+0000 7f599e535640 1 -- 172.21.15.22:0/1794451723 wait complete. 2023-11-24T06:13:01.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.653+0000 7f599e535640 1 Processor -- start 2023-11-24T06:13:01.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.653+0000 7f599e535640 1 -- start start 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.654+0000 7f599e535640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59980cf050 0x7f599815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.654+0000 7f599e535640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59980cf500 0x7f5998154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.654+0000 7f599e535640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f599813dfd0 0x7f5998151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.654+0000 7f599e535640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998154040 con 0x7f599813dfd0 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.654+0000 7f599e535640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998151ba0 con 0x7f59980cf050 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.654+0000 7f599e535640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599815be00 con 0x7f59980cf500 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599dd34640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f599813dfd0 0x7f5998151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599dd34640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f599813dfd0 0x7f5998151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44904/0 (socket says 172.21.15.22:44904) 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599dd34640 1 -- 172.21.15.22:0/1594233893 learned_addr learned my addr 172.21.15.22:0/1594233893 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599d533640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59980cf050 0x7f599815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599cd32640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59980cf500 0x7f5998154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599dd34640 1 -- 172.21.15.22:0/1594233893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59980cf500 msgr2=0x7f5998154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599dd34640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59980cf500 0x7f5998154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599dd34640 1 -- 172.21.15.22:0/1594233893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59980cf050 msgr2=0x7f599815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599dd34640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59980cf050 0x7f599815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599dd34640 1 -- 172.21.15.22:0/1594233893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994009400 con 0x7f599813dfd0 2023-11-24T06:13:01.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.655+0000 7f599dd34640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f599813dfd0 0x7f5998151660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f599000c7a0 tx=0x7f599000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:01.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.656+0000 7f598dffb640 1 -- 172.21.15.22:0/1594233893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990003b70 con 0x7f599813dfd0 2023-11-24T06:13:01.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.656+0000 7f598dffb640 1 -- 172.21.15.22:0/1594233893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5990003cf0 con 0x7f599813dfd0 2023-11-24T06:13:01.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.656+0000 7f598dffb640 1 -- 172.21.15.22:0/1594233893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990003ea0 con 0x7f599813dfd0 2023-11-24T06:13:01.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.656+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599815c0e0 con 0x7f599813dfd0 2023-11-24T06:13:01.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.656+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59981f2a30 con 0x7f599813dfd0 2023-11-24T06:13:01.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.657+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5998154180 con 0x7f599813dfd0 2023-11-24T06:13:01.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.658+0000 7f598dffb640 1 -- 172.21.15.22:0/1594233893 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f599000aa90 con 0x7f599813dfd0 2023-11-24T06:13:01.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.659+0000 7f598dffb640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f597c06ae40 0x7f597c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:01.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.659+0000 7f598dffb640 1 -- 172.21.15.22:0/1594233893 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f59900894e0 con 0x7f599813dfd0 2023-11-24T06:13:01.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.659+0000 7f599d533640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f597c06ae40 0x7f597c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:01.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.660+0000 7f599d533640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f597c06ae40 0x7f597c06d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5994036000 tx=0x7f5994008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:01.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.663+0000 7f598dffb640 1 -- 172.21.15.22:0/1594233893 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59900544f0 con 0x7f599813dfd0 2023-11-24T06:13:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.858+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f599804e840 con 0x7f599813dfd0 2023-11-24T06:13:01.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.861+0000 7f598dffb640 1 -- 172.21.15.22:0/1594233893 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f5990057b10 con 0x7f599813dfd0 2023-11-24T06:13:01.864 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:01.865 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f597c06ae40 msgr2=0x7f597c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f597c06ae40 0x7f597c06d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5994036000 tx=0x7f5994008030 comp rx=0 tx=0).stop 2023-11-24T06:13:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f599813dfd0 msgr2=0x7f5998151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f599813dfd0 0x7f5998151660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f599000c7a0 tx=0x7f599000cc60 comp rx=0 tx=0).stop 2023-11-24T06:13:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 shutdown_connections 2023-11-24T06:13:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f597c06ae40 0x7f597c06d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f599813dfd0 0x7f5998151660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59980cf500 0x7f5998154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 --2- 172.21.15.22:0/1594233893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59980cf050 0x7f599815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 >> 172.21.15.22:0/1594233893 conn(0x7f599806a860 msgr2=0x7f5998071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 shutdown_connections 2023-11-24T06:13:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:01.864+0000 7f599e535640 1 -- 172.21.15.22:0/1594233893 wait complete. 2023-11-24T06:13:01.888 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:01.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.113+0000 7f77bc9dc640 1 Processor -- start 2023-11-24T06:13:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.113+0000 7f77bc9dc640 1 -- start start 2023-11-24T06:13:02.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.115+0000 7f77bc9dc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f77b8160b10 0x7f77b806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.115+0000 7f77bc9dc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f77b8072280 0x7f77b806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.115+0000 7f77bc9dc640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b806cd50 con 0x7f77b806c900 2023-11-24T06:13:02.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.115+0000 7f77bc9dc640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b80b2320 con 0x7f77b8160b10 2023-11-24T06:13:02.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.115+0000 7f77bc9dc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b806df30 con 0x7f77b8072280 2023-11-24T06:13:02.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.115+0000 7f77b6d9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f77b806c900 0x7f77b8160fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50684/0 (socket says 172.21.15.22:50684) 2023-11-24T06:13:02.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.115+0000 7f77b659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f77b8160b10 0x7f77b806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:02.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.115+0000 7f77b6d9d640 1 -- 172.21.15.22:0/2495433755 learned_addr learned my addr 172.21.15.22:0/2495433755 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:02.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.116+0000 7f77add9b640 1 --2- 172.21.15.22:0/2495433755 >> v2:172.21.15.31:3300/0 conn(0x7f77b8072280 0x7f77b806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:02.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.116+0000 7f77b5d9b640 1 -- 172.21.15.22:0/2495433755 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720890912 0 0) 0x7f77b0001490 con 0x7f77b806c900 2023-11-24T06:13:02.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.116+0000 7f77b659c640 1 -- 172.21.15.22:0/2495433755 >> v2:172.21.15.31:3300/0 conn(0x7f77b8072280 msgr2=0x7f77b806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:02.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.116+0000 7f77b659c640 1 --2- 172.21.15.22:0/2495433755 >> v2:172.21.15.31:3300/0 conn(0x7f77b8072280 0x7f77b806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.116+0000 7f77b659c640 1 -- 172.21.15.22:0/2495433755 >> v1:172.21.15.22:6789/0 conn(0x7f77b806c900 legacy=0x7f77b8160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.116+0000 7f77b659c640 1 -- 172.21.15.22:0/2495433755 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b8071780 con 0x7f77b8160b10 2023-11-24T06:13:02.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.118+0000 7f77b659c640 1 --2- 172.21.15.22:0/2495433755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b8160b10 0x7f77b806e420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f77b80d0100 tx=0x7f77a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bc995a7301553 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:02.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.118+0000 7f77b5d9b640 1 -- 172.21.15.22:0/2495433755 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a802e070 con 0x7f77b8160b10 2023-11-24T06:13:02.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.118+0000 7f77b5d9b640 1 -- 172.21.15.22:0/2495433755 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a80315a0 con 0x7f77b8160b10 2023-11-24T06:13:02.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.118+0000 7f77b5d9b640 1 -- 172.21.15.22:0/2495433755 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8031930 con 0x7f77b8160b10 2023-11-24T06:13:02.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.119+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2495433755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b8160b10 msgr2=0x7f77b806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.119+0000 7f77bc9dc640 1 --2- 172.21.15.22:0/2495433755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b8160b10 0x7f77b806e420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f77b80d0100 tx=0x7f77a802b840 comp rx=0 tx=0).stop 2023-11-24T06:13:02.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.119+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2495433755 shutdown_connections 2023-11-24T06:13:02.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.119+0000 7f77bc9dc640 1 --2- 172.21.15.22:0/2495433755 >> v2:172.21.15.31:3300/0 conn(0x7f77b8072280 0x7f77b806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.119+0000 7f77bc9dc640 1 --2- 172.21.15.22:0/2495433755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b8160b10 0x7f77b806e420 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.119+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2495433755 >> 172.21.15.22:0/2495433755 conn(0x7f77b80b0ba0 msgr2=0x7f77b80b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:02.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.119+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2495433755 shutdown_connections 2023-11-24T06:13:02.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.119+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2495433755 wait complete. 2023-11-24T06:13:02.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.121+0000 7f77bc9dc640 1 Processor -- start 2023-11-24T06:13:02.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.121+0000 7f77bc9dc640 1 -- start start 2023-11-24T06:13:02.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.122+0000 7f77bc9dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b806c900 0x7f77b814cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.122+0000 7f77bc9dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77b8072280 0x7f77b8150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.122+0000 7f77bc9dc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77b8160b10 0x7f77b809ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.122+0000 7f77bc9dc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80c9270 con 0x7f77b806c900 2023-11-24T06:13:02.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.122+0000 7f77bc9dc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b814d280 con 0x7f77b8072280 2023-11-24T06:13:02.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.122+0000 7f77bc9dc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80c8f90 con 0x7f77b8160b10 2023-11-24T06:13:02.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.122+0000 7f77b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b806c900 0x7f77b814cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:02.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.123+0000 7f77b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b806c900 0x7f77b814cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44918/0 (socket says 172.21.15.22:44918) 2023-11-24T06:13:02.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.123+0000 7f77b659c640 1 -- 172.21.15.22:0/2424630976 learned_addr learned my addr 172.21.15.22:0/2424630976 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.123+0000 7f77b659c640 1 -- 172.21.15.22:0/2424630976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77b8160b10 msgr2=0x7f77b809ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.123+0000 7f77b659c640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77b8160b10 0x7f77b809ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.123+0000 7f77b659c640 1 -- 172.21.15.22:0/2424630976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77b8072280 msgr2=0x7f77b8150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.123+0000 7f77b659c640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77b8072280 0x7f77b8150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.123+0000 7f77b659c640 1 -- 172.21.15.22:0/2424630976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a8009400 con 0x7f77b806c900 2023-11-24T06:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.123+0000 7f77b659c640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b806c900 0x7f77b814cd40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f77a8034040 tx=0x7f77a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.124+0000 7f77af7fe640 1 -- 172.21.15.22:0/2424630976 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8032840 con 0x7f77b806c900 2023-11-24T06:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.124+0000 7f77af7fe640 1 -- 172.21.15.22:0/2424630976 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a80329a0 con 0x7f77b806c900 2023-11-24T06:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.124+0000 7f77af7fe640 1 -- 172.21.15.22:0/2424630976 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8032d50 con 0x7f77b806c900 2023-11-24T06:13:02.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.124+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b80cd3a0 con 0x7f77b806c900 2023-11-24T06:13:02.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.124+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b80cd960 con 0x7f77b806c900 2023-11-24T06:13:02.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.125+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b80cd200 con 0x7f77b806c900 2023-11-24T06:13:02.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.126+0000 7f77af7fe640 1 -- 172.21.15.22:0/2424630976 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77a804e430 con 0x7f77b806c900 2023-11-24T06:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.127+0000 7f77af7fe640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f779806ae40 0x7f779806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.127+0000 7f77af7fe640 1 -- 172.21.15.22:0/2424630976 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f77a80ab760 con 0x7f77b806c900 2023-11-24T06:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.128+0000 7f77add9b640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f779806ae40 0x7f779806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.128+0000 7f77add9b640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f779806ae40 0x7f779806d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f77a0006fd0 tx=0x7f77a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:02.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.132+0000 7f77af7fe640 1 -- 172.21.15.22:0/2424630976 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77b80cd200 con 0x7f77b806c900 2023-11-24T06:13:02.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.330+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77b80cd200 con 0x7f77b806c900 2023-11-24T06:13:02.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.331+0000 7f77af7fe640 1 -- 172.21.15.22:0/2424630976 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77b80cd200 con 0x7f77b806c900 2023-11-24T06:13:02.334 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:13:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f779806ae40 msgr2=0x7f779806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f779806ae40 0x7f779806d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f77a0006fd0 tx=0x7f77a0008040 comp rx=0 tx=0).stop 2023-11-24T06:13:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b806c900 msgr2=0x7f77b814cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b806c900 0x7f77b814cd40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f77a8034040 tx=0x7f77a80046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 shutdown_connections 2023-11-24T06:13:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f779806ae40 0x7f779806d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77b8160b10 0x7f77b809ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77b8072280 0x7f77b8150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 --2- 172.21.15.22:0/2424630976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77b806c900 0x7f77b814cd40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 >> 172.21.15.22:0/2424630976 conn(0x7f77b80b0ba0 msgr2=0x7f77b80ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.334+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 shutdown_connections 2023-11-24T06:13:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.335+0000 7f77bc9dc640 1 -- 172.21.15.22:0/2424630976 wait complete. 2023-11-24T06:13:02.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:02.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.575+0000 7f9724dc9640 1 Processor -- start 2023-11-24T06:13:02.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.575+0000 7f9724dc9640 1 -- start start 2023-11-24T06:13:02.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.576+0000 7f9724dc9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9720160bd0 0x7f97200b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.576+0000 7f9724dc9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97200b3210 0x7f9720167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.576+0000 7f9724dc9640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97200b23e0 con 0x7f97200b48d0 2023-11-24T06:13:02.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.576+0000 7f9724dc9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97200cdc70 con 0x7f97200b3210 2023-11-24T06:13:02.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.576+0000 7f9724dc9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97200b2870 con 0x7f9720160bd0 2023-11-24T06:13:02.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.577+0000 7f971ed9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97200b3210 0x7f9720167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:02.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.577+0000 7f971ed9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97200b3210 0x7f9720167290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44934/0 (socket says 172.21.15.22:44934) 2023-11-24T06:13:02.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.577+0000 7f971ed9d640 1 -- 172.21.15.22:0/2031620372 learned_addr learned my addr 172.21.15.22:0/2031620372 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:02.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.577+0000 7f971dd9b640 1 --1- 172.21.15.22:0/2031620372 >> v1:172.21.15.22:6789/0 conn(0x7f97200b48d0 0x7f97200b2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50696/0 (socket says 172.21.15.22:50696) 2023-11-24T06:13:02.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.577+0000 7f971ed9d640 1 -- 172.21.15.22:0/2031620372 >> v2:172.21.15.31:3300/0 conn(0x7f9720160bd0 msgr2=0x7f97200b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:02.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.577+0000 7f971ed9d640 1 --2- 172.21.15.22:0/2031620372 >> v2:172.21.15.31:3300/0 conn(0x7f9720160bd0 0x7f97200b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.577+0000 7f971ed9d640 1 -- 172.21.15.22:0/2031620372 >> v1:172.21.15.22:6789/0 conn(0x7f97200b48d0 legacy=0x7f97200b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.577+0000 7f971ed9d640 1 -- 172.21.15.22:0/2031620372 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97200d41b0 con 0x7f97200b3210 2023-11-24T06:13:02.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.578+0000 7f971ed9d640 1 --2- 172.21.15.22:0/2031620372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b3210 0x7f9720167290 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f97200cda60 tx=0x7f971802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4fce47e3a2e7c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:02.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f971d59a640 1 -- 172.21.15.22:0/2031620372 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718031870 con 0x7f97200b3210 2023-11-24T06:13:02.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f971d59a640 1 -- 172.21.15.22:0/2031620372 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97180319d0 con 0x7f97200b3210 2023-11-24T06:13:02.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f971d59a640 1 -- 172.21.15.22:0/2031620372 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718031d60 con 0x7f97200b3210 2023-11-24T06:13:02.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f9724dc9640 1 -- 172.21.15.22:0/2031620372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b3210 msgr2=0x7f9720167290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f9724dc9640 1 --2- 172.21.15.22:0/2031620372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b3210 0x7f9720167290 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f97200cda60 tx=0x7f971802b910 comp rx=0 tx=0).stop 2023-11-24T06:13:02.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f9724dc9640 1 -- 172.21.15.22:0/2031620372 shutdown_connections 2023-11-24T06:13:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f9724dc9640 1 --2- 172.21.15.22:0/2031620372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b3210 0x7f9720167290 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f9724dc9640 1 --2- 172.21.15.22:0/2031620372 >> v2:172.21.15.31:3300/0 conn(0x7f9720160bd0 0x7f97200b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f9724dc9640 1 -- 172.21.15.22:0/2031620372 >> 172.21.15.22:0/2031620372 conn(0x7f972009c5a0 msgr2=0x7f97200d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f9724dc9640 1 -- 172.21.15.22:0/2031620372 shutdown_connections 2023-11-24T06:13:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.579+0000 7f9724dc9640 1 -- 172.21.15.22:0/2031620372 wait complete. 2023-11-24T06:13:02.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.581+0000 7f9724dc9640 1 Processor -- start 2023-11-24T06:13:02.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.581+0000 7f9724dc9640 1 -- start start 2023-11-24T06:13:02.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.582+0000 7f9724dc9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97200b3210 0x7f9720156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.582+0000 7f9724dc9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b48d0 0x7f97200b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.582+0000 7f9724dc9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9720160bd0 0x7f97200b8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.582+0000 7f9724dc9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97201f38f0 con 0x7f97200b48d0 2023-11-24T06:13:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.582+0000 7f9724dc9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97200b6870 con 0x7f9720160bd0 2023-11-24T06:13:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.582+0000 7f9724dc9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97200cd100 con 0x7f97200b3210 2023-11-24T06:13:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.583+0000 7f971dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b48d0 0x7f97200b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.583+0000 7f971dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b48d0 0x7f97200b81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44936/0 (socket says 172.21.15.22:44936) 2023-11-24T06:13:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.583+0000 7f971dd9b640 1 -- 172.21.15.22:0/3116846423 learned_addr learned my addr 172.21.15.22:0/3116846423 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.583+0000 7f971dd9b640 1 -- 172.21.15.22:0/3116846423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97200b3210 msgr2=0x7f9720156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.583+0000 7f971dd9b640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97200b3210 0x7f9720156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.583+0000 7f971dd9b640 1 -- 172.21.15.22:0/3116846423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9720160bd0 msgr2=0x7f97200b8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.583+0000 7f971dd9b640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9720160bd0 0x7f97200b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.583+0000 7f971dd9b640 1 -- 172.21.15.22:0/3116846423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180094d0 con 0x7f97200b48d0 2023-11-24T06:13:02.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.583+0000 7f971dd9b640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b48d0 0x7f97200b81e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f970800c430 tx=0x7f970800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:02.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.584+0000 7f9716ffd640 1 -- 172.21.15.22:0/3116846423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97080074e0 con 0x7f97200b48d0 2023-11-24T06:13:02.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.584+0000 7f9716ffd640 1 -- 172.21.15.22:0/3116846423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9708007640 con 0x7f97200b48d0 2023-11-24T06:13:02.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.584+0000 7f9716ffd640 1 -- 172.21.15.22:0/3116846423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708004a00 con 0x7f97200b48d0 2023-11-24T06:13:02.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.584+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97200b6ac0 con 0x7f97200b48d0 2023-11-24T06:13:02.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.584+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97200b7080 con 0x7f97200b48d0 2023-11-24T06:13:02.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.585+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97200c66f0 con 0x7f97200b48d0 2023-11-24T06:13:02.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.586+0000 7f9716ffd640 1 -- 172.21.15.22:0/3116846423 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9708004b60 con 0x7f97200b48d0 2023-11-24T06:13:02.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.587+0000 7f9716ffd640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f970006ae90 0x7f970006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.587+0000 7f9716ffd640 1 -- 172.21.15.22:0/3116846423 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9708088f90 con 0x7f97200b48d0 2023-11-24T06:13:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.587+0000 7f971e59c640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f970006ae90 0x7f970006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.588+0000 7f971e59c640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f970006ae90 0x7f970006d350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f971000ab90 tx=0x7f9710009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:02.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.592+0000 7f9716ffd640 1 -- 172.21.15.22:0/3116846423 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9708057b20 con 0x7f97200b48d0 2023-11-24T06:13:02.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.789+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97200a1210 con 0x7f97200b48d0 2023-11-24T06:13:02.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.790+0000 7f9716ffd640 1 -- 172.21.15.22:0/3116846423 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97080576b0 con 0x7f97200b48d0 2023-11-24T06:13:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:13:02.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.792+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f970006ae90 msgr2=0x7f970006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.792+0000 7f9724dc9640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f970006ae90 0x7f970006d350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f971000ab90 tx=0x7f9710009250 comp rx=0 tx=0).stop 2023-11-24T06:13:02.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.792+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b48d0 msgr2=0x7f97200b81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:02.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.792+0000 7f9724dc9640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b48d0 0x7f97200b81e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f970800c430 tx=0x7f970800c8f0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.793+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 shutdown_connections 2023-11-24T06:13:02.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.793+0000 7f9724dc9640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f970006ae90 0x7f970006d350 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.793+0000 7f9724dc9640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9720160bd0 0x7f97200b8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.793+0000 7f9724dc9640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97200b48d0 0x7f97200b81e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.793+0000 7f9724dc9640 1 --2- 172.21.15.22:0/3116846423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97200b3210 0x7f9720156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:02.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.793+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 >> 172.21.15.22:0/3116846423 conn(0x7f972009c5a0 msgr2=0x7f97200cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:02.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.793+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 shutdown_connections 2023-11-24T06:13:02.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:02.793+0000 7f9724dc9640 1 -- 172.21.15.22:0/3116846423 wait complete. 2023-11-24T06:13:02.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:03.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.045+0000 7feeb6f3c640 1 Processor -- start 2023-11-24T06:13:03.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.046+0000 7feeb6f3c640 1 -- start start 2023-11-24T06:13:03.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.047+0000 7feeb6f3c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb00d1d90 0x7feeb00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.047+0000 7feeb6f3c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00c6bf0 con 0x7feeb00d0fa0 2023-11-24T06:13:03.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.047+0000 7feeb6f3c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00d13d0 con 0x7feeb015d3b0 2023-11-24T06:13:03.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.047+0000 7feeb6f3c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00cedc0 con 0x7feeb00d1d90 2023-11-24T06:13:03.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.048+0000 7feeb673b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7feeb00d0fa0 0x7feeb00b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50710/0 (socket says 172.21.15.22:50710) 2023-11-24T06:13:03.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.048+0000 7feeb673b640 1 -- 172.21.15.22:0/1899313874 learned_addr learned my addr 172.21.15.22:0/1899313874 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:03.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.048+0000 7feeb5739640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb00d1d90 0x7feeb00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.048+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962987 0 0) 0x7feeb00c6bf0 con 0x7feeb00d0fa0 2023-11-24T06:13:03.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.048+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee9c003520 con 0x7feeb00d0fa0 2023-11-24T06:13:03.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2484568059 0 0) 0x7fee9c003520 con 0x7feeb00d0fa0 2023-11-24T06:13:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb00d1d90 msgr2=0x7feeb00ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb00d1d90 0x7feeb00ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 >> v1:172.21.15.31:6789/0 conn(0x7feeb015d3b0 legacy=0x7feeb00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00c6e40 con 0x7feeb00d0fa0 2023-11-24T06:13:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7feea8001670 con 0x7feeb00d0fa0 2023-11-24T06:13:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 >> v1:172.21.15.22:6789/0 conn(0x7feeb00d0fa0 legacy=0x7feeb00b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7fee9c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb00d1d90 0x7fee9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee9c004d00 0x7fee9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00cedc0 con 0x7fee9c003a10 2023-11-24T06:13:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c00bab0 con 0x7fee9c004d00 2023-11-24T06:13:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c00bc70 con 0x7feeb00d1d90 2023-11-24T06:13:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.049+0000 7feeb5f3a640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7fee9c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.050+0000 7feeb5739640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb00d1d90 0x7fee9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.050+0000 7feeb673b640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee9c004d00 0x7fee9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.050+0000 7feeb5f3a640 1 -- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb00d1d90 msgr2=0x7fee9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.050+0000 7feeb5f3a640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb00d1d90 0x7fee9c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.050+0000 7feeb5f3a640 1 -- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee9c004d00 msgr2=0x7fee9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.050+0000 7feeb5f3a640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee9c004d00 0x7fee9c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.050+0000 7feeb5f3a640 1 -- 172.21.15.22:0/1899313874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c003520 con 0x7fee9c003a10 2023-11-24T06:13:03.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.050+0000 7feeb5739640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb00d1d90 0x7fee9c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:03.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.051+0000 7feeb5f3a640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7fee9c003df0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feeac001f60 tx=0x7fee9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca3e2d5e475e28c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:03.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.051+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac02c710 con 0x7fee9c003a10 2023-11-24T06:13:03.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.051+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac02c890 con 0x7fee9c003a10 2023-11-24T06:13:03.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.051+0000 7feeb4f38640 1 -- 172.21.15.22:0/1899313874 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac02cc40 con 0x7fee9c003a10 2023-11-24T06:13:03.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.052+0000 7feeb6f3c640 1 -- 172.21.15.22:0/1899313874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 msgr2=0x7fee9c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.052+0000 7feeb6f3c640 1 --2- 172.21.15.22:0/1899313874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7fee9c003df0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feeac001f60 tx=0x7fee9c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.052+0000 7feeb673b640 1 -- 172.21.15.22:0/1899313874 reap_dead start 2023-11-24T06:13:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.052+0000 7feeb6f3c640 1 -- 172.21.15.22:0/1899313874 shutdown_connections 2023-11-24T06:13:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.052+0000 7feeb6f3c640 1 -- 172.21.15.22:0/1899313874 >> 172.21.15.22:0/1899313874 conn(0x7feeb00d30a0 msgr2=0x7feeb00d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.052+0000 7feeb6f3c640 1 -- 172.21.15.22:0/1899313874 shutdown_connections 2023-11-24T06:13:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.052+0000 7feeb6f3c640 1 -- 172.21.15.22:0/1899313874 wait complete. 2023-11-24T06:13:03.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.054+0000 7feeb6f3c640 1 Processor -- start 2023-11-24T06:13:03.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.054+0000 7feeb6f3c640 1 -- start start 2023-11-24T06:13:03.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.055+0000 7feeb6f3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7feeb014d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.055+0000 7feeb6f3c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb0156510 0x7feeb00b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.055+0000 7feeb6f3c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb00b8810 0x7feeb00b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.055+0000 7feeb6f3c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb014d8f0 con 0x7fee9c003a10 2023-11-24T06:13:03.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.055+0000 7feeb6f3c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00b8c90 con 0x7feeb00b8810 2023-11-24T06:13:03.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.055+0000 7feeb6f3c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00cb4b0 con 0x7feeb0156510 2023-11-24T06:13:03.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.055+0000 7feeb5f3a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7feeb014d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.055+0000 7feeb5f3a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7feeb014d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44956/0 (socket says 172.21.15.22:44956) 2023-11-24T06:13:03.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.055+0000 7feeb5f3a640 1 -- 172.21.15.22:0/4080678925 learned_addr learned my addr 172.21.15.22:0/4080678925 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:03.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.056+0000 7feeb5739640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb0156510 0x7feeb00b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.056+0000 7feeb673b640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb00b8810 0x7feeb00b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.056+0000 7feeb5f3a640 1 -- 172.21.15.22:0/4080678925 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb0156510 msgr2=0x7feeb00b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.056+0000 7feeb5f3a640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb0156510 0x7feeb00b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.056+0000 7feeb5f3a640 1 -- 172.21.15.22:0/4080678925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb00b8810 msgr2=0x7feeb00b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.056+0000 7feeb5f3a640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb00b8810 0x7feeb00b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.056+0000 7feeb5f3a640 1 -- 172.21.15.22:0/4080678925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0159920 con 0x7fee9c003a10 2023-11-24T06:13:03.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.056+0000 7feeb673b640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb00b8810 0x7feeb00b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:03.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.056+0000 7feeb5f3a640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7feeb014d3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feeac002050 tx=0x7feeac0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:03.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.057+0000 7feea67fc640 1 -- 172.21.15.22:0/4080678925 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac003d80 con 0x7fee9c003a10 2023-11-24T06:13:03.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.057+0000 7feea67fc640 1 -- 172.21.15.22:0/4080678925 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac02ce80 con 0x7fee9c003a10 2023-11-24T06:13:03.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.057+0000 7feea67fc640 1 -- 172.21.15.22:0/4080678925 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac034920 con 0x7fee9c003a10 2023-11-24T06:13:03.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.057+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb00cab80 con 0x7fee9c003a10 2023-11-24T06:13:03.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.057+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb00cb140 con 0x7fee9c003a10 2023-11-24T06:13:03.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.058+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb014d8f0 con 0x7fee9c003a10 2023-11-24T06:13:03.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.059+0000 7feea67fc640 1 -- 172.21.15.22:0/4080678925 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feeac03b050 con 0x7fee9c003a10 2023-11-24T06:13:03.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.060+0000 7feea67fc640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee9406ae40 0x7fee9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.060+0000 7feea67fc640 1 -- 172.21.15.22:0/4080678925 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7feeac0ab3a0 con 0x7fee9c003a10 2023-11-24T06:13:03.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.060+0000 7feeb5739640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee9406ae40 0x7fee9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.061+0000 7feeb5739640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee9406ae40 0x7fee9406d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feeb0159c20 tx=0x7feea0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:03.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.065+0000 7feea67fc640 1 -- 172.21.15.22:0/4080678925 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feeb014d8f0 con 0x7fee9c003a10 2023-11-24T06:13:03.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.255+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feeb014d8f0 con 0x7fee9c003a10 2023-11-24T06:13:03.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.256+0000 7feea67fc640 1 -- 172.21.15.22:0/4080678925 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7feeb014d8f0 con 0x7fee9c003a10 2023-11-24T06:13:03.259 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:13:03.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee9406ae40 msgr2=0x7fee9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee9406ae40 0x7fee9406d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feeb0159c20 tx=0x7feea0008040 comp rx=0 tx=0).stop 2023-11-24T06:13:03.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 msgr2=0x7feeb014d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7feeb014d3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feeac002050 tx=0x7feeac0015b0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 shutdown_connections 2023-11-24T06:13:03.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee9406ae40 0x7fee9406d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb00b8810 0x7feeb00b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb0156510 0x7feeb00b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 --2- 172.21.15.22:0/4080678925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee9c003a10 0x7feeb014d3b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 >> 172.21.15.22:0/4080678925 conn(0x7feeb00d30a0 msgr2=0x7feeb00d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:03.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 shutdown_connections 2023-11-24T06:13:03.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.259+0000 7feeb6f3c640 1 -- 172.21.15.22:0/4080678925 wait complete. 2023-11-24T06:13:03.282 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:13:03.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.502+0000 7f3aec5be640 1 Processor -- start 2023-11-24T06:13:03.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.502+0000 7f3aec5be640 1 -- start start 2023-11-24T06:13:03.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.504+0000 7f3aec5be640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ae40b3b60 0x7f3ae406d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.504+0000 7f3aec5be640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae40717a0 0x7f3ae40ad890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.504+0000 7f3aec5be640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae40ad400 con 0x7f3ae406da60 2023-11-24T06:13:03.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.504+0000 7f3aec5be640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae406dee0 con 0x7f3ae40b3b60 2023-11-24T06:13:03.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.504+0000 7f3aec5be640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae40acb50 con 0x7f3ae40717a0 2023-11-24T06:13:03.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.504+0000 7f3ae9b59640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3ae406da60 0x7f3ae4071090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50720/0 (socket says 172.21.15.22:50720) 2023-11-24T06:13:03.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.504+0000 7f3aea35a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ae40b3b60 0x7f3ae406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.504+0000 7f3ae9b59640 1 -- 172.21.15.22:0/3953939133 learned_addr learned my addr 172.21.15.22:0/3953939133 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:03.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.505+0000 7f3aeab5b640 1 --2- 172.21.15.22:0/3953939133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae40717a0 0x7f3ae40ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.505+0000 7f3ae9358640 1 -- 172.21.15.22:0/3953939133 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199052748 0 0) 0x7f3ae40ad400 con 0x7f3ae406da60 2023-11-24T06:13:03.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.505+0000 7f3ae9358640 1 -- 172.21.15.22:0/3953939133 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad0003520 con 0x7f3ae406da60 2023-11-24T06:13:03.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.505+0000 7f3aea35a640 1 -- 172.21.15.22:0/3953939133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae40717a0 msgr2=0x7f3ae40ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:03.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.505+0000 7f3aea35a640 1 --2- 172.21.15.22:0/3953939133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae40717a0 0x7f3ae40ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.505+0000 7f3aea35a640 1 -- 172.21.15.22:0/3953939133 >> v1:172.21.15.22:6789/0 conn(0x7f3ae406da60 legacy=0x7f3ae4071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.505+0000 7f3aea35a640 1 -- 172.21.15.22:0/3953939133 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae40acdf0 con 0x7f3ae40b3b60 2023-11-24T06:13:03.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.506+0000 7f3aea35a640 1 --2- 172.21.15.22:0/3953939133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40b3b60 0x7f3ae406d520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00097a0 tx=0x7f3ae002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828d0ec76b586bfa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:03.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.506+0000 7f3ae9358640 1 -- 172.21.15.22:0/3953939133 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae002d040 con 0x7f3ae40b3b60 2023-11-24T06:13:03.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.506+0000 7f3ae9358640 1 -- 172.21.15.22:0/3953939133 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae0031810 con 0x7f3ae40b3b60 2023-11-24T06:13:03.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.506+0000 7f3ae9358640 1 -- 172.21.15.22:0/3953939133 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0031ba0 con 0x7f3ae40b3b60 2023-11-24T06:13:03.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.507+0000 7f3aec5be640 1 -- 172.21.15.22:0/3953939133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40b3b60 msgr2=0x7f3ae406d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.507+0000 7f3aec5be640 1 --2- 172.21.15.22:0/3953939133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40b3b60 0x7f3ae406d520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00097a0 tx=0x7f3ae002b8b0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.507+0000 7f3aec5be640 1 -- 172.21.15.22:0/3953939133 shutdown_connections 2023-11-24T06:13:03.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.507+0000 7f3aec5be640 1 --2- 172.21.15.22:0/3953939133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae40717a0 0x7f3ae40ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.507+0000 7f3aec5be640 1 --2- 172.21.15.22:0/3953939133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40b3b60 0x7f3ae406d520 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.507+0000 7f3aec5be640 1 -- 172.21.15.22:0/3953939133 >> 172.21.15.22:0/3953939133 conn(0x7f3ae40b0d80 msgr2=0x7f3ae40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:03.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.507+0000 7f3aec5be640 1 -- 172.21.15.22:0/3953939133 shutdown_connections 2023-11-24T06:13:03.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.507+0000 7f3aec5be640 1 -- 172.21.15.22:0/3953939133 wait complete. 2023-11-24T06:13:03.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.509+0000 7f3aec5be640 1 Processor -- start 2023-11-24T06:13:03.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.509+0000 7f3aec5be640 1 -- start start 2023-11-24T06:13:03.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.510+0000 7f3aec5be640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae406da60 0x7f3ae4160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.510+0000 7f3aec5be640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40717a0 0x7f3ae414c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.510+0000 7f3aec5be640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40b3b60 0x7f3ae4154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.510+0000 7f3aec5be640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae4160e80 con 0x7f3ae40717a0 2023-11-24T06:13:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.510+0000 7f3aec5be640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae41f68e0 con 0x7f3ae40b3b60 2023-11-24T06:13:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.510+0000 7f3aec5be640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae41f6b80 con 0x7f3ae406da60 2023-11-24T06:13:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3ae9b59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40717a0 0x7f3ae414c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3ae9b59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40717a0 0x7f3ae414c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44974/0 (socket says 172.21.15.22:44974) 2023-11-24T06:13:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3ae9b59640 1 -- 172.21.15.22:0/3189384212 learned_addr learned my addr 172.21.15.22:0/3189384212 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:03.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3aea35a640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae406da60 0x7f3ae4160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3aeab5b640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40b3b60 0x7f3ae4154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3ae9b59640 1 -- 172.21.15.22:0/3189384212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae406da60 msgr2=0x7f3ae4160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3ae9b59640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae406da60 0x7f3ae4160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3ae9b59640 1 -- 172.21.15.22:0/3189384212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40b3b60 msgr2=0x7f3ae4154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3ae9b59640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40b3b60 0x7f3ae4154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.511+0000 7f3ae9b59640 1 -- 172.21.15.22:0/3189384212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae0009400 con 0x7f3ae40717a0 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.512+0000 7f3ae9b59640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40717a0 0x7f3ae414c290 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400c410 tx=0x7f3ad400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.512+0000 7f3adaffd640 1 -- 172.21.15.22:0/3189384212 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4005ce0 con 0x7f3ae40717a0 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.512+0000 7f3adaffd640 1 -- 172.21.15.22:0/3189384212 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad4005e40 con 0x7f3ae40717a0 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.512+0000 7f3adaffd640 1 -- 172.21.15.22:0/3189384212 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40072f0 con 0x7f3ae40717a0 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.512+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae41f6e60 con 0x7f3ae40717a0 2023-11-24T06:13:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.512+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae4161090 con 0x7f3ae40717a0 2023-11-24T06:13:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.513+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae41f7380 con 0x7f3ae40717a0 2023-11-24T06:13:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.514+0000 7f3adaffd640 1 -- 172.21.15.22:0/3189384212 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ad4007510 con 0x7f3ae40717a0 2023-11-24T06:13:03.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.515+0000 7f3adaffd640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3ac806ae40 0x7f3ac806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:03.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.515+0000 7f3adaffd640 1 -- 172.21.15.22:0/3189384212 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3ad4088d20 con 0x7f3ae40717a0 2023-11-24T06:13:03.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.515+0000 7f3aea35a640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3ac806ae40 0x7f3ac806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:03.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.516+0000 7f3aea35a640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3ac806ae40 0x7f3ac806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0036000 tx=0x7f3ae003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:03.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.520+0000 7f3adaffd640 1 -- 172.21.15.22:0/3189384212 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ae41f7380 con 0x7f3ae40717a0 2023-11-24T06:13:03.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.735+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ae41f7380 con 0x7f3ae40717a0 2023-11-24T06:13:03.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.735+0000 7f3adaffd640 1 -- 172.21.15.22:0/3189384212 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ae41f7380 con 0x7f3ae40717a0 2023-11-24T06:13:03.739 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:13:03.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3ac806ae40 msgr2=0x7f3ac806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3ac806ae40 0x7f3ac806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0036000 tx=0x7f3ae003c040 comp rx=0 tx=0).stop 2023-11-24T06:13:03.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40717a0 msgr2=0x7f3ae414c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:03.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40717a0 0x7f3ae414c290 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400c410 tx=0x7f3ad400c8d0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 shutdown_connections 2023-11-24T06:13:03.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3ac806ae40 0x7f3ac806d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40b3b60 0x7f3ae4154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ae40717a0 0x7f3ae414c290 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 --2- 172.21.15.22:0/3189384212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ae406da60 0x7f3ae4160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 >> 172.21.15.22:0/3189384212 conn(0x7f3ae40b0d80 msgr2=0x7f3ae40b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 shutdown_connections 2023-11-24T06:13:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:03.738+0000 7f3aec5be640 1 -- 172.21.15.22:0/3189384212 wait complete. 2023-11-24T06:13:03.761 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:13:03.761 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:03.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:04.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.042+0000 7fcf80e27640 1 Processor -- start 2023-11-24T06:13:04.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.042+0000 7fcf80e27640 1 -- start start 2023-11-24T06:13:04.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.044+0000 7fcf80e27640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcf7c0cf050 0x7fcf7c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.044+0000 7fcf80e27640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c0cd7b0 0x7fcf7c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.044+0000 7fcf80e27640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7c15fa70 con 0x7fcf7c13dfd0 2023-11-24T06:13:04.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.044+0000 7fcf80e27640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7c0cfa40 con 0x7fcf7c0cf050 2023-11-24T06:13:04.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.044+0000 7fcf80e27640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c15c580 con 0x7fcf7c0cd7b0 2023-11-24T06:13:04.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.044+0000 7fcf7b7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcf7c13dfd0 0x7fcf7c15be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50726/0 (socket says 172.21.15.22:50726) 2023-11-24T06:13:04.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.044+0000 7fcf7b7fe640 1 -- 172.21.15.22:0/2957973455 learned_addr learned my addr 172.21.15.22:0/2957973455 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:04.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.044+0000 7fcf7affd640 1 --2- 172.21.15.22:0/2957973455 >> v2:172.21.15.22:3300/0 conn(0x7fcf7c0cf050 0x7fcf7c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.045+0000 7fcf7bfff640 1 --2- 172.21.15.22:0/2957973455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c0cd7b0 0x7fcf7c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.045+0000 7fcf7a7fc640 1 -- 172.21.15.22:0/2957973455 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165495493 0 0) 0x7fcf7c15fa70 con 0x7fcf7c13dfd0 2023-11-24T06:13:04.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.045+0000 7fcf7a7fc640 1 -- 172.21.15.22:0/2957973455 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf68003520 con 0x7fcf7c13dfd0 2023-11-24T06:13:04.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.045+0000 7fcf7affd640 1 -- 172.21.15.22:0/2957973455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c0cd7b0 msgr2=0x7fcf7c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:04.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.045+0000 7fcf7affd640 1 --2- 172.21.15.22:0/2957973455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c0cd7b0 0x7fcf7c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.045+0000 7fcf7affd640 1 -- 172.21.15.22:0/2957973455 >> v1:172.21.15.22:6789/0 conn(0x7fcf7c13dfd0 legacy=0x7fcf7c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.045+0000 7fcf7affd640 1 -- 172.21.15.22:0/2957973455 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c140900 con 0x7fcf7c0cf050 2023-11-24T06:13:04.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.046+0000 7fcf7affd640 1 --2- 172.21.15.22:0/2957973455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 0x7fcf7c0cf500 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009dc0 tx=0x7fcf6402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0eb1f2cd529be0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:04.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.046+0000 7fcf7a7fc640 1 -- 172.21.15.22:0/2957973455 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6402cc40 con 0x7fcf7c0cf050 2023-11-24T06:13:04.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.047+0000 7fcf7a7fc640 1 -- 172.21.15.22:0/2957973455 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6402cda0 con 0x7fcf7c0cf050 2023-11-24T06:13:04.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.047+0000 7fcf7a7fc640 1 -- 172.21.15.22:0/2957973455 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64034660 con 0x7fcf7c0cf050 2023-11-24T06:13:04.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.047+0000 7fcf80e27640 1 -- 172.21.15.22:0/2957973455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 msgr2=0x7fcf7c0cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.047+0000 7fcf80e27640 1 --2- 172.21.15.22:0/2957973455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 0x7fcf7c0cf500 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009dc0 tx=0x7fcf6402be90 comp rx=0 tx=0).stop 2023-11-24T06:13:04.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.047+0000 7fcf80e27640 1 -- 172.21.15.22:0/2957973455 shutdown_connections 2023-11-24T06:13:04.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.047+0000 7fcf80e27640 1 --2- 172.21.15.22:0/2957973455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 0x7fcf7c0cf500 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.047+0000 7fcf80e27640 1 --2- 172.21.15.22:0/2957973455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c0cd7b0 0x7fcf7c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.047+0000 7fcf80e27640 1 -- 172.21.15.22:0/2957973455 >> 172.21.15.22:0/2957973455 conn(0x7fcf7c06a860 msgr2=0x7fcf7c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:04.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.047+0000 7fcf80e27640 1 -- 172.21.15.22:0/2957973455 shutdown_connections 2023-11-24T06:13:04.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.048+0000 7fcf80e27640 1 -- 172.21.15.22:0/2957973455 wait complete. 2023-11-24T06:13:04.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.049+0000 7fcf80e27640 1 Processor -- start 2023-11-24T06:13:04.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.049+0000 7fcf80e27640 1 -- start start 2023-11-24T06:13:04.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.050+0000 7fcf80e27640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7c0cd7b0 0x7fcf7c070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.050+0000 7fcf80e27640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 0x7fcf7c157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.050+0000 7fcf80e27640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c13dfd0 0x7fcf7c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.050+0000 7fcf80e27640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c155a20 con 0x7fcf7c0cf050 2023-11-24T06:13:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.050+0000 7fcf80e27640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c157a70 con 0x7fcf7c0cd7b0 2023-11-24T06:13:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.050+0000 7fcf80e27640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c157d50 con 0x7fcf7c13dfd0 2023-11-24T06:13:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 0x7fcf7c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 0x7fcf7c157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45000/0 (socket says 172.21.15.22:45000) 2023-11-24T06:13:04.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7affd640 1 -- 172.21.15.22:0/2572625442 learned_addr learned my addr 172.21.15.22:0/2572625442 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:04.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7b7fe640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7c0cd7b0 0x7fcf7c070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7bfff640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c13dfd0 0x7fcf7c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7affd640 1 -- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c13dfd0 msgr2=0x7fcf7c0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7affd640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c13dfd0 0x7fcf7c0716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7affd640 1 -- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7c0cd7b0 msgr2=0x7fcf7c070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7affd640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7c0cd7b0 0x7fcf7c070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7affd640 1 -- 172.21.15.22:0/2572625442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64009a70 con 0x7fcf7c0cf050 2023-11-24T06:13:04.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7b7fe640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7c0cd7b0 0x7fcf7c070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:04.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.051+0000 7fcf7bfff640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c13dfd0 0x7fcf7c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:04.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.052+0000 7fcf7affd640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 0x7fcf7c157000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf64000f80 tx=0x7fcf64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:04.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.052+0000 7fcf73fff640 1 -- 172.21.15.22:0/2572625442 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64040650 con 0x7fcf7c0cf050 2023-11-24T06:13:04.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.052+0000 7fcf73fff640 1 -- 172.21.15.22:0/2572625442 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf640407b0 con 0x7fcf7c0cf050 2023-11-24T06:13:04.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.052+0000 7fcf73fff640 1 -- 172.21.15.22:0/2572625442 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64040b60 con 0x7fcf7c0cf050 2023-11-24T06:13:04.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.052+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c158030 con 0x7fcf7c0cf050 2023-11-24T06:13:04.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.052+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c1592f0 con 0x7fcf7c0cf050 2023-11-24T06:13:04.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.053+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7c159510 con 0x7fcf7c0cf050 2023-11-24T06:13:04.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.054+0000 7fcf73fff640 1 -- 172.21.15.22:0/2572625442 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf64040cc0 con 0x7fcf7c0cf050 2023-11-24T06:13:04.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.055+0000 7fcf73fff640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf5c06ae40 0x7fcf5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.055+0000 7fcf73fff640 1 -- 172.21.15.22:0/2572625442 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fcf640ac360 con 0x7fcf7c0cf050 2023-11-24T06:13:04.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.056+0000 7fcf7b7fe640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf5c06ae40 0x7fcf5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.056+0000 7fcf7b7fe640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf5c06ae40 0x7fcf5c06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c007fd0 tx=0x7fcf6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:04.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.060+0000 7fcf73fff640 1 -- 172.21.15.22:0/2572625442 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcf640774a0 con 0x7fcf7c0cf050 2023-11-24T06:13:04.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.255+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf7c15eb30 con 0x7fcf7c0cf050 2023-11-24T06:13:04.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.258+0000 7fcf73fff640 1 -- 172.21.15.22:0/2572625442 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7fcf6407aac0 con 0x7fcf7c0cf050 2023-11-24T06:13:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:04.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf5c06ae40 msgr2=0x7fcf5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf5c06ae40 0x7fcf5c06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c007fd0 tx=0x7fcf6c009040 comp rx=0 tx=0).stop 2023-11-24T06:13:04.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 msgr2=0x7fcf7c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 0x7fcf7c157000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf64000f80 tx=0x7fcf64004a40 comp rx=0 tx=0).stop 2023-11-24T06:13:04.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 shutdown_connections 2023-11-24T06:13:04.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf5c06ae40 0x7fcf5c06d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf7c13dfd0 0x7fcf7c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf7c0cf050 0x7fcf7c157000 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 --2- 172.21.15.22:0/2572625442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7c0cd7b0 0x7fcf7c070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 >> 172.21.15.22:0/2572625442 conn(0x7fcf7c06a860 msgr2=0x7fcf7c15e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:04.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 shutdown_connections 2023-11-24T06:13:04.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.261+0000 7fcf80e27640 1 -- 172.21.15.22:0/2572625442 wait complete. 2023-11-24T06:13:04.282 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:04.282 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:04.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.506+0000 7fe70d823640 1 Processor -- start 2023-11-24T06:13:04.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.506+0000 7fe70d823640 1 -- start start 2023-11-24T06:13:04.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.507+0000 7fe70d823640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe70815b350 0x7fe7080abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.507+0000 7fe70d823640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe70809cb30 0x7fe7080b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.507+0000 7fe70d823640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70815b730 con 0x7fe7080adb60 2023-11-24T06:13:04.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.507+0000 7fe70d823640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7080ac740 con 0x7fe70809cb30 2023-11-24T06:13:04.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.507+0000 7fe70d823640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7080ac460 con 0x7fe70815b350 2023-11-24T06:13:04.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.508+0000 7fe7067fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe70809cb30 0x7fe7080b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.508+0000 7fe7067fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe70809cb30 0x7fe7080b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45004/0 (socket says 172.21.15.22:45004) 2023-11-24T06:13:04.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.508+0000 7fe7067fc640 1 -- 172.21.15.22:0/1238179013 learned_addr learned my addr 172.21.15.22:0/1238179013 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:04.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.508+0000 7fe706ffd640 1 --2- 172.21.15.22:0/1238179013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe70815b350 0x7fe7080abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.508+0000 7fe7067fc640 1 -- 172.21.15.22:0/1238179013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe70815b350 msgr2=0x7fe7080abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:04.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.508+0000 7fe7067fc640 1 --2- 172.21.15.22:0/1238179013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe70815b350 0x7fe7080abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.508+0000 7fe7067fc640 1 -- 172.21.15.22:0/1238179013 >> v1:172.21.15.31:6789/0 conn(0x7fe7080adb60 legacy=0x7fe7080adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:04.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.508+0000 7fe7067fc640 1 -- 172.21.15.22:0/1238179013 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7080b2a50 con 0x7fe70809cb30 2023-11-24T06:13:04.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.509+0000 7fe7067fc640 1 --2- 172.21.15.22:0/1238179013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70809cb30 0x7fe7080b3530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009870 tx=0x7fe6f802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7eeaf424ebc881 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:04.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe705ffb640 1 -- 172.21.15.22:0/1238179013 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8031640 con 0x7fe70809cb30 2023-11-24T06:13:04.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe705ffb640 1 -- 172.21.15.22:0/1238179013 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f80317a0 con 0x7fe70809cb30 2023-11-24T06:13:04.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe705ffb640 1 -- 172.21.15.22:0/1238179013 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8031b30 con 0x7fe70809cb30 2023-11-24T06:13:04.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe70d823640 1 -- 172.21.15.22:0/1238179013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70809cb30 msgr2=0x7fe7080b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe70d823640 1 --2- 172.21.15.22:0/1238179013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70809cb30 0x7fe7080b3530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009870 tx=0x7fe6f802b8f0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe70d823640 1 -- 172.21.15.22:0/1238179013 shutdown_connections 2023-11-24T06:13:04.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe70d823640 1 --2- 172.21.15.22:0/1238179013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70809cb30 0x7fe7080b3530 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe70d823640 1 --2- 172.21.15.22:0/1238179013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe70815b350 0x7fe7080abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe70d823640 1 -- 172.21.15.22:0/1238179013 >> 172.21.15.22:0/1238179013 conn(0x7fe7080b0ba0 msgr2=0x7fe7080b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:04.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.510+0000 7fe70d823640 1 -- 172.21.15.22:0/1238179013 shutdown_connections 2023-11-24T06:13:04.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.511+0000 7fe70d823640 1 -- 172.21.15.22:0/1238179013 wait complete. 2023-11-24T06:13:04.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.512+0000 7fe70d823640 1 Processor -- start 2023-11-24T06:13:04.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.513+0000 7fe70d823640 1 -- start start 2023-11-24T06:13:04.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.513+0000 7fe70d823640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe70809cb30 0x7fe70809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe70d823640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7080adb60 0x7fe708153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe70d823640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70815b350 0x7fe7081f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe70d823640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70809b660 con 0x7fe70815b350 2023-11-24T06:13:04.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe70d823640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70809b0a0 con 0x7fe7080adb60 2023-11-24T06:13:04.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe70d823640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70809b380 con 0x7fe70809cb30 2023-11-24T06:13:04.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70815b350 0x7fe7081f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70815b350 0x7fe7081f3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45010/0 (socket says 172.21.15.22:45010) 2023-11-24T06:13:04.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe7077fe640 1 -- 172.21.15.22:0/1019021213 learned_addr learned my addr 172.21.15.22:0/1019021213 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:04.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe7077fe640 1 -- 172.21.15.22:0/1019021213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe70809cb30 msgr2=0x7fe70809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe7077fe640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe70809cb30 0x7fe70809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe7077fe640 1 -- 172.21.15.22:0/1019021213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7080adb60 msgr2=0x7fe708153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe7077fe640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7080adb60 0x7fe708153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.514+0000 7fe7077fe640 1 -- 172.21.15.22:0/1019021213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80094d0 con 0x7fe70815b350 2023-11-24T06:13:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.515+0000 7fe7077fe640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70815b350 0x7fe7081f3800 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c780 tx=0x7fe70000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.515+0000 7fe6fffff640 1 -- 172.21.15.22:0/1019021213 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700004b60 con 0x7fe70815b350 2023-11-24T06:13:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.515+0000 7fe6fffff640 1 -- 172.21.15.22:0/1019021213 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70000ce90 con 0x7fe70815b350 2023-11-24T06:13:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.515+0000 7fe6fffff640 1 -- 172.21.15.22:0/1019021213 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70000a850 con 0x7fe70815b350 2023-11-24T06:13:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.515+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7081f3000 con 0x7fe70815b350 2023-11-24T06:13:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.515+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe708153fa0 con 0x7fe70815b350 2023-11-24T06:13:04.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.516+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7081f3520 con 0x7fe70815b350 2023-11-24T06:13:04.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.517+0000 7fe6fffff640 1 -- 172.21.15.22:0/1019021213 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe70000a9b0 con 0x7fe70815b350 2023-11-24T06:13:04.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.518+0000 7fe6fffff640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6e806ae40 0x7fe6e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.518+0000 7fe6fffff640 1 -- 172.21.15.22:0/1019021213 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe7000898e0 con 0x7fe70815b350 2023-11-24T06:13:04.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.519+0000 7fe706ffd640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6e806ae40 0x7fe6e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.519+0000 7fe706ffd640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6e806ae40 0x7fe6e806d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0006fd0 tx=0x7fe6f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:04.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.522+0000 7fe6fffff640 1 -- 172.21.15.22:0/1019021213 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7081f3520 con 0x7fe70815b350 2023-11-24T06:13:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.719+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7081f3520 con 0x7fe70815b350 2023-11-24T06:13:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.719+0000 7fe6fffff640 1 -- 172.21.15.22:0/1019021213 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7081f3520 con 0x7fe70815b350 2023-11-24T06:13:04.722 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:13:04.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6e806ae40 msgr2=0x7fe6e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6e806ae40 0x7fe6e806d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0006fd0 tx=0x7fe6f0008040 comp rx=0 tx=0).stop 2023-11-24T06:13:04.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70815b350 msgr2=0x7fe7081f3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70815b350 0x7fe7081f3800 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c780 tx=0x7fe70000cc40 comp rx=0 tx=0).stop 2023-11-24T06:13:04.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 shutdown_connections 2023-11-24T06:13:04.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6e806ae40 0x7fe6e806d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70815b350 0x7fe7081f3800 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7080adb60 0x7fe708153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 --2- 172.21.15.22:0/1019021213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe70809cb30 0x7fe70809aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 >> 172.21.15.22:0/1019021213 conn(0x7fe7080b0ba0 msgr2=0x7fe7080cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:04.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 shutdown_connections 2023-11-24T06:13:04.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.722+0000 7fe70d823640 1 -- 172.21.15.22:0/1019021213 wait complete. 2023-11-24T06:13:04.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:04.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.966+0000 7fd8cacdf640 1 Processor -- start 2023-11-24T06:13:04.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.966+0000 7fd8cacdf640 1 -- start start 2023-11-24T06:13:04.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.967+0000 7fd8cacdf640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd8c4153ea0 0x7fd8c40ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.967+0000 7fd8cacdf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8c4154280 0x7fd8c415d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.967+0000 7fd8cacdf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4070850 0x7fd8c4071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.968+0000 7fd8cacdf640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c40ce650 con 0x7fd8c4153ea0 2023-11-24T06:13:04.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.968+0000 7fd8cacdf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c4154710 con 0x7fd8c4154280 2023-11-24T06:13:04.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.968+0000 7fd8cacdf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c415ddd0 con 0x7fd8c4070850 2023-11-24T06:13:04.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.968+0000 7fd8c9cdd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd8c4153ea0 0x7fd8c40ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.968+0000 7fd8c9cdd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd8c4153ea0 0x7fd8c40ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45022/0 (socket says 172.21.15.22:45022) 2023-11-24T06:13:04.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.968+0000 7fd8c9cdd640 1 -- 172.21.15.22:0/3036043994 learned_addr learned my addr 172.21.15.22:0/3036043994 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:04.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.968+0000 7fd8ca4de640 1 --2- 172.21.15.22:0/3036043994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4070850 0x7fd8c4071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.968+0000 7fd8c94dc640 1 --2- 172.21.15.22:0/3036043994 >> v2:172.21.15.31:3300/0 conn(0x7fd8c4154280 0x7fd8c415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.969+0000 7fd8c9cdd640 1 -- 172.21.15.22:0/3036043994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4070850 msgr2=0x7fd8c4071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:04.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.969+0000 7fd8c9cdd640 1 --2- 172.21.15.22:0/3036043994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4070850 0x7fd8c4071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.969+0000 7fd8c9cdd640 1 -- 172.21.15.22:0/3036043994 >> v2:172.21.15.31:3300/0 conn(0x7fd8c4154280 msgr2=0x7fd8c415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:04.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.969+0000 7fd8c9cdd640 1 --2- 172.21.15.22:0/3036043994 >> v2:172.21.15.31:3300/0 conn(0x7fd8c4154280 0x7fd8c415d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.969+0000 7fd8c9cdd640 1 -- 172.21.15.22:0/3036043994 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c415e0a0 con 0x7fd8c4153ea0 2023-11-24T06:13:04.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.970+0000 7fd8c9cdd640 1 --2- 172.21.15.22:0/3036043994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 0x7fd8c40ad450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4157e50 tx=0x7fd8c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e7b67b7d5f0b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:04.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.970+0000 7fd8c8cdb640 1 -- 172.21.15.22:0/3036043994 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0031870 con 0x7fd8c4153ea0 2023-11-24T06:13:04.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.970+0000 7fd8c8cdb640 1 -- 172.21.15.22:0/3036043994 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c00319d0 con 0x7fd8c4153ea0 2023-11-24T06:13:04.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.970+0000 7fd8c8cdb640 1 -- 172.21.15.22:0/3036043994 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0031d60 con 0x7fd8c4153ea0 2023-11-24T06:13:04.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.971+0000 7fd8cacdf640 1 -- 172.21.15.22:0/3036043994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 msgr2=0x7fd8c40ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.971+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/3036043994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 0x7fd8c40ad450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4157e50 tx=0x7fd8c002b910 comp rx=0 tx=0).stop 2023-11-24T06:13:04.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.971+0000 7fd8cacdf640 1 -- 172.21.15.22:0/3036043994 shutdown_connections 2023-11-24T06:13:04.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.971+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/3036043994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4070850 0x7fd8c4071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.971+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/3036043994 >> v2:172.21.15.31:3300/0 conn(0x7fd8c4154280 0x7fd8c415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.971+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/3036043994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 0x7fd8c40ad450 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.971+0000 7fd8cacdf640 1 -- 172.21.15.22:0/3036043994 >> 172.21.15.22:0/3036043994 conn(0x7fd8c40cec10 msgr2=0x7fd8c40cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:04.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.971+0000 7fd8cacdf640 1 -- 172.21.15.22:0/3036043994 shutdown_connections 2023-11-24T06:13:04.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.971+0000 7fd8cacdf640 1 -- 172.21.15.22:0/3036043994 wait complete. 2023-11-24T06:13:04.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.973+0000 7fd8cacdf640 1 Processor -- start 2023-11-24T06:13:04.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.973+0000 7fd8cacdf640 1 -- start start 2023-11-24T06:13:04.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.974+0000 7fd8cacdf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c4070850 0x7fd8c413c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.974+0000 7fd8cacdf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 0x7fd8c41e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.974+0000 7fd8cacdf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4154280 0x7fd8c40b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.974+0000 7fd8cacdf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40b01d0 con 0x7fd8c4153ea0 2023-11-24T06:13:04.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.974+0000 7fd8cacdf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41400f0 con 0x7fd8c4070850 2023-11-24T06:13:04.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.974+0000 7fd8cacdf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40b0420 con 0x7fd8c4154280 2023-11-24T06:13:04.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c94dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 0x7fd8c41e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c94dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 0x7fd8c41e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45034/0 (socket says 172.21.15.22:45034) 2023-11-24T06:13:04.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c94dc640 1 -- 172.21.15.22:0/2325833392 learned_addr learned my addr 172.21.15.22:0/2325833392 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:04.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8ca4de640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4154280 0x7fd8c40b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c9cdd640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c4070850 0x7fd8c413c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c94dc640 1 -- 172.21.15.22:0/2325833392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4154280 msgr2=0x7fd8c40b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c94dc640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4154280 0x7fd8c40b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c94dc640 1 -- 172.21.15.22:0/2325833392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c4070850 msgr2=0x7fd8c413c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:04.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c94dc640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c4070850 0x7fd8c413c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:04.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c94dc640 1 -- 172.21.15.22:0/2325833392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00094d0 con 0x7fd8c4153ea0 2023-11-24T06:13:04.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8ca4de640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4154280 0x7fd8c40b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:04.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.975+0000 7fd8c94dc640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 0x7fd8c41e5900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400d800 tx=0x7fd8b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:04.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.976+0000 7fd8ba7fc640 1 -- 172.21.15.22:0/2325833392 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400b6c0 con 0x7fd8c4153ea0 2023-11-24T06:13:04.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.976+0000 7fd8ba7fc640 1 -- 172.21.15.22:0/2325833392 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400b820 con 0x7fd8c4153ea0 2023-11-24T06:13:04.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.976+0000 7fd8ba7fc640 1 -- 172.21.15.22:0/2325833392 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400bbb0 con 0x7fd8c4153ea0 2023-11-24T06:13:04.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.976+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c40b0700 con 0x7fd8c4153ea0 2023-11-24T06:13:04.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.976+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c413cf00 con 0x7fd8c4153ea0 2023-11-24T06:13:04.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.977+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c404e840 con 0x7fd8c4153ea0 2023-11-24T06:13:04.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.978+0000 7fd8ba7fc640 1 -- 172.21.15.22:0/2325833392 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8b400bd10 con 0x7fd8c4153ea0 2023-11-24T06:13:04.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.979+0000 7fd8ba7fc640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8a806ae40 0x7fd8a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.979+0000 7fd8ba7fc640 1 -- 172.21.15.22:0/2325833392 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd8b4089b70 con 0x7fd8c4153ea0 2023-11-24T06:13:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.979+0000 7fd8c9cdd640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8a806ae40 0x7fd8a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:04.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.980+0000 7fd8c9cdd640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8a806ae40 0x7fd8a806d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0036000 tx=0x7fd8c003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:04.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:04.984+0000 7fd8ba7fc640 1 -- 172.21.15.22:0/2325833392 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8b4054c20 con 0x7fd8c4153ea0 2023-11-24T06:13:05.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.177+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8c415d240 con 0x7fd8c4153ea0 2023-11-24T06:13:05.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.178+0000 7fd8ba7fc640 1 -- 172.21.15.22:0/2325833392 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8b4058240 con 0x7fd8c4153ea0 2023-11-24T06:13:05.182 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:13:05.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.180+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8a806ae40 msgr2=0x7fd8a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.180+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8a806ae40 0x7fd8a806d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0036000 tx=0x7fd8c003c040 comp rx=0 tx=0).stop 2023-11-24T06:13:05.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.180+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 msgr2=0x7fd8c41e5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.180+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 0x7fd8c41e5900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400d800 tx=0x7fd8b400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.181+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 shutdown_connections 2023-11-24T06:13:05.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.181+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8a806ae40 0x7fd8a806d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.181+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8c4154280 0x7fd8c40b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.181+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8c4153ea0 0x7fd8c41e5900 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.181+0000 7fd8cacdf640 1 --2- 172.21.15.22:0/2325833392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c4070850 0x7fd8c413c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.181+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 >> 172.21.15.22:0/2325833392 conn(0x7fd8c40cec10 msgr2=0x7fd8c40ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:05.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.181+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 shutdown_connections 2023-11-24T06:13:05.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.181+0000 7fd8cacdf640 1 -- 172.21.15.22:0/2325833392 wait complete. 2023-11-24T06:13:05.202 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:05.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.436+0000 7fca7d978640 1 Processor -- start 2023-11-24T06:13:05.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.436+0000 7fca7d978640 1 -- start start 2023-11-24T06:13:05.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.437+0000 7fca7d978640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca7815b120 0x7fca780cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.437+0000 7fca7d978640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca780cbd70 con 0x7fca78070a60 2023-11-24T06:13:05.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.438+0000 7fca7d978640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca780cb7b0 con 0x7fca780cd1e0 2023-11-24T06:13:05.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.438+0000 7fca7d978640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca780cba90 con 0x7fca7815b120 2023-11-24T06:13:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.438+0000 7fca76ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca7815b120 0x7fca780cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.438+0000 7fca767fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fca78070a60 0x7fca780cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50734/0 (socket says 172.21.15.22:50734) 2023-11-24T06:13:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.438+0000 7fca767fc640 1 -- 172.21.15.22:0/2681863269 learned_addr learned my addr 172.21.15.22:0/2681863269 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.438+0000 7fca76ffd640 1 -- 172.21.15.22:0/2681863269 >> v1:172.21.15.31:6789/0 conn(0x7fca780cd1e0 legacy=0x7fca780cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.438+0000 7fca76ffd640 1 -- 172.21.15.22:0/2681863269 >> v1:172.21.15.22:6789/0 conn(0x7fca78070a60 legacy=0x7fca780cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.438+0000 7fca76ffd640 1 -- 172.21.15.22:0/2681863269 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780d0840 con 0x7fca7815b120 2023-11-24T06:13:05.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.438+0000 7fca75ffb640 1 -- 172.21.15.22:0/2681863269 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416208128 0 0) 0x7fca780cbd70 con 0x7fca78070a60 2023-11-24T06:13:05.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.440+0000 7fca76ffd640 1 --2- 172.21.15.22:0/2681863269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca7815b120 0x7fca780cec00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fca68009d90 tx=0x7fca6802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0924f3de8fe4b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:05.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.440+0000 7fca75ffb640 1 -- 172.21.15.22:0/2681863269 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6802cbd0 con 0x7fca7815b120 2023-11-24T06:13:05.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.440+0000 7fca75ffb640 1 -- 172.21.15.22:0/2681863269 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6802cd30 con 0x7fca7815b120 2023-11-24T06:13:05.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.440+0000 7fca75ffb640 1 -- 172.21.15.22:0/2681863269 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6802cea0 con 0x7fca7815b120 2023-11-24T06:13:05.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.440+0000 7fca7d978640 1 -- 172.21.15.22:0/2681863269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca7815b120 msgr2=0x7fca780cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.440+0000 7fca7d978640 1 --2- 172.21.15.22:0/2681863269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca7815b120 0x7fca780cec00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fca68009d90 tx=0x7fca6802be20 comp rx=0 tx=0).stop 2023-11-24T06:13:05.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.441+0000 7fca7d978640 1 -- 172.21.15.22:0/2681863269 shutdown_connections 2023-11-24T06:13:05.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.441+0000 7fca7d978640 1 --2- 172.21.15.22:0/2681863269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca7815b120 0x7fca780cec00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.441+0000 7fca7d978640 1 -- 172.21.15.22:0/2681863269 >> 172.21.15.22:0/2681863269 conn(0x7fca780b2ba0 msgr2=0x7fca780b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:05.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.441+0000 7fca7d978640 1 -- 172.21.15.22:0/2681863269 shutdown_connections 2023-11-24T06:13:05.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.441+0000 7fca7d978640 1 -- 172.21.15.22:0/2681863269 wait complete. 2023-11-24T06:13:05.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.443+0000 7fca7d978640 1 Processor -- start 2023-11-24T06:13:05.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.443+0000 7fca7d978640 1 -- start start 2023-11-24T06:13:05.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca7d978640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca78070a60 0x7fca781589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca7d978640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780cd1e0 0x7fca78156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca7d978640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca7815b120 0x7fca78154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca7d978640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78157920 con 0x7fca78070a60 2023-11-24T06:13:05.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca7d978640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78157c00 con 0x7fca780cd1e0 2023-11-24T06:13:05.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca7d978640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca78157ee0 con 0x7fca7815b120 2023-11-24T06:13:05.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca78070a60 0x7fca781589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca78070a60 0x7fca781589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45050/0 (socket says 172.21.15.22:45050) 2023-11-24T06:13:05.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca76ffd640 1 -- 172.21.15.22:0/834310717 learned_addr learned my addr 172.21.15.22:0/834310717 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:05.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.444+0000 7fca767fc640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780cd1e0 0x7fca78156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca76ffd640 1 -- 172.21.15.22:0/834310717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca7815b120 msgr2=0x7fca78154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca76ffd640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca7815b120 0x7fca78154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca76ffd640 1 -- 172.21.15.22:0/834310717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780cd1e0 msgr2=0x7fca78156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca76ffd640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780cd1e0 0x7fca78156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca76ffd640 1 -- 172.21.15.22:0/834310717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009a70 con 0x7fca78070a60 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca767fc640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780cd1e0 0x7fca78156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca76ffd640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca78070a60 0x7fca781589c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fca68009d90 tx=0x7fca68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca6ffff640 1 -- 172.21.15.22:0/834310717 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6802cea0 con 0x7fca78070a60 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca6ffff640 1 -- 172.21.15.22:0/834310717 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6803e610 con 0x7fca78070a60 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca6ffff640 1 -- 172.21.15.22:0/834310717 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6803e9c0 con 0x7fca78070a60 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca781581c0 con 0x7fca78070a60 2023-11-24T06:13:05.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.445+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca780cb0a0 con 0x7fca78070a60 2023-11-24T06:13:05.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.447+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca78158680 con 0x7fca78070a60 2023-11-24T06:13:05.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.448+0000 7fca6ffff640 1 -- 172.21.15.22:0/834310717 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca6803b050 con 0x7fca78070a60 2023-11-24T06:13:05.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.448+0000 7fca6ffff640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca5806ae90 0x7fca5806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.449+0000 7fca6ffff640 1 -- 172.21.15.22:0/834310717 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fca680abfe0 con 0x7fca78070a60 2023-11-24T06:13:05.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.449+0000 7fca767fc640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca5806ae90 0x7fca5806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.449+0000 7fca767fc640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca5806ae90 0x7fca5806d350 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca7806c640 tx=0x7fca60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:05.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.453+0000 7fca6ffff640 1 -- 172.21.15.22:0/834310717 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca680dee90 con 0x7fca78070a60 2023-11-24T06:13:05.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.653+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca7806fa90 con 0x7fca78070a60 2023-11-24T06:13:05.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.654+0000 7fca6ffff640 1 -- 172.21.15.22:0/834310717 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca68077040 con 0x7fca78070a60 2023-11-24T06:13:05.657 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:13:05.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca5806ae90 msgr2=0x7fca5806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca5806ae90 0x7fca5806d350 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca7806c640 tx=0x7fca60009040 comp rx=0 tx=0).stop 2023-11-24T06:13:05.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca78070a60 msgr2=0x7fca781589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca78070a60 0x7fca781589c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fca68009d90 tx=0x7fca68004a40 comp rx=0 tx=0).stop 2023-11-24T06:13:05.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 shutdown_connections 2023-11-24T06:13:05.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca5806ae90 0x7fca5806d350 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca7815b120 0x7fca78154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780cd1e0 0x7fca78156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 --2- 172.21.15.22:0/834310717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca78070a60 0x7fca781589c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 >> 172.21.15.22:0/834310717 conn(0x7fca780b2ba0 msgr2=0x7fca780b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:05.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 shutdown_connections 2023-11-24T06:13:05.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.657+0000 7fca7d978640 1 -- 172.21.15.22:0/834310717 wait complete. 2023-11-24T06:13:05.680 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:13:05.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.904+0000 7f6341943640 1 Processor -- start 2023-11-24T06:13:05.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.905+0000 7f6341943640 1 -- start start 2023-11-24T06:13:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.906+0000 7f6341943640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f633c146c70 0x7f633c0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.906+0000 7f6341943640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c0b3b60 con 0x7f633c146890 2023-11-24T06:13:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.906+0000 7f6341943640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c06cd20 con 0x7f633c0b3710 2023-11-24T06:13:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.906+0000 7f6341943640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c161ec0 con 0x7f633c146c70 2023-11-24T06:13:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.907+0000 7f633affd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f633c146890 0x7f633c06c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50740/0 (socket says 172.21.15.22:50740) 2023-11-24T06:13:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.907+0000 7f633affd640 1 -- 172.21.15.22:0/862020723 learned_addr learned my addr 172.21.15.22:0/862020723 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:05.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.907+0000 7f633a7fc640 1 --2- 172.21.15.22:0/862020723 >> v2:172.21.15.31:3300/0 conn(0x7f633c146c70 0x7f633c0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.907+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556022269 0 0) 0x7f632c001490 con 0x7f633c146890 2023-11-24T06:13:05.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.907+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6328003520 con 0x7f633c146890 2023-11-24T06:13:05.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1684924349 0 0) 0x7f6328003520 con 0x7f633c146890 2023-11-24T06:13:05.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 >> v2:172.21.15.31:3300/0 conn(0x7f633c146c70 msgr2=0x7f633c0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:05.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 --2- 172.21.15.22:0/862020723 >> v2:172.21.15.31:3300/0 conn(0x7f633c146c70 0x7f633c0b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 >> v1:172.21.15.31:6789/0 conn(0x7f633c0b3710 legacy=0x7f633c15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c161be0 con 0x7f633c146890 2023-11-24T06:13:05.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f632c001b80 con 0x7f633c146890 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 >> v1:172.21.15.22:6789/0 conn(0x7f633c146890 legacy=0x7f633c06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328003970 0x7f6328003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63280047c0 0x7f6328004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328005180 0x7f632800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c161ec0 con 0x7f6328005180 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632800c020 con 0x7f63280047c0 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632800c1e0 con 0x7f6328003970 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.908+0000 7f633b7fe640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328005180 0x7f632800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.909+0000 7f633a7fc640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63280047c0 0x7f6328004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.909+0000 7f633affd640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328003970 0x7f6328003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.909+0000 7f633b7fe640 1 -- 172.21.15.22:0/862020723 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328003970 msgr2=0x7f6328003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.909+0000 7f633b7fe640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328003970 0x7f6328003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.909+0000 7f633b7fe640 1 -- 172.21.15.22:0/862020723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63280047c0 msgr2=0x7f6328004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:05.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.909+0000 7f633b7fe640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63280047c0 0x7f6328004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.909+0000 7f633b7fe640 1 -- 172.21.15.22:0/862020723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328003520 con 0x7f6328005180 2023-11-24T06:13:05.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.909+0000 7f633affd640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328003970 0x7f6328003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:05.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.910+0000 7f633b7fe640 1 -- 172.21.15.22:0/862020723 reap_dead start 2023-11-24T06:13:05.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.910+0000 7f633b7fe640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328005180 0x7f632800b980 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6334001750 tx=0x7f63280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3ee97d87ab75d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:05.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.910+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340052d0 con 0x7f6328005180 2023-11-24T06:13:05.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.910+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633402e050 con 0x7f6328005180 2023-11-24T06:13:05.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.910+0000 7f6339ffb640 1 -- 172.21.15.22:0/862020723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334003830 con 0x7f6328005180 2023-11-24T06:13:05.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.911+0000 7f6341943640 1 -- 172.21.15.22:0/862020723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328005180 msgr2=0x7f632800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.911+0000 7f6341943640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328005180 0x7f632800b980 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6334001750 tx=0x7f63280057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.911+0000 7f6341943640 1 -- 172.21.15.22:0/862020723 shutdown_connections 2023-11-24T06:13:05.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.911+0000 7f6341943640 1 --2- 172.21.15.22:0/862020723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328005180 0x7f632800b980 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.911+0000 7f6341943640 1 -- 172.21.15.22:0/862020723 >> 172.21.15.22:0/862020723 conn(0x7f633c066610 msgr2=0x7f633c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:05.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.911+0000 7f6341943640 1 -- 172.21.15.22:0/862020723 shutdown_connections 2023-11-24T06:13:05.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.911+0000 7f6341943640 1 -- 172.21.15.22:0/862020723 wait complete. 2023-11-24T06:13:05.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.914+0000 7f6341943640 1 Processor -- start 2023-11-24T06:13:05.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.914+0000 7f6341943640 1 -- start start 2023-11-24T06:13:05.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.915+0000 7f6341943640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328005180 0x7f633c0cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.915+0000 7f6341943640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f633c1f4db0 0x7f633c1f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.915+0000 7f6341943640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0b1bb0 0x7f633c140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.915+0000 7f6341943640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c1f4bf0 con 0x7f633c1f4db0 2023-11-24T06:13:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.915+0000 7f6341943640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0cf250 con 0x7f633c0b1bb0 2023-11-24T06:13:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.915+0000 7f6341943640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c1f5230 con 0x7f6328005180 2023-11-24T06:13:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f633c1f4db0 0x7f633c1f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f633c1f4db0 0x7f633c1f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45064/0 (socket says 172.21.15.22:45064) 2023-11-24T06:13:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633a7fc640 1 -- 172.21.15.22:0/2927415098 learned_addr learned my addr 172.21.15.22:0/2927415098 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633affd640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328005180 0x7f633c0cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633b7fe640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0b1bb0 0x7f633c140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633a7fc640 1 -- 172.21.15.22:0/2927415098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328005180 msgr2=0x7f633c0cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633a7fc640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328005180 0x7f633c0cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633a7fc640 1 -- 172.21.15.22:0/2927415098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0b1bb0 msgr2=0x7f633c140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:05.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633a7fc640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0b1bb0 0x7f633c140630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:05.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633a7fc640 1 -- 172.21.15.22:0/2927415098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0cb1a0 con 0x7f633c1f4db0 2023-11-24T06:13:05.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.916+0000 7f633b7fe640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0b1bb0 0x7f633c140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:05.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.917+0000 7f633a7fc640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f633c1f4db0 0x7f633c1f46b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6324011540 tx=0x7f6324011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:05.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.917+0000 7f6333fff640 1 -- 172.21.15.22:0/2927415098 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324015930 con 0x7f633c1f4db0 2023-11-24T06:13:05.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.917+0000 7f6333fff640 1 -- 172.21.15.22:0/2927415098 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324015a90 con 0x7f633c1f4db0 2023-11-24T06:13:05.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.917+0000 7f6333fff640 1 -- 172.21.15.22:0/2927415098 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324015e60 con 0x7f633c1f4db0 2023-11-24T06:13:05.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.917+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c0cb480 con 0x7f633c1f4db0 2023-11-24T06:13:05.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.917+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c0cba40 con 0x7f633c1f4db0 2023-11-24T06:13:05.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.918+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c067da0 con 0x7f633c1f4db0 2023-11-24T06:13:05.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.919+0000 7f6333fff640 1 -- 172.21.15.22:0/2927415098 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f632400f460 con 0x7f633c1f4db0 2023-11-24T06:13:05.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.920+0000 7f6333fff640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f631c06ae70 0x7f631c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:05.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.920+0000 7f6333fff640 1 -- 172.21.15.22:0/2927415098 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f6324089f10 con 0x7f633c1f4db0 2023-11-24T06:13:05.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.921+0000 7f633affd640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f631c06ae70 0x7f631c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:05.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.921+0000 7f633affd640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f631c06ae70 0x7f631c06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f632c001cb0 tx=0x7f632c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:05.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:05.924+0000 7f6333fff640 1 -- 172.21.15.22:0/2927415098 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6324054e90 con 0x7f633c1f4db0 2023-11-24T06:13:06.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.131+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f633c074770 con 0x7f633c1f4db0 2023-11-24T06:13:06.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.132+0000 7f6333fff640 1 -- 172.21.15.22:0/2927415098 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f63240584b0 con 0x7f633c1f4db0 2023-11-24T06:13:06.135 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f631c06ae70 msgr2=0x7f631c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f631c06ae70 0x7f631c06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f632c001cb0 tx=0x7f632c009040 comp rx=0 tx=0).stop 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f633c1f4db0 msgr2=0x7f633c1f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f633c1f4db0 0x7f633c1f46b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6324011540 tx=0x7f6324011a00 comp rx=0 tx=0).stop 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 shutdown_connections 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f631c06ae70 0x7f631c06d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0b1bb0 0x7f633c140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f633c1f4db0 0x7f633c1f46b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 --2- 172.21.15.22:0/2927415098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6328005180 0x7f633c0cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 >> 172.21.15.22:0/2927415098 conn(0x7f633c066610 msgr2=0x7f633c160ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:06.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 shutdown_connections 2023-11-24T06:13:06.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.135+0000 7f6341943640 1 -- 172.21.15.22:0/2927415098 wait complete. 2023-11-24T06:13:06.158 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2023-11-24T06:13:06.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:06.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-24T06:13:06.257 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:13:06.257 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:13:06.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:06.257 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T06:13:06.311 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:13:06.312 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:06.376 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:13:06.377 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:06.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:06.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.668+0000 7efe24859640 1 Processor -- start 2023-11-24T06:13:06.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.669+0000 7efe24859640 1 -- start start 2023-11-24T06:13:06.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.670+0000 7efe24859640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe2015d5e0 0x7efe200b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:06.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.670+0000 7efe24859640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2006bf60 0x7efe200b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:06.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.671+0000 7efe24859640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2006bbf0 con 0x7efe200b15f0 2023-11-24T06:13:06.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.671+0000 7efe24859640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe200b2330 con 0x7efe2015d5e0 2023-11-24T06:13:06.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.671+0000 7efe24859640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe200b2610 con 0x7efe2006bf60 2023-11-24T06:13:06.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.671+0000 7efe1ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efe200b15f0 0x7efe200cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50752/0 (socket says 172.21.15.22:50752) 2023-11-24T06:13:06.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.671+0000 7efe1ffff640 1 -- 172.21.15.22:0/3212279325 learned_addr learned my addr 172.21.15.22:0/3212279325 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:06.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.671+0000 7efe1f7fe640 1 --2- 172.21.15.22:0/3212279325 >> v2:172.21.15.22:3300/0 conn(0x7efe2015d5e0 0x7efe200b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:06.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.671+0000 7efe17fff640 1 --2- 172.21.15.22:0/3212279325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2006bf60 0x7efe200b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:06.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.671+0000 7efe1effd640 1 -- 172.21.15.22:0/3212279325 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563197543 0 0) 0x7efe2006bbf0 con 0x7efe200b15f0 2023-11-24T06:13:06.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.671+0000 7efe1effd640 1 -- 172.21.15.22:0/3212279325 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe0c003520 con 0x7efe200b15f0 2023-11-24T06:13:06.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.672+0000 7efe1f7fe640 1 -- 172.21.15.22:0/3212279325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2006bf60 msgr2=0x7efe200b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:06.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.672+0000 7efe1f7fe640 1 --2- 172.21.15.22:0/3212279325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2006bf60 0x7efe200b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.672+0000 7efe1f7fe640 1 -- 172.21.15.22:0/3212279325 >> v1:172.21.15.22:6789/0 conn(0x7efe200b15f0 legacy=0x7efe200cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:06.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.672+0000 7efe1effd640 1 -- 172.21.15.22:0/3212279325 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3457134784 0 0) 0x7efe0c003520 con 0x7efe200b15f0 2023-11-24T06:13:06.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.672+0000 7efe1f7fe640 1 -- 172.21.15.22:0/3212279325 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2006b6d0 con 0x7efe2015d5e0 2023-11-24T06:13:06.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.672+0000 7efe17fff640 1 --2- 172.21.15.22:0/3212279325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2006bf60 0x7efe200b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:06.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.673+0000 7efe1f7fe640 1 --2- 172.21.15.22:0/3212279325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2015d5e0 0x7efe200b1cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efe100097a0 tx=0x7efe1002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329819b7f5214e62 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:06.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.674+0000 7efe1effd640 1 -- 172.21.15.22:0/3212279325 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180019f0 con 0x7efe2015d5e0 2023-11-24T06:13:06.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.674+0000 7efe1effd640 1 -- 172.21.15.22:0/3212279325 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1002e050 con 0x7efe2015d5e0 2023-11-24T06:13:06.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.674+0000 7efe1effd640 1 -- 172.21.15.22:0/3212279325 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10030710 con 0x7efe2015d5e0 2023-11-24T06:13:06.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.674+0000 7efe24859640 1 -- 172.21.15.22:0/3212279325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2015d5e0 msgr2=0x7efe200b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:06.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.674+0000 7efe24859640 1 --2- 172.21.15.22:0/3212279325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2015d5e0 0x7efe200b1cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efe100097a0 tx=0x7efe1002b710 comp rx=0 tx=0).stop 2023-11-24T06:13:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.674+0000 7efe24859640 1 -- 172.21.15.22:0/3212279325 shutdown_connections 2023-11-24T06:13:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.674+0000 7efe24859640 1 --2- 172.21.15.22:0/3212279325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2006bf60 0x7efe200b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.674+0000 7efe24859640 1 --2- 172.21.15.22:0/3212279325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2015d5e0 0x7efe200b1cd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.674+0000 7efe24859640 1 -- 172.21.15.22:0/3212279325 >> 172.21.15.22:0/3212279325 conn(0x7efe200b2a00 msgr2=0x7efe200b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.675+0000 7efe24859640 1 -- 172.21.15.22:0/3212279325 shutdown_connections 2023-11-24T06:13:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.675+0000 7efe24859640 1 -- 172.21.15.22:0/3212279325 wait complete. 2023-11-24T06:13:06.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.676+0000 7efe24859640 1 Processor -- start 2023-11-24T06:13:06.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.677+0000 7efe24859640 1 -- start start 2023-11-24T06:13:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe24859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2006bf60 0x7efe201573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe24859640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe200b15f0 0x7efe200afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe24859640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2015d5e0 0x7efe200c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe24859640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe201f6370 con 0x7efe2006bf60 2023-11-24T06:13:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe24859640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe200af6f0 con 0x7efe200b15f0 2023-11-24T06:13:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe24859640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe201f3990 con 0x7efe2015d5e0 2023-11-24T06:13:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe1f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2006bf60 0x7efe201573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe1f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2006bf60 0x7efe201573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45078/0 (socket says 172.21.15.22:45078) 2023-11-24T06:13:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe1f7fe640 1 -- 172.21.15.22:0/649025992 learned_addr learned my addr 172.21.15.22:0/649025992 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe1f7fe640 1 -- 172.21.15.22:0/649025992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2015d5e0 msgr2=0x7efe200c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe1f7fe640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2015d5e0 0x7efe200c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe1f7fe640 1 -- 172.21.15.22:0/649025992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe200b15f0 msgr2=0x7efe200afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe17fff640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe200b15f0 0x7efe200afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe1f7fe640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe200b15f0 0x7efe200afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.678+0000 7efe1f7fe640 1 -- 172.21.15.22:0/649025992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe10009400 con 0x7efe2006bf60 2023-11-24T06:13:06.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.679+0000 7efe1f7fe640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2006bf60 0x7efe201573f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efe10000c00 tx=0x7efe100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:06.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.679+0000 7efe1cff9640 1 -- 172.21.15.22:0/649025992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1003c6e0 con 0x7efe2006bf60 2023-11-24T06:13:06.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.679+0000 7efe1cff9640 1 -- 172.21.15.22:0/649025992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1003c860 con 0x7efe2006bf60 2023-11-24T06:13:06.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.679+0000 7efe1cff9640 1 -- 172.21.15.22:0/649025992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1003cc10 con 0x7efe2006bf60 2023-11-24T06:13:06.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.679+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe201f36b0 con 0x7efe2006bf60 2023-11-24T06:13:06.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.680+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe200af380 con 0x7efe2006bf60 2023-11-24T06:13:06.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.681+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe200af510 con 0x7efe2006bf60 2023-11-24T06:13:06.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.682+0000 7efe1cff9640 1 -- 172.21.15.22:0/649025992 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe10039070 con 0x7efe2006bf60 2023-11-24T06:13:06.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.683+0000 7efe1cff9640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe0006ae40 0x7efe0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:06.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.683+0000 7efe1cff9640 1 -- 172.21.15.22:0/649025992 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7efe100aaf30 con 0x7efe2006bf60 2023-11-24T06:13:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.683+0000 7efe17fff640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe0006ae40 0x7efe0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.684+0000 7efe17fff640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe0006ae40 0x7efe0006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe200c6be0 tx=0x7efe08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:06.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.687+0000 7efe1cff9640 1 -- 172.21.15.22:0/649025992 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe10075eb0 con 0x7efe2006bf60 2023-11-24T06:13:06.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.881+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe2004e840 con 0x7efe2006bf60 2023-11-24T06:13:06.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.884+0000 7efe1cff9640 1 -- 172.21.15.22:0/649025992 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7efe10040090 con 0x7efe2006bf60 2023-11-24T06:13:06.887 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:06.887 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:06.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe0006ae40 msgr2=0x7efe0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:06.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe0006ae40 0x7efe0006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe200c6be0 tx=0x7efe08008040 comp rx=0 tx=0).stop 2023-11-24T06:13:06.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2006bf60 msgr2=0x7efe201573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:06.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2006bf60 0x7efe201573f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efe10000c00 tx=0x7efe100046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 shutdown_connections 2023-11-24T06:13:06.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe0006ae40 0x7efe0006d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe2015d5e0 0x7efe200c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe200b15f0 0x7efe200afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 --2- 172.21.15.22:0/649025992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe2006bf60 0x7efe201573f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:06.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 >> 172.21.15.22:0/649025992 conn(0x7efe200b2a00 msgr2=0x7efe200d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:06.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 shutdown_connections 2023-11-24T06:13:06.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:06.887+0000 7efe24859640 1 -- 172.21.15.22:0/649025992 wait complete. 2023-11-24T06:13:06.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:06.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.138+0000 7f33ba0e7640 1 Processor -- start 2023-11-24T06:13:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.138+0000 7f33ba0e7640 1 -- start start 2023-11-24T06:13:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.140+0000 7f33ba0e7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33b4162600 0x7f33b4162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.140+0000 7f33ba0e7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f33b406c3c0 0x7f33b406c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.140+0000 7f33ba0e7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b4162fa0 con 0x7f33b4162220 2023-11-24T06:13:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.140+0000 7f33ba0e7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b406cd90 con 0x7f33b406c3c0 2023-11-24T06:13:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.140+0000 7f33ba0e7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40706a0 con 0x7f33b4162600 2023-11-24T06:13:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.141+0000 7f33b3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f33b406c3c0 0x7f33b406c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.141+0000 7f33b37fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f33b4162220 0x7f33b40b1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:58736/0 (socket says 172.21.15.22:58736) 2023-11-24T06:13:07.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.141+0000 7f33b37fe640 1 -- 172.21.15.22:0/2864189083 learned_addr learned my addr 172.21.15.22:0/2864189083 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:07.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.141+0000 7f33b2ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33b4162600 0x7f33b4162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.141+0000 7f33b3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f33b406c3c0 0x7f33b406c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45080/0 (socket says 172.21.15.22:45080) 2023-11-24T06:13:07.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.141+0000 7f33b3fff640 1 -- 172.21.15.22:0/2864189083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33b4162600 msgr2=0x7f33b4162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:07.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.141+0000 7f33b3fff640 1 --2- 172.21.15.22:0/2864189083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33b4162600 0x7f33b4162a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.141+0000 7f33b3fff640 1 -- 172.21.15.22:0/2864189083 >> v1:172.21.15.31:6789/0 conn(0x7f33b4162220 legacy=0x7f33b40b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.141+0000 7f33b3fff640 1 -- 172.21.15.22:0/2864189083 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4070c60 con 0x7f33b406c3c0 2023-11-24T06:13:07.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.142+0000 7f33b3fff640 1 --2- 172.21.15.22:0/2864189083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 0x7f33b406c850 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009d90 tx=0x7f33ac02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c568858d8cb5039 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:07.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.143+0000 7f33b27fc640 1 -- 172.21.15.22:0/2864189083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac02cc50 con 0x7f33b406c3c0 2023-11-24T06:13:07.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.143+0000 7f33b27fc640 1 -- 172.21.15.22:0/2864189083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac02cdb0 con 0x7f33b406c3c0 2023-11-24T06:13:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.143+0000 7f33b27fc640 1 -- 172.21.15.22:0/2864189083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac034660 con 0x7f33b406c3c0 2023-11-24T06:13:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.143+0000 7f33ba0e7640 1 -- 172.21.15.22:0/2864189083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 msgr2=0x7f33b406c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.143+0000 7f33ba0e7640 1 --2- 172.21.15.22:0/2864189083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 0x7f33b406c850 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009d90 tx=0x7f33ac02bea0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.144+0000 7f33ba0e7640 1 -- 172.21.15.22:0/2864189083 shutdown_connections 2023-11-24T06:13:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.144+0000 7f33ba0e7640 1 --2- 172.21.15.22:0/2864189083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 0x7f33b406c850 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.144+0000 7f33ba0e7640 1 --2- 172.21.15.22:0/2864189083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33b4162600 0x7f33b4162a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.144+0000 7f33ba0e7640 1 -- 172.21.15.22:0/2864189083 >> 172.21.15.22:0/2864189083 conn(0x7f33b40b0ba0 msgr2=0x7f33b40b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.144+0000 7f33ba0e7640 1 -- 172.21.15.22:0/2864189083 shutdown_connections 2023-11-24T06:13:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.144+0000 7f33ba0e7640 1 -- 172.21.15.22:0/2864189083 wait complete. 2023-11-24T06:13:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.146+0000 7f33ba0e7640 1 Processor -- start 2023-11-24T06:13:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.146+0000 7f33ba0e7640 1 -- start start 2023-11-24T06:13:07.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.147+0000 7f33ba0e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 0x7f33b41fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.147+0000 7f33ba0e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b4162220 0x7f33b40b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.147+0000 7f33ba0e7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33b4162600 0x7f33b41f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.147+0000 7f33ba0e7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40b3530 con 0x7f33b406c3c0 2023-11-24T06:13:07.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.147+0000 7f33ba0e7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b41fb790 con 0x7f33b4162220 2023-11-24T06:13:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.147+0000 7f33ba0e7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b41f74a0 con 0x7f33b4162600 2023-11-24T06:13:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.147+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 0x7f33b41fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.147+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 0x7f33b41fa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45086/0 (socket says 172.21.15.22:45086) 2023-11-24T06:13:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.147+0000 7f33b37fe640 1 -- 172.21.15.22:0/3957531453 learned_addr learned my addr 172.21.15.22:0/3957531453 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33b37fe640 1 -- 172.21.15.22:0/3957531453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33b4162600 msgr2=0x7f33b41f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33b37fe640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33b4162600 0x7f33b41f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33b37fe640 1 -- 172.21.15.22:0/3957531453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b4162220 msgr2=0x7f33b40b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33b37fe640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b4162220 0x7f33b40b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33b37fe640 1 -- 172.21.15.22:0/3957531453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac009a70 con 0x7f33b406c3c0 2023-11-24T06:13:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33b37fe640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 0x7f33b41fa7f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c4d0 tx=0x7f33a400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33abfff640 1 -- 172.21.15.22:0/3957531453 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4005ce0 con 0x7f33b406c3c0 2023-11-24T06:13:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33abfff640 1 -- 172.21.15.22:0/3957531453 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4005e40 con 0x7f33b406c3c0 2023-11-24T06:13:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33abfff640 1 -- 172.21.15.22:0/3957531453 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4007270 con 0x7f33b406c3c0 2023-11-24T06:13:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.148+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b41faef0 con 0x7f33b406c3c0 2023-11-24T06:13:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.149+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b41fb4b0 con 0x7f33b406c3c0 2023-11-24T06:13:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.150+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b409d200 con 0x7f33b406c3c0 2023-11-24T06:13:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.151+0000 7f33abfff640 1 -- 172.21.15.22:0/3957531453 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33a40073d0 con 0x7f33b406c3c0 2023-11-24T06:13:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.152+0000 7f33abfff640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f339406ae70 0x7f339406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.152+0000 7f33abfff640 1 -- 172.21.15.22:0/3957531453 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f33a4088ab0 con 0x7f33b406c3c0 2023-11-24T06:13:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.152+0000 7f33b2ffd640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f339406ae70 0x7f339406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.153+0000 7f33b2ffd640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f339406ae70 0x7f339406d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f33b41570c0 tx=0x7f339c0095a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:07.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.156+0000 7f33abfff640 1 -- 172.21.15.22:0/3957531453 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33a4057600 con 0x7f33b406c3c0 2023-11-24T06:13:07.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.349+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33b4161a40 con 0x7f33b406c3c0 2023-11-24T06:13:07.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.350+0000 7f33abfff640 1 -- 172.21.15.22:0/3957531453 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33a4017020 con 0x7f33b406c3c0 2023-11-24T06:13:07.353 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.352+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f339406ae70 msgr2=0x7f339406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f339406ae70 0x7f339406d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f33b41570c0 tx=0x7f339c0095a0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 msgr2=0x7f33b41fa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 0x7f33b41fa7f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c4d0 tx=0x7f33a400c990 comp rx=0 tx=0).stop 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 shutdown_connections 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f339406ae70 0x7f339406d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33b4162600 0x7f33b41f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b4162220 0x7f33b40b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 --2- 172.21.15.22:0/3957531453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33b406c3c0 0x7f33b41fa7f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 >> 172.21.15.22:0/3957531453 conn(0x7f33b40b0ba0 msgr2=0x7f33b40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 shutdown_connections 2023-11-24T06:13:07.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.353+0000 7f33ba0e7640 1 -- 172.21.15.22:0/3957531453 wait complete. 2023-11-24T06:13:07.374 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:07.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.597+0000 7f128c9b0640 1 Processor -- start 2023-11-24T06:13:07.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.597+0000 7f128c9b0640 1 -- start start 2023-11-24T06:13:07.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.599+0000 7f128c9b0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f128815b350 0x7f12880abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.599+0000 7f128c9b0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128815b730 con 0x7f12880adb60 2023-11-24T06:13:07.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.599+0000 7f128c9b0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12880ac740 con 0x7f128809cb30 2023-11-24T06:13:07.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.599+0000 7f128c9b0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12880ac460 con 0x7f128815b350 2023-11-24T06:13:07.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.599+0000 7f1286d9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f12880adb60 0x7f12880adf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50760/0 (socket says 172.21.15.22:50760) 2023-11-24T06:13:07.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.599+0000 7f1286d9d640 1 -- 172.21.15.22:0/4109023710 learned_addr learned my addr 172.21.15.22:0/4109023710 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:07.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f128659c640 1 --2- 172.21.15.22:0/4109023710 >> v2:172.21.15.31:3300/0 conn(0x7f128815b350 0x7f12880abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098523718 0 0) 0x7f1280001490 con 0x7f12880adb60 2023-11-24T06:13:07.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1274003520 con 0x7f12880adb60 2023-11-24T06:13:07.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2082119949 0 0) 0x7f1274003520 con 0x7f12880adb60 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 >> v2:172.21.15.31:3300/0 conn(0x7f128815b350 msgr2=0x7f12880abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f1285d9b640 1 --2- 172.21.15.22:0/4109023710 >> v2:172.21.15.31:3300/0 conn(0x7f128815b350 0x7f12880abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 >> v1:172.21.15.31:6789/0 conn(0x7f128809cb30 legacy=0x7f12880b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12880b2a50 con 0x7f12880adb60 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f1280001b80 con 0x7f12880adb60 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.600+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 >> v1:172.21.15.22:6789/0 conn(0x7f12880adb60 legacy=0x7f12880adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1285d9b640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12740039c0 0x7f1274003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1285d9b640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12740047c0 0x7f1274004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1285d9b640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1274005180 0x7f127400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12880ac460 con 0x7f1274005180 2023-11-24T06:13:07.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127400c080 con 0x7f12740039c0 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127400c240 con 0x7f12740047c0 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1286d9d640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1274005180 0x7f127400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f128659c640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12740039c0 0x7f1274003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f127ffff640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12740047c0 0x7f1274004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1286d9d640 1 -- 172.21.15.22:0/4109023710 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12740047c0 msgr2=0x7f1274004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1286d9d640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12740047c0 0x7f1274004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1286d9d640 1 -- 172.21.15.22:0/4109023710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12740039c0 msgr2=0x7f1274003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1286d9d640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12740039c0 0x7f1274003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f1286d9d640 1 -- 172.21.15.22:0/4109023710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274003520 con 0x7f1274005180 2023-11-24T06:13:07.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.601+0000 7f127ffff640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12740047c0 0x7f1274004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:07.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.602+0000 7f1286d9d640 1 -- 172.21.15.22:0/4109023710 reap_dead start 2023-11-24T06:13:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.603+0000 7f1286d9d640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1274005180 0x7f127400b980 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f128000a730 tx=0x7f12740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66db92f997afda5f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.603+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12800072d0 con 0x7f1274005180 2023-11-24T06:13:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.603+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128002f070 con 0x7f1274005180 2023-11-24T06:13:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.603+0000 7f1285d9b640 1 -- 172.21.15.22:0/4109023710 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12800076b0 con 0x7f1274005180 2023-11-24T06:13:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.603+0000 7f128c9b0640 1 -- 172.21.15.22:0/4109023710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1274005180 msgr2=0x7f127400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.603+0000 7f128c9b0640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1274005180 0x7f127400b980 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f128000a730 tx=0x7f12740057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.604+0000 7f128c9b0640 1 -- 172.21.15.22:0/4109023710 shutdown_connections 2023-11-24T06:13:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.604+0000 7f128c9b0640 1 --2- 172.21.15.22:0/4109023710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1274005180 0x7f127400b980 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.604+0000 7f128c9b0640 1 -- 172.21.15.22:0/4109023710 >> 172.21.15.22:0/4109023710 conn(0x7f12880b0ba0 msgr2=0x7f12880b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:07.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.604+0000 7f128c9b0640 1 -- 172.21.15.22:0/4109023710 shutdown_connections 2023-11-24T06:13:07.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.604+0000 7f128c9b0640 1 -- 172.21.15.22:0/4109023710 wait complete. 2023-11-24T06:13:07.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.605+0000 7f128c9b0640 1 Processor -- start 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.605+0000 7f128c9b0640 1 -- start start 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.606+0000 7f128c9b0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1274005180 0x7f1288146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.606+0000 7f128c9b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1288153c20 0x7f12881540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.606+0000 7f128c9b0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1288155d10 0x7f1288156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.606+0000 7f128c9b0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12881509b0 con 0x7f1288153c20 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.606+0000 7f128c9b0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288147070 con 0x7f1274005180 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.606+0000 7f128c9b0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128814ee80 con 0x7f1288155d10 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f127ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1288153c20 0x7f12881540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f127ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1288153c20 0x7f12881540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45108/0 (socket says 172.21.15.22:45108) 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f127ffff640 1 -- 172.21.15.22:0/2125841804 learned_addr learned my addr 172.21.15.22:0/2125841804 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:07.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f1286d9d640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1288155d10 0x7f1288156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f128659c640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1274005180 0x7f1288146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f127ffff640 1 -- 172.21.15.22:0/2125841804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1288155d10 msgr2=0x7f1288156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f127ffff640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1288155d10 0x7f1288156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f127ffff640 1 -- 172.21.15.22:0/2125841804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1274005180 msgr2=0x7f1288146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f127ffff640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1274005180 0x7f1288146b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f127ffff640 1 -- 172.21.15.22:0/2125841804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12881545e0 con 0x7f1288153c20 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.607+0000 7f127ffff640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1288153c20 0x7f12881540a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f127000d7a0 tx=0x7f127000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.608+0000 7f127effd640 1 -- 172.21.15.22:0/2125841804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270005270 con 0x7f1288153c20 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.608+0000 7f127effd640 1 -- 172.21.15.22:0/2125841804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12700053d0 con 0x7f1288153c20 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.608+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1288150050 con 0x7f1288153c20 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.608+0000 7f127effd640 1 -- 172.21.15.22:0/2125841804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000b890 con 0x7f1288153c20 2023-11-24T06:13:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.608+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12881502f0 con 0x7f1288153c20 2023-11-24T06:13:07.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.609+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1288150af0 con 0x7f1288153c20 2023-11-24T06:13:07.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.610+0000 7f127effd640 1 -- 172.21.15.22:0/2125841804 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f127000b9f0 con 0x7f1288153c20 2023-11-24T06:13:07.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.611+0000 7f127effd640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f126806ae40 0x7f126806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:07.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.611+0000 7f127effd640 1 -- 172.21.15.22:0/2125841804 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1270089490 con 0x7f1288153c20 2023-11-24T06:13:07.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.611+0000 7f128659c640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f126806ae40 0x7f126806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:07.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.612+0000 7f128659c640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f126806ae40 0x7f126806d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12780098d0 tx=0x7f1278008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:07.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.616+0000 7f127effd640 1 -- 172.21.15.22:0/2125841804 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1288150af0 con 0x7f1288153c20 2023-11-24T06:13:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.811+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12880ac740 con 0x7f1288153c20 2023-11-24T06:13:07.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.812+0000 7f127effd640 1 -- 172.21.15.22:0/2125841804 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12880ac740 con 0x7f1288153c20 2023-11-24T06:13:07.814 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:13:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f126806ae40 msgr2=0x7f126806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f126806ae40 0x7f126806d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12780098d0 tx=0x7f1278008040 comp rx=0 tx=0).stop 2023-11-24T06:13:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1288153c20 msgr2=0x7f12881540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1288153c20 0x7f12881540a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f127000d7a0 tx=0x7f127000dc60 comp rx=0 tx=0).stop 2023-11-24T06:13:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 shutdown_connections 2023-11-24T06:13:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f126806ae40 0x7f126806d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1288155d10 0x7f1288156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1288153c20 0x7f12881540a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 --2- 172.21.15.22:0/2125841804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1274005180 0x7f1288146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:07.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 >> 172.21.15.22:0/2125841804 conn(0x7f12880b0ba0 msgr2=0x7f1288071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:07.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 shutdown_connections 2023-11-24T06:13:07.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:07.814+0000 7f128c9b0640 1 -- 172.21.15.22:0/2125841804 wait complete. 2023-11-24T06:13:07.836 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:08.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.053+0000 7f3e7d14e640 1 Processor -- start 2023-11-24T06:13:08.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.053+0000 7f3e7d14e640 1 -- start start 2023-11-24T06:13:08.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.054+0000 7f3e7d14e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e7815d3b0 0x7f3e780ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.054+0000 7f3e7d14e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 0x7f3e780d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.054+0000 7f3e7d14e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e780d1bc0 0x7f3e780b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.054+0000 7f3e7d14e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780d2010 con 0x7f3e7815d3b0 2023-11-24T06:13:08.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.054+0000 7f3e7d14e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780c6bf0 con 0x7f3e780d1bc0 2023-11-24T06:13:08.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.054+0000 7f3e7d14e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780d1400 con 0x7f3e780d0fa0 2023-11-24T06:13:08.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.055+0000 7f3e77fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e7815d3b0 0x7f3e780ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.055+0000 7f3e77fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e7815d3b0 0x7f3e780ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45116/0 (socket says 172.21.15.22:45116) 2023-11-24T06:13:08.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.055+0000 7f3e77fff640 1 -- 172.21.15.22:0/3527888403 learned_addr learned my addr 172.21.15.22:0/3527888403 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:08.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.055+0000 7f3e7c94d640 1 --2- 172.21.15.22:0/3527888403 >> v2:172.21.15.31:3300/0 conn(0x7f3e780d1bc0 0x7f3e780b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.055+0000 7f3e777fe640 1 --2- 172.21.15.22:0/3527888403 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 0x7f3e780d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.056+0000 7f3e77fff640 1 -- 172.21.15.22:0/3527888403 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 msgr2=0x7f3e780d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:08.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.056+0000 7f3e77fff640 1 --2- 172.21.15.22:0/3527888403 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 0x7f3e780d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.056+0000 7f3e77fff640 1 -- 172.21.15.22:0/3527888403 >> v2:172.21.15.31:3300/0 conn(0x7f3e780d1bc0 msgr2=0x7f3e780b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:08.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.056+0000 7f3e77fff640 1 --2- 172.21.15.22:0/3527888403 >> v2:172.21.15.31:3300/0 conn(0x7f3e780d1bc0 0x7f3e780b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.056+0000 7f3e77fff640 1 -- 172.21.15.22:0/3527888403 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780cedc0 con 0x7f3e7815d3b0 2023-11-24T06:13:08.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.057+0000 7f3e77fff640 1 --2- 172.21.15.22:0/3527888403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7815d3b0 0x7f3e780ce6c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3e780cf310 tx=0x7f3e6802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e382d38c361585f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:08.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.057+0000 7f3e76ffd640 1 -- 172.21.15.22:0/3527888403 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6802c9e0 con 0x7f3e7815d3b0 2023-11-24T06:13:08.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.057+0000 7f3e76ffd640 1 -- 172.21.15.22:0/3527888403 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6802cb40 con 0x7f3e7815d3b0 2023-11-24T06:13:08.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.057+0000 7f3e76ffd640 1 -- 172.21.15.22:0/3527888403 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e680343f0 con 0x7f3e7815d3b0 2023-11-24T06:13:08.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.058+0000 7f3e7d14e640 1 -- 172.21.15.22:0/3527888403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7815d3b0 msgr2=0x7f3e780ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.058+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/3527888403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7815d3b0 0x7f3e780ce6c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3e780cf310 tx=0x7f3e6802be40 comp rx=0 tx=0).stop 2023-11-24T06:13:08.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.058+0000 7f3e7d14e640 1 -- 172.21.15.22:0/3527888403 shutdown_connections 2023-11-24T06:13:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.058+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/3527888403 >> v2:172.21.15.31:3300/0 conn(0x7f3e780d1bc0 0x7f3e780b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.058+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/3527888403 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 0x7f3e780d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.058+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/3527888403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7815d3b0 0x7f3e780ce6c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.058+0000 7f3e7d14e640 1 -- 172.21.15.22:0/3527888403 >> 172.21.15.22:0/3527888403 conn(0x7f3e780d30a0 msgr2=0x7f3e780d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.058+0000 7f3e7d14e640 1 -- 172.21.15.22:0/3527888403 shutdown_connections 2023-11-24T06:13:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.058+0000 7f3e7d14e640 1 -- 172.21.15.22:0/3527888403 wait complete. 2023-11-24T06:13:08.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.060+0000 7f3e7d14e640 1 Processor -- start 2023-11-24T06:13:08.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.060+0000 7f3e7d14e640 1 -- start start 2023-11-24T06:13:08.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.061+0000 7f3e7d14e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 0x7f3e7814e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.061+0000 7f3e7d14e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e780d1bc0 0x7f3e7809f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.061+0000 7f3e7d14e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e7815d3b0 0x7f3e7809cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.061+0000 7f3e7d14e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780a0060 con 0x7f3e780d1bc0 2023-11-24T06:13:08.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.061+0000 7f3e7d14e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780a0340 con 0x7f3e7815d3b0 2023-11-24T06:13:08.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.061+0000 7f3e7d14e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780a0620 con 0x7f3e780d0fa0 2023-11-24T06:13:08.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e780d1bc0 0x7f3e7809f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e780d1bc0 0x7f3e7809f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45126/0 (socket says 172.21.15.22:45126) 2023-11-24T06:13:08.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e777fe640 1 -- 172.21.15.22:0/2325416413 learned_addr learned my addr 172.21.15.22:0/2325416413 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:08.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e77fff640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 0x7f3e7814e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e7c94d640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e7815d3b0 0x7f3e7809cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e777fe640 1 -- 172.21.15.22:0/2325416413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 msgr2=0x7f3e7814e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e777fe640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 0x7f3e7814e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e777fe640 1 -- 172.21.15.22:0/2325416413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e7815d3b0 msgr2=0x7f3e7809cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e777fe640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e7815d3b0 0x7f3e7809cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e777fe640 1 -- 172.21.15.22:0/2325416413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e68009b30 con 0x7f3e780d1bc0 2023-11-24T06:13:08.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.062+0000 7f3e7c94d640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e7815d3b0 0x7f3e7809cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:08.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.063+0000 7f3e777fe640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e780d1bc0 0x7f3e7809f710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000d800 tx=0x7f3e6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:08.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.063+0000 7f3e74ff9640 1 -- 172.21.15.22:0/2325416413 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e600096a0 con 0x7f3e780d1bc0 2023-11-24T06:13:08.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.063+0000 7f3e74ff9640 1 -- 172.21.15.22:0/2325416413 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e60009800 con 0x7f3e780d1bc0 2023-11-24T06:13:08.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.063+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e780b62a0 con 0x7f3e780d1bc0 2023-11-24T06:13:08.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.063+0000 7f3e74ff9640 1 -- 172.21.15.22:0/2325416413 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60009990 con 0x7f3e780d1bc0 2023-11-24T06:13:08.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.063+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7809fc50 con 0x7f3e780d1bc0 2023-11-24T06:13:08.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.064+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7808d100 con 0x7f3e780d1bc0 2023-11-24T06:13:08.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.065+0000 7f3e74ff9640 1 -- 172.21.15.22:0/2325416413 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e60009af0 con 0x7f3e780d1bc0 2023-11-24T06:13:08.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.067+0000 7f3e74ff9640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e5806ae40 0x7f3e5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.067+0000 7f3e74ff9640 1 -- 172.21.15.22:0/2325416413 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3e60089bb0 con 0x7f3e780d1bc0 2023-11-24T06:13:08.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.067+0000 7f3e77fff640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e5806ae40 0x7f3e5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.068+0000 7f3e77fff640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e5806ae40 0x7f3e5806d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3e68035000 tx=0x7f3e68030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:08.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.071+0000 7f3e74ff9640 1 -- 172.21.15.22:0/2325416413 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e60054b30 con 0x7f3e780d1bc0 2023-11-24T06:13:08.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.266+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e7804e840 con 0x7f3e780d1bc0 2023-11-24T06:13:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.267+0000 7f3e74ff9640 1 -- 172.21.15.22:0/2325416413 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e60058150 con 0x7f3e780d1bc0 2023-11-24T06:13:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:13:08.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e5806ae40 msgr2=0x7f3e5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e5806ae40 0x7f3e5806d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3e68035000 tx=0x7f3e68030000 comp rx=0 tx=0).stop 2023-11-24T06:13:08.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e780d1bc0 msgr2=0x7f3e7809f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e780d1bc0 0x7f3e7809f710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000d800 tx=0x7f3e6000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 shutdown_connections 2023-11-24T06:13:08.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e5806ae40 0x7f3e5806d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e7815d3b0 0x7f3e7809cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e780d1bc0 0x7f3e7809f710 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 --2- 172.21.15.22:0/2325416413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e780d0fa0 0x7f3e7814e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.269+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 >> 172.21.15.22:0/2325416413 conn(0x7f3e780d30a0 msgr2=0x7f3e7806c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:08.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.270+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 shutdown_connections 2023-11-24T06:13:08.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.270+0000 7f3e7d14e640 1 -- 172.21.15.22:0/2325416413 wait complete. 2023-11-24T06:13:08.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:13:08.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.510+0000 7f8c2a589640 1 Processor -- start 2023-11-24T06:13:08.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.511+0000 7f8c2a589640 1 -- start start 2023-11-24T06:13:08.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.512+0000 7f8c2a589640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c2415b340 0x7f8c240abff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.512+0000 7f8c2a589640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c2406dc30 0x7f8c240b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.512+0000 7f8c2a589640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c240ac530 con 0x7f8c240cbcb0 2023-11-24T06:13:08.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.512+0000 7f8c2a589640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c240b2080 con 0x7f8c2415b340 2023-11-24T06:13:08.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.512+0000 7f8c2a589640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240b2360 con 0x7f8c2406dc30 2023-11-24T06:13:08.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.512+0000 7f8c1bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8c240cbcb0 0x7f8c2406d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50774/0 (socket says 172.21.15.22:50774) 2023-11-24T06:13:08.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.512+0000 7f8c1bfff640 1 -- 172.21.15.22:0/478363672 learned_addr learned my addr 172.21.15.22:0/478363672 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:08.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.512+0000 7f8c23fff640 1 --2- 172.21.15.22:0/478363672 >> v2:172.21.15.31:3300/0 conn(0x7f8c2415b340 0x7f8c240abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c28b26640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c2406dc30 0x7f8c240b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635472683 0 0) 0x7f8c240ac530 con 0x7f8c240cbcb0 2023-11-24T06:13:08.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c10003520 con 0x7f8c240cbcb0 2023-11-24T06:13:08.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3895829289 0 0) 0x7f8c10003520 con 0x7f8c240cbcb0 2023-11-24T06:13:08.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c2406dc30 msgr2=0x7f8c240b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:08.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c2406dc30 0x7f8c240b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 >> v2:172.21.15.31:3300/0 conn(0x7f8c2415b340 msgr2=0x7f8c240abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:08.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 --2- 172.21.15.22:0/478363672 >> v2:172.21.15.31:3300/0 conn(0x7f8c2415b340 0x7f8c240abff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c240b2640 con 0x7f8c240cbcb0 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f8c0c001670 con 0x7f8c240cbcb0 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 >> v1:172.21.15.22:6789/0 conn(0x7f8c240cbcb0 legacy=0x7f8c2406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c10003970 0x7f8c10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c2406dc30 0x7f8c100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c10004d00 0x7f8c10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240b2080 con 0x7f8c10004d00 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240b2360 con 0x7f8c10003970 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.513+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1000b980 con 0x7f8c2406dc30 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.514+0000 7f8c28b26640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c10004d00 0x7f8c10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.514+0000 7f8c23fff640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c10003970 0x7f8c10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.514+0000 7f8c1bfff640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c2406dc30 0x7f8c100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.514+0000 7f8c28b26640 1 -- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c2406dc30 msgr2=0x7f8c100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:08.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.514+0000 7f8c28b26640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c2406dc30 0x7f8c100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.514+0000 7f8c28b26640 1 -- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c10003970 msgr2=0x7f8c10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:08.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.514+0000 7f8c28b26640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c10003970 0x7f8c10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.514+0000 7f8c28b26640 1 -- 172.21.15.22:0/478363672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10003520 con 0x7f8c10004d00 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.515+0000 7f8c28b26640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c10004d00 0x7f8c10005180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009fc0 tx=0x7f8c100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5b80bfdb583476 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c02cbd0 con 0x7f8c10004d00 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00f040 con 0x7f8c10004d00 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c237fe640 1 -- 172.21.15.22:0/478363672 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c034440 con 0x7f8c10004d00 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c2a589640 1 -- 172.21.15.22:0/478363672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c10004d00 msgr2=0x7f8c10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c2a589640 1 --2- 172.21.15.22:0/478363672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c10004d00 0x7f8c10005180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009fc0 tx=0x7f8c100057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c28b26640 1 -- 172.21.15.22:0/478363672 reap_dead start 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c2a589640 1 -- 172.21.15.22:0/478363672 shutdown_connections 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c2a589640 1 -- 172.21.15.22:0/478363672 >> 172.21.15.22:0/478363672 conn(0x7f8c240b0d80 msgr2=0x7f8c240b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:08.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c2a589640 1 -- 172.21.15.22:0/478363672 shutdown_connections 2023-11-24T06:13:08.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.516+0000 7f8c2a589640 1 -- 172.21.15.22:0/478363672 wait complete. 2023-11-24T06:13:08.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.518+0000 7f8c2a589640 1 Processor -- start 2023-11-24T06:13:08.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.518+0000 7f8c2a589640 1 -- start start 2023-11-24T06:13:08.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.519+0000 7f8c2a589640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c10004d00 0x7f8c24142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.519+0000 7f8c2a589640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c241430e0 0x7f8c240cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.519+0000 7f8c2a589640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c240cd750 0x7f8c24158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.519+0000 7f8c2a589640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240cdbd0 con 0x7f8c240cd750 2023-11-24T06:13:08.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.519+0000 7f8c2a589640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24158e00 con 0x7f8c241430e0 2023-11-24T06:13:08.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.519+0000 7f8c2a589640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24144430 con 0x7f8c10004d00 2023-11-24T06:13:08.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c28b26640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c240cd750 0x7f8c24158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c28b26640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c240cd750 0x7f8c24158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45140/0 (socket says 172.21.15.22:45140) 2023-11-24T06:13:08.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c28b26640 1 -- 172.21.15.22:0/2186723524 learned_addr learned my addr 172.21.15.22:0/2186723524 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:08.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c1bfff640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c241430e0 0x7f8c240cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c23fff640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c10004d00 0x7f8c24142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c28b26640 1 -- 172.21.15.22:0/2186723524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c10004d00 msgr2=0x7f8c24142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c28b26640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c10004d00 0x7f8c24142ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c28b26640 1 -- 172.21.15.22:0/2186723524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c241430e0 msgr2=0x7f8c240cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c28b26640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c241430e0 0x7f8c240cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c28b26640 1 -- 172.21.15.22:0/2186723524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24143670 con 0x7f8c240cd750 2023-11-24T06:13:08.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.520+0000 7f8c1bfff640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c241430e0 0x7f8c240cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:08.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.521+0000 7f8c28b26640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c240cd750 0x7f8c24158040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c002230 tx=0x7f8c1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:08.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.521+0000 7f8c217fa640 1 -- 172.21.15.22:0/2186723524 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c003990 con 0x7f8c240cd750 2023-11-24T06:13:08.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.521+0000 7f8c217fa640 1 -- 172.21.15.22:0/2186723524 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c003af0 con 0x7f8c240cd750 2023-11-24T06:13:08.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.521+0000 7f8c217fa640 1 -- 172.21.15.22:0/2186723524 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c003ea0 con 0x7f8c240cd750 2023-11-24T06:13:08.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.521+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c24143950 con 0x7f8c240cd750 2023-11-24T06:13:08.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.521+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c24143f10 con 0x7f8c240cd750 2023-11-24T06:13:08.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.522+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2415f540 con 0x7f8c240cd750 2023-11-24T06:13:08.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.523+0000 7f8c217fa640 1 -- 172.21.15.22:0/2186723524 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c1c034940 con 0x7f8c240cd750 2023-11-24T06:13:08.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.524+0000 7f8c217fa640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8c0406ae40 0x7f8c0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:08.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.524+0000 7f8c217fa640 1 -- 172.21.15.22:0/2186723524 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8c1c0ab400 con 0x7f8c240cd750 2023-11-24T06:13:08.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.524+0000 7f8c23fff640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8c0406ae40 0x7f8c0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:08.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.525+0000 7f8c23fff640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8c0406ae40 0x7f8c0406d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009950 tx=0x7f8c14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:08.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.528+0000 7f8c217fa640 1 -- 172.21.15.22:0/2186723524 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c1c0765d0 con 0x7f8c240cd750 2023-11-24T06:13:08.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.738+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8c2406c490 con 0x7f8c240cd750 2023-11-24T06:13:08.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.739+0000 7f8c217fa640 1 -- 172.21.15.22:0/2186723524 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8c1c079bf0 con 0x7f8c240cd750 2023-11-24T06:13:08.741 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.741+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8c0406ae40 msgr2=0x7f8c0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.741+0000 7f8c2a589640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8c0406ae40 0x7f8c0406d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009950 tx=0x7f8c14008040 comp rx=0 tx=0).stop 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.741+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c240cd750 msgr2=0x7f8c24158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.741+0000 7f8c2a589640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c240cd750 0x7f8c24158040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c002230 tx=0x7f8c1c009750 comp rx=0 tx=0).stop 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.742+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 shutdown_connections 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.742+0000 7f8c2a589640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8c0406ae40 0x7f8c0406d300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.742+0000 7f8c2a589640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c240cd750 0x7f8c24158040 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.742+0000 7f8c2a589640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c241430e0 0x7f8c240cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.742+0000 7f8c2a589640 1 --2- 172.21.15.22:0/2186723524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c10004d00 0x7f8c24142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.742+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 >> 172.21.15.22:0/2186723524 conn(0x7f8c240b0d80 msgr2=0x7f8c24155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.742+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 shutdown_connections 2023-11-24T06:13:08.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:08.742+0000 7f8c2a589640 1 -- 172.21.15.22:0/2186723524 wait complete. 2023-11-24T06:13:08.764 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:13:08.764 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:08.830 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:09.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.061+0000 7f8a5ffff640 1 Processor -- start 2023-11-24T06:13:09.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.061+0000 7f8a5ffff640 1 -- start start 2023-11-24T06:13:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.063+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a60143570 0x7f8a600cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.063+0000 7f8a5ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a6015e6b0 0x7f8a600cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.063+0000 7f8a5ffff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a60071700 con 0x7f8a60143950 2023-11-24T06:13:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.063+0000 7f8a5ffff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6015b410 con 0x7f8a6015e6b0 2023-11-24T06:13:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.063+0000 7f8a5ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6015b130 con 0x7f8a60143570 2023-11-24T06:13:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.063+0000 7f8a5f7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a6015e6b0 0x7f8a600cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.063+0000 7f8a5f7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a6015e6b0 0x7f8a600cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45142/0 (socket says 172.21.15.22:45142) 2023-11-24T06:13:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.063+0000 7f8a5f7fe640 1 -- 172.21.15.22:0/2336999430 learned_addr learned my addr 172.21.15.22:0/2336999430 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.063+0000 7f8a5effd640 1 --2- 172.21.15.22:0/2336999430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a60143570 0x7f8a600cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.064+0000 7f8a5f7fe640 1 -- 172.21.15.22:0/2336999430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a60143570 msgr2=0x7f8a600cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:09.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.064+0000 7f8a5f7fe640 1 --2- 172.21.15.22:0/2336999430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a60143570 0x7f8a600cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.064+0000 7f8a5f7fe640 1 -- 172.21.15.22:0/2336999430 >> v1:172.21.15.31:6789/0 conn(0x7f8a60143950 legacy=0x7f8a6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:09.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.064+0000 7f8a5f7fe640 1 -- 172.21.15.22:0/2336999430 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6015dbd0 con 0x7f8a6015e6b0 2023-11-24T06:13:09.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.065+0000 7f8a5f7fe640 1 --2- 172.21.15.22:0/2336999430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a6015e6b0 0x7f8a600cf590 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009e50 tx=0x7f8a5802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdefd9e1440eec7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:09.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.065+0000 7f8a5e7fc640 1 -- 172.21.15.22:0/2336999430 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5802c9e0 con 0x7f8a6015e6b0 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.065+0000 7f8a5e7fc640 1 -- 172.21.15.22:0/2336999430 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5802cb40 con 0x7f8a6015e6b0 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.065+0000 7f8a5e7fc640 1 -- 172.21.15.22:0/2336999430 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580343f0 con 0x7f8a6015e6b0 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.066+0000 7f8a5ffff640 1 -- 172.21.15.22:0/2336999430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a6015e6b0 msgr2=0x7f8a600cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.066+0000 7f8a5ffff640 1 --2- 172.21.15.22:0/2336999430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a6015e6b0 0x7f8a600cf590 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009e50 tx=0x7f8a5802be40 comp rx=0 tx=0).stop 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.066+0000 7f8a5ffff640 1 -- 172.21.15.22:0/2336999430 shutdown_connections 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.066+0000 7f8a5ffff640 1 --2- 172.21.15.22:0/2336999430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a6015e6b0 0x7f8a600cf590 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.066+0000 7f8a5ffff640 1 --2- 172.21.15.22:0/2336999430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a60143570 0x7f8a600cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.066+0000 7f8a5ffff640 1 -- 172.21.15.22:0/2336999430 >> 172.21.15.22:0/2336999430 conn(0x7f8a6006a860 msgr2=0x7f8a6006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.066+0000 7f8a5ffff640 1 -- 172.21.15.22:0/2336999430 shutdown_connections 2023-11-24T06:13:09.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.066+0000 7f8a5ffff640 1 -- 172.21.15.22:0/2336999430 wait complete. 2023-11-24T06:13:09.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.068+0000 7f8a5ffff640 1 Processor -- start 2023-11-24T06:13:09.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.068+0000 7f8a5ffff640 1 -- start start 2023-11-24T06:13:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a60143570 0x7f8a601399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a60143950 0x7f8a6013b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a6015e6b0 0x7f8a6013b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a5ffff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6013cb70 con 0x7f8a60143950 2023-11-24T06:13:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a5ffff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6013dc90 con 0x7f8a6015e6b0 2023-11-24T06:13:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a5ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6013bef0 con 0x7f8a60143570 2023-11-24T06:13:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a567fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a60143950 0x7f8a6013b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a567fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a60143950 0x7f8a6013b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45144/0 (socket says 172.21.15.22:45144) 2023-11-24T06:13:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a567fc640 1 -- 172.21.15.22:0/3787191271 learned_addr learned my addr 172.21.15.22:0/3787191271 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a567fc640 1 -- 172.21.15.22:0/3787191271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a60143570 msgr2=0x7f8a601399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a567fc640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a60143570 0x7f8a601399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.069+0000 7f8a567fc640 1 -- 172.21.15.22:0/3787191271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a6015e6b0 msgr2=0x7f8a6013b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.070+0000 7f8a5f7fe640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a6015e6b0 0x7f8a6013b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.070+0000 7f8a567fc640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a6015e6b0 0x7f8a6013b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.070+0000 7f8a567fc640 1 -- 172.21.15.22:0/3787191271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58009b30 con 0x7f8a60143950 2023-11-24T06:13:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.070+0000 7f8a567fc640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a60143950 0x7f8a6013b3a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800b3c0 tx=0x7f8a4800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.070+0000 7f8a57fff640 1 -- 172.21.15.22:0/3787191271 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48011830 con 0x7f8a60143950 2023-11-24T06:13:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.070+0000 7f8a57fff640 1 -- 172.21.15.22:0/3787191271 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a48011990 con 0x7f8a60143950 2023-11-24T06:13:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.070+0000 7f8a57fff640 1 -- 172.21.15.22:0/3787191271 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48011d80 con 0x7f8a60143950 2023-11-24T06:13:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.070+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6013c1d0 con 0x7f8a60143950 2023-11-24T06:13:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.070+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6013c790 con 0x7f8a60143950 2023-11-24T06:13:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.071+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6013ce90 con 0x7f8a60143950 2023-11-24T06:13:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.072+0000 7f8a57fff640 1 -- 172.21.15.22:0/3787191271 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a4801b460 con 0x7f8a60143950 2023-11-24T06:13:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.073+0000 7f8a57fff640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8a4006ae40 0x7f8a4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.073+0000 7f8a57fff640 1 -- 172.21.15.22:0/3787191271 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8a480892b0 con 0x7f8a60143950 2023-11-24T06:13:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.074+0000 7f8a5effd640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8a4006ae40 0x7f8a4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.074+0000 7f8a5effd640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8a4006ae40 0x7f8a4006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000a810 tx=0x7f8a50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:09.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.078+0000 7f8a57fff640 1 -- 172.21.15.22:0/3787191271 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a6013ce90 con 0x7f8a60143950 2023-11-24T06:13:09.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.273+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a6013ce90 con 0x7f8a60143950 2023-11-24T06:13:09.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.275+0000 7f8a57fff640 1 -- 172.21.15.22:0/3787191271 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f8a6013ce90 con 0x7f8a60143950 2023-11-24T06:13:09.278 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:09.278 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8a4006ae40 msgr2=0x7f8a4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8a4006ae40 0x7f8a4006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000a810 tx=0x7f8a50008040 comp rx=0 tx=0).stop 2023-11-24T06:13:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a60143950 msgr2=0x7f8a6013b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a60143950 0x7f8a6013b3a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800b3c0 tx=0x7f8a4800b880 comp rx=0 tx=0).stop 2023-11-24T06:13:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 shutdown_connections 2023-11-24T06:13:09.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8a4006ae40 0x7f8a4006d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a6015e6b0 0x7f8a6013b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a60143950 0x7f8a6013b3a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 --2- 172.21.15.22:0/3787191271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a60143570 0x7f8a601399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.278+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 >> 172.21.15.22:0/3787191271 conn(0x7f8a6006a860 msgr2=0x7f8a6006ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:09.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.279+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 shutdown_connections 2023-11-24T06:13:09.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.279+0000 7f8a5ffff640 1 -- 172.21.15.22:0/3787191271 wait complete. 2023-11-24T06:13:09.300 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:09.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:09.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.514+0000 7f3ea3675640 1 Processor -- start 2023-11-24T06:13:09.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.514+0000 7f3ea3675640 1 -- start start 2023-11-24T06:13:09.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.516+0000 7f3ea3675640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e9c15b350 0x7f3e9c0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.516+0000 7f3ea3675640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9c15b730 con 0x7f3e9c0adb60 2023-11-24T06:13:09.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.516+0000 7f3ea3675640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9c0ac740 con 0x7f3e9c09cb30 2023-11-24T06:13:09.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.516+0000 7f3ea3675640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0ac460 con 0x7f3e9c15b350 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.516+0000 7f3ea1c12640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3e9c0adb60 0x7f3e9c0adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50778/0 (socket says 172.21.15.22:50778) 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.516+0000 7f3ea1c12640 1 -- 172.21.15.22:0/618839657 learned_addr learned my addr 172.21.15.22:0/618839657 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3ea1411640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e9c15b350 0x7f3e9c0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062681857 0 0) 0x7f3e94001490 con 0x7f3e9c0adb60 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e88003520 con 0x7f3e9c0adb60 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732699839 0 0) 0x7f3e90001110 con 0x7f3e9c09cb30 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e94001490 con 0x7f3e9c09cb30 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2674012135 0 0) 0x7f3e88003520 con 0x7f3e9c0adb60 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e9c15b350 msgr2=0x7f3e9c0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:09.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e9c15b350 0x7f3e9c0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 >> v1:172.21.15.31:6789/0 conn(0x7f3e9c09cb30 legacy=0x7f3e9c0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c0b2a50 con 0x7f3e9c0adb60 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f3e94001b80 con 0x7f3e9c0adb60 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.517+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 >> v1:172.21.15.22:6789/0 conn(0x7f3e9c0adb60 legacy=0x7f3e9c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.518+0000 7f3e8ffff640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e88003b30 0x7f3e88003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.518+0000 7f3e8ffff640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e880047c0 0x7f3e88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.518+0000 7f3e8ffff640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e88005180 0x7f3e8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.518+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0ac460 con 0x7f3e88005180 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.518+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8800bfa0 con 0x7f3e880047c0 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.518+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8800c160 con 0x7f3e88003b30 2023-11-24T06:13:09.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.518+0000 7f3ea1c12640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e88005180 0x7f3e8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.518+0000 7f3ea1411640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e88003b30 0x7f3e88003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.518+0000 7f3ea0c10640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e880047c0 0x7f3e88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.519+0000 7f3ea1c12640 1 -- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e88003b30 msgr2=0x7f3e88003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:09.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.519+0000 7f3ea1c12640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e88003b30 0x7f3e88003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.519+0000 7f3ea1c12640 1 -- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e880047c0 msgr2=0x7f3e88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:09.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.519+0000 7f3ea1c12640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e880047c0 0x7f3e88004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.519+0000 7f3ea1c12640 1 -- 172.21.15.22:0/618839657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e88003520 con 0x7f3e88005180 2023-11-24T06:13:09.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.520+0000 7f3ea1c12640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e88005180 0x7f3e8800b980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400a6f0 tx=0x7f3e880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9262f982f64c8a91 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:09.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.520+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e940072d0 con 0x7f3e88005180 2023-11-24T06:13:09.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.520+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9402f070 con 0x7f3e88005180 2023-11-24T06:13:09.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.520+0000 7f3e8ffff640 1 -- 172.21.15.22:0/618839657 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e940076b0 con 0x7f3e88005180 2023-11-24T06:13:09.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.521+0000 7f3ea3675640 1 -- 172.21.15.22:0/618839657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e88005180 msgr2=0x7f3e8800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.521+0000 7f3ea3675640 1 --2- 172.21.15.22:0/618839657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e88005180 0x7f3e8800b980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400a6f0 tx=0x7f3e880057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.521+0000 7f3ea1c12640 1 -- 172.21.15.22:0/618839657 reap_dead start 2023-11-24T06:13:09.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.521+0000 7f3ea3675640 1 -- 172.21.15.22:0/618839657 shutdown_connections 2023-11-24T06:13:09.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.521+0000 7f3ea3675640 1 -- 172.21.15.22:0/618839657 >> 172.21.15.22:0/618839657 conn(0x7f3e9c0b0ba0 msgr2=0x7f3e9c0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:09.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.521+0000 7f3ea3675640 1 -- 172.21.15.22:0/618839657 shutdown_connections 2023-11-24T06:13:09.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.521+0000 7f3ea3675640 1 -- 172.21.15.22:0/618839657 wait complete. 2023-11-24T06:13:09.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.523+0000 7f3ea3675640 1 Processor -- start 2023-11-24T06:13:09.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.523+0000 7f3ea3675640 1 -- start start 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.524+0000 7f3ea3675640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e88005180 0x7f3e9c14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.524+0000 7f3ea3675640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e9c14fc00 0x7f3e9c150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.524+0000 7f3ea3675640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e9c1598c0 0x7f3e9c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.524+0000 7f3ea3675640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c15a280 con 0x7f3e9c14fc00 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.524+0000 7f3ea3675640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c1f7850 con 0x7f3e9c1598c0 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.524+0000 7f3ea3675640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c14c300 con 0x7f3e88005180 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.524+0000 7f3ea0c10640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e9c14fc00 0x7f3e9c150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea0c10640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e9c14fc00 0x7f3e9c150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45158/0 (socket says 172.21.15.22:45158) 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea0c10640 1 -- 172.21.15.22:0/2152300550 learned_addr learned my addr 172.21.15.22:0/2152300550 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea1c12640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e9c1598c0 0x7f3e9c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea1411640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e88005180 0x7f3e9c14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea0c10640 1 -- 172.21.15.22:0/2152300550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e88005180 msgr2=0x7f3e9c14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea0c10640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e88005180 0x7f3e9c14bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea0c10640 1 -- 172.21.15.22:0/2152300550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e9c1598c0 msgr2=0x7f3e9c159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea0c10640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e9c1598c0 0x7f3e9c159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea0c10640 1 -- 172.21.15.22:0/2152300550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c1f6ad0 con 0x7f3e9c14fc00 2023-11-24T06:13:09.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.525+0000 7f3ea0c10640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e9c14fc00 0x7f3e9c150590 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000f7d0 tx=0x7f3e9000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:09.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.526+0000 7f3e8dffb640 1 -- 172.21.15.22:0/2152300550 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000fe80 con 0x7f3e9c14fc00 2023-11-24T06:13:09.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.526+0000 7f3e8dffb640 1 -- 172.21.15.22:0/2152300550 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e900052e0 con 0x7f3e9c14fc00 2023-11-24T06:13:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.526+0000 7f3e8dffb640 1 -- 172.21.15.22:0/2152300550 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000d910 con 0x7f3e9c14fc00 2023-11-24T06:13:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.526+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9c150ad0 con 0x7f3e9c14fc00 2023-11-24T06:13:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.526+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c1f6d70 con 0x7f3e9c14fc00 2023-11-24T06:13:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.527+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9c09d200 con 0x7f3e9c14fc00 2023-11-24T06:13:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.528+0000 7f3e8dffb640 1 -- 172.21.15.22:0/2152300550 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e9000da70 con 0x7f3e9c14fc00 2023-11-24T06:13:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.529+0000 7f3e8dffb640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e8006ae70 0x7f3e8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.529+0000 7f3e8dffb640 1 -- 172.21.15.22:0/2152300550 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3e900894e0 con 0x7f3e9c14fc00 2023-11-24T06:13:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.529+0000 7f3ea1411640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e8006ae70 0x7f3e8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.530+0000 7f3ea1411640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e8006ae70 0x7f3e8006d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c1f6890 tx=0x7f3e98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:09.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.534+0000 7f3e8dffb640 1 -- 172.21.15.22:0/2152300550 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e90054590 con 0x7f3e9c14fc00 2023-11-24T06:13:09.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.727+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e9c0ac740 con 0x7f3e9c14fc00 2023-11-24T06:13:09.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.728+0000 7f3e8dffb640 1 -- 172.21.15.22:0/2152300550 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e9c0ac740 con 0x7f3e9c14fc00 2023-11-24T06:13:09.731 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:13:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.730+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e8006ae70 msgr2=0x7f3e8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.730+0000 7f3ea3675640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e8006ae70 0x7f3e8006d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c1f6890 tx=0x7f3e98008040 comp rx=0 tx=0).stop 2023-11-24T06:13:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.730+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e9c14fc00 msgr2=0x7f3e9c150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.730+0000 7f3ea3675640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e9c14fc00 0x7f3e9c150590 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000f7d0 tx=0x7f3e9000fc90 comp rx=0 tx=0).stop 2023-11-24T06:13:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.731+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 shutdown_connections 2023-11-24T06:13:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.731+0000 7f3ea3675640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3e8006ae70 0x7f3e8006d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.731+0000 7f3ea3675640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e9c1598c0 0x7f3e9c159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.731+0000 7f3ea3675640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e9c14fc00 0x7f3e9c150590 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.731+0000 7f3ea3675640 1 --2- 172.21.15.22:0/2152300550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e88005180 0x7f3e9c14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.731+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 >> 172.21.15.22:0/2152300550 conn(0x7f3e9c0b0ba0 msgr2=0x7f3e9c0b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:09.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.731+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 shutdown_connections 2023-11-24T06:13:09.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.731+0000 7f3ea3675640 1 -- 172.21.15.22:0/2152300550 wait complete. 2023-11-24T06:13:09.752 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:09.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.974+0000 7fb700a13640 1 Processor -- start 2023-11-24T06:13:09.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.974+0000 7fb700a13640 1 -- start start 2023-11-24T06:13:09.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.975+0000 7fb700a13640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6fc0d1d90 0x7fb6fc0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.975+0000 7fb700a13640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6fc0c6bf0 con 0x7fb6fc0d0fa0 2023-11-24T06:13:09.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.975+0000 7fb700a13640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6fc0d13d0 con 0x7fb6fc15d3b0 2023-11-24T06:13:09.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.975+0000 7fb700a13640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0cedc0 con 0x7fb6fc0d1d90 2023-11-24T06:13:09.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.976+0000 7fb6fbfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb6fc0d0fa0 0x7fb6fc0b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50784/0 (socket says 172.21.15.22:50784) 2023-11-24T06:13:09.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.976+0000 7fb6fbfff640 1 -- 172.21.15.22:0/3093539877 learned_addr learned my addr 172.21.15.22:0/3093539877 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:09.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.976+0000 7fb6faffd640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6fc0d1d90 0x7fb6fc0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609093052 0 0) 0x7fb6fc0c6bf0 con 0x7fb6fc0d0fa0 2023-11-24T06:13:09.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e8003520 con 0x7fb6fc0d0fa0 2023-11-24T06:13:09.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670994584 0 0) 0x7fb6fc0d13d0 con 0x7fb6fc15d3b0 2023-11-24T06:13:09.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6fc0c6bf0 con 0x7fb6fc15d3b0 2023-11-24T06:13:09.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148022584 0 0) 0x7fb6e8003520 con 0x7fb6fc0d0fa0 2023-11-24T06:13:09.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6fc0d1d90 msgr2=0x7fb6fc0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6fc0d1d90 0x7fb6fc0ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 >> v1:172.21.15.31:6789/0 conn(0x7fb6fc15d3b0 legacy=0x7fb6fc0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc0c6e40 con 0x7fb6fc0d0fa0 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fb6f4001670 con 0x7fb6fc0d0fa0 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 >> v1:172.21.15.22:6789/0 conn(0x7fb6fc0d0fa0 legacy=0x7fb6fc0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6fc0d1d90 0x7fb6e8003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6e8004150 0x7fb6e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e8004d00 0x7fb6e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0cedc0 con 0x7fb6e8004d00 2023-11-24T06:13:09.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e800bbc0 con 0x7fb6e8004150 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.977+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e800bd80 con 0x7fb6fc0d1d90 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.978+0000 7fb6fbfff640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e8004d00 0x7fb6e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.978+0000 7fb6fb7fe640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6fc0d1d90 0x7fb6e8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.978+0000 7fb6faffd640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6e8004150 0x7fb6e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.978+0000 7fb6fbfff640 1 -- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6fc0d1d90 msgr2=0x7fb6e8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.978+0000 7fb6fbfff640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6fc0d1d90 0x7fb6e8003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.978+0000 7fb6fbfff640 1 -- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6e8004150 msgr2=0x7fb6e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.978+0000 7fb6fbfff640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6e8004150 0x7fb6e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.978+0000 7fb6fbfff640 1 -- 172.21.15.22:0/3093539877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e8003520 con 0x7fb6e8004d00 2023-11-24T06:13:09.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.978+0000 7fb6fb7fe640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6fc0d1d90 0x7fb6e8003ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.979+0000 7fb6fbfff640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e8004d00 0x7fb6e8005180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4007f90 tx=0x7fb6e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98261a71fa8e6290 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.979+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4005ad0 con 0x7fb6e8004d00 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.979+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f4005c30 con 0x7fb6e8004d00 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.979+0000 7fb6fa7fc640 1 -- 172.21.15.22:0/3093539877 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f402c9b0 con 0x7fb6e8004d00 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.980+0000 7fb700a13640 1 -- 172.21.15.22:0/3093539877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e8004d00 msgr2=0x7fb6e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.980+0000 7fb700a13640 1 --2- 172.21.15.22:0/3093539877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e8004d00 0x7fb6e8005180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4007f90 tx=0x7fb6e80057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.980+0000 7fb6fbfff640 1 -- 172.21.15.22:0/3093539877 reap_dead start 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.980+0000 7fb700a13640 1 -- 172.21.15.22:0/3093539877 shutdown_connections 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.980+0000 7fb700a13640 1 -- 172.21.15.22:0/3093539877 >> 172.21.15.22:0/3093539877 conn(0x7fb6fc0d30a0 msgr2=0x7fb6fc0d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.980+0000 7fb700a13640 1 -- 172.21.15.22:0/3093539877 shutdown_connections 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.980+0000 7fb700a13640 1 -- 172.21.15.22:0/3093539877 wait complete. 2023-11-24T06:13:09.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.982+0000 7fb700a13640 1 Processor -- start 2023-11-24T06:13:09.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.982+0000 7fb700a13640 1 -- start start 2023-11-24T06:13:09.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.983+0000 7fb700a13640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8004d00 0x7fb6fc0a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.983+0000 7fb700a13640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0a0b20 0x7fb6fc0b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.983+0000 7fb700a13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc0b7c00 0x7fb6fc0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.983+0000 7fb700a13640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc146910 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.983+0000 7fb700a13640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0b8110 con 0x7fb6fc0b7c00 2023-11-24T06:13:09.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.983+0000 7fb700a13640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0b83f0 con 0x7fb6e8004d00 2023-11-24T06:13:09.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.983+0000 7fb6faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0a0b20 0x7fb6fc0b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.983+0000 7fb6faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0a0b20 0x7fb6fc0b76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45176/0 (socket says 172.21.15.22:45176) 2023-11-24T06:13:09.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.983+0000 7fb6faffd640 1 -- 172.21.15.22:0/500862257 learned_addr learned my addr 172.21.15.22:0/500862257 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:09.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6fb7fe640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8004d00 0x7fb6fc0a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6fbfff640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc0b7c00 0x7fb6fc0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6faffd640 1 -- 172.21.15.22:0/500862257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8004d00 msgr2=0x7fb6fc0a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6faffd640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8004d00 0x7fb6fc0a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6faffd640 1 -- 172.21.15.22:0/500862257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc0b7c00 msgr2=0x7fb6fc0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:09.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6faffd640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc0b7c00 0x7fb6fc0cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:09.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6faffd640 1 -- 172.21.15.22:0/500862257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc1465a0 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6faffd640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0a0b20 0x7fb6fc0b76c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4011600 tx=0x7fb6e4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:09.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6f3fff640 1 -- 172.21.15.22:0/500862257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e400f920 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6f3fff640 1 -- 172.21.15.22:0/500862257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e400fa80 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.984+0000 7fb6f3fff640 1 -- 172.21.15.22:0/500862257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e400fdf0 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.985+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6fc15ac40 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.985+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6fc0cd140 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.986+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6fc146a80 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.987+0000 7fb6f3fff640 1 -- 172.21.15.22:0/500862257 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6e4015460 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.988+0000 7fb6f3fff640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6dc06ae70 0x7fb6dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:09.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.988+0000 7fb6f3fff640 1 -- 172.21.15.22:0/500862257 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb6e4089b70 con 0x7fb6fc0a0b20 2023-11-24T06:13:09.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.988+0000 7fb6fb7fe640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6dc06ae70 0x7fb6dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:09.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.989+0000 7fb6fb7fe640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6dc06ae70 0x7fb6dc06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0012e0 tx=0x7fb6ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:09.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:09.992+0000 7fb6f3fff640 1 -- 172.21.15.22:0/500862257 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6e4054b70 con 0x7fb6fc0a0b20 2023-11-24T06:13:10.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.178+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6fc04e840 con 0x7fb6fc0a0b20 2023-11-24T06:13:10.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.179+0000 7fb6f3fff640 1 -- 172.21.15.22:0/500862257 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6e4022020 con 0x7fb6fc0a0b20 2023-11-24T06:13:10.182 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:13:10.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6dc06ae70 msgr2=0x7fb6dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6dc06ae70 0x7fb6dc06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0012e0 tx=0x7fb6ec009040 comp rx=0 tx=0).stop 2023-11-24T06:13:10.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0a0b20 msgr2=0x7fb6fc0b76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0a0b20 0x7fb6fc0b76c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4011600 tx=0x7fb6e4011ac0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 shutdown_connections 2023-11-24T06:13:10.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6dc06ae70 0x7fb6dc06d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc0b7c00 0x7fb6fc0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0a0b20 0x7fb6fc0b76c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 --2- 172.21.15.22:0/500862257 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6e8004d00 0x7fb6fc0a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 >> 172.21.15.22:0/500862257 conn(0x7fb6fc0d30a0 msgr2=0x7fb6fc0c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:10.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 shutdown_connections 2023-11-24T06:13:10.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.181+0000 7fb700a13640 1 -- 172.21.15.22:0/500862257 wait complete. 2023-11-24T06:13:10.202 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:10.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.428+0000 7f749f59e640 1 Processor -- start 2023-11-24T06:13:10.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.428+0000 7f749f59e640 1 -- start start 2023-11-24T06:13:10.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.430+0000 7f749f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a00ad450 0x7f74a0154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.430+0000 7f749f59e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a00ce650 con 0x7f74a0070850 2023-11-24T06:13:10.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.430+0000 7f749f59e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a015e0a0 con 0x7f74a0153ea0 2023-11-24T06:13:10.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.430+0000 7f749f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a01547c0 con 0x7f74a00ad450 2023-11-24T06:13:10.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.430+0000 7f749ed9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f74a0070850 0x7f74a0071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50790/0 (socket says 172.21.15.22:50790) 2023-11-24T06:13:10.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.430+0000 7f749ed9d640 1 -- 172.21.15.22:0/2198500458 learned_addr learned my addr 172.21.15.22:0/2198500458 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:10.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.430+0000 7f7497fff640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a00ad450 0x7f74a0154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019007840 0 0) 0x7f74a00ce650 con 0x7f74a0070850 2023-11-24T06:13:10.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f748c003520 con 0x7f74a0070850 2023-11-24T06:13:10.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407097422 0 0) 0x7f74a015e0a0 con 0x7f74a0153ea0 2023-11-24T06:13:10.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a00ce650 con 0x7f74a0153ea0 2023-11-24T06:13:10.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3581149748 0 0) 0x7f748c003520 con 0x7f74a0070850 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a00ad450 msgr2=0x7f74a0154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a00ad450 0x7f74a0154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 >> v1:172.21.15.31:6789/0 conn(0x7f74a0153ea0 legacy=0x7f74a015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a015e380 con 0x7f74a0070850 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f74980019f0 con 0x7f74a0070850 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 >> v1:172.21.15.22:6789/0 conn(0x7f74a0070850 legacy=0x7f74a0071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a00ad450 0x7f748c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.431+0000 7f749dd9b640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f748c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f749dd9b640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f748c004d00 0x7f748c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a01547c0 con 0x7f748c004100 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c00bac0 con 0x7f748c004d00 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c00bc80 con 0x7f74a00ad450 2023-11-24T06:13:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f7497fff640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f748c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f749e59c640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a00ad450 0x7f748c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f749ed9d640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f748c004d00 0x7f748c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f7497fff640 1 -- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a00ad450 msgr2=0x7f748c003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:10.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f7497fff640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a00ad450 0x7f748c003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f7497fff640 1 -- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f748c004d00 msgr2=0x7f748c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:10.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f7497fff640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f748c004d00 0x7f748c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.432+0000 7f7497fff640 1 -- 172.21.15.22:0/2198500458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c003520 con 0x7f748c004100 2023-11-24T06:13:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.433+0000 7f7497fff640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f748c0047c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7488009ac0 tx=0x7f748c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24c425c5003ec71 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.434+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748802c600 con 0x7f748c004100 2023-11-24T06:13:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.434+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748802c760 con 0x7f748c004100 2023-11-24T06:13:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.434+0000 7f749dd9b640 1 -- 172.21.15.22:0/2198500458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748802caf0 con 0x7f748c004100 2023-11-24T06:13:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.434+0000 7f749f59e640 1 -- 172.21.15.22:0/2198500458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 msgr2=0x7f748c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.434+0000 7f749f59e640 1 --2- 172.21.15.22:0/2198500458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f748c0047c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7488009ac0 tx=0x7f748c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.434+0000 7f749ed9d640 1 -- 172.21.15.22:0/2198500458 reap_dead start 2023-11-24T06:13:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.435+0000 7f749f59e640 1 -- 172.21.15.22:0/2198500458 shutdown_connections 2023-11-24T06:13:10.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.435+0000 7f749f59e640 1 -- 172.21.15.22:0/2198500458 >> 172.21.15.22:0/2198500458 conn(0x7f74a00cec10 msgr2=0x7f74a00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:10.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.435+0000 7f749f59e640 1 -- 172.21.15.22:0/2198500458 shutdown_connections 2023-11-24T06:13:10.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.435+0000 7f749f59e640 1 -- 172.21.15.22:0/2198500458 wait complete. 2023-11-24T06:13:10.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.436+0000 7f749f59e640 1 Processor -- start 2023-11-24T06:13:10.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.437+0000 7f749f59e640 1 -- start start 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.437+0000 7f749f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f74a00b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.437+0000 7f749f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a0156d40 0x7f74a00ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749f59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a01571a0 0x7f74a00aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749f59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00b1080 con 0x7f748c004100 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749f59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00af380 con 0x7f74a0156d40 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749f59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00af660 con 0x7f74a01571a0 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f74a00b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f74a00b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45196/0 (socket says 172.21.15.22:45196) 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749e59c640 1 -- 172.21.15.22:0/1001887463 learned_addr learned my addr 172.21.15.22:0/1001887463 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749e59c640 1 -- 172.21.15.22:0/1001887463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a01571a0 msgr2=0x7f74a00aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749e59c640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a01571a0 0x7f74a00aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749e59c640 1 -- 172.21.15.22:0/1001887463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a0156d40 msgr2=0x7f74a00ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749e59c640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a0156d40 0x7f74a00ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.438+0000 7f749e59c640 1 -- 172.21.15.22:0/1001887463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a00b0060 con 0x7f748c004100 2023-11-24T06:13:10.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.439+0000 7f749e59c640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f74a00b0b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f749000e7b0 tx=0x7f749000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.439+0000 7f7496ffd640 1 -- 172.21.15.22:0/1001887463 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000ee60 con 0x7f748c004100 2023-11-24T06:13:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.439+0000 7f7496ffd640 1 -- 172.21.15.22:0/1001887463 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74900052e0 con 0x7f748c004100 2023-11-24T06:13:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.439+0000 7f7496ffd640 1 -- 172.21.15.22:0/1001887463 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000c6c0 con 0x7f748c004100 2023-11-24T06:13:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.439+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a00b0340 con 0x7f748c004100 2023-11-24T06:13:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.439+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a014d6a0 con 0x7f748c004100 2023-11-24T06:13:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.440+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a00b3af0 con 0x7f748c004100 2023-11-24T06:13:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.441+0000 7f7496ffd640 1 -- 172.21.15.22:0/1001887463 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f749000c820 con 0x7f748c004100 2023-11-24T06:13:10.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.442+0000 7f7496ffd640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f748006ae40 0x7f748006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.442+0000 7f7496ffd640 1 -- 172.21.15.22:0/1001887463 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7490089600 con 0x7f748c004100 2023-11-24T06:13:10.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.442+0000 7f7497fff640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f748006ae40 0x7f748006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.443+0000 7f7497fff640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f748006ae40 0x7f748006d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7488036000 tx=0x7f748802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:10.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.447+0000 7f7496ffd640 1 -- 172.21.15.22:0/1001887463 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7490054610 con 0x7f748c004100 2023-11-24T06:13:10.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.643+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74a00ad8b0 con 0x7f748c004100 2023-11-24T06:13:10.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.644+0000 7f7496ffd640 1 -- 172.21.15.22:0/1001887463 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7490057c30 con 0x7f748c004100 2023-11-24T06:13:10.647 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.646+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f748006ae40 msgr2=0x7f748006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.646+0000 7f749f59e640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f748006ae40 0x7f748006d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7488036000 tx=0x7f748802e000 comp rx=0 tx=0).stop 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 msgr2=0x7f74a00b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f74a00b0b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f749000e7b0 tx=0x7f749000ec70 comp rx=0 tx=0).stop 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 shutdown_connections 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f748006ae40 0x7f748006d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74a01571a0 0x7f74a00aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74a0156d40 0x7f74a00ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 --2- 172.21.15.22:0/1001887463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f748c004100 0x7f74a00b0b40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 >> 172.21.15.22:0/1001887463 conn(0x7f74a00cec10 msgr2=0x7f74a006c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 shutdown_connections 2023-11-24T06:13:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.647+0000 7f749f59e640 1 -- 172.21.15.22:0/1001887463 wait complete. 2023-11-24T06:13:10.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:13:10.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.887+0000 7f491f7ec640 1 Processor -- start 2023-11-24T06:13:10.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.887+0000 7f491f7ec640 1 -- start start 2023-11-24T06:13:10.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.888+0000 7f491f7ec640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4918072150 0x7f49180abff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.888+0000 7f491f7ec640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49180ac530 con 0x7f49180b39a0 2023-11-24T06:13:10.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.888+0000 7f491f7ec640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49180725c0 con 0x7f491815a090 2023-11-24T06:13:10.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.888+0000 7f491f7ec640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49180ac760 con 0x7f4918072150 2023-11-24T06:13:10.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.889+0000 7f491cd87640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f49180b39a0 0x7f491806d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50792/0 (socket says 172.21.15.22:50792) 2023-11-24T06:13:10.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.889+0000 7f491dd89640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4918072150 0x7f49180abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.889+0000 7f491cd87640 1 -- 172.21.15.22:0/4138072265 learned_addr learned my addr 172.21.15.22:0/4138072265 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:10.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.889+0000 7f491dd89640 1 -- 172.21.15.22:0/4138072265 >> v1:172.21.15.31:6789/0 conn(0x7f491815a090 legacy=0x7f49180b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:10.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.889+0000 7f491dd89640 1 -- 172.21.15.22:0/4138072265 >> v1:172.21.15.22:6789/0 conn(0x7f49180b39a0 legacy=0x7f491806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.889+0000 7f491dd89640 1 -- 172.21.15.22:0/4138072265 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491815a7f0 con 0x7f4918072150 2023-11-24T06:13:10.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.890+0000 7f491dd89640 1 --2- 172.21.15.22:0/4138072265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4918072150 0x7f49180abff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4910009d90 tx=0x7f491002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd950f635409f8f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:10.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.890+0000 7f490ffff640 1 -- 172.21.15.22:0/4138072265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491002cc60 con 0x7f4918072150 2023-11-24T06:13:10.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.890+0000 7f490ffff640 1 -- 172.21.15.22:0/4138072265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491002cdc0 con 0x7f4918072150 2023-11-24T06:13:10.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.891+0000 7f490ffff640 1 -- 172.21.15.22:0/4138072265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910034660 con 0x7f4918072150 2023-11-24T06:13:10.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.891+0000 7f491f7ec640 1 -- 172.21.15.22:0/4138072265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4918072150 msgr2=0x7f49180abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.891+0000 7f491f7ec640 1 --2- 172.21.15.22:0/4138072265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4918072150 0x7f49180abff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4910009d90 tx=0x7f491002beb0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.891+0000 7f491f7ec640 1 -- 172.21.15.22:0/4138072265 shutdown_connections 2023-11-24T06:13:10.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.891+0000 7f491f7ec640 1 --2- 172.21.15.22:0/4138072265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4918072150 0x7f49180abff0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.891+0000 7f491f7ec640 1 -- 172.21.15.22:0/4138072265 >> 172.21.15.22:0/4138072265 conn(0x7f49180b0d80 msgr2=0x7f49180b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:10.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.891+0000 7f491f7ec640 1 -- 172.21.15.22:0/4138072265 shutdown_connections 2023-11-24T06:13:10.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.891+0000 7f491f7ec640 1 -- 172.21.15.22:0/4138072265 wait complete. 2023-11-24T06:13:10.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.893+0000 7f491f7ec640 1 Processor -- start 2023-11-24T06:13:10.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.893+0000 7f491f7ec640 1 -- start start 2023-11-24T06:13:10.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.894+0000 7f491f7ec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4918072150 0x7f491814ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.894+0000 7f491f7ec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49180b39a0 0x7f491813a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.894+0000 7f491f7ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f491815a090 0x7f49181f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.894+0000 7f491f7ec640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4918153370 con 0x7f49180b39a0 2023-11-24T06:13:10.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.894+0000 7f491f7ec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4918153650 con 0x7f491815a090 2023-11-24T06:13:10.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.894+0000 7f491f7ec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4918153930 con 0x7f4918072150 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.894+0000 7f491cd87640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49180b39a0 0x7f491813a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491cd87640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49180b39a0 0x7f491813a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45216/0 (socket says 172.21.15.22:45216) 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491cd87640 1 -- 172.21.15.22:0/3329555874 learned_addr learned my addr 172.21.15.22:0/3329555874 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491d588640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4918072150 0x7f491814ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491dd89640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f491815a090 0x7f49181f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491cd87640 1 -- 172.21.15.22:0/3329555874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4918072150 msgr2=0x7f491814ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491cd87640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4918072150 0x7f491814ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491cd87640 1 -- 172.21.15.22:0/3329555874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f491815a090 msgr2=0x7f49181f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491cd87640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f491815a090 0x7f49181f02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491cd87640 1 -- 172.21.15.22:0/3329555874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910009a70 con 0x7f49180b39a0 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491dd89640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f491815a090 0x7f49181f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:10.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f491cd87640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49180b39a0 0x7f491813a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f490800c4a0 tx=0x7f490800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:10.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.895+0000 7f490dffb640 1 -- 172.21.15.22:0/3329555874 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908005ce0 con 0x7f49180b39a0 2023-11-24T06:13:10.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.896+0000 7f490dffb640 1 -- 172.21.15.22:0/3329555874 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4908005e40 con 0x7f49180b39a0 2023-11-24T06:13:10.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.896+0000 7f490dffb640 1 -- 172.21.15.22:0/3329555874 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908007270 con 0x7f49180b39a0 2023-11-24T06:13:10.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.896+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4918153c10 con 0x7f49180b39a0 2023-11-24T06:13:10.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.896+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4918153020 con 0x7f49180b39a0 2023-11-24T06:13:10.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.897+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4918153e50 con 0x7f49180b39a0 2023-11-24T06:13:10.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.898+0000 7f490dffb640 1 -- 172.21.15.22:0/3329555874 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4908007490 con 0x7f49180b39a0 2023-11-24T06:13:10.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.899+0000 7f490dffb640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f48fc06ae90 0x7f48fc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:10.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.899+0000 7f490dffb640 1 -- 172.21.15.22:0/3329555874 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f4908088b60 con 0x7f49180b39a0 2023-11-24T06:13:10.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.899+0000 7f491d588640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f48fc06ae90 0x7f48fc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:10.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.899+0000 7f491d588640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f48fc06ae90 0x7f48fc06d350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4914006fd0 tx=0x7f4914008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:10.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:10.903+0000 7f490dffb640 1 -- 172.21.15.22:0/3329555874 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4918153e50 con 0x7f49180b39a0 2023-11-24T06:13:11.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.102+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4918153e50 con 0x7f49180b39a0 2023-11-24T06:13:11.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.103+0000 7f490dffb640 1 -- 172.21.15.22:0/3329555874 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4918153e50 con 0x7f49180b39a0 2023-11-24T06:13:11.106 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:13:11.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f48fc06ae90 msgr2=0x7f48fc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:11.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f48fc06ae90 0x7f48fc06d350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4914006fd0 tx=0x7f4914008040 comp rx=0 tx=0).stop 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49180b39a0 msgr2=0x7f491813a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49180b39a0 0x7f491813a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f490800c4a0 tx=0x7f490800c960 comp rx=0 tx=0).stop 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 shutdown_connections 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f48fc06ae90 0x7f48fc06d350 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f491815a090 0x7f49181f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49180b39a0 0x7f491813a760 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 --2- 172.21.15.22:0/3329555874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4918072150 0x7f491814ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.105+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 >> 172.21.15.22:0/3329555874 conn(0x7f49180b0d80 msgr2=0x7f49180704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.106+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 shutdown_connections 2023-11-24T06:13:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.106+0000 7f491f7ec640 1 -- 172.21.15.22:0/3329555874 wait complete. 2023-11-24T06:13:11.126 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2023-11-24T06:13:11.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:11.126 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-24T06:13:11.239 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:13:11.240 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:13:11.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:11.240 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T06:13:11.296 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:13:11.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:11.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.519+0000 7f1de2a7c640 1 Processor -- start 2023-11-24T06:13:11.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.519+0000 7f1de2a7c640 1 -- start start 2023-11-24T06:13:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.520+0000 7f1de2a7c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ddc15a100 0x7f1ddc0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.521+0000 7f1de2a7c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc13da30 con 0x7f1ddc0abff0 2023-11-24T06:13:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.521+0000 7f1de2a7c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc06e340 con 0x7f1ddc0ae7e0 2023-11-24T06:13:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.521+0000 7f1de2a7c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc0ac840 con 0x7f1ddc15a100 2023-11-24T06:13:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.521+0000 7f1ddbfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1ddc0abff0 0x7f1ddc06d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36862/0 (socket says 172.21.15.22:36862) 2023-11-24T06:13:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.521+0000 7f1ddbfff640 1 -- 172.21.15.22:0/1378590539 learned_addr learned my addr 172.21.15.22:0/1378590539 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.521+0000 7f1de0818640 1 --2- 172.21.15.22:0/1378590539 >> v2:172.21.15.31:3300/0 conn(0x7f1ddc15a100 0x7f1ddc0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22165154 0 0) 0x7f1ddc13da30 con 0x7f1ddc0abff0 2023-11-24T06:13:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc4003520 con 0x7f1ddc0abff0 2023-11-24T06:13:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4241255505 0 0) 0x7f1dc4003520 con 0x7f1ddc0abff0 2023-11-24T06:13:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 >> v2:172.21.15.31:3300/0 conn(0x7f1ddc15a100 msgr2=0x7f1ddc0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 --2- 172.21.15.22:0/1378590539 >> v2:172.21.15.31:3300/0 conn(0x7f1ddc15a100 0x7f1ddc0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 >> v1:172.21.15.31:6789/0 conn(0x7f1ddc0ae7e0 legacy=0x7f1ddc06dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0ac560 con 0x7f1ddc0abff0 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f1dd0001670 con 0x7f1ddc0abff0 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 >> v1:172.21.15.22:6789/0 conn(0x7f1ddc0abff0 legacy=0x7f1ddc06d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4003970 0x7f1dc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1dc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dc4005180 0x7f1dc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0ac840 con 0x7f1dc40047c0 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc400c020 con 0x7f1dc4003970 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.522+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc400c1e0 con 0x7f1dc4005180 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.523+0000 7f1ddbfff640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1dc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.523+0000 7f1de0818640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4003970 0x7f1dc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.523+0000 7f1ddbfff640 1 -- 172.21.15.22:0/1378590539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dc4005180 msgr2=0x7f1dc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.523+0000 7f1de1019640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dc4005180 0x7f1dc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.523+0000 7f1ddbfff640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1dc4005180 0x7f1dc400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.523+0000 7f1ddbfff640 1 -- 172.21.15.22:0/1378590539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4003970 msgr2=0x7f1dc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.523+0000 7f1ddbfff640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1dc4003970 0x7f1dc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.523+0000 7f1ddbfff640 1 -- 172.21.15.22:0/1378590539 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4003520 con 0x7f1dc40047c0 2023-11-24T06:13:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.523+0000 7f1de1019640 1 -- 172.21.15.22:0/1378590539 reap_dead start 2023-11-24T06:13:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.524+0000 7f1ddbfff640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1dc4004c40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000c240 tx=0x7f1dc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22105a18b6d53ad2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.524+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0005ad0 con 0x7f1dc40047c0 2023-11-24T06:13:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.525+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd0005c30 con 0x7f1dc40047c0 2023-11-24T06:13:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.525+0000 7f1ddb7fe640 1 -- 172.21.15.22:0/1378590539 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd002caf0 con 0x7f1dc40047c0 2023-11-24T06:13:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.525+0000 7f1de2a7c640 1 -- 172.21.15.22:0/1378590539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 msgr2=0x7f1dc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.525+0000 7f1de2a7c640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1dc4004c40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000c240 tx=0x7f1dc40057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.525+0000 7f1de2a7c640 1 -- 172.21.15.22:0/1378590539 shutdown_connections 2023-11-24T06:13:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.525+0000 7f1de2a7c640 1 --2- 172.21.15.22:0/1378590539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1dc4004c40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.525+0000 7f1de2a7c640 1 -- 172.21.15.22:0/1378590539 >> 172.21.15.22:0/1378590539 conn(0x7f1ddc0b0d80 msgr2=0x7f1ddc0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.525+0000 7f1de2a7c640 1 -- 172.21.15.22:0/1378590539 shutdown_connections 2023-11-24T06:13:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.525+0000 7f1de2a7c640 1 -- 172.21.15.22:0/1378590539 wait complete. 2023-11-24T06:13:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.527+0000 7f1de2a7c640 1 Processor -- start 2023-11-24T06:13:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.527+0000 7f1de2a7c640 1 -- start start 2023-11-24T06:13:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.528+0000 7f1de2a7c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1ddc06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.528+0000 7f1de2a7c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc06db10 0x7f1ddc158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.528+0000 7f1de2a7c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ddc158750 0x7f1ddc1f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.528+0000 7f1de2a7c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc157190 con 0x7f1dc40047c0 2023-11-24T06:13:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.528+0000 7f1de2a7c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc157470 con 0x7f1ddc06db10 2023-11-24T06:13:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.528+0000 7f1de2a7c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc157750 con 0x7f1ddc158750 2023-11-24T06:13:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.528+0000 7f1de0818640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1ddc06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.528+0000 7f1de0818640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1ddc06d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39782/0 (socket says 172.21.15.22:39782) 2023-11-24T06:13:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.528+0000 7f1de0818640 1 -- 172.21.15.22:0/2979164593 learned_addr learned my addr 172.21.15.22:0/2979164593 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1de0818640 1 -- 172.21.15.22:0/2979164593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ddc158750 msgr2=0x7f1ddc1f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1de0818640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ddc158750 0x7f1ddc1f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1de0818640 1 -- 172.21.15.22:0/2979164593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc06db10 msgr2=0x7f1ddc158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1de0818640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc06db10 0x7f1ddc158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1de0818640 1 -- 172.21.15.22:0/2979164593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc157a30 con 0x7f1dc40047c0 2023-11-24T06:13:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1de0818640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1ddc06d5d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009f30 tx=0x7f1dcc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1dd97fa640 1 -- 172.21.15.22:0/2979164593 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00e030 con 0x7f1dc40047c0 2023-11-24T06:13:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1dd97fa640 1 -- 172.21.15.22:0/2979164593 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc016470 con 0x7f1dc40047c0 2023-11-24T06:13:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1dd97fa640 1 -- 172.21.15.22:0/2979164593 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc016820 con 0x7f1dc40047c0 2023-11-24T06:13:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.529+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc157d10 con 0x7f1dc40047c0 2023-11-24T06:13:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.530+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc1f38e0 con 0x7f1dc40047c0 2023-11-24T06:13:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.531+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc067960 con 0x7f1dc40047c0 2023-11-24T06:13:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.532+0000 7f1dd97fa640 1 -- 172.21.15.22:0/2979164593 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dcc016980 con 0x7f1dc40047c0 2023-11-24T06:13:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.533+0000 7f1dd97fa640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1dc806ae40 0x7f1dc806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.533+0000 7f1dd97fa640 1 -- 172.21.15.22:0/2979164593 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1dcc00f070 con 0x7f1dc40047c0 2023-11-24T06:13:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.533+0000 7f1ddbfff640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1dc806ae40 0x7f1dc806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.534+0000 7f1ddbfff640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1dc806ae40 0x7f1dc806d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0034000 tx=0x7f1dd0039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.537+0000 7f1dd97fa640 1 -- 172.21.15.22:0/2979164593 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1dcc055680 con 0x7f1dc40047c0 2023-11-24T06:13:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.781+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ddc157ea0 con 0x7f1dc40047c0 2023-11-24T06:13:11.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.782+0000 7f1dd97fa640 1 -- 172.21.15.22:0/2979164593 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f1dcc058ca0 con 0x7f1dc40047c0 2023-11-24T06:13:11.785 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:11.786 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2596011389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2596011389},{"type":"v1","addr":"172.21.15.22:6837","nonce":2596011389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1715395658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1715395658},{"type":"v1","addr":"172.21.15.31:6834","nonce":1715395658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2020783180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2020783180},{"type":"v1","addr":"172.21.15.31:6835","nonce":2020783180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:12:00.092195+0000","modified":"2023-11-24T06:12:03.157366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/4189980327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":4189980327},{"type":"v1","addr":"172.21.15.22:6835","nonce":4189980327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:13:11.786 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-11-24T06:13:11.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1dc806ae40 msgr2=0x7f1dc806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:11.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1dc806ae40 0x7f1dc806d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0034000 tx=0x7f1dd0039040 comp rx=0 tx=0).stop 2023-11-24T06:13:11.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 msgr2=0x7f1ddc06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:11.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1ddc06d5d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009f30 tx=0x7f1dcc0115a0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 shutdown_connections 2023-11-24T06:13:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1dc806ae40 0x7f1dc806d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ddc158750 0x7f1ddc1f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc06db10 0x7f1ddc158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 --2- 172.21.15.22:0/2979164593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1dc40047c0 0x7f1ddc06d5d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.785+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 >> 172.21.15.22:0/2979164593 conn(0x7f1ddc0b0d80 msgr2=0x7f1ddc0aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.786+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 shutdown_connections 2023-11-24T06:13:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:11.786+0000 7f1de2a7c640 1 -- 172.21.15.22:0/2979164593 wait complete. 2023-11-24T06:13:11.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.029+0000 7f44bdc6d640 1 Processor -- start 2023-11-24T06:13:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.029+0000 7f44bdc6d640 1 -- start start 2023-11-24T06:13:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.031+0000 7f44bdc6d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f44b813dfd0 0x7f44b815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.031+0000 7f44bdc6d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44b80cf050 0x7f44b80cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.031+0000 7f44bdc6d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80ce7c0 con 0x7f44b806c130 2023-11-24T06:13:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.031+0000 7f44bdc6d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80cfa40 con 0x7f44b80cf050 2023-11-24T06:13:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.031+0000 7f44bdc6d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b8140900 con 0x7f44b813dfd0 2023-11-24T06:13:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.031+0000 7f44bd46c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f44b806c130 0x7f44b806c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36876/0 (socket says 172.21.15.22:36876) 2023-11-24T06:13:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.031+0000 7f44b7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44b80cf050 0x7f44b80cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.031+0000 7f44bd46c640 1 -- 172.21.15.22:0/3870365247 learned_addr learned my addr 172.21.15.22:0/3870365247 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.031+0000 7f44bcc6b640 1 --2- 172.21.15.22:0/3870365247 >> v2:172.21.15.31:3300/0 conn(0x7f44b813dfd0 0x7f44b815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.032+0000 7f44b7fff640 1 -- 172.21.15.22:0/3870365247 >> v2:172.21.15.31:3300/0 conn(0x7f44b813dfd0 msgr2=0x7f44b815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.032+0000 7f44b7fff640 1 --2- 172.21.15.22:0/3870365247 >> v2:172.21.15.31:3300/0 conn(0x7f44b813dfd0 0x7f44b815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.032+0000 7f44b77fe640 1 -- 172.21.15.22:0/3870365247 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975274266 0 0) 0x7f44b80ce7c0 con 0x7f44b806c130 2023-11-24T06:13:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.032+0000 7f44b7fff640 1 -- 172.21.15.22:0/3870365247 >> v1:172.21.15.22:6789/0 conn(0x7f44b806c130 legacy=0x7f44b806c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.032+0000 7f44b7fff640 1 -- 172.21.15.22:0/3870365247 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b815fa70 con 0x7f44b80cf050 2023-11-24T06:13:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.033+0000 7f44b7fff640 1 --2- 172.21.15.22:0/3870365247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b80cf050 0x7f44b80cf500 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f44b80cfc10 tx=0x7f44a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3ceebe37ca9850 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.033+0000 7f44b77fe640 1 -- 172.21.15.22:0/3870365247 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4031830 con 0x7f44b80cf050 2023-11-24T06:13:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.033+0000 7f44b77fe640 1 -- 172.21.15.22:0/3870365247 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a4031990 con 0x7f44b80cf050 2023-11-24T06:13:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.033+0000 7f44b77fe640 1 -- 172.21.15.22:0/3870365247 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4031d20 con 0x7f44b80cf050 2023-11-24T06:13:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.034+0000 7f44bdc6d640 1 -- 172.21.15.22:0/3870365247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b80cf050 msgr2=0x7f44b80cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.034+0000 7f44bdc6d640 1 --2- 172.21.15.22:0/3870365247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b80cf050 0x7f44b80cf500 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f44b80cfc10 tx=0x7f44a402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.034+0000 7f44bdc6d640 1 -- 172.21.15.22:0/3870365247 shutdown_connections 2023-11-24T06:13:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.034+0000 7f44bdc6d640 1 --2- 172.21.15.22:0/3870365247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b80cf050 0x7f44b80cf500 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.034+0000 7f44bdc6d640 1 --2- 172.21.15.22:0/3870365247 >> v2:172.21.15.31:3300/0 conn(0x7f44b813dfd0 0x7f44b815be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.034+0000 7f44bdc6d640 1 -- 172.21.15.22:0/3870365247 >> 172.21.15.22:0/3870365247 conn(0x7f44b806a860 msgr2=0x7f44b806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.034+0000 7f44bdc6d640 1 -- 172.21.15.22:0/3870365247 shutdown_connections 2023-11-24T06:13:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.034+0000 7f44bdc6d640 1 -- 172.21.15.22:0/3870365247 wait complete. 2023-11-24T06:13:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.036+0000 7f44bdc6d640 1 Processor -- start 2023-11-24T06:13:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.036+0000 7f44bdc6d640 1 -- start start 2023-11-24T06:13:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.037+0000 7f44bdc6d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b806c130 0x7f44b813b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.037+0000 7f44bdc6d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80cf050 0x7f44b813c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.037+0000 7f44bdc6d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b813dfd0 0x7f44b8158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.037+0000 7f44bdc6d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b813d050 con 0x7f44b806c130 2023-11-24T06:13:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.037+0000 7f44bdc6d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b815bde0 con 0x7f44b80cf050 2023-11-24T06:13:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.037+0000 7f44bdc6d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b813b560 con 0x7f44b813dfd0 2023-11-24T06:13:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.037+0000 7f44bcc6b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b806c130 0x7f44b813b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.037+0000 7f44bcc6b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b806c130 0x7f44b813b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39794/0 (socket says 172.21.15.22:39794) 2023-11-24T06:13:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.037+0000 7f44bcc6b640 1 -- 172.21.15.22:0/2443438089 learned_addr learned my addr 172.21.15.22:0/2443438089 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44b7fff640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80cf050 0x7f44b813c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44bd46c640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b813dfd0 0x7f44b8158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44bcc6b640 1 -- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b813dfd0 msgr2=0x7f44b8158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44bcc6b640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b813dfd0 0x7f44b8158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44bcc6b640 1 -- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80cf050 msgr2=0x7f44b813c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44bcc6b640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80cf050 0x7f44b813c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44bcc6b640 1 -- 172.21.15.22:0/2443438089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a4009400 con 0x7f44b806c130 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44b7fff640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80cf050 0x7f44b813c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44bd46c640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b813dfd0 0x7f44b8158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44bcc6b640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b806c130 0x7f44b813b020 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00d5f0 tx=0x7f44ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:12.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.038+0000 7f44b57fa640 1 -- 172.21.15.22:0/2443438089 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0125f0 con 0x7f44b806c130 2023-11-24T06:13:12.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.039+0000 7f44b57fa640 1 -- 172.21.15.22:0/2443438089 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac012750 con 0x7f44b806c130 2023-11-24T06:13:12.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.039+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b815c080 con 0x7f44b806c130 2023-11-24T06:13:12.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.039+0000 7f44b57fa640 1 -- 172.21.15.22:0/2443438089 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac012b00 con 0x7f44b806c130 2023-11-24T06:13:12.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.039+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b815c640 con 0x7f44b806c130 2023-11-24T06:13:12.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.040+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b815c7d0 con 0x7f44b806c130 2023-11-24T06:13:12.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.041+0000 7f44b57fa640 1 -- 172.21.15.22:0/2443438089 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44ac012c60 con 0x7f44b806c130 2023-11-24T06:13:12.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.042+0000 7f44b57fa640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449c06ae40 0x7f449c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.042+0000 7f44b57fa640 1 -- 172.21.15.22:0/2443438089 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f44ac089c00 con 0x7f44b806c130 2023-11-24T06:13:12.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.042+0000 7f44b7fff640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449c06ae40 0x7f449c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.043+0000 7f44b7fff640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449c06ae40 0x7f449c06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f44a4036000 tx=0x7f44a4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.046+0000 7f44b57fa640 1 -- 172.21.15.22:0/2443438089 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44ac090080 con 0x7f44b806c130 2023-11-24T06:13:12.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.242+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44b804e840 con 0x7f44b806c130 2023-11-24T06:13:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.245+0000 7f44b57fa640 1 -- 172.21.15.22:0/2443438089 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f44ac054b90 con 0x7f44b806c130 2023-11-24T06:13:12.248 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:12.249 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:12.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.248+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449c06ae40 msgr2=0x7f449c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.248+0000 7f44bdc6d640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449c06ae40 0x7f449c06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f44a4036000 tx=0x7f44a4008030 comp rx=0 tx=0).stop 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.248+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b806c130 msgr2=0x7f44b813b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.248+0000 7f44bdc6d640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b806c130 0x7f44b813b020 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00d5f0 tx=0x7f44ac00dab0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.249+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 shutdown_connections 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.249+0000 7f44bdc6d640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449c06ae40 0x7f449c06d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.249+0000 7f44bdc6d640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b813dfd0 0x7f44b8158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.249+0000 7f44bdc6d640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80cf050 0x7f44b813c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.249+0000 7f44bdc6d640 1 --2- 172.21.15.22:0/2443438089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b806c130 0x7f44b813b020 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.249+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 >> 172.21.15.22:0/2443438089 conn(0x7f44b806a860 msgr2=0x7f44b80ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.249+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 shutdown_connections 2023-11-24T06:13:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.249+0000 7f44bdc6d640 1 -- 172.21.15.22:0/2443438089 wait complete. 2023-11-24T06:13:12.272 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:11:58.565118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:11:59.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:12.272 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:12.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.500+0000 7f3b03fff640 1 Processor -- start 2023-11-24T06:13:12.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.500+0000 7f3b03fff640 1 -- start start 2023-11-24T06:13:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.501+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b04144770 0x7f3b0415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.501+0000 7f3b03fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3b0415f0a0 0x7f3b040ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.502+0000 7f3b03fff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0415f930 con 0x7f3b040b35a0 2023-11-24T06:13:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.502+0000 7f3b03fff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b040b43b0 con 0x7f3b0415f0a0 2023-11-24T06:13:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.502+0000 7f3b03fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0415f530 con 0x7f3b04144770 2023-11-24T06:13:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.502+0000 7f3b037fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3b0415f0a0 0x7f3b040ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.502+0000 7f3b037fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3b0415f0a0 0x7f3b040ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39808/0 (socket says 172.21.15.22:39808) 2023-11-24T06:13:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.502+0000 7f3b037fe640 1 -- 172.21.15.22:0/320622259 learned_addr learned my addr 172.21.15.22:0/320622259 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.502+0000 7f3b02ffd640 1 --2- 172.21.15.22:0/320622259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b04144770 0x7f3b0415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.502+0000 7f3b037fe640 1 -- 172.21.15.22:0/320622259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b04144770 msgr2=0x7f3b0415eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.502+0000 7f3b037fe640 1 --2- 172.21.15.22:0/320622259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b04144770 0x7f3b0415eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.503+0000 7f3b037fe640 1 -- 172.21.15.22:0/320622259 >> v1:172.21.15.31:6789/0 conn(0x7f3b040b35a0 legacy=0x7f3b0406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.503+0000 7f3b037fe640 1 -- 172.21.15.22:0/320622259 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040ce9f0 con 0x7f3b0415f0a0 2023-11-24T06:13:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.503+0000 7f3b02ffd640 1 --2- 172.21.15.22:0/320622259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b04144770 0x7f3b0415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.504+0000 7f3b037fe640 1 --2- 172.21.15.22:0/320622259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b0415f0a0 0x7f3b040ce4b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009e80 tx=0x7f3afc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cfa616e40797fa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.504+0000 7f3b01ffb640 1 -- 172.21.15.22:0/320622259 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc02ca50 con 0x7f3b0415f0a0 2023-11-24T06:13:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.504+0000 7f3b01ffb640 1 -- 172.21.15.22:0/320622259 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc02cbb0 con 0x7f3b0415f0a0 2023-11-24T06:13:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.504+0000 7f3b01ffb640 1 -- 172.21.15.22:0/320622259 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0343f0 con 0x7f3b0415f0a0 2023-11-24T06:13:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.505+0000 7f3b03fff640 1 -- 172.21.15.22:0/320622259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b0415f0a0 msgr2=0x7f3b040ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.505+0000 7f3b03fff640 1 --2- 172.21.15.22:0/320622259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b0415f0a0 0x7f3b040ce4b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009e80 tx=0x7f3afc02beb0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.505+0000 7f3b03fff640 1 -- 172.21.15.22:0/320622259 shutdown_connections 2023-11-24T06:13:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.505+0000 7f3b03fff640 1 --2- 172.21.15.22:0/320622259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b0415f0a0 0x7f3b040ce4b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.505+0000 7f3b03fff640 1 --2- 172.21.15.22:0/320622259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b04144770 0x7f3b0415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.505+0000 7f3b03fff640 1 -- 172.21.15.22:0/320622259 >> 172.21.15.22:0/320622259 conn(0x7f3b040cec10 msgr2=0x7f3b040cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.505+0000 7f3b03fff640 1 -- 172.21.15.22:0/320622259 shutdown_connections 2023-11-24T06:13:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.505+0000 7f3b03fff640 1 -- 172.21.15.22:0/320622259 wait complete. 2023-11-24T06:13:12.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.507+0000 7f3b03fff640 1 Processor -- start 2023-11-24T06:13:12.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.508+0000 7f3b03fff640 1 -- start start 2023-11-24T06:13:12.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.508+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b040b35a0 0x7f3b0415a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b04144770 0x7f3b040c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0415f0a0 0x7f3b040c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b03fff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0415aec0 con 0x7f3b04144770 2023-11-24T06:13:12.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b03fff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040c4d70 con 0x7f3b0415f0a0 2023-11-24T06:13:12.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b03fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040c4160 con 0x7f3b040b35a0 2023-11-24T06:13:12.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b027fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b04144770 0x7f3b040c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b027fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b04144770 0x7f3b040c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39824/0 (socket says 172.21.15.22:39824) 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b027fc640 1 -- 172.21.15.22:0/3203455490 learned_addr learned my addr 172.21.15.22:0/3203455490 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b02ffd640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b040b35a0 0x7f3b0415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b037fe640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0415f0a0 0x7f3b040c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b027fc640 1 -- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b040b35a0 msgr2=0x7f3b0415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b027fc640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b040b35a0 0x7f3b0415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b027fc640 1 -- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0415f0a0 msgr2=0x7f3b040c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b027fc640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0415f0a0 0x7f3b040c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b027fc640 1 -- 172.21.15.22:0/3203455490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009b30 con 0x7f3b04144770 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b02ffd640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b040b35a0 0x7f3b0415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.509+0000 7f3b037fe640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0415f0a0 0x7f3b040c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:12.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.510+0000 7f3b027fc640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b04144770 0x7f3b040c69e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3af800b3f0 tx=0x7f3af800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:12.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.510+0000 7f3aeb7fe640 1 -- 172.21.15.22:0/3203455490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8011830 con 0x7f3b04144770 2023-11-24T06:13:12.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.510+0000 7f3aeb7fe640 1 -- 172.21.15.22:0/3203455490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8011990 con 0x7f3b04144770 2023-11-24T06:13:12.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.510+0000 7f3aeb7fe640 1 -- 172.21.15.22:0/3203455490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8011d40 con 0x7f3b04144770 2023-11-24T06:13:12.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.510+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b040c4440 con 0x7f3b04144770 2023-11-24T06:13:12.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.510+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b040c4a00 con 0x7f3b04144770 2023-11-24T06:13:12.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.511+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0404e840 con 0x7f3b04144770 2023-11-24T06:13:12.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.512+0000 7f3aeb7fe640 1 -- 172.21.15.22:0/3203455490 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3af801a400 con 0x7f3b04144770 2023-11-24T06:13:12.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.514+0000 7f3aeb7fe640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3af006ae40 0x7f3af006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.514+0000 7f3aeb7fe640 1 -- 172.21.15.22:0/3203455490 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3af80894b0 con 0x7f3b04144770 2023-11-24T06:13:12.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.514+0000 7f3b02ffd640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3af006ae40 0x7f3af006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.515+0000 7f3b02ffd640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3af006ae40 0x7f3af006d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3af4006fd0 tx=0x7f3af4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:12.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.518+0000 7f3aeb7fe640 1 -- 172.21.15.22:0/3203455490 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3af80544c0 con 0x7f3b04144770 2023-11-24T06:13:12.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.712+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b040b2460 con 0x7f3b04144770 2023-11-24T06:13:12.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.713+0000 7f3aeb7fe640 1 -- 172.21.15.22:0/3203455490 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3af8057ae0 con 0x7f3b04144770 2023-11-24T06:13:12.716 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:13:12.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.717+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3af006ae40 msgr2=0x7f3af006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.717+0000 7f3b03fff640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3af006ae40 0x7f3af006d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3af4006fd0 tx=0x7f3af4008040 comp rx=0 tx=0).stop 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.717+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b04144770 msgr2=0x7f3b040c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.717+0000 7f3b03fff640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b04144770 0x7f3b040c69e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3af800b3f0 tx=0x7f3af800b8b0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.718+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 shutdown_connections 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.718+0000 7f3b03fff640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3af006ae40 0x7f3af006d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.718+0000 7f3b03fff640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b0415f0a0 0x7f3b040c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.718+0000 7f3b03fff640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b04144770 0x7f3b040c69e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.718+0000 7f3b03fff640 1 --2- 172.21.15.22:0/3203455490 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b040b35a0 0x7f3b0415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.718+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 >> 172.21.15.22:0/3203455490 conn(0x7f3b040cec10 msgr2=0x7f3b04142000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.718+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 shutdown_connections 2023-11-24T06:13:12.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.718+0000 7f3b03fff640 1 -- 172.21.15.22:0/3203455490 wait complete. 2023-11-24T06:13:12.740 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:12.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.961+0000 7fcbda14e640 1 Processor -- start 2023-11-24T06:13:12.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.961+0000 7fcbda14e640 1 -- start start 2023-11-24T06:13:12.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.962+0000 7fcbda14e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40d1d90 0x7fcbd40ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.962+0000 7fcbda14e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcbd40d0fa0 0x7fcbd40b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.962+0000 7fcbda14e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40c6bf0 con 0x7fcbd415d3b0 2023-11-24T06:13:12.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.962+0000 7fcbda14e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd40d13d0 con 0x7fcbd40d0fa0 2023-11-24T06:13:12.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.962+0000 7fcbda14e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40cedc0 con 0x7fcbd40d1d90 2023-11-24T06:13:12.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.963+0000 7fcbd914c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcbd415d3b0 0x7fcbd40d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36890/0 (socket says 172.21.15.22:36890) 2023-11-24T06:13:12.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.963+0000 7fcbd914c640 1 -- 172.21.15.22:0/479105923 learned_addr learned my addr 172.21.15.22:0/479105923 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:12.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.963+0000 7fcbd894b640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40d1d90 0x7fcbd40ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.963+0000 7fcbd994d640 1 --2- 172.21.15.22:0/479105923 >> v2:172.21.15.31:3300/0 conn(0x7fcbd40d0fa0 0x7fcbd40b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.963+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636457985 0 0) 0x7fcbd40c6bf0 con 0x7fcbd415d3b0 2023-11-24T06:13:12.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc0003520 con 0x7fcbd415d3b0 2023-11-24T06:13:12.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352253811 0 0) 0x7fcbc0003520 con 0x7fcbd415d3b0 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40d1d90 msgr2=0x7fcbd40ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40d1d90 0x7fcbd40ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 >> v2:172.21.15.31:3300/0 conn(0x7fcbd40d0fa0 msgr2=0x7fcbd40b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 --2- 172.21.15.22:0/479105923 >> v2:172.21.15.31:3300/0 conn(0x7fcbd40d0fa0 0x7fcbd40b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40c6e40 con 0x7fcbd415d3b0 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fcbd0001670 con 0x7fcbd415d3b0 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 >> v1:172.21.15.22:6789/0 conn(0x7fcbd415d3b0 legacy=0x7fcbd40d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00039e0 0x7fcbc0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40d1d90 0x7fcbc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40d13d0 con 0x7fcbc00047c0 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40cedc0 con 0x7fcbc00039e0 2023-11-24T06:13:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc000ba60 con 0x7fcbd40d1d90 2023-11-24T06:13:12.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.964+0000 7fcbd894b640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.965+0000 7fcbd894b640 1 -- 172.21.15.22:0/479105923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40d1d90 msgr2=0x7fcbc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.965+0000 7fcbd894b640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40d1d90 0x7fcbc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.965+0000 7fcbd894b640 1 -- 172.21.15.22:0/479105923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00039e0 msgr2=0x7fcbc0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.965+0000 7fcbd894b640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00039e0 0x7fcbc0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.965+0000 7fcbd894b640 1 -- 172.21.15.22:0/479105923 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0003520 con 0x7fcbc00047c0 2023-11-24T06:13:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.966+0000 7fcbd894b640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbc0004c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009a90 tx=0x7fcbc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9df1cbb66350c8c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.966+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc402c6b0 con 0x7fcbc00047c0 2023-11-24T06:13:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.966+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc402c810 con 0x7fcbc00047c0 2023-11-24T06:13:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.966+0000 7fcbcbfff640 1 -- 172.21.15.22:0/479105923 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc402cba0 con 0x7fcbc00047c0 2023-11-24T06:13:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.967+0000 7fcbda14e640 1 -- 172.21.15.22:0/479105923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 msgr2=0x7fcbc0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.967+0000 7fcbda14e640 1 --2- 172.21.15.22:0/479105923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbc0004c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009a90 tx=0x7fcbc00057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.967+0000 7fcbd994d640 1 -- 172.21.15.22:0/479105923 reap_dead start 2023-11-24T06:13:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.967+0000 7fcbda14e640 1 -- 172.21.15.22:0/479105923 shutdown_connections 2023-11-24T06:13:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.967+0000 7fcbda14e640 1 -- 172.21.15.22:0/479105923 >> 172.21.15.22:0/479105923 conn(0x7fcbd40d30a0 msgr2=0x7fcbd40d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.967+0000 7fcbda14e640 1 -- 172.21.15.22:0/479105923 shutdown_connections 2023-11-24T06:13:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.967+0000 7fcbda14e640 1 -- 172.21.15.22:0/479105923 wait complete. 2023-11-24T06:13:12.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.969+0000 7fcbda14e640 1 Processor -- start 2023-11-24T06:13:12.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.969+0000 7fcbda14e640 1 -- start start 2023-11-24T06:13:12.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.970+0000 7fcbda14e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbd409f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.970+0000 7fcbda14e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40ccfb0 0x7fcbd40caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.970+0000 7fcbda14e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd409ce70 0x7fcbd40cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.970+0000 7fcbda14e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40a0730 con 0x7fcbc00047c0 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.970+0000 7fcbda14e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd409fe90 con 0x7fcbd409ce70 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.970+0000 7fcbda14e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40a0170 con 0x7fcbd40ccfb0 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.970+0000 7fcbd914c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbd409f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.970+0000 7fcbd914c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbd409f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39846/0 (socket says 172.21.15.22:39846) 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.970+0000 7fcbd914c640 1 -- 172.21.15.22:0/3726934833 learned_addr learned my addr 172.21.15.22:0/3726934833 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.971+0000 7fcbd894b640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40ccfb0 0x7fcbd40caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.971+0000 7fcbd994d640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd409ce70 0x7fcbd40cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.971+0000 7fcbd914c640 1 -- 172.21.15.22:0/3726934833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40ccfb0 msgr2=0x7fcbd40caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.971+0000 7fcbd914c640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40ccfb0 0x7fcbd40caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.971+0000 7fcbd914c640 1 -- 172.21.15.22:0/3726934833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd409ce70 msgr2=0x7fcbd40cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:12.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.971+0000 7fcbd914c640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd409ce70 0x7fcbd40cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:12.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.971+0000 7fcbd914c640 1 -- 172.21.15.22:0/3726934833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40a0450 con 0x7fcbc00047c0 2023-11-24T06:13:12.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.971+0000 7fcbd914c640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbd409f590 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000c730 tx=0x7fcbd000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:12.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.971+0000 7fcbc9ffb640 1 -- 172.21.15.22:0/3726934833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd00072d0 con 0x7fcbc00047c0 2023-11-24T06:13:12.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.972+0000 7fcbc9ffb640 1 -- 172.21.15.22:0/3726934833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd0007450 con 0x7fcbc00047c0 2023-11-24T06:13:12.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.972+0000 7fcbc9ffb640 1 -- 172.21.15.22:0/3726934833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd00047e0 con 0x7fcbc00047c0 2023-11-24T06:13:12.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.972+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd40caa20 con 0x7fcbc00047c0 2023-11-24T06:13:12.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.972+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd40cb9c0 con 0x7fcbc00047c0 2023-11-24T06:13:12.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.973+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd40cac10 con 0x7fcbc00047c0 2023-11-24T06:13:12.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.974+0000 7fcbc9ffb640 1 -- 172.21.15.22:0/3726934833 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbd0004b70 con 0x7fcbc00047c0 2023-11-24T06:13:12.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.975+0000 7fcbc9ffb640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcbb806ae40 0x7fcbb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:12.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.975+0000 7fcbc9ffb640 1 -- 172.21.15.22:0/3726934833 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fcbd0088bc0 con 0x7fcbc00047c0 2023-11-24T06:13:12.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.975+0000 7fcbd894b640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcbb806ae40 0x7fcbb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:12.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.976+0000 7fcbd894b640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcbb806ae40 0x7fcbb806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4036000 tx=0x7fcbc4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:12.979+0000 7fcbc9ffb640 1 -- 172.21.15.22:0/3726934833 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcbd0057700 con 0x7fcbc00047c0 2023-11-24T06:13:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.176+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcbd404e840 con 0x7fcbc00047c0 2023-11-24T06:13:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.176+0000 7fcbc9ffb640 1 -- 172.21.15.22:0/3726934833 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcbd00180a0 con 0x7fcbc00047c0 2023-11-24T06:13:13.179 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:13:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.179+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcbb806ae40 msgr2=0x7fcbb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.179+0000 7fcbda14e640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcbb806ae40 0x7fcbb806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4036000 tx=0x7fcbc4030000 comp rx=0 tx=0).stop 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.179+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 msgr2=0x7fcbd409f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.179+0000 7fcbda14e640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbd409f590 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000c730 tx=0x7fcbd000cbf0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.179+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 shutdown_connections 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.179+0000 7fcbda14e640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcbb806ae40 0x7fcbb806d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.180+0000 7fcbda14e640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd409ce70 0x7fcbd40cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.180+0000 7fcbda14e640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbd40ccfb0 0x7fcbd40caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.180+0000 7fcbda14e640 1 --2- 172.21.15.22:0/3726934833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbc00047c0 0x7fcbd409f590 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.180+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 >> 172.21.15.22:0/3726934833 conn(0x7fcbd40d30a0 msgr2=0x7fcbd406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.180+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 shutdown_connections 2023-11-24T06:13:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.180+0000 7fcbda14e640 1 -- 172.21.15.22:0/3726934833 wait complete. 2023-11-24T06:13:13.202 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.427+0000 7fc5bb59e640 1 Processor -- start 2023-11-24T06:13:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.427+0000 7fc5bb59e640 1 -- start start 2023-11-24T06:13:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.429+0000 7fc5bb59e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5bc153ea0 0x7fc5bc0ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.429+0000 7fc5bb59e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5bc0ce650 con 0x7fc5bc154280 2023-11-24T06:13:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.429+0000 7fc5bb59e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5bc154710 con 0x7fc5bc070850 2023-11-24T06:13:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.429+0000 7fc5bb59e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc15e0a0 con 0x7fc5bc153ea0 2023-11-24T06:13:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.429+0000 7fc5b3fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc5bc154280 0x7fc5bc15d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36900/0 (socket says 172.21.15.22:36900) 2023-11-24T06:13:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.429+0000 7fc5b3fff640 1 -- 172.21.15.22:0/1300238945 learned_addr learned my addr 172.21.15.22:0/1300238945 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:13.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5ba59c640 1 --2- 172.21.15.22:0/1300238945 >> v2:172.21.15.31:3300/0 conn(0x7fc5bc153ea0 0x7fc5bc0ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481546040 0 0) 0x7fc5bc0ce650 con 0x7fc5bc154280 2023-11-24T06:13:13.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a8003520 con 0x7fc5bc154280 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874770579 0 0) 0x7fc5a8003520 con 0x7fc5bc154280 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 >> v2:172.21.15.31:3300/0 conn(0x7fc5bc153ea0 msgr2=0x7fc5bc0ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 --2- 172.21.15.22:0/1300238945 >> v2:172.21.15.31:3300/0 conn(0x7fc5bc153ea0 0x7fc5bc0ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 >> v1:172.21.15.31:6789/0 conn(0x7fc5bc070850 legacy=0x7fc5bc071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc15e380 con 0x7fc5bc154280 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fc5a4001670 con 0x7fc5bc154280 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 >> v1:172.21.15.22:6789/0 conn(0x7fc5bc154280 legacy=0x7fc5bc15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.430+0000 7fc5b9d9b640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5a80039e0 0x7fc5a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5b9d9b640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a80047c0 0x7fc5a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5b9d9b640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8005180 0x7fc5a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc15e0a0 con 0x7fc5a8005180 2023-11-24T06:13:13.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a800c0b0 con 0x7fc5a80047c0 2023-11-24T06:13:13.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a800c270 con 0x7fc5a80039e0 2023-11-24T06:13:13.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5bad9d640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8005180 0x7fc5a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5b3fff640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a80047c0 0x7fc5a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5ba59c640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5a80039e0 0x7fc5a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5bad9d640 1 -- 172.21.15.22:0/1300238945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5a80039e0 msgr2=0x7fc5a8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5bad9d640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5a80039e0 0x7fc5a8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5bad9d640 1 -- 172.21.15.22:0/1300238945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a80047c0 msgr2=0x7fc5a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5bad9d640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a80047c0 0x7fc5a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.431+0000 7fc5bad9d640 1 -- 172.21.15.22:0/1300238945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a8003520 con 0x7fc5a8005180 2023-11-24T06:13:13.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.432+0000 7fc5bad9d640 1 -- 172.21.15.22:0/1300238945 reap_dead start 2023-11-24T06:13:13.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.433+0000 7fc5bad9d640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8005180 0x7fc5a800b980 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4001e50 tx=0x7fc5a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6011151c02bf18e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.433+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4003b70 con 0x7fc5a8005180 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.433+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4003d10 con 0x7fc5a8005180 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.433+0000 7fc5b9d9b640 1 -- 172.21.15.22:0/1300238945 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4005310 con 0x7fc5a8005180 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.433+0000 7fc5bb59e640 1 -- 172.21.15.22:0/1300238945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8005180 msgr2=0x7fc5a800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.433+0000 7fc5bb59e640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8005180 0x7fc5a800b980 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4001e50 tx=0x7fc5a80057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.433+0000 7fc5bb59e640 1 -- 172.21.15.22:0/1300238945 shutdown_connections 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.433+0000 7fc5bb59e640 1 --2- 172.21.15.22:0/1300238945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8005180 0x7fc5a800b980 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.433+0000 7fc5bb59e640 1 -- 172.21.15.22:0/1300238945 >> 172.21.15.22:0/1300238945 conn(0x7fc5bc0cec10 msgr2=0x7fc5bc0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.434+0000 7fc5bb59e640 1 -- 172.21.15.22:0/1300238945 shutdown_connections 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.434+0000 7fc5bb59e640 1 -- 172.21.15.22:0/1300238945 wait complete. 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.435+0000 7fc5bb59e640 1 Processor -- start 2023-11-24T06:13:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.435+0000 7fc5bb59e640 1 -- start start 2023-11-24T06:13:13.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.436+0000 7fc5bb59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5a8005180 0x7fc5bc14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.436+0000 7fc5bb59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5bc150160 0x7fc5bc1e6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.436+0000 7fc5bb59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5bc0b0a00 0x7fc5bc0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.436+0000 7fc5bb59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc0b13c0 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.436+0000 7fc5bb59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc1f2c60 con 0x7fc5bc150160 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.436+0000 7fc5bb59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc1e6a70 con 0x7fc5a8005180 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5bad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5bc0b0a00 0x7fc5bc0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5bad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5bc0b0a00 0x7fc5bc0b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39858/0 (socket says 172.21.15.22:39858) 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5bad9d640 1 -- 172.21.15.22:0/3555366519 learned_addr learned my addr 172.21.15.22:0/3555366519 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5b3fff640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5bc150160 0x7fc5bc1e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5ba59c640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5a8005180 0x7fc5bc14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5bad9d640 1 -- 172.21.15.22:0/3555366519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5a8005180 msgr2=0x7fc5bc14fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5bad9d640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5a8005180 0x7fc5bc14fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5bad9d640 1 -- 172.21.15.22:0/3555366519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5bc150160 msgr2=0x7fc5bc1e6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5bad9d640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5bc150160 0x7fc5bc1e6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.437+0000 7fc5bad9d640 1 -- 172.21.15.22:0/3555366519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc1e6cf0 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.438+0000 7fc5bad9d640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5bc0b0a00 0x7fc5bc0b0e80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4001f70 tx=0x7fc5b40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:13.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.438+0000 7fc5b2ffd640 1 -- 172.21.15.22:0/3555366519 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4006d50 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.438+0000 7fc5b2ffd640 1 -- 172.21.15.22:0/3555366519 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4039480 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.438+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc1e6fd0 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.438+0000 7fc5b2ffd640 1 -- 172.21.15.22:0/3555366519 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4039850 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.438+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc156100 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.439+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc04e840 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.440+0000 7fc5b2ffd640 1 -- 172.21.15.22:0/3555366519 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5b40399b0 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.441+0000 7fc5b2ffd640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59c06ae40 0x7fc59c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.441+0000 7fc5b2ffd640 1 -- 172.21.15.22:0/3555366519 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc5b40ab3e0 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.441+0000 7fc5ba59c640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59c06ae40 0x7fc59c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.442+0000 7fc5ba59c640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59c06ae40 0x7fc59c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009990 tx=0x7fc5ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:13.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.445+0000 7fc5b2ffd640 1 -- 172.21.15.22:0/3555366519 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5b4076360 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.640+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5bc06dc60 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.641+0000 7fc5b2ffd640 1 -- 172.21.15.22:0/3555366519 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5b4079980 con 0x7fc5bc0b0a00 2023-11-24T06:13:13.643 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:13:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.643+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59c06ae40 msgr2=0x7fc59c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.643+0000 7fc5bb59e640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59c06ae40 0x7fc59c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009990 tx=0x7fc5ac008040 comp rx=0 tx=0).stop 2023-11-24T06:13:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.643+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5bc0b0a00 msgr2=0x7fc5bc0b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.643+0000 7fc5bb59e640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5bc0b0a00 0x7fc5bc0b0e80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4001f70 tx=0x7fc5b40014a0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.644+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 shutdown_connections 2023-11-24T06:13:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.644+0000 7fc5bb59e640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59c06ae40 0x7fc59c06d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.644+0000 7fc5bb59e640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5bc0b0a00 0x7fc5bc0b0e80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.644+0000 7fc5bb59e640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5bc150160 0x7fc5bc1e6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.644+0000 7fc5bb59e640 1 --2- 172.21.15.22:0/3555366519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5a8005180 0x7fc5bc14fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.644+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 >> 172.21.15.22:0/3555366519 conn(0x7fc5bc0cec10 msgr2=0x7fc5bc06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.644+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 shutdown_connections 2023-11-24T06:13:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.644+0000 7fc5bb59e640 1 -- 172.21.15.22:0/3555366519 wait complete. 2023-11-24T06:13:13.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:13.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.885+0000 7fab15602640 1 Processor -- start 2023-11-24T06:13:13.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.886+0000 7fab15602640 1 -- start start 2023-11-24T06:13:13.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.887+0000 7fab15602640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fab1006d250 0x7fab1015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.887+0000 7fab15602640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab1015ddb0 0x7fab10070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.887+0000 7fab15602640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab10161670 con 0x7fab10157770 2023-11-24T06:13:13.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.887+0000 7fab15602640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1015e610 con 0x7fab1015ddb0 2023-11-24T06:13:13.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.887+0000 7fab15602640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab10160d40 con 0x7fab1006d250 2023-11-24T06:13:13.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.888+0000 7fab14e01640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab1015ddb0 0x7fab10070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.888+0000 7fab14e01640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab1015ddb0 0x7fab10070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39868/0 (socket says 172.21.15.22:39868) 2023-11-24T06:13:13.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.888+0000 7fab14e01640 1 -- 172.21.15.22:0/4118468216 learned_addr learned my addr 172.21.15.22:0/4118468216 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:13.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.888+0000 7fab07fff640 1 --2- 172.21.15.22:0/4118468216 >> v2:172.21.15.31:3300/0 conn(0x7fab1006d250 0x7fab1015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.888+0000 7fab14e01640 1 -- 172.21.15.22:0/4118468216 >> v2:172.21.15.31:3300/0 conn(0x7fab1006d250 msgr2=0x7fab1015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:13.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.888+0000 7fab14e01640 1 --2- 172.21.15.22:0/4118468216 >> v2:172.21.15.31:3300/0 conn(0x7fab1006d250 0x7fab1015d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.888+0000 7fab14e01640 1 -- 172.21.15.22:0/4118468216 >> v1:172.21.15.31:6789/0 conn(0x7fab10157770 legacy=0x7fab1006cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:13.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.888+0000 7fab14e01640 1 -- 172.21.15.22:0/4118468216 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10161020 con 0x7fab1015ddb0 2023-11-24T06:13:13.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.889+0000 7fab14e01640 1 --2- 172.21.15.22:0/4118468216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1015ddb0 0x7fab10070720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fab100cfcd0 tx=0x7fab0802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a4e7706c1dfed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:13.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.890+0000 7fab0f7fe640 1 -- 172.21.15.22:0/4118468216 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0802ca80 con 0x7fab1015ddb0 2023-11-24T06:13:13.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.890+0000 7fab0f7fe640 1 -- 172.21.15.22:0/4118468216 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0802cbe0 con 0x7fab1015ddb0 2023-11-24T06:13:13.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.890+0000 7fab0f7fe640 1 -- 172.21.15.22:0/4118468216 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080343f0 con 0x7fab1015ddb0 2023-11-24T06:13:13.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.890+0000 7fab15602640 1 -- 172.21.15.22:0/4118468216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1015ddb0 msgr2=0x7fab10070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.890+0000 7fab15602640 1 --2- 172.21.15.22:0/4118468216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1015ddb0 0x7fab10070720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fab100cfcd0 tx=0x7fab0802bee0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.890+0000 7fab15602640 1 -- 172.21.15.22:0/4118468216 shutdown_connections 2023-11-24T06:13:13.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.890+0000 7fab15602640 1 --2- 172.21.15.22:0/4118468216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1015ddb0 0x7fab10070720 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.890+0000 7fab15602640 1 --2- 172.21.15.22:0/4118468216 >> v2:172.21.15.31:3300/0 conn(0x7fab1006d250 0x7fab1015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.890+0000 7fab15602640 1 -- 172.21.15.22:0/4118468216 >> 172.21.15.22:0/4118468216 conn(0x7fab1006a860 msgr2=0x7fab1006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:13.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.891+0000 7fab15602640 1 -- 172.21.15.22:0/4118468216 shutdown_connections 2023-11-24T06:13:13.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.891+0000 7fab15602640 1 -- 172.21.15.22:0/4118468216 wait complete. 2023-11-24T06:13:13.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.893+0000 7fab15602640 1 Processor -- start 2023-11-24T06:13:13.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.893+0000 7fab15602640 1 -- start start 2023-11-24T06:13:13.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.894+0000 7fab15602640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1006d250 0x7fab100cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.894+0000 7fab15602640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab10157770 0x7fab10154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.894+0000 7fab15602640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab1015ddb0 0x7fab1015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.894+0000 7fab15602640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab10157cd0 con 0x7fab1006d250 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.894+0000 7fab15602640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab10157f20 con 0x7fab1015ddb0 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.894+0000 7fab15602640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab10158200 con 0x7fab10157770 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.894+0000 7fab0ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1006d250 0x7fab100cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.894+0000 7fab0ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1006d250 0x7fab100cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39872/0 (socket says 172.21.15.22:39872) 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.894+0000 7fab0ffff640 1 -- 172.21.15.22:0/549414630 learned_addr learned my addr 172.21.15.22:0/549414630 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab14e01640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab1015ddb0 0x7fab1015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab0ffff640 1 -- 172.21.15.22:0/549414630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab10157770 msgr2=0x7fab10154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab0ffff640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab10157770 0x7fab10154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab0ffff640 1 -- 172.21.15.22:0/549414630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab1015ddb0 msgr2=0x7fab1015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:13.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab0ffff640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab1015ddb0 0x7fab1015aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:13.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab0ffff640 1 -- 172.21.15.22:0/549414630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08009b30 con 0x7fab1006d250 2023-11-24T06:13:13.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab0ffff640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1006d250 0x7fab100cb760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fab0000c410 tx=0x7fab0000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:13.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab0d7fa640 1 -- 172.21.15.22:0/549414630 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab000035f0 con 0x7fab1006d250 2023-11-24T06:13:13.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab0d7fa640 1 -- 172.21.15.22:0/549414630 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab00003750 con 0x7fab1006d250 2023-11-24T06:13:13.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab0d7fa640 1 -- 172.21.15.22:0/549414630 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00003b40 con 0x7fab1006d250 2023-11-24T06:13:13.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.895+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab10161c80 con 0x7fab1006d250 2023-11-24T06:13:13.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.896+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab101587c0 con 0x7fab1006d250 2023-11-24T06:13:13.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.897+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab10161ae0 con 0x7fab1006d250 2023-11-24T06:13:13.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.897+0000 7fab0d7fa640 1 -- 172.21.15.22:0/549414630 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab00003ca0 con 0x7fab1006d250 2023-11-24T06:13:13.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.899+0000 7fab0d7fa640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaf006ae40 0x7faaf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:13.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.899+0000 7fab0d7fa640 1 -- 172.21.15.22:0/549414630 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fab000888f0 con 0x7fab1006d250 2023-11-24T06:13:13.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.899+0000 7fab07fff640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaf006ae40 0x7faaf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:13.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.900+0000 7fab07fff640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaf006ae40 0x7faaf006d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faaf8006fd0 tx=0x7faaf8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:13.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:13.903+0000 7fab0d7fa640 1 -- 172.21.15.22:0/549414630 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab10161ae0 con 0x7fab1006d250 2023-11-24T06:13:14.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.141+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab10161ae0 con 0x7fab1006d250 2023-11-24T06:13:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.142+0000 7fab0d7fa640 1 -- 172.21.15.22:0/549414630 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fab10161ae0 con 0x7fab1006d250 2023-11-24T06:13:14.145 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:14.145 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2596011389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2596011389},{"type":"v1","addr":"172.21.15.22:6837","nonce":2596011389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1715395658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1715395658},{"type":"v1","addr":"172.21.15.31:6834","nonce":1715395658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2020783180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2020783180},{"type":"v1","addr":"172.21.15.31:6835","nonce":2020783180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:12:00.092195+0000","modified":"2023-11-24T06:12:03.157366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/4189980327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":4189980327},{"type":"v1","addr":"172.21.15.22:6835","nonce":4189980327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:13:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaf006ae40 msgr2=0x7faaf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaf006ae40 0x7faaf006d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faaf8006fd0 tx=0x7faaf8008040 comp rx=0 tx=0).stop 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1006d250 msgr2=0x7fab100cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1006d250 0x7fab100cb760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fab0000c410 tx=0x7fab0000c8d0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 shutdown_connections 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaf006ae40 0x7faaf006d300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab1015ddb0 0x7fab1015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab10157770 0x7fab10154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 --2- 172.21.15.22:0/549414630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab1006d250 0x7fab100cb760 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 >> 172.21.15.22:0/549414630 conn(0x7fab1006a860 msgr2=0x7fab10155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:14.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 shutdown_connections 2023-11-24T06:13:14.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.145+0000 7fab15602640 1 -- 172.21.15.22:0/549414630 wait complete. 2023-11-24T06:13:14.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.387+0000 7ff590a32640 1 Processor -- start 2023-11-24T06:13:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.387+0000 7ff590a32640 1 -- start start 2023-11-24T06:13:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.389+0000 7ff590a32640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff58c15b3d0 0x7ff58c0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.389+0000 7ff590a32640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0cc550 con 0x7ff58c0cfb20 2023-11-24T06:13:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.389+0000 7ff590a32640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0ce7c0 con 0x7ff58c15aff0 2023-11-24T06:13:14.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.389+0000 7ff590a32640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58c0cf140 con 0x7ff58c15b3d0 2023-11-24T06:13:14.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.389+0000 7ff58affd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff58c0cfb20 0x7ff58c0b3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36906/0 (socket says 172.21.15.22:36906) 2023-11-24T06:13:14.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.389+0000 7ff58affd640 1 -- 172.21.15.22:0/318844348 learned_addr learned my addr 172.21.15.22:0/318844348 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:14.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.389+0000 7ff58bfff640 1 --2- 172.21.15.22:0/318844348 >> v2:172.21.15.22:3300/0 conn(0x7ff58c15b3d0 0x7ff58c0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.390+0000 7ff58a7fc640 1 -- 172.21.15.22:0/318844348 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078277095 0 0) 0x7ff58c0cc550 con 0x7ff58c0cfb20 2023-11-24T06:13:14.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.390+0000 7ff58a7fc640 1 -- 172.21.15.22:0/318844348 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff578003520 con 0x7ff58c0cfb20 2023-11-24T06:13:14.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.390+0000 7ff58bfff640 1 -- 172.21.15.22:0/318844348 >> v1:172.21.15.31:6789/0 conn(0x7ff58c15aff0 legacy=0x7ff58c0cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.390+0000 7ff58bfff640 1 -- 172.21.15.22:0/318844348 >> v1:172.21.15.22:6789/0 conn(0x7ff58c0cfb20 legacy=0x7ff58c0b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.390+0000 7ff58bfff640 1 -- 172.21.15.22:0/318844348 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0cbc20 con 0x7ff58c15b3d0 2023-11-24T06:13:14.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.391+0000 7ff58bfff640 1 --2- 172.21.15.22:0/318844348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c15b3d0 0x7ff58c0cea40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff5840097a0 tx=0x7ff58402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871a9d5f2c3b7096 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:14.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.391+0000 7ff58a7fc640 1 -- 172.21.15.22:0/318844348 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584030610 con 0x7ff58c15b3d0 2023-11-24T06:13:14.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.391+0000 7ff58a7fc640 1 -- 172.21.15.22:0/318844348 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584030770 con 0x7ff58c15b3d0 2023-11-24T06:13:14.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.391+0000 7ff58a7fc640 1 -- 172.21.15.22:0/318844348 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584030b00 con 0x7ff58c15b3d0 2023-11-24T06:13:14.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.392+0000 7ff590a32640 1 -- 172.21.15.22:0/318844348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c15b3d0 msgr2=0x7ff58c0cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.392+0000 7ff590a32640 1 --2- 172.21.15.22:0/318844348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c15b3d0 0x7ff58c0cea40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff5840097a0 tx=0x7ff58402b960 comp rx=0 tx=0).stop 2023-11-24T06:13:14.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.392+0000 7ff590a32640 1 -- 172.21.15.22:0/318844348 shutdown_connections 2023-11-24T06:13:14.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.392+0000 7ff590a32640 1 --2- 172.21.15.22:0/318844348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c15b3d0 0x7ff58c0cea40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.392+0000 7ff590a32640 1 -- 172.21.15.22:0/318844348 >> 172.21.15.22:0/318844348 conn(0x7ff58c0d0e70 msgr2=0x7ff58c0d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:14.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.392+0000 7ff590a32640 1 -- 172.21.15.22:0/318844348 shutdown_connections 2023-11-24T06:13:14.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.392+0000 7ff590a32640 1 -- 172.21.15.22:0/318844348 wait complete. 2023-11-24T06:13:14.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.394+0000 7ff590a32640 1 Processor -- start 2023-11-24T06:13:14.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.394+0000 7ff590a32640 1 -- start start 2023-11-24T06:13:14.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.395+0000 7ff590a32640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c0cfb20 0x7ff58c0c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.395+0000 7ff590a32640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff58c15aff0 0x7ff58c1f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.395+0000 7ff590a32640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff58c15b3d0 0x7ff58c073310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.395+0000 7ff590a32640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0ce0f0 con 0x7ff58c0cfb20 2023-11-24T06:13:14.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.395+0000 7ff590a32640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0ca050 con 0x7ff58c15b3d0 2023-11-24T06:13:14.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.395+0000 7ff590a32640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c1f8180 con 0x7ff58c15aff0 2023-11-24T06:13:14.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.395+0000 7ff58b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c0cfb20 0x7ff58c0c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c0cfb20 0x7ff58c0c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39894/0 (socket says 172.21.15.22:39894) 2023-11-24T06:13:14.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58b7fe640 1 -- 172.21.15.22:0/1598913409 learned_addr learned my addr 172.21.15.22:0/1598913409 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:14.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58affd640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff58c15aff0 0x7ff58c1f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58bfff640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff58c15b3d0 0x7ff58c073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58b7fe640 1 -- 172.21.15.22:0/1598913409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff58c15aff0 msgr2=0x7ff58c1f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58b7fe640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff58c15aff0 0x7ff58c1f7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58b7fe640 1 -- 172.21.15.22:0/1598913409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff58c15b3d0 msgr2=0x7ff58c073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58b7fe640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff58c15b3d0 0x7ff58c073310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58b7fe640 1 -- 172.21.15.22:0/1598913409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584009400 con 0x7ff58c0cfb20 2023-11-24T06:13:14.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff58b7fe640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c0cfb20 0x7ff58c0c9b10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c870 tx=0x7ff57c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:14.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.396+0000 7ff583fff640 1 -- 172.21.15.22:0/1598913409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c003b70 con 0x7ff58c0cfb20 2023-11-24T06:13:14.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.397+0000 7ff583fff640 1 -- 172.21.15.22:0/1598913409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c003cf0 con 0x7ff58c0cfb20 2023-11-24T06:13:14.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.397+0000 7ff583fff640 1 -- 172.21.15.22:0/1598913409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00aa90 con 0x7ff58c0cfb20 2023-11-24T06:13:14.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.397+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c0c7cf0 con 0x7ff58c0cfb20 2023-11-24T06:13:14.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.397+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c0c9030 con 0x7ff58c0cfb20 2023-11-24T06:13:14.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.398+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c04e840 con 0x7ff58c0cfb20 2023-11-24T06:13:14.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.399+0000 7ff583fff640 1 -- 172.21.15.22:0/1598913409 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff57c00abf0 con 0x7ff58c0cfb20 2023-11-24T06:13:14.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.400+0000 7ff583fff640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff56c06ae40 0x7ff56c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.400+0000 7ff583fff640 1 -- 172.21.15.22:0/1598913409 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff57c089570 con 0x7ff58c0cfb20 2023-11-24T06:13:14.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.400+0000 7ff58affd640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff56c06ae40 0x7ff56c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.401+0000 7ff58affd640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff56c06ae40 0x7ff56c06d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff58c06d730 tx=0x7ff574009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:14.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.404+0000 7ff583fff640 1 -- 172.21.15.22:0/1598913409 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff57c054590 con 0x7ff58c0cfb20 2023-11-24T06:13:14.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.598+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff58c0ca250 con 0x7ff58c0cfb20 2023-11-24T06:13:14.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.601+0000 7ff583fff640 1 -- 172.21.15.22:0/1598913409 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7ff57c003e60 con 0x7ff58c0cfb20 2023-11-24T06:13:14.604 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:14.605 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:14.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff56c06ae40 msgr2=0x7ff56c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff56c06ae40 0x7ff56c06d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff58c06d730 tx=0x7ff574009040 comp rx=0 tx=0).stop 2023-11-24T06:13:14.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c0cfb20 msgr2=0x7ff58c0c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c0cfb20 0x7ff58c0c9b10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c870 tx=0x7ff57c00cd30 comp rx=0 tx=0).stop 2023-11-24T06:13:14.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 shutdown_connections 2023-11-24T06:13:14.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff56c06ae40 0x7ff56c06d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff58c15b3d0 0x7ff58c073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff58c15aff0 0x7ff58c1f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 --2- 172.21.15.22:0/1598913409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff58c0cfb20 0x7ff58c0c9b10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 >> 172.21.15.22:0/1598913409 conn(0x7ff58c0d0e70 msgr2=0x7ff58c0b62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:14.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 shutdown_connections 2023-11-24T06:13:14.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.604+0000 7ff590a32640 1 -- 172.21.15.22:0/1598913409 wait complete. 2023-11-24T06:13:14.629 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:13:14.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:14.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.850+0000 7f3702990640 1 Processor -- start 2023-11-24T06:13:14.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.850+0000 7f3702990640 1 -- start start 2023-11-24T06:13:14.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.851+0000 7f3702990640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f36fc06d520 0x7f36fc06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.851+0000 7f3702990640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36fc0ad720 0x7f36fc15ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.851+0000 7f3702990640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36fc15c360 con 0x7f36fc0abff0 2023-11-24T06:13:14.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.851+0000 7f3702990640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc0b41a0 con 0x7f36fc0ad720 2023-11-24T06:13:14.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.851+0000 7f3702990640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc06de40 con 0x7f36fc06d520 2023-11-24T06:13:14.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.851+0000 7f36fb7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36fc0ad720 0x7f36fc15ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.851+0000 7f36fb7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36fc0ad720 0x7f36fc15ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39910/0 (socket says 172.21.15.22:39910) 2023-11-24T06:13:14.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.851+0000 7f36fb7fe640 1 -- 172.21.15.22:0/1433757377 learned_addr learned my addr 172.21.15.22:0/1433757377 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:14.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.852+0000 7f36fbfff640 1 --2- 172.21.15.22:0/1433757377 >> v2:172.21.15.31:3300/0 conn(0x7f36fc06d520 0x7f36fc06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.852+0000 7f36fb7fe640 1 -- 172.21.15.22:0/1433757377 >> v2:172.21.15.31:3300/0 conn(0x7f36fc06d520 msgr2=0x7f36fc06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:14.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.852+0000 7f36fb7fe640 1 --2- 172.21.15.22:0/1433757377 >> v2:172.21.15.31:3300/0 conn(0x7f36fc06d520 0x7f36fc06d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.852+0000 7f36fb7fe640 1 -- 172.21.15.22:0/1433757377 >> v1:172.21.15.31:6789/0 conn(0x7f36fc0abff0 legacy=0x7f36fc15f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:14.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.852+0000 7f36fb7fe640 1 -- 172.21.15.22:0/1433757377 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc15ba30 con 0x7f36fc0ad720 2023-11-24T06:13:14.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.853+0000 7f36fb7fe640 1 --2- 172.21.15.22:0/1433757377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 0x7f36fc15ecd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f36fc06c070 tx=0x7f36e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b4649ce1a37d60 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.854+0000 7f36faffd640 1 -- 172.21.15.22:0/1433757377 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4031870 con 0x7f36fc0ad720 2023-11-24T06:13:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.854+0000 7f36faffd640 1 -- 172.21.15.22:0/1433757377 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e40319d0 con 0x7f36fc0ad720 2023-11-24T06:13:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.854+0000 7f36faffd640 1 -- 172.21.15.22:0/1433757377 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4031d60 con 0x7f36fc0ad720 2023-11-24T06:13:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.855+0000 7f3702990640 1 -- 172.21.15.22:0/1433757377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 msgr2=0x7f36fc15ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.855+0000 7f3702990640 1 --2- 172.21.15.22:0/1433757377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 0x7f36fc15ecd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f36fc06c070 tx=0x7f36e402b910 comp rx=0 tx=0).stop 2023-11-24T06:13:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.855+0000 7f3702990640 1 -- 172.21.15.22:0/1433757377 shutdown_connections 2023-11-24T06:13:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.855+0000 7f3702990640 1 --2- 172.21.15.22:0/1433757377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 0x7f36fc15ecd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.855+0000 7f3702990640 1 --2- 172.21.15.22:0/1433757377 >> v2:172.21.15.31:3300/0 conn(0x7f36fc06d520 0x7f36fc06d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.855+0000 7f3702990640 1 -- 172.21.15.22:0/1433757377 >> 172.21.15.22:0/1433757377 conn(0x7f36fc0b0d80 msgr2=0x7f36fc0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.855+0000 7f3702990640 1 -- 172.21.15.22:0/1433757377 shutdown_connections 2023-11-24T06:13:14.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.855+0000 7f3702990640 1 -- 172.21.15.22:0/1433757377 wait complete. 2023-11-24T06:13:14.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.857+0000 7f3702990640 1 Processor -- start 2023-11-24T06:13:14.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.857+0000 7f3702990640 1 -- start start 2023-11-24T06:13:14.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.858+0000 7f3702990640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36fc06d520 0x7f36fc157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.858+0000 7f3702990640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36fc0abff0 0x7f36fc14a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.858+0000 7f3702990640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 0x7f36fc14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.858+0000 7f3702990640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc151ea0 con 0x7f36fc0ad720 2023-11-24T06:13:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.858+0000 7f3702990640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc14ada0 con 0x7f36fc06d520 2023-11-24T06:13:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.858+0000 7f3702990640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0cda40 con 0x7f36fc0abff0 2023-11-24T06:13:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.858+0000 7f3700f2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 0x7f36fc14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.858+0000 7f3700f2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 0x7f36fc14a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39916/0 (socket says 172.21.15.22:39916) 2023-11-24T06:13:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.858+0000 7f3700f2d640 1 -- 172.21.15.22:0/569740940 learned_addr learned my addr 172.21.15.22:0/569740940 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f36fbfff640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36fc06d520 0x7f36fc157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f3700f2d640 1 -- 172.21.15.22:0/569740940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36fc0abff0 msgr2=0x7f36fc14a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f36fb7fe640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36fc0abff0 0x7f36fc14a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f3700f2d640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36fc0abff0 0x7f36fc14a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f3700f2d640 1 -- 172.21.15.22:0/569740940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36fc06d520 msgr2=0x7f36fc157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:14.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f3700f2d640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36fc06d520 0x7f36fc157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:14.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f3700f2d640 1 -- 172.21.15.22:0/569740940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40094d0 con 0x7f36fc0ad720 2023-11-24T06:13:14.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f36fbfff640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36fc06d520 0x7f36fc157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:14.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f3700f2d640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 0x7f36fc14a860 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c3e0 tx=0x7f36f400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.859+0000 7f36f8ff9640 1 -- 172.21.15.22:0/569740940 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4011790 con 0x7f36fc0ad720 2023-11-24T06:13:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.860+0000 7f36f8ff9640 1 -- 172.21.15.22:0/569740940 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f40118f0 con 0x7f36fc0ad720 2023-11-24T06:13:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.860+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc1520b0 con 0x7f36fc0ad720 2023-11-24T06:13:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.860+0000 7f36f8ff9640 1 -- 172.21.15.22:0/569740940 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4011ce0 con 0x7f36fc0ad720 2023-11-24T06:13:14.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.860+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc152670 con 0x7f36fc0ad720 2023-11-24T06:13:14.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.861+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc074770 con 0x7f36fc0ad720 2023-11-24T06:13:14.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.862+0000 7f36f8ff9640 1 -- 172.21.15.22:0/569740940 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36f401c460 con 0x7f36fc0ad720 2023-11-24T06:13:14.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.863+0000 7f36f8ff9640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36dc06ae40 0x7f36dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:14.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.863+0000 7f36f8ff9640 1 -- 172.21.15.22:0/569740940 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f36f4089570 con 0x7f36fc0ad720 2023-11-24T06:13:14.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.863+0000 7f36fbfff640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36dc06ae40 0x7f36dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:14.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.864+0000 7f36fbfff640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36dc06ae40 0x7f36dc06d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f36fc06ee80 tx=0x7f36ec0039f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:14.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:14.868+0000 7f36f8ff9640 1 -- 172.21.15.22:0/569740940 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36f4054570 con 0x7f36fc0ad720 2023-11-24T06:13:15.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.104+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36fc15b6b0 con 0x7f36fc0ad720 2023-11-24T06:13:15.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.105+0000 7f36f8ff9640 1 -- 172.21.15.22:0/569740940 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f36f4057b90 con 0x7f36fc0ad720 2023-11-24T06:13:15.108 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:15.108 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2596011389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2596011389},{"type":"v1","addr":"172.21.15.22:6837","nonce":2596011389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1715395658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1715395658},{"type":"v1","addr":"172.21.15.31:6834","nonce":1715395658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2020783180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2020783180},{"type":"v1","addr":"172.21.15.31:6835","nonce":2020783180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:12:00.092195+0000","modified":"2023-11-24T06:12:03.157366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/4189980327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":4189980327},{"type":"v1","addr":"172.21.15.22:6835","nonce":4189980327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:13:15.109 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-11-24T06:13:15.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.108+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36dc06ae40 msgr2=0x7f36dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.108+0000 7f3702990640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36dc06ae40 0x7f36dc06d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f36fc06ee80 tx=0x7f36ec0039f0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 msgr2=0x7f36fc14a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 0x7f36fc14a860 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c3e0 tx=0x7f36f400c8a0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 shutdown_connections 2023-11-24T06:13:15.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f36dc06ae40 0x7f36dc06d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc0ad720 0x7f36fc14a860 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36fc0abff0 0x7f36fc14a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 --2- 172.21.15.22:0/569740940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36fc06d520 0x7f36fc157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 >> 172.21.15.22:0/569740940 conn(0x7f36fc0b0d80 msgr2=0x7f36fc0acc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:15.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 shutdown_connections 2023-11-24T06:13:15.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.109+0000 7f3702990640 1 -- 172.21.15.22:0/569740940 wait complete. 2023-11-24T06:13:15.132 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:15.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.355+0000 7f634bfff640 1 Processor -- start 2023-11-24T06:13:15.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.355+0000 7f634bfff640 1 -- start start 2023-11-24T06:13:15.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.357+0000 7f634bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f634c0cf050 0x7f634c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.357+0000 7f634bfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f634c0cd7b0 0x7f634c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.357+0000 7f634bfff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c15fa70 con 0x7f634c13dfd0 2023-11-24T06:13:15.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.357+0000 7f634bfff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0cfa40 con 0x7f634c0cd7b0 2023-11-24T06:13:15.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.357+0000 7f634bfff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c15c580 con 0x7f634c0cf050 2023-11-24T06:13:15.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.358+0000 7f634b7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f634c0cd7b0 0x7f634c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.358+0000 7f634b7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f634c0cd7b0 0x7f634c0cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39922/0 (socket says 172.21.15.22:39922) 2023-11-24T06:13:15.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.358+0000 7f634b7fe640 1 -- 172.21.15.22:0/3629516357 learned_addr learned my addr 172.21.15.22:0/3629516357 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:15.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.358+0000 7f634a7fc640 1 --2- 172.21.15.22:0/3629516357 >> v2:172.21.15.31:3300/0 conn(0x7f634c0cf050 0x7f634c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.358+0000 7f634b7fe640 1 -- 172.21.15.22:0/3629516357 >> v2:172.21.15.31:3300/0 conn(0x7f634c0cf050 msgr2=0x7f634c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:15.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.358+0000 7f634b7fe640 1 --2- 172.21.15.22:0/3629516357 >> v2:172.21.15.31:3300/0 conn(0x7f634c0cf050 0x7f634c0cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.358+0000 7f634b7fe640 1 -- 172.21.15.22:0/3629516357 >> v1:172.21.15.31:6789/0 conn(0x7f634c13dfd0 legacy=0x7f634c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:15.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.358+0000 7f634b7fe640 1 -- 172.21.15.22:0/3629516357 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c140900 con 0x7f634c0cd7b0 2023-11-24T06:13:15.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.360+0000 7f634b7fe640 1 --2- 172.21.15.22:0/3629516357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cd7b0 0x7f634c0cdbb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f634c06e070 tx=0x7f634402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04be97fae706ef8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:15.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.360+0000 7f6349ffb640 1 -- 172.21.15.22:0/3629516357 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634402ca80 con 0x7f634c0cd7b0 2023-11-24T06:13:15.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.360+0000 7f6349ffb640 1 -- 172.21.15.22:0/3629516357 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634402cbe0 con 0x7f634c0cd7b0 2023-11-24T06:13:15.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.360+0000 7f6349ffb640 1 -- 172.21.15.22:0/3629516357 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63440343f0 con 0x7f634c0cd7b0 2023-11-24T06:13:15.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.361+0000 7f634bfff640 1 -- 172.21.15.22:0/3629516357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cd7b0 msgr2=0x7f634c0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.361+0000 7f634bfff640 1 --2- 172.21.15.22:0/3629516357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cd7b0 0x7f634c0cdbb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f634c06e070 tx=0x7f634402bee0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.361+0000 7f634bfff640 1 -- 172.21.15.22:0/3629516357 shutdown_connections 2023-11-24T06:13:15.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.361+0000 7f634bfff640 1 --2- 172.21.15.22:0/3629516357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cd7b0 0x7f634c0cdbb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.361+0000 7f634bfff640 1 --2- 172.21.15.22:0/3629516357 >> v2:172.21.15.31:3300/0 conn(0x7f634c0cf050 0x7f634c0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.361+0000 7f634bfff640 1 -- 172.21.15.22:0/3629516357 >> 172.21.15.22:0/3629516357 conn(0x7f634c06a860 msgr2=0x7f634c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:15.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.361+0000 7f634bfff640 1 -- 172.21.15.22:0/3629516357 shutdown_connections 2023-11-24T06:13:15.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.361+0000 7f634bfff640 1 -- 172.21.15.22:0/3629516357 wait complete. 2023-11-24T06:13:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.363+0000 7f634bfff640 1 Processor -- start 2023-11-24T06:13:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.363+0000 7f634bfff640 1 -- start start 2023-11-24T06:13:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.364+0000 7f634bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c0cd7b0 0x7f634c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.364+0000 7f634bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cf050 0x7f634c0b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.364+0000 7f634bfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c13dfd0 0x7f634c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.364+0000 7f634bfff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c154110 con 0x7f634c0cf050 2023-11-24T06:13:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.364+0000 7f634bfff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0c8280 con 0x7f634c0cd7b0 2023-11-24T06:13:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.364+0000 7f634bfff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0cad80 con 0x7f634c13dfd0 2023-11-24T06:13:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cf050 0x7f634c0b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cf050 0x7f634c0b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39926/0 (socket says 172.21.15.22:39926) 2023-11-24T06:13:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634a7fc640 1 -- 172.21.15.22:0/1738380092 learned_addr learned my addr 172.21.15.22:0/1738380092 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:15.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634affd640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c0cd7b0 0x7f634c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634a7fc640 1 -- 172.21.15.22:0/1738380092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c13dfd0 msgr2=0x7f634c0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634b7fe640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c13dfd0 0x7f634c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634a7fc640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c13dfd0 0x7f634c0b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634a7fc640 1 -- 172.21.15.22:0/1738380092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c0cd7b0 msgr2=0x7f634c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634a7fc640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c0cd7b0 0x7f634c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634a7fc640 1 -- 172.21.15.22:0/1738380092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344009b30 con 0x7f634c0cf050 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.365+0000 7f634affd640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c0cd7b0 0x7f634c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.366+0000 7f634a7fc640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cf050 0x7f634c0b3120 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f634000d800 tx=0x7f634000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.366+0000 7f6333fff640 1 -- 172.21.15.22:0/1738380092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634000b660 con 0x7f634c0cf050 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.366+0000 7f6333fff640 1 -- 172.21.15.22:0/1738380092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634000b7c0 con 0x7f634c0cf050 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.366+0000 7f6333fff640 1 -- 172.21.15.22:0/1738380092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634000bb50 con 0x7f634c0cf050 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.366+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c1309f0 con 0x7f634c0cf050 2023-11-24T06:13:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.366+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c0b36c0 con 0x7f634c0cf050 2023-11-24T06:13:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.368+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c04e840 con 0x7f634c0cf050 2023-11-24T06:13:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.368+0000 7f6333fff640 1 -- 172.21.15.22:0/1738380092 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f634000bcb0 con 0x7f634c0cf050 2023-11-24T06:13:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.369+0000 7f6333fff640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f633806ae40 0x7f633806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.369+0000 7f6333fff640 1 -- 172.21.15.22:0/1738380092 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f6340089bc0 con 0x7f634c0cf050 2023-11-24T06:13:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.370+0000 7f634affd640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f633806ae40 0x7f633806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.371+0000 7f634affd640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f633806ae40 0x7f633806d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f633c00a810 tx=0x7f633c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:15.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.375+0000 7f6333fff640 1 -- 172.21.15.22:0/1738380092 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6340054be0 con 0x7f634c0cf050 2023-11-24T06:13:15.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.605+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f634c0ce9a0 con 0x7f634c0cf050 2023-11-24T06:13:15.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.606+0000 7f6333fff640 1 -- 172.21.15.22:0/1738380092 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f6340058200 con 0x7f634c0cf050 2023-11-24T06:13:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:15.609 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2596011389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2596011389},{"type":"v1","addr":"172.21.15.22:6837","nonce":2596011389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1715395658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1715395658},{"type":"v1","addr":"172.21.15.31:6834","nonce":1715395658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2020783180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2020783180},{"type":"v1","addr":"172.21.15.31:6835","nonce":2020783180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:12:00.092195+0000","modified":"2023-11-24T06:12:03.157366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/4189980327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":4189980327},{"type":"v1","addr":"172.21.15.22:6835","nonce":4189980327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:13:15.609 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-11-24T06:13:15.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f633806ae40 msgr2=0x7f633806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f633806ae40 0x7f633806d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f633c00a810 tx=0x7f633c008040 comp rx=0 tx=0).stop 2023-11-24T06:13:15.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cf050 msgr2=0x7f634c0b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cf050 0x7f634c0b3120 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f634000d800 tx=0x7f634000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 shutdown_connections 2023-11-24T06:13:15.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f633806ae40 0x7f633806d300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c13dfd0 0x7f634c0b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f634c0cf050 0x7f634c0b3120 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 --2- 172.21.15.22:0/1738380092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c0cd7b0 0x7f634c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 >> 172.21.15.22:0/1738380092 conn(0x7f634c06a860 msgr2=0x7f634c15ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:15.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 shutdown_connections 2023-11-24T06:13:15.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.608+0000 7f634bfff640 1 -- 172.21.15.22:0/1738380092 wait complete. 2023-11-24T06:13:15.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:15.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.839+0000 7fa8398d3640 1 Processor -- start 2023-11-24T06:13:15.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.840+0000 7fa8398d3640 1 -- start start 2023-11-24T06:13:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.841+0000 7fa8398d3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa83406d520 0x7fa83406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.841+0000 7fa8398d3640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83415c360 con 0x7fa8340ad720 2023-11-24T06:13:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.841+0000 7fa8398d3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83415faf0 con 0x7fa8340abff0 2023-11-24T06:13:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.841+0000 7fa8398d3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8340b41a0 con 0x7fa83406d520 2023-11-24T06:13:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.842+0000 7fa82a7fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa8340ad720 0x7fa83415ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36920/0 (socket says 172.21.15.22:36920) 2023-11-24T06:13:15.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.842+0000 7fa82a7fc640 1 -- 172.21.15.22:0/4284075438 learned_addr learned my addr 172.21.15.22:0/4284075438 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:15.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.842+0000 7fa832ffd640 1 --2- 172.21.15.22:0/4284075438 >> v2:172.21.15.31:3300/0 conn(0x7fa83406d520 0x7fa83406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.842+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210386261 0 0) 0x7fa83415c360 con 0x7fa8340ad720 2023-11-24T06:13:15.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.842+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa820003520 con 0x7fa8340ad720 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969926137 0 0) 0x7fa820003520 con 0x7fa8340ad720 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 >> v2:172.21.15.31:3300/0 conn(0x7fa83406d520 msgr2=0x7fa83406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 --2- 172.21.15.22:0/4284075438 >> v2:172.21.15.31:3300/0 conn(0x7fa83406d520 0x7fa83406d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 >> v1:172.21.15.31:6789/0 conn(0x7fa8340abff0 legacy=0x7fa83415f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83406de40 con 0x7fa8340ad720 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fa81c0019f0 con 0x7fa8340ad720 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 >> v1:172.21.15.22:6789/0 conn(0x7fa8340ad720 legacy=0x7fa83415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 --2- 172.21.15.22:0/4284075438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa820003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 --2- 172.21.15.22:0/4284075438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8200047c0 0x7fa820004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 --2- 172.21.15.22:0/4284075438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa820005180 0x7fa82000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82000bff0 con 0x7fa820003970 2023-11-24T06:13:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82000c160 con 0x7fa820005180 2023-11-24T06:13:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82000c320 con 0x7fa8200047c0 2023-11-24T06:13:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa832ffd640 1 --2- 172.21.15.22:0/4284075438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa820003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa832ffd640 1 -- 172.21.15.22:0/4284075438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8200047c0 msgr2=0x7fa820004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa832ffd640 1 --2- 172.21.15.22:0/4284075438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8200047c0 0x7fa820004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa832ffd640 1 -- 172.21.15.22:0/4284075438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa820005180 msgr2=0x7fa82000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa832ffd640 1 --2- 172.21.15.22:0/4284075438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa820005180 0x7fa82000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.843+0000 7fa832ffd640 1 -- 172.21.15.22:0/4284075438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa820003520 con 0x7fa820003970 2023-11-24T06:13:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.844+0000 7fa8337fe640 1 -- 172.21.15.22:0/4284075438 reap_dead start 2023-11-24T06:13:15.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.845+0000 7fa832ffd640 1 --2- 172.21.15.22:0/4284075438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa820003d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa824009ac0 tx=0x7fa8200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2284e0dbf97a3a4d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.845+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82402c6f0 con 0x7fa820003970 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.845+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82402c850 con 0x7fa820003970 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.845+0000 7fa8327fc640 1 -- 172.21.15.22:0/4284075438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82402cbe0 con 0x7fa820003970 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.845+0000 7fa8398d3640 1 -- 172.21.15.22:0/4284075438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 msgr2=0x7fa820003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.845+0000 7fa8398d3640 1 --2- 172.21.15.22:0/4284075438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa820003d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa824009ac0 tx=0x7fa8200057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.845+0000 7fa8398d3640 1 -- 172.21.15.22:0/4284075438 shutdown_connections 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.845+0000 7fa8398d3640 1 --2- 172.21.15.22:0/4284075438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa820003d90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.846+0000 7fa8398d3640 1 -- 172.21.15.22:0/4284075438 >> 172.21.15.22:0/4284075438 conn(0x7fa8340b0d80 msgr2=0x7fa8340b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.846+0000 7fa8398d3640 1 -- 172.21.15.22:0/4284075438 shutdown_connections 2023-11-24T06:13:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.846+0000 7fa8398d3640 1 -- 172.21.15.22:0/4284075438 wait complete. 2023-11-24T06:13:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.847+0000 7fa8398d3640 1 Processor -- start 2023-11-24T06:13:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.848+0000 7fa8398d3640 1 -- start start 2023-11-24T06:13:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa8398d3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa8341f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa8398d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8340ce9c0 0x7fa8341f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa8398d3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa834152120 0x7fa834141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa8398d3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340c8400 con 0x7fa820003970 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa8398d3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340cab70 con 0x7fa8340ce9c0 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa8398d3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8341f2d70 con 0x7fa834152120 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa832ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa8341f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa832ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa8341f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39932/0 (socket says 172.21.15.22:39932) 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa832ffd640 1 -- 172.21.15.22:0/796721015 learned_addr learned my addr 172.21.15.22:0/796721015 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa82a7fc640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8340ce9c0 0x7fa8341f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa832ffd640 1 -- 172.21.15.22:0/796721015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa834152120 msgr2=0x7fa834141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa8337fe640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa834152120 0x7fa834141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.849+0000 7fa832ffd640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa834152120 0x7fa834141320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa832ffd640 1 -- 172.21.15.22:0/796721015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8340ce9c0 msgr2=0x7fa8341f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa832ffd640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8340ce9c0 0x7fa8341f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:15.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa832ffd640 1 -- 172.21.15.22:0/796721015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8340c8610 con 0x7fa820003970 2023-11-24T06:13:15.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa82a7fc640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8340ce9c0 0x7fa8341f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:15.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa832ffd640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa8341f22f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa82402c290 tx=0x7fa824004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:15.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa830ff9640 1 -- 172.21.15.22:0/796721015 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824003810 con 0x7fa820003970 2023-11-24T06:13:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa830ff9640 1 -- 172.21.15.22:0/796721015 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa824003970 con 0x7fa820003970 2023-11-24T06:13:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa830ff9640 1 -- 172.21.15.22:0/796721015 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824003ce0 con 0x7fa820003970 2023-11-24T06:13:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8340cad80 con 0x7fa820003970 2023-11-24T06:13:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.850+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa834141860 con 0x7fa820003970 2023-11-24T06:13:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.852+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa834074770 con 0x7fa820003970 2023-11-24T06:13:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.852+0000 7fa830ff9640 1 -- 172.21.15.22:0/796721015 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa824040450 con 0x7fa820003970 2023-11-24T06:13:15.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.853+0000 7fa830ff9640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa81406ae40 0x7fa81406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.853+0000 7fa830ff9640 1 -- 172.21.15.22:0/796721015 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa8240ab540 con 0x7fa820003970 2023-11-24T06:13:15.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.854+0000 7fa82a7fc640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa81406ae40 0x7fa81406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.854+0000 7fa82a7fc640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa81406ae40 0x7fa81406d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa81c001560 tx=0x7fa81c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:15.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:15.858+0000 7fa830ff9640 1 -- 172.21.15.22:0/796721015 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa824076560 con 0x7fa820003970 2023-11-24T06:13:16.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.054+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8340c88f0 con 0x7fa820003970 2023-11-24T06:13:16.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.056+0000 7fa830ff9640 1 -- 172.21.15.22:0/796721015 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16753 (secure 0 0 0) 0x7fa824079b80 con 0x7fa820003970 2023-11-24T06:13:16.059 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:16.059 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:12:42.395910+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:11:58.565118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:11:59.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:16.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.059+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa81406ae40 msgr2=0x7fa81406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.059+0000 7fa8398d3640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa81406ae40 0x7fa81406d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa81c001560 tx=0x7fa81c009040 comp rx=0 tx=0).stop 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.059+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 msgr2=0x7fa8341f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.059+0000 7fa8398d3640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa8341f22f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa82402c290 tx=0x7fa824004730 comp rx=0 tx=0).stop 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.059+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 shutdown_connections 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.059+0000 7fa8398d3640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa81406ae40 0x7fa81406d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.059+0000 7fa8398d3640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa834152120 0x7fa834141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.059+0000 7fa8398d3640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8340ce9c0 0x7fa8341f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.059+0000 7fa8398d3640 1 --2- 172.21.15.22:0/796721015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820003970 0x7fa8341f22f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.060+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 >> 172.21.15.22:0/796721015 conn(0x7fa8340b0d80 msgr2=0x7fa8340acca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.060+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 shutdown_connections 2023-11-24T06:13:16.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.060+0000 7fa8398d3640 1 -- 172.21.15.22:0/796721015 wait complete. 2023-11-24T06:13:16.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:13:16.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.299+0000 7fcffd31d640 1 Processor -- start 2023-11-24T06:13:16.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.299+0000 7fcffd31d640 1 -- start start 2023-11-24T06:13:16.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.300+0000 7fcffd31d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcff80b39a0 0x7fcff8072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.300+0000 7fcffd31d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff806d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.300+0000 7fcffd31d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff80ac760 con 0x7fcff815a090 2023-11-24T06:13:16.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.300+0000 7fcffd31d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff815a7f0 con 0x7fcff80b39a0 2023-11-24T06:13:16.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.301+0000 7fcffd31d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff815aad0 con 0x7fcff80abff0 2023-11-24T06:13:16.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.301+0000 7fcff77fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff806d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.301+0000 7fcff67fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcff80b39a0 0x7fcff8072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.301+0000 7fcff77fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff806d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:37602/0 (socket says 172.21.15.22:37602) 2023-11-24T06:13:16.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.301+0000 7fcff67fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcff80b39a0 0x7fcff8072150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:51318/0 (socket says 172.21.15.22:51318) 2023-11-24T06:13:16.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.301+0000 7fcff77fe640 1 -- 172.21.15.22:0/3068804714 learned_addr learned my addr 172.21.15.22:0/3068804714 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.302+0000 7fcff67fc640 1 -- 172.21.15.22:0/3068804714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 msgr2=0x7fcff806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.302+0000 7fcff67fc640 1 --2- 172.21.15.22:0/3068804714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff806d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.302+0000 7fcff67fc640 1 -- 172.21.15.22:0/3068804714 >> v1:172.21.15.31:6789/0 conn(0x7fcff815a090 legacy=0x7fcff80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.302+0000 7fcff67fc640 1 -- 172.21.15.22:0/3068804714 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff815adb0 con 0x7fcff80b39a0 2023-11-24T06:13:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.302+0000 7fcff77fe640 1 --2- 172.21.15.22:0/3068804714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff806d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:16.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.304+0000 7fcff67fc640 1 --2- 172.21.15.22:0/3068804714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff80b39a0 0x7fcff8072150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cba416d1d525146 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.305+0000 7fcff5ffb640 1 -- 172.21.15.22:0/3068804714 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe802cc60 con 0x7fcff80b39a0 2023-11-24T06:13:16.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.305+0000 7fcff5ffb640 1 -- 172.21.15.22:0/3068804714 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe802cdc0 con 0x7fcff80b39a0 2023-11-24T06:13:16.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.305+0000 7fcff5ffb640 1 -- 172.21.15.22:0/3068804714 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8034660 con 0x7fcff80b39a0 2023-11-24T06:13:16.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.306+0000 7fcffd31d640 1 -- 172.21.15.22:0/3068804714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff80b39a0 msgr2=0x7fcff8072150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.306+0000 7fcffd31d640 1 --2- 172.21.15.22:0/3068804714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff80b39a0 0x7fcff8072150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe802beb0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.306+0000 7fcffd31d640 1 -- 172.21.15.22:0/3068804714 shutdown_connections 2023-11-24T06:13:16.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.306+0000 7fcffd31d640 1 --2- 172.21.15.22:0/3068804714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff806d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.306+0000 7fcffd31d640 1 --2- 172.21.15.22:0/3068804714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff80b39a0 0x7fcff8072150 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.306+0000 7fcffd31d640 1 -- 172.21.15.22:0/3068804714 >> 172.21.15.22:0/3068804714 conn(0x7fcff80b0d80 msgr2=0x7fcff80b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:16.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.306+0000 7fcffd31d640 1 -- 172.21.15.22:0/3068804714 shutdown_connections 2023-11-24T06:13:16.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.306+0000 7fcffd31d640 1 -- 172.21.15.22:0/3068804714 wait complete. 2023-11-24T06:13:16.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.308+0000 7fcffd31d640 1 Processor -- start 2023-11-24T06:13:16.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.308+0000 7fcffd31d640 1 -- start start 2023-11-24T06:13:16.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcffd31d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff81472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcffd31d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff80b39a0 0x7fcff81f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcffd31d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff815a090 0x7fcff8156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcffd31d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81ef100 con 0x7fcff80b39a0 2023-11-24T06:13:16.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcffd31d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81ef2d0 con 0x7fcff815a090 2023-11-24T06:13:16.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcffd31d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80cd2a0 con 0x7fcff80abff0 2023-11-24T06:13:16.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcff67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff80b39a0 0x7fcff81f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcff67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff80b39a0 0x7fcff81f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39934/0 (socket says 172.21.15.22:39934) 2023-11-24T06:13:16.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcff67fc640 1 -- 172.21.15.22:0/2356073653 learned_addr learned my addr 172.21.15.22:0/2356073653 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:16.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcff77fe640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff815a090 0x7fcff8156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.310+0000 7fcff6ffd640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff81472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.311+0000 7fcff67fc640 1 -- 172.21.15.22:0/2356073653 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 msgr2=0x7fcff81472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.311+0000 7fcff67fc640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff81472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.311+0000 7fcff67fc640 1 -- 172.21.15.22:0/2356073653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff815a090 msgr2=0x7fcff8156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.311+0000 7fcff67fc640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff815a090 0x7fcff8156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.311+0000 7fcff67fc640 1 -- 172.21.15.22:0/2356073653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff000b770 con 0x7fcff80b39a0 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.311+0000 7fcff6ffd640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff81472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.311+0000 7fcff67fc640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff80b39a0 0x7fcff81f2710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.311+0000 7fcfef7fe640 1 -- 172.21.15.22:0/2356073653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe803e610 con 0x7fcff80b39a0 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.312+0000 7fcfef7fe640 1 -- 172.21.15.22:0/2356073653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe803e790 con 0x7fcff80b39a0 2023-11-24T06:13:16.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.312+0000 7fcfef7fe640 1 -- 172.21.15.22:0/2356073653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe803eb40 con 0x7fcff80b39a0 2023-11-24T06:13:16.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.312+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe8009a70 con 0x7fcff80b39a0 2023-11-24T06:13:16.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.312+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff80cd860 con 0x7fcff80b39a0 2023-11-24T06:13:16.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.313+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff81ef410 con 0x7fcff80b39a0 2023-11-24T06:13:16.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.314+0000 7fcfef7fe640 1 -- 172.21.15.22:0/2356073653 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfe803b050 con 0x7fcff80b39a0 2023-11-24T06:13:16.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.315+0000 7fcfef7fe640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcfd806ae40 0x7fcfd806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.315+0000 7fcfef7fe640 1 -- 172.21.15.22:0/2356073653 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fcfe80abf70 con 0x7fcff80b39a0 2023-11-24T06:13:16.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.315+0000 7fcff6ffd640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcfd806ae40 0x7fcfd806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.316+0000 7fcff6ffd640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcfd806ae40 0x7fcfd806d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00015e0 tx=0x7fcfe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.321+0000 7fcfef7fe640 1 -- 172.21.15.22:0/2356073653 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcfe80dee90 con 0x7fcff80b39a0 2023-11-24T06:13:16.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.554+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcff8074770 con 0x7fcff80b39a0 2023-11-24T06:13:16.557 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-11-24T06:13:16.555+0000 7f6dde801640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:13:16.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.557+0000 7fcfef7fe640 1 -- 172.21.15.22:0/2356073653 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcff81ef410 con 0x7fcff80b39a0 2023-11-24T06:13:16.560 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:13:16.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.561+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcfd806ae40 msgr2=0x7fcfd806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.561+0000 7fcffd31d640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcfd806ae40 0x7fcfd806d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00015e0 tx=0x7fcfe0009040 comp rx=0 tx=0).stop 2023-11-24T06:13:16.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.561+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff80b39a0 msgr2=0x7fcff81f2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.561+0000 7fcffd31d640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff80b39a0 0x7fcff81f2710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe8004a40 comp rx=0 tx=0).stop 2023-11-24T06:13:16.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.561+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 shutdown_connections 2023-11-24T06:13:16.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.561+0000 7fcffd31d640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcfd806ae40 0x7fcfd806d300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.561+0000 7fcffd31d640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff815a090 0x7fcff8156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.561+0000 7fcffd31d640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff80b39a0 0x7fcff81f2710 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.561+0000 7fcffd31d640 1 --2- 172.21.15.22:0/2356073653 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcff80abff0 0x7fcff81472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.562+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 >> 172.21.15.22:0/2356073653 conn(0x7fcff80b0d80 msgr2=0x7fcff8159360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:16.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.562+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 shutdown_connections 2023-11-24T06:13:16.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.562+0000 7fcffd31d640 1 -- 172.21.15.22:0/2356073653 wait complete. 2023-11-24T06:13:16.576 INFO:tasks.ceph.mds.a.smithi022.stderr: -3913> 2023-11-24T06:12:05.439+0000 7f7265709640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:13:16.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:13:16.636 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-11-24T06:13:16.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.784+0000 7fa2834b4640 1 Processor -- start 2023-11-24T06:13:16.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.784+0000 7fa2834b4640 1 -- start start 2023-11-24T06:13:16.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.785+0000 7fa2834b4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 0x7fa27c0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.785+0000 7fa2834b4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa27c0d1d90 0x7fa27c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.786+0000 7fa2834b4640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27c0c6bf0 con 0x7fa27c0d0fa0 2023-11-24T06:13:16.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.786+0000 7fa2834b4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c0d1400 con 0x7fa27c0d1d90 2023-11-24T06:13:16.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.786+0000 7fa2834b4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0cedc0 con 0x7fa27c15d3b0 2023-11-24T06:13:16.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.786+0000 7fa281cb1640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa27c0d0fa0 0x7fa27c0d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36926/0 (socket says 172.21.15.22:36926) 2023-11-24T06:13:16.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.786+0000 7fa281cb1640 1 -- 172.21.15.22:0/1881508952 learned_addr learned my addr 172.21.15.22:0/1881508952 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.786+0000 7fa2824b2640 1 --2- 172.21.15.22:0/1881508952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 0x7fa27c0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.786+0000 7fa282cb3640 1 --2- 172.21.15.22:0/1881508952 >> v2:172.21.15.31:3300/0 conn(0x7fa27c0d1d90 0x7fa27c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.787+0000 7fa2814b0640 1 -- 172.21.15.22:0/1881508952 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665759544 0 0) 0x7fa27c0c6bf0 con 0x7fa27c0d0fa0 2023-11-24T06:13:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.787+0000 7fa2814b0640 1 -- 172.21.15.22:0/1881508952 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa268003520 con 0x7fa27c0d0fa0 2023-11-24T06:13:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.787+0000 7fa282cb3640 1 -- 172.21.15.22:0/1881508952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 msgr2=0x7fa27c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.787+0000 7fa282cb3640 1 --2- 172.21.15.22:0/1881508952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 0x7fa27c0ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.787+0000 7fa2814b0640 1 -- 172.21.15.22:0/1881508952 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3854823236 0 0) 0x7fa268003520 con 0x7fa27c0d0fa0 2023-11-24T06:13:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.787+0000 7fa282cb3640 1 -- 172.21.15.22:0/1881508952 >> v1:172.21.15.22:6789/0 conn(0x7fa27c0d0fa0 legacy=0x7fa27c0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.787+0000 7fa282cb3640 1 -- 172.21.15.22:0/1881508952 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c0c6e40 con 0x7fa27c0d1d90 2023-11-24T06:13:16.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.789+0000 7fa282cb3640 1 --2- 172.21.15.22:0/1881508952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d1d90 0x7fa27c0b3ca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa274009d90 tx=0x7fa27402bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae54205b70e2ecf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.790+0000 7fa2814b0640 1 -- 172.21.15.22:0/1881508952 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c001670 con 0x7fa27c0d1d90 2023-11-24T06:13:16.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.790+0000 7fa2814b0640 1 -- 172.21.15.22:0/1881508952 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27402c810 con 0x7fa27c0d1d90 2023-11-24T06:13:16.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.790+0000 7fa2814b0640 1 -- 172.21.15.22:0/1881508952 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27402cba0 con 0x7fa27c0d1d90 2023-11-24T06:13:16.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.790+0000 7fa2834b4640 1 -- 172.21.15.22:0/1881508952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d1d90 msgr2=0x7fa27c0b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.790+0000 7fa2834b4640 1 --2- 172.21.15.22:0/1881508952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d1d90 0x7fa27c0b3ca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa274009d90 tx=0x7fa27402bce0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.790+0000 7fa2834b4640 1 -- 172.21.15.22:0/1881508952 shutdown_connections 2023-11-24T06:13:16.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.790+0000 7fa2834b4640 1 --2- 172.21.15.22:0/1881508952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d1d90 0x7fa27c0b3ca0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.790+0000 7fa2834b4640 1 --2- 172.21.15.22:0/1881508952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 0x7fa27c0ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.790+0000 7fa2834b4640 1 -- 172.21.15.22:0/1881508952 >> 172.21.15.22:0/1881508952 conn(0x7fa27c0d30a0 msgr2=0x7fa27c0d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:16.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.791+0000 7fa2834b4640 1 -- 172.21.15.22:0/1881508952 shutdown_connections 2023-11-24T06:13:16.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.791+0000 7fa2834b4640 1 -- 172.21.15.22:0/1881508952 wait complete. 2023-11-24T06:13:16.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.792+0000 7fa2834b4640 1 Processor -- start 2023-11-24T06:13:16.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.792+0000 7fa2834b4640 1 -- start start 2023-11-24T06:13:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.793+0000 7fa2834b4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d0fa0 0x7fa27c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.793+0000 7fa2834b4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c0d1d90 0x7fa27c1f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.793+0000 7fa2834b4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 0x7fa27c15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.793+0000 7fa2834b4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0b6ce0 con 0x7fa27c0d1d90 2023-11-24T06:13:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.793+0000 7fa2834b4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0c8680 con 0x7fa27c0d0fa0 2023-11-24T06:13:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.793+0000 7fa2834b4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0c8960 con 0x7fa27c15d3b0 2023-11-24T06:13:16.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa281cb1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c0d1d90 0x7fa27c1f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa281cb1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c0d1d90 0x7fa27c1f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39968/0 (socket says 172.21.15.22:39968) 2023-11-24T06:13:16.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa281cb1640 1 -- 172.21.15.22:0/810865491 learned_addr learned my addr 172.21.15.22:0/810865491 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:16.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa282cb3640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 0x7fa27c15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa2824b2640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d0fa0 0x7fa27c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa281cb1640 1 -- 172.21.15.22:0/810865491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 msgr2=0x7fa27c15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa281cb1640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 0x7fa27c15af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa281cb1640 1 -- 172.21.15.22:0/810865491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d0fa0 msgr2=0x7fa27c0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa281cb1640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d0fa0 0x7fa27c0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa281cb1640 1 -- 172.21.15.22:0/810865491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274009a70 con 0x7fa27c0d1d90 2023-11-24T06:13:16.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.794+0000 7fa2824b2640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d0fa0 0x7fa27c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:16.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.795+0000 7fa281cb1640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c0d1d90 0x7fa27c1f2be0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00c710 tx=0x7fa26c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.795+0000 7fa272ffd640 1 -- 172.21.15.22:0/810865491 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c005ad0 con 0x7fa27c0d1d90 2023-11-24T06:13:16.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.795+0000 7fa272ffd640 1 -- 172.21.15.22:0/810865491 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c005c30 con 0x7fa27c0d1d90 2023-11-24T06:13:16.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.795+0000 7fa272ffd640 1 -- 172.21.15.22:0/810865491 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c007070 con 0x7fa27c0d1d90 2023-11-24T06:13:16.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.795+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c0c8c40 con 0x7fa27c0d1d90 2023-11-24T06:13:16.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.795+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c0c8310 con 0x7fa27c0d1d90 2023-11-24T06:13:16.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.796+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c0b6e20 con 0x7fa27c0d1d90 2023-11-24T06:13:16.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.797+0000 7fa272ffd640 1 -- 172.21.15.22:0/810865491 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa26c0071f0 con 0x7fa27c0d1d90 2023-11-24T06:13:16.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.798+0000 7fa272ffd640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa26006ae40 0x7fa26006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.798+0000 7fa272ffd640 1 -- 172.21.15.22:0/810865491 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fa26c089420 con 0x7fa27c0d1d90 2023-11-24T06:13:16.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.798+0000 7fa2824b2640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa26006ae40 0x7fa26006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.799+0000 7fa2824b2640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa26006ae40 0x7fa26006d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0b5b00 tx=0x7fa278008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:16.803+0000 7fa272ffd640 1 -- 172.21.15.22:0/810865491 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa27c0b6e20 con 0x7fa27c0d1d90 2023-11-24T06:13:17.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.032+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa27c0b6e20 con 0x7fa27c0d1d90 2023-11-24T06:13:17.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.640+0000 7fa272ffd640 1 -- 172.21.15.22:0/810865491 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa27c0b6e20 con 0x7fa27c0d1d90 2023-11-24T06:13:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa26006ae40 msgr2=0x7fa26006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa26006ae40 0x7fa26006d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0b5b00 tx=0x7fa278008040 comp rx=0 tx=0).stop 2023-11-24T06:13:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c0d1d90 msgr2=0x7fa27c1f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c0d1d90 0x7fa27c1f2be0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00c710 tx=0x7fa26c00cbd0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 shutdown_connections 2023-11-24T06:13:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa26006ae40 0x7fa26006d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa27c15d3b0 0x7fa27c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c0d1d90 0x7fa27c1f2be0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 --2- 172.21.15.22:0/810865491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa27c0d0fa0 0x7fa27c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 >> 172.21.15.22:0/810865491 conn(0x7fa27c0d30a0 msgr2=0x7fa27c15f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 shutdown_connections 2023-11-24T06:13:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.644+0000 7fa2834b4640 1 -- 172.21.15.22:0/810865491 wait complete. 2023-11-24T06:13:17.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:13:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.886+0000 7faae1259640 1 Processor -- start 2023-11-24T06:13:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.886+0000 7faae1259640 1 -- start start 2023-11-24T06:13:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faae1259640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faadc06dae0 0x7faadc15b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faae1259640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faadc15bbd0 0x7faadc070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faae1259640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc144ca0 con 0x7faadc1448c0 2023-11-24T06:13:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faae1259640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc15c450 con 0x7faadc15bbd0 2023-11-24T06:13:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faae1259640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0715b0 con 0x7faadc06dae0 2023-11-24T06:13:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faadbfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faadc1448c0 0x7faadc06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36938/0 (socket says 172.21.15.22:36938) 2023-11-24T06:13:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faadbfff640 1 -- 172.21.15.22:0/3796735484 learned_addr learned my addr 172.21.15.22:0/3796735484 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faad3fff640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faadc06dae0 0x7faadc15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300546784 0 0) 0x7faadc144ca0 con 0x7faadc1448c0 2023-11-24T06:13:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faae0a58640 1 --2- 172.21.15.22:0/3796735484 >> v2:172.21.15.31:3300/0 conn(0x7faadc15bbd0 0x7faadc070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.888+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac8003520 con 0x7faadc1448c0 2023-11-24T06:13:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741983855 0 0) 0x7faac8003520 con 0x7faadc1448c0 2023-11-24T06:13:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faadc06dae0 msgr2=0x7faadc15b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faadc06dae0 0x7faadc15b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 >> v2:172.21.15.31:3300/0 conn(0x7faadc15bbd0 msgr2=0x7faadc070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 --2- 172.21.15.22:0/3796735484 >> v2:172.21.15.31:3300/0 conn(0x7faadc15bbd0 0x7faadc070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc071890 con 0x7faadc1448c0 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7faacc001670 con 0x7faadc1448c0 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 >> v1:172.21.15.22:6789/0 conn(0x7faadc1448c0 legacy=0x7faadc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faac8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac80047c0 0x7faac8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac8005180 0x7faac800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15c450 con 0x7faac80039e0 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0715b0 con 0x7faac80047c0 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac800bfc0 con 0x7faac8005180 2023-11-24T06:13:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faad3fff640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faadc06dae0 0x7faadc15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.889+0000 7faadbfff640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faac8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.890+0000 7faadbfff640 1 -- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac8005180 msgr2=0x7faac800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.890+0000 7faadbfff640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac8005180 0x7faac800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.890+0000 7faadbfff640 1 -- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac80047c0 msgr2=0x7faac8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.890+0000 7faadbfff640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac80047c0 0x7faac8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.890+0000 7faadbfff640 1 -- 172.21.15.22:0/3796735484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8003520 con 0x7faac80039e0 2023-11-24T06:13:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.891+0000 7faadbfff640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faac8003e00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c190 tx=0x7faac80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab9880e8a431988 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.891+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc005ad0 con 0x7faac80039e0 2023-11-24T06:13:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.891+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc005c50 con 0x7faac80039e0 2023-11-24T06:13:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.891+0000 7faadb7fe640 1 -- 172.21.15.22:0/3796735484 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc02c7c0 con 0x7faac80039e0 2023-11-24T06:13:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.891+0000 7faae1259640 1 -- 172.21.15.22:0/3796735484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 msgr2=0x7faac8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.891+0000 7faae1259640 1 --2- 172.21.15.22:0/3796735484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faac8003e00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c190 tx=0x7faac80057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.892+0000 7faae0a58640 1 -- 172.21.15.22:0/3796735484 reap_dead start 2023-11-24T06:13:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.892+0000 7faae1259640 1 -- 172.21.15.22:0/3796735484 shutdown_connections 2023-11-24T06:13:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.892+0000 7faae1259640 1 -- 172.21.15.22:0/3796735484 >> 172.21.15.22:0/3796735484 conn(0x7faadc0b0aa0 msgr2=0x7faadc0b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.892+0000 7faae1259640 1 -- 172.21.15.22:0/3796735484 shutdown_connections 2023-11-24T06:13:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.892+0000 7faae1259640 1 -- 172.21.15.22:0/3796735484 wait complete. 2023-11-24T06:13:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.893+0000 7faae1259640 1 Processor -- start 2023-11-24T06:13:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.894+0000 7faae1259640 1 -- start start 2023-11-24T06:13:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faae1259640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faadc156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faae1259640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faadc0b3750 0x7faadc13a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faae1259640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faadc13f7c0 0x7faadc13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faae1259640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc06d670 con 0x7faac80039e0 2023-11-24T06:13:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faae1259640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc140180 con 0x7faadc13f7c0 2023-11-24T06:13:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faae1259640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0b3f30 con 0x7faadc0b3750 2023-11-24T06:13:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faadbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faadc156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faadbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faadc156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39976/0 (socket says 172.21.15.22:39976) 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faadbfff640 1 -- 172.21.15.22:0/784855633 learned_addr learned my addr 172.21.15.22:0/784855633 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faadbfff640 1 -- 172.21.15.22:0/784855633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faadc0b3750 msgr2=0x7faadc13a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faadbfff640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faadc0b3750 0x7faadc13a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faadbfff640 1 -- 172.21.15.22:0/784855633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faadc13f7c0 msgr2=0x7faadc13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faadbfff640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faadc13f7c0 0x7faadc13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.895+0000 7faadbfff640 1 -- 172.21.15.22:0/784855633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0724f0 con 0x7faac80039e0 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.896+0000 7faadbfff640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faadc156240 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c190 tx=0x7faadc144e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.896+0000 7faad97fa640 1 -- 172.21.15.22:0/784855633 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc039070 con 0x7faac80039e0 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.896+0000 7faad97fa640 1 -- 172.21.15.22:0/784855633 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc02cbd0 con 0x7faac80039e0 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.896+0000 7faad97fa640 1 -- 172.21.15.22:0/784855633 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc03c040 con 0x7faac80039e0 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.896+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc13a680 con 0x7faac80039e0 2023-11-24T06:13:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.896+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc06cfb0 con 0x7faac80039e0 2023-11-24T06:13:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.897+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc04e840 con 0x7faac80039e0 2023-11-24T06:13:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.898+0000 7faad97fa640 1 -- 172.21.15.22:0/784855633 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faacc032070 con 0x7faac80039e0 2023-11-24T06:13:17.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.899+0000 7faad97fa640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faabc06ae40 0x7faabc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.899+0000 7faad97fa640 1 -- 172.21.15.22:0/784855633 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5940+0+0 (secure 0 0 0) 0x7faacc0aa970 con 0x7faac80039e0 2023-11-24T06:13:17.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.899+0000 7faad3fff640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faabc06ae40 0x7faabc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.900+0000 7faad3fff640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faabc06ae40 0x7faabc06d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faac4006e20 tx=0x7faac4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:17.903+0000 7faad97fa640 1 -- 172.21.15.22:0/784855633 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faacc075890 con 0x7faac80039e0 2023-11-24T06:13:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.100+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faadc0008d0 con 0x7faac80039e0 2023-11-24T06:13:18.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.644+0000 7faad97fa640 1 -- 172.21.15.22:0/784855633 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7faacc078eb0 con 0x7faac80039e0 2023-11-24T06:13:18.647 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:13:18.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.647+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faabc06ae40 msgr2=0x7faabc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.647+0000 7faae1259640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faabc06ae40 0x7faabc06d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faac4006e20 tx=0x7faac4008040 comp rx=0 tx=0).stop 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.647+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 msgr2=0x7faadc156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.647+0000 7faae1259640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faadc156240 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c190 tx=0x7faadc144e30 comp rx=0 tx=0).stop 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.648+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 shutdown_connections 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.648+0000 7faae1259640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faabc06ae40 0x7faabc06d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.648+0000 7faae1259640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faadc13f7c0 0x7faadc13fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.648+0000 7faae1259640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faadc0b3750 0x7faadc13a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.648+0000 7faae1259640 1 --2- 172.21.15.22:0/784855633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac80039e0 0x7faadc156240 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.648+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 >> 172.21.15.22:0/784855633 conn(0x7faadc0b0aa0 msgr2=0x7faadc06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.648+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 shutdown_connections 2023-11-24T06:13:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.648+0000 7faae1259640 1 -- 172.21.15.22:0/784855633 wait complete. 2023-11-24T06:13:18.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:13:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.886+0000 7f930759e640 1 Processor -- start 2023-11-24T06:13:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.887+0000 7f930759e640 1 -- start start 2023-11-24T06:13:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.888+0000 7f930759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f930815d3b0 0x7f93080ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.888+0000 7f930759e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93080d1d90 0x7f93080b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.888+0000 7f930759e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93080c6bf0 con 0x7f93080d0fa0 2023-11-24T06:13:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.888+0000 7f930759e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93080d1400 con 0x7f93080d1d90 2023-11-24T06:13:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.888+0000 7f930759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93080cedc0 con 0x7f930815d3b0 2023-11-24T06:13:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.889+0000 7f92fffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f93080d0fa0 0x7f93080d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36944/0 (socket says 172.21.15.22:36944) 2023-11-24T06:13:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.889+0000 7f92fffff640 1 -- 172.21.15.22:0/299359870 learned_addr learned my addr 172.21.15.22:0/299359870 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.889+0000 7f930659c640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f930815d3b0 0x7f93080ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.889+0000 7f9306d9d640 1 --2- 172.21.15.22:0/299359870 >> v2:172.21.15.31:3300/0 conn(0x7f93080d1d90 0x7f93080b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.889+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327169521 0 0) 0x7f93080c6bf0 con 0x7f93080d0fa0 2023-11-24T06:13:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.889+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f4003520 con 0x7f93080d0fa0 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2355557874 0 0) 0x7f92f4003520 con 0x7f93080d0fa0 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f930815d3b0 msgr2=0x7f93080ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f930815d3b0 0x7f93080ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 >> v2:172.21.15.31:3300/0 conn(0x7f93080d1d90 msgr2=0x7f93080b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 --2- 172.21.15.22:0/299359870 >> v2:172.21.15.31:3300/0 conn(0x7f93080d1d90 0x7f93080b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080c6e40 con 0x7f93080d0fa0 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f92f0001670 con 0x7f93080d0fa0 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 >> v1:172.21.15.22:6789/0 conn(0x7f93080d0fa0 legacy=0x7f93080d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f40039e0 0x7f92f4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f40047c0 0x7f92f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f930815d3b0 0x7f92f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080d1400 con 0x7f92f40039e0 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080cedc0 con 0x7f92f40047c0 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f400ba30 con 0x7f930815d3b0 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.890+0000 7f930659c640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f40039e0 0x7f92f4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.891+0000 7f930659c640 1 -- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f930815d3b0 msgr2=0x7f92f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.891+0000 7f9306d9d640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f930815d3b0 0x7f92f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.891+0000 7f92fffff640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f40047c0 0x7f92f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.891+0000 7f930659c640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f930815d3b0 0x7f92f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.891+0000 7f930659c640 1 -- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f40047c0 msgr2=0x7f92f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.891+0000 7f930659c640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f40047c0 0x7f92f4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.891+0000 7f930659c640 1 -- 172.21.15.22:0/299359870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4003520 con 0x7f92f40039e0 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.891+0000 7f9306d9d640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f930815d3b0 0x7f92f4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.892+0000 7f930659c640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f40039e0 0x7f92f4003e00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009a90 tx=0x7f92f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c2048e206d61ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.892+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f802c660 con 0x7f92f40039e0 2023-11-24T06:13:18.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.892+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f802c7c0 con 0x7f92f40039e0 2023-11-24T06:13:18.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.892+0000 7f9305d9b640 1 -- 172.21.15.22:0/299359870 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f802cb50 con 0x7f92f40039e0 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.893+0000 7f930759e640 1 -- 172.21.15.22:0/299359870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f40039e0 msgr2=0x7f92f4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.893+0000 7f930759e640 1 --2- 172.21.15.22:0/299359870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f40039e0 0x7f92f4003e00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009a90 tx=0x7f92f40057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.893+0000 7f9306d9d640 1 -- 172.21.15.22:0/299359870 reap_dead start 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.893+0000 7f930759e640 1 -- 172.21.15.22:0/299359870 shutdown_connections 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.893+0000 7f930759e640 1 -- 172.21.15.22:0/299359870 >> 172.21.15.22:0/299359870 conn(0x7f93080d30a0 msgr2=0x7f93080d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.893+0000 7f930759e640 1 -- 172.21.15.22:0/299359870 shutdown_connections 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.893+0000 7f930759e640 1 -- 172.21.15.22:0/299359870 wait complete. 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.895+0000 7f930759e640 1 Processor -- start 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.895+0000 7f930759e640 1 -- start start 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.896+0000 7f930759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92f40039e0 0x7f93080cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.896+0000 7f930759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f930815b880 0x7f93081e9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.896+0000 7f930759e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080b7e30 0x7f93080b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.896+0000 7f930759e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080b8800 con 0x7f930815b880 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.896+0000 7f930759e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080ccf60 con 0x7f93080b7e30 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.896+0000 7f930759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930815c0d0 con 0x7f92f40039e0 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.896+0000 7f92fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f930815b880 0x7f93081e9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.896+0000 7f92fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f930815b880 0x7f93081e9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39980/0 (socket says 172.21.15.22:39980) 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.896+0000 7f92fffff640 1 -- 172.21.15.22:0/857273067 learned_addr learned my addr 172.21.15.22:0/857273067 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f9306d9d640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080b7e30 0x7f93080b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f930659c640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92f40039e0 0x7f93080cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f92fffff640 1 -- 172.21.15.22:0/857273067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92f40039e0 msgr2=0x7f93080cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f92fffff640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92f40039e0 0x7f93080cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f92fffff640 1 -- 172.21.15.22:0/857273067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080b7e30 msgr2=0x7f93080b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f92fffff640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080b7e30 0x7f93080b82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f92fffff640 1 -- 172.21.15.22:0/857273067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080cc350 con 0x7f930815b880 2023-11-24T06:13:18.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f930659c640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92f40039e0 0x7f93080cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:18.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f92fffff640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f930815b880 0x7f93081e9150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f92f000d780 tx=0x7f92f000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f92feffd640 1 -- 172.21.15.22:0/857273067 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00074e0 con 0x7f930815b880 2023-11-24T06:13:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.897+0000 7f92feffd640 1 -- 172.21.15.22:0/857273067 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f000de90 con 0x7f930815b880 2023-11-24T06:13:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.898+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93080cc630 con 0x7f930815b880 2023-11-24T06:13:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.898+0000 7f92feffd640 1 -- 172.21.15.22:0/857273067 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00049e0 con 0x7f930815b880 2023-11-24T06:13:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.898+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93080ccbf0 con 0x7f930815b880 2023-11-24T06:13:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.899+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93080cd110 con 0x7f930815b880 2023-11-24T06:13:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.900+0000 7f92feffd640 1 -- 172.21.15.22:0/857273067 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92f0004b40 con 0x7f930815b880 2023-11-24T06:13:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.901+0000 7f92feffd640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f92e806ae40 0x7f92e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.901+0000 7f92feffd640 1 -- 172.21.15.22:0/857273067 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f92f0089240 con 0x7f930815b880 2023-11-24T06:13:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.901+0000 7f930659c640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f92e806ae40 0x7f92e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.902+0000 7f930659c640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f92e806ae40 0x7f92e806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f92f8036000 tx=0x7f92f8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:18.905+0000 7f92feffd640 1 -- 172.21.15.22:0/857273067 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93080cd110 con 0x7f930815b880 2023-11-24T06:13:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.106+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f93080cd0d0 con 0x7f930815b880 2023-11-24T06:13:19.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.668+0000 7f92feffd640 1 -- 172.21.15.22:0/857273067 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f92f00190d0 con 0x7f930815b880 2023-11-24T06:13:19.671 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-11-24T06:13:19.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f92e806ae40 msgr2=0x7f92e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f92e806ae40 0x7f92e806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f92f8036000 tx=0x7f92f8030000 comp rx=0 tx=0).stop 2023-11-24T06:13:19.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f930815b880 msgr2=0x7f93081e9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f930815b880 0x7f93081e9150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f92f000d780 tx=0x7f92f000dc40 comp rx=0 tx=0).stop 2023-11-24T06:13:19.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 shutdown_connections 2023-11-24T06:13:19.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f92e806ae40 0x7f92e806d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080b7e30 0x7f93080b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f930815b880 0x7f93081e9150 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 --2- 172.21.15.22:0/857273067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92f40039e0 0x7f93080cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 >> 172.21.15.22:0/857273067 conn(0x7f93080d30a0 msgr2=0x7f930806c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:19.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 shutdown_connections 2023-11-24T06:13:19.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.673+0000 7f930759e640 1 -- 172.21.15.22:0/857273067 wait complete. 2023-11-24T06:13:19.696 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:13:19.696 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:13:19.697 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:13:19.697 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:13:19.697 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:13:19.697 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:13:19.697 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:13:19.697 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:13:19.697 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:13:19.697 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:13:19.698 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:13:19.698 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:13:19.698 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:13:19.698 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:13:19.698 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:13:19.698 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:13:19.716 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:13:19.716 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:13:19.720 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:13:19.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:13:19.721 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:13:19.721 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:13:19.722 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:13:19.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:13:19.767 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:13:19.767 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:19.771 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:13:19.771 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:19.771 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:13:19.772 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:19.778 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:13:19.779 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:19.779 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:13:19.930 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2023-11-24T06:13:19.933 INFO:tasks.ceph.mds.d.smithi031.stdout:starting mds.d at 2023-11-24T06:13:19.939 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-11-24T06:13:19.942 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-11-24T06:13:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.973+0000 7fbdae22b640 1 Processor -- start 2023-11-24T06:13:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.973+0000 7fbdae22b640 1 -- start start 2023-11-24T06:13:19.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.974+0000 7fbdae22b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda81460b0 0x7fbda80b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.974+0000 7fbdae22b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbda806b760 0x7fbda80b3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.974+0000 7fbdae22b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda806cd50 con 0x7fbda80b35b0 2023-11-24T06:13:19.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.974+0000 7fbdae22b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda8146a90 con 0x7fbda806b760 2023-11-24T06:13:19.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.974+0000 7fbdae22b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80b3a40 con 0x7fbda81460b0 2023-11-24T06:13:19.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.974+0000 7fbda6ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbda806b760 0x7fbda80b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.974+0000 7fbda6ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbda806b760 0x7fbda80b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40026/0 (socket says 172.21.15.22:40026) 2023-11-24T06:13:19.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.974+0000 7fbda6ffd640 1 -- 172.21.15.22:0/3687254280 learned_addr learned my addr 172.21.15.22:0/3687254280 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:19.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.975+0000 7fbda77fe640 1 --2- 172.21.15.22:0/3687254280 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda81460b0 0x7fbda80b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.975+0000 7fbda6ffd640 1 -- 172.21.15.22:0/3687254280 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda81460b0 msgr2=0x7fbda80b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:19.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.975+0000 7fbda6ffd640 1 --2- 172.21.15.22:0/3687254280 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda81460b0 0x7fbda80b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.975+0000 7fbda6ffd640 1 -- 172.21.15.22:0/3687254280 >> v1:172.21.15.31:6789/0 conn(0x7fbda80b35b0 legacy=0x7fbda8160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.975+0000 7fbda6ffd640 1 -- 172.21.15.22:0/3687254280 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8146490 con 0x7fbda806b760 2023-11-24T06:13:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.976+0000 7fbda6ffd640 1 --2- 172.21.15.22:0/3687254280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda806b760 0x7fbda80b3070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009870 tx=0x7fbd9c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bc3e163a3240b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.976+0000 7fbda67fc640 1 -- 172.21.15.22:0/3687254280 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c031640 con 0x7fbda806b760 2023-11-24T06:13:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbda67fc640 1 -- 172.21.15.22:0/3687254280 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c0317a0 con 0x7fbda806b760 2023-11-24T06:13:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbda67fc640 1 -- 172.21.15.22:0/3687254280 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c031b30 con 0x7fbda806b760 2023-11-24T06:13:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbdae22b640 1 -- 172.21.15.22:0/3687254280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda806b760 msgr2=0x7fbda80b3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbdae22b640 1 --2- 172.21.15.22:0/3687254280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda806b760 0x7fbda80b3070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009870 tx=0x7fbd9c02b8f0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbdae22b640 1 -- 172.21.15.22:0/3687254280 shutdown_connections 2023-11-24T06:13:19.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbdae22b640 1 --2- 172.21.15.22:0/3687254280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda806b760 0x7fbda80b3070 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbdae22b640 1 --2- 172.21.15.22:0/3687254280 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda81460b0 0x7fbda80b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbdae22b640 1 -- 172.21.15.22:0/3687254280 >> 172.21.15.22:0/3687254280 conn(0x7fbda80663d0 msgr2=0x7fbda80667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:19.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbdae22b640 1 -- 172.21.15.22:0/3687254280 shutdown_connections 2023-11-24T06:13:19.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.977+0000 7fbdae22b640 1 -- 172.21.15.22:0/3687254280 wait complete. 2023-11-24T06:13:19.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.979+0000 7fbdae22b640 1 Processor -- start 2023-11-24T06:13:19.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.979+0000 7fbdae22b640 1 -- start start 2023-11-24T06:13:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.980+0000 7fbdae22b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda806b760 0x7fbda80ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.980+0000 7fbdae22b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda80b35b0 0x7fbda815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.980+0000 7fbdae22b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda81460b0 0x7fbda813da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.980+0000 7fbdae22b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda815ef30 con 0x7fbda80b35b0 2023-11-24T06:13:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.980+0000 7fbdae22b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80caa00 con 0x7fbda81460b0 2023-11-24T06:13:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.980+0000 7fbdae22b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80cace0 con 0x7fbda806b760 2023-11-24T06:13:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.980+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda80b35b0 0x7fbda815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.980+0000 7fbda77fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda806b760 0x7fbda80ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.980+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda80b35b0 0x7fbda815e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40042/0 (socket says 172.21.15.22:40042) 2023-11-24T06:13:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.981+0000 7fbda6ffd640 1 -- 172.21.15.22:0/2549388219 learned_addr learned my addr 172.21.15.22:0/2549388219 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.981+0000 7fbda7fff640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda81460b0 0x7fbda813da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.981+0000 7fbda6ffd640 1 -- 172.21.15.22:0/2549388219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda806b760 msgr2=0x7fbda80ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.981+0000 7fbda6ffd640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda806b760 0x7fbda80ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.981+0000 7fbda6ffd640 1 -- 172.21.15.22:0/2549388219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda81460b0 msgr2=0x7fbda813da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.981+0000 7fbda6ffd640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda81460b0 0x7fbda813da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.981+0000 7fbda6ffd640 1 -- 172.21.15.22:0/2549388219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0094d0 con 0x7fbda80b35b0 2023-11-24T06:13:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.981+0000 7fbda6ffd640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda80b35b0 0x7fbda815e9f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c000c00 tx=0x7fbd9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.982+0000 7fbd8ffff640 1 -- 172.21.15.22:0/2549388219 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c03a930 con 0x7fbda80b35b0 2023-11-24T06:13:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.982+0000 7fbd8ffff640 1 -- 172.21.15.22:0/2549388219 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c03aa90 con 0x7fbda80b35b0 2023-11-24T06:13:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.982+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda80cafc0 con 0x7fbda80b35b0 2023-11-24T06:13:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.982+0000 7fbd8ffff640 1 -- 172.21.15.22:0/2549388219 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c03ae40 con 0x7fbda80b35b0 2023-11-24T06:13:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.982+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda80cb580 con 0x7fbda80b35b0 2023-11-24T06:13:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.983+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda8074770 con 0x7fbda80b35b0 2023-11-24T06:13:19.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.984+0000 7fbd8ffff640 1 -- 172.21.15.22:0/2549388219 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd9c02f050 con 0x7fbda80b35b0 2023-11-24T06:13:19.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.985+0000 7fbd8ffff640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd9406ae90 0x7fbd9406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.985+0000 7fbd8ffff640 1 -- 172.21.15.22:0/2549388219 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd9c0aaf60 con 0x7fbda80b35b0 2023-11-24T06:13:19.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.985+0000 7fbda77fe640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd9406ae90 0x7fbd9406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.986+0000 7fbda77fe640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd9406ae90 0x7fbd9406d350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009b40 tx=0x7fbd98009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:19.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:19.990+0000 7fbd8ffff640 1 -- 172.21.15.22:0/2549388219 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd9c0763a0 con 0x7fbda80b35b0 2023-11-24T06:13:20.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:20.202+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbda81415c0 con 0x7fbda80b35b0 2023-11-24T06:13:20.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:20.697 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:21.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.431+0000 7fbd8ffff640 1 -- 172.21.15.22:0/2549388219 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbd9c0799c0 con 0x7fbda80b35b0 2023-11-24T06:13:21.434 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-11-24T06:13:21.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd9406ae90 msgr2=0x7fbd9406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:21.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd9406ae90 0x7fbd9406d350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009b40 tx=0x7fbd98009190 comp rx=0 tx=0).stop 2023-11-24T06:13:21.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda80b35b0 msgr2=0x7fbda815e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:21.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda80b35b0 0x7fbda815e9f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c000c00 tx=0x7fbd9c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 shutdown_connections 2023-11-24T06:13:21.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd9406ae90 0x7fbd9406d350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda81460b0 0x7fbda813da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda80b35b0 0x7fbda815e9f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 --2- 172.21.15.22:0/2549388219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda806b760 0x7fbda80ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 >> 172.21.15.22:0/2549388219 conn(0x7fbda80663d0 msgr2=0x7fbda80b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:21.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 shutdown_connections 2023-11-24T06:13:21.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.435+0000 7fbdae22b640 1 -- 172.21.15.22:0/2549388219 wait complete. 2023-11-24T06:13:21.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:13:21.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.687+0000 7fc7451a5640 1 Processor -- start 2023-11-24T06:13:21.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.687+0000 7fc7451a5640 1 -- start start 2023-11-24T06:13:21.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.689+0000 7fc7451a5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc74006dc30 0x7fc7400acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:21.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.689+0000 7fc7451a5640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc740071cd0 con 0x7fc740070780 2023-11-24T06:13:21.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.689+0000 7fc7451a5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7400b2120 con 0x7fc740160970 2023-11-24T06:13:21.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.689+0000 7fc7451a5640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400b2400 con 0x7fc74006dc30 2023-11-24T06:13:21.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.689+0000 7fc737fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc740070780 0x7fc74006d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36254/0 (socket says 172.21.15.22:36254) 2023-11-24T06:13:21.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.689+0000 7fc737fff640 1 -- 172.21.15.22:0/1000402748 learned_addr learned my addr 172.21.15.22:0/1000402748 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:21.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.689+0000 7fc73f59e640 1 --2- 172.21.15.22:0/1000402748 >> v2:172.21.15.22:3300/0 conn(0x7fc74006dc30 0x7fc7400acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:21.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.690+0000 7fc73f59e640 1 -- 172.21.15.22:0/1000402748 >> v1:172.21.15.31:6789/0 conn(0x7fc740160970 legacy=0x7fc7400b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:21.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.690+0000 7fc73f59e640 1 -- 172.21.15.22:0/1000402748 >> v1:172.21.15.22:6789/0 conn(0x7fc740070780 legacy=0x7fc74006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:21.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.690+0000 7fc73f59e640 1 -- 172.21.15.22:0/1000402748 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400b26e0 con 0x7fc74006dc30 2023-11-24T06:13:21.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.691+0000 7fc73f59e640 1 --2- 172.21.15.22:0/1000402748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 0x7fc7400acbe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc738009d90 tx=0x7fc73802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa54cbc5c0f6559 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:21.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.692+0000 7fc73e59c640 1 -- 172.21.15.22:0/1000402748 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73802cc70 con 0x7fc74006dc30 2023-11-24T06:13:21.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.692+0000 7fc73e59c640 1 -- 172.21.15.22:0/1000402748 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73802cdd0 con 0x7fc74006dc30 2023-11-24T06:13:21.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.692+0000 7fc73e59c640 1 -- 172.21.15.22:0/1000402748 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738034660 con 0x7fc74006dc30 2023-11-24T06:13:21.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.692+0000 7fc7451a5640 1 -- 172.21.15.22:0/1000402748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 msgr2=0x7fc7400acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:21.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.693+0000 7fc7451a5640 1 --2- 172.21.15.22:0/1000402748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 0x7fc7400acbe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc738009d90 tx=0x7fc73802bec0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.693+0000 7fc7451a5640 1 -- 172.21.15.22:0/1000402748 shutdown_connections 2023-11-24T06:13:21.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.693+0000 7fc7451a5640 1 --2- 172.21.15.22:0/1000402748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 0x7fc7400acbe0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.693+0000 7fc7451a5640 1 -- 172.21.15.22:0/1000402748 >> 172.21.15.22:0/1000402748 conn(0x7fc7400b0d80 msgr2=0x7fc7400b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:21.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.693+0000 7fc7451a5640 1 -- 172.21.15.22:0/1000402748 shutdown_connections 2023-11-24T06:13:21.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.693+0000 7fc7451a5640 1 -- 172.21.15.22:0/1000402748 wait complete. 2023-11-24T06:13:21.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.695+0000 7fc7451a5640 1 Processor -- start 2023-11-24T06:13:21.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.695+0000 7fc7451a5640 1 -- start start 2023-11-24T06:13:21.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc7451a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 0x7fc740153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:21.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc7451a5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc740070780 0x7fc740070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:21.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc7451a5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740160970 0x7fc74015f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:21.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc7451a5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7401412e0 con 0x7fc74006dc30 2023-11-24T06:13:21.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc7451a5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7401409d0 con 0x7fc740160970 2023-11-24T06:13:21.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc7451a5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7401547a0 con 0x7fc740070780 2023-11-24T06:13:21.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc73ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 0x7fc740153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:21.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc73ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 0x7fc740153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56076/0 (socket says 172.21.15.22:56076) 2023-11-24T06:13:21.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc73ed9d640 1 -- 172.21.15.22:0/3624235804 learned_addr learned my addr 172.21.15.22:0/3624235804 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:21.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc73f59e640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740160970 0x7fc74015f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc73ed9d640 1 -- 172.21.15.22:0/3624235804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc740070780 msgr2=0x7fc740070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc737fff640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc740070780 0x7fc740070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.696+0000 7fc73ed9d640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc740070780 0x7fc740070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc73ed9d640 1 -- 172.21.15.22:0/3624235804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740160970 msgr2=0x7fc74015f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc73ed9d640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740160970 0x7fc74015f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc73ed9d640 1 -- 172.21.15.22:0/3624235804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738009a70 con 0x7fc74006dc30 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc73f59e640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740160970 0x7fc74015f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc73ed9d640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 0x7fc740153ee0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc73000c400 tx=0x7fc73000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc7377fe640 1 -- 172.21.15.22:0/3624235804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300052d0 con 0x7fc74006dc30 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc7377fe640 1 -- 172.21.15.22:0/3624235804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730005430 con 0x7fc74006dc30 2023-11-24T06:13:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc7377fe640 1 -- 172.21.15.22:0/3624235804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730003830 con 0x7fc74006dc30 2023-11-24T06:13:21.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc740140c20 con 0x7fc74006dc30 2023-11-24T06:13:21.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.697+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc740154420 con 0x7fc74006dc30 2023-11-24T06:13:21.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.699+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc740074770 con 0x7fc74006dc30 2023-11-24T06:13:21.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.700+0000 7fc7377fe640 1 -- 172.21.15.22:0/3624235804 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc730003990 con 0x7fc74006dc30 2023-11-24T06:13:21.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.701+0000 7fc7377fe640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc72006ae70 0x7fc72006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:21.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.701+0000 7fc7377fe640 1 -- 172.21.15.22:0/3624235804 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7300887e0 con 0x7fc74006dc30 2023-11-24T06:13:21.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.701+0000 7fc737fff640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc72006ae70 0x7fc72006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:21.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.702+0000 7fc737fff640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc72006ae70 0x7fc72006d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc7400b3aa0 tx=0x7fc728009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:21.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.707+0000 7fc7377fe640 1 -- 172.21.15.22:0/3624235804 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc730053bd0 con 0x7fc74006dc30 2023-11-24T06:13:21.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.969+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc74006e290 con 0x7fc74006dc30 2023-11-24T06:13:21.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.970+0000 7fc7377fe640 1 -- 172.21.15.22:0/3624235804 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fc7300571f0 con 0x7fc74006dc30 2023-11-24T06:13:21.973 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:21.973 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:13:21.973 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-11-24T06:13:21.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.973 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBlC0/KHRAAP3OMqK3lsC21mJ3yyEa2uQ==", 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-11-24T06:13:21.974 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBl1X/aBhAAY61uwiv5vBaTPkDByOLPmw==", 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBlfblGMBAAjEBBQvn4tcLAx4BB3IjQrw==", 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.975 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBlxcDDGBAAMX5i2Zfh+M5ZvjS1gKUVwA==", 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:13:21.976 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQByPmBl1c3MDBAAG4T9x4tKBMvnezzPu4t21g==", 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-11-24T06:13:21.977 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB1PmBlnqt2JxAASc03pLw8zZ4XPH46+FtW3Q==", 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB5PmBld+YeBhAA8jBhyD2sGPOXouNHKK4mUQ==", 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:13:21.978 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB8PmBlx3blDxAAuB/aw9Wmh3rIxKpm7HK73A==", 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCDPmBlows5IRAAcEuvr47gyOcmFYg2HRRakw==", 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-11-24T06:13:21.980 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCHPmBlYK2jABAAJ093DHd2vAmF07tYS/qHzA==", 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCKPmBlYV2SGxAAArDvmB2DRwHwVy+cOu3JNw==", 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:13:21.981 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCNPmBlyZsANhAAKCXDIC1kjqyk42AJqK93/g==", 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBlp6jYJxAA527jQJV49tBf9Am4wak0NA==", 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-11-24T06:13:21.983 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBwPmBlGvWoBBAAvbXYydB5FV2WWwhJpeoP/A==", 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBld3CuMxAAwvncg0GHEOgekURnLX45ow==", 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.984 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBwPmBlWinREBAALUxc6wrq/vbCi/RkUtnoLw==", 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:13:21.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBtPmBlU/GnCxAAg5trW7FqqDD3pTR9iBuH6A==", 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-mds", 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCXPmBls/ceJBAAjpetsnv33/rglGecEuvxkQ==", 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-mds" 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-mgr", 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCXPmBlDRYfJBAATXF6gWPkj9TZCAqd6mYcaw==", 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-24T06:13:21.987 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-osd", 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCXPmBlajAfJBAAVmkyaW6gLar4/xT4OPZ6vg==", 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-osd" 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rbd", 2023-11-24T06:13:21.988 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCXPmBl4EofJBAAXn3vKUSYgedjZ/RC6RuJvw==", 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCXPmBlvGUfJBAAXXm/740X4ml2wBePexUlXA==", 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.989 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rgw", 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCXPmBlvoEfJBAABs0EBPixxOBIoAF0TL7+5Q==", 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBlLBh/EBAA1PD6yyS4WDatwZsP2fu8Nw==", 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-11-24T06:13:21.990 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBl35NuAxAAr2yZZ37B4v9xkzTh/HGQhg==", 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-11-24T06:13:21.991 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:13:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc72006ae70 msgr2=0x7fc72006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc72006ae70 0x7fc72006d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc7400b3aa0 tx=0x7fc728009040 comp rx=0 tx=0).stop 2023-11-24T06:13:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 msgr2=0x7fc740153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 0x7fc740153ee0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc73000c400 tx=0x7fc73000c8c0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 shutdown_connections 2023-11-24T06:13:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc72006ae70 0x7fc72006d330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740160970 0x7fc74015f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc740070780 0x7fc740070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 --2- 172.21.15.22:0/3624235804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc74006dc30 0x7fc740153ee0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 >> 172.21.15.22:0/3624235804 conn(0x7fc7400b0d80 msgr2=0x7fc7400b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 shutdown_connections 2023-11-24T06:13:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:21.973+0000 7fc7451a5640 1 -- 172.21.15.22:0/3624235804 wait complete. 2023-11-24T06:13:21.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-24T06:13:22.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.218+0000 7fc1506bb640 1 Processor -- start 2023-11-24T06:13:22.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.218+0000 7fc1506bb640 1 -- start start 2023-11-24T06:13:22.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.220+0000 7fc1506bb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc148161930 0x7fc1480ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.220+0000 7fc1506bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1480719c0 0x7fc1480ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.220+0000 7fc1506bb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1480ad510 con 0x7fc14806d520 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.220+0000 7fc1506bb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1480acc50 con 0x7fc148161930 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.220+0000 7fc1506bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc148071e60 con 0x7fc1480719c0 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.220+0000 7fc14e457640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc148161930 0x7fc1480ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.220+0000 7fc14ec58640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc14806d520 0x7fc1480b2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36268/0 (socket says 172.21.15.22:36268) 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.220+0000 7fc14e457640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc148161930 0x7fc1480ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56080/0 (socket says 172.21.15.22:56080) 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.220+0000 7fc14ec58640 1 -- 172.21.15.22:0/2726177089 learned_addr learned my addr 172.21.15.22:0/2726177089 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.221+0000 7fc14dc56640 1 --2- 172.21.15.22:0/2726177089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1480719c0 0x7fc1480ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.221+0000 7fc14e457640 1 -- 172.21.15.22:0/2726177089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1480719c0 msgr2=0x7fc1480ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.221+0000 7fc14e457640 1 --2- 172.21.15.22:0/2726177089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1480719c0 0x7fc1480ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.221+0000 7fc14e457640 1 -- 172.21.15.22:0/2726177089 >> v1:172.21.15.22:6789/0 conn(0x7fc14806d520 legacy=0x7fc1480b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.221+0000 7fc14e457640 1 -- 172.21.15.22:0/2726177089 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1480acec0 con 0x7fc148161930 2023-11-24T06:13:22.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.221+0000 7fc14d455640 1 -- 172.21.15.22:0/2726177089 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185301780 0 0) 0x7fc1480ad510 con 0x7fc14806d520 2023-11-24T06:13:22.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.221+0000 7fc14dc56640 1 --2- 172.21.15.22:0/2726177089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1480719c0 0x7fc1480ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.222+0000 7fc14e457640 1 --2- 172.21.15.22:0/2726177089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc148161930 0x7fc1480ae6a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc1440097a0 tx=0x7fc14402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798e0c01d3364382 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.222+0000 7fc14d455640 1 -- 172.21.15.22:0/2726177089 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144030800 con 0x7fc148161930 2023-11-24T06:13:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.222+0000 7fc14d455640 1 -- 172.21.15.22:0/2726177089 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc144030960 con 0x7fc148161930 2023-11-24T06:13:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.222+0000 7fc14d455640 1 -- 172.21.15.22:0/2726177089 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144030cf0 con 0x7fc148161930 2023-11-24T06:13:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.223+0000 7fc1506bb640 1 -- 172.21.15.22:0/2726177089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc148161930 msgr2=0x7fc1480ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.223+0000 7fc1506bb640 1 --2- 172.21.15.22:0/2726177089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc148161930 0x7fc1480ae6a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc1440097a0 tx=0x7fc14402b940 comp rx=0 tx=0).stop 2023-11-24T06:13:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.223+0000 7fc1506bb640 1 -- 172.21.15.22:0/2726177089 shutdown_connections 2023-11-24T06:13:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.223+0000 7fc1506bb640 1 --2- 172.21.15.22:0/2726177089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1480719c0 0x7fc1480ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.223+0000 7fc1506bb640 1 --2- 172.21.15.22:0/2726177089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc148161930 0x7fc1480ae6a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.223+0000 7fc1506bb640 1 -- 172.21.15.22:0/2726177089 >> 172.21.15.22:0/2726177089 conn(0x7fc1480b0d80 msgr2=0x7fc1480b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.223+0000 7fc1506bb640 1 -- 172.21.15.22:0/2726177089 shutdown_connections 2023-11-24T06:13:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.223+0000 7fc1506bb640 1 -- 172.21.15.22:0/2726177089 wait complete. 2023-11-24T06:13:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.225+0000 7fc1506bb640 1 Processor -- start 2023-11-24T06:13:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.225+0000 7fc1506bb640 1 -- start start 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.226+0000 7fc1506bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14806d520 0x7fc1480cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.226+0000 7fc1506bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1480719c0 0x7fc14814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.226+0000 7fc1506bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc148161930 0x7fc1481609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.226+0000 7fc1506bb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1481fb900 con 0x7fc1480719c0 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.226+0000 7fc1506bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14814f090 con 0x7fc14806d520 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.226+0000 7fc1506bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480ccd70 con 0x7fc148161930 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.226+0000 7fc14dc56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1480719c0 0x7fc14814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.226+0000 7fc14dc56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1480719c0 0x7fc14814eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56094/0 (socket says 172.21.15.22:56094) 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.226+0000 7fc14dc56640 1 -- 172.21.15.22:0/3066062922 learned_addr learned my addr 172.21.15.22:0/3066062922 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc14e457640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14806d520 0x7fc1480cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc14ec58640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc148161930 0x7fc1481609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc14dc56640 1 -- 172.21.15.22:0/3066062922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc148161930 msgr2=0x7fc1481609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc14dc56640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc148161930 0x7fc1481609c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc14dc56640 1 -- 172.21.15.22:0/3066062922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14806d520 msgr2=0x7fc1480cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc14dc56640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14806d520 0x7fc1480cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc14dc56640 1 -- 172.21.15.22:0/3066062922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144009400 con 0x7fc1480719c0 2023-11-24T06:13:22.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc14e457640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14806d520 0x7fc1480cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:22.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc14dc56640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1480719c0 0x7fc14814eb50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c7f0 tx=0x7fc13800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:22.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.227+0000 7fc13effd640 1 -- 172.21.15.22:0/3066062922 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138007a30 con 0x7fc1480719c0 2023-11-24T06:13:22.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.228+0000 7fc13effd640 1 -- 172.21.15.22:0/3066062922 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138007b90 con 0x7fc1480719c0 2023-11-24T06:13:22.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.228+0000 7fc13effd640 1 -- 172.21.15.22:0/3066062922 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13800ce40 con 0x7fc1480719c0 2023-11-24T06:13:22.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.228+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1480cd050 con 0x7fc1480719c0 2023-11-24T06:13:22.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.228+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1480cd610 con 0x7fc1480719c0 2023-11-24T06:13:22.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.229+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc148074770 con 0x7fc1480719c0 2023-11-24T06:13:22.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.230+0000 7fc13effd640 1 -- 172.21.15.22:0/3066062922 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1380113f0 con 0x7fc1480719c0 2023-11-24T06:13:22.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.231+0000 7fc13effd640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc12c06ae40 0x7fc12c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.231+0000 7fc13effd640 1 -- 172.21.15.22:0/3066062922 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc1380894b0 con 0x7fc1480719c0 2023-11-24T06:13:22.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.231+0000 7fc14e457640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc12c06ae40 0x7fc12c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.232+0000 7fc14e457640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc12c06ae40 0x7fc12c06d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc144036000 tx=0x7fc144008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.236+0000 7fc13effd640 1 -- 172.21.15.22:0/3066062922 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc138054810 con 0x7fc1480719c0 2023-11-24T06:13:22.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.499+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc14806e290 con 0x7fc1480719c0 2023-11-24T06:13:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.504+0000 7fc13effd640 1 -- 172.21.15.22:0/3066062922 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc138057e30 con 0x7fc1480719c0 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.506+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc12c06ae40 msgr2=0x7fc12c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.506+0000 7fc1506bb640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc12c06ae40 0x7fc12c06d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc144036000 tx=0x7fc144008030 comp rx=0 tx=0).stop 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.506+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1480719c0 msgr2=0x7fc14814eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.506+0000 7fc1506bb640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1480719c0 0x7fc14814eb50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c7f0 tx=0x7fc13800cbf0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.507+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 shutdown_connections 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.507+0000 7fc1506bb640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc12c06ae40 0x7fc12c06d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.507+0000 7fc1506bb640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc148161930 0x7fc1481609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.507+0000 7fc1506bb640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1480719c0 0x7fc14814eb50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.507+0000 7fc1506bb640 1 --2- 172.21.15.22:0/3066062922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14806d520 0x7fc1480cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.507+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 >> 172.21.15.22:0/3066062922 conn(0x7fc1480b0d80 msgr2=0x7fc148164040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.507+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 shutdown_connections 2023-11-24T06:13:22.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.507+0000 7fc1506bb640 1 -- 172.21.15.22:0/3066062922 wait complete. 2023-11-24T06:13:22.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-24T06:13:22.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.748+0000 7fa860c2b640 1 Processor -- start 2023-11-24T06:13:22.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.748+0000 7fa860c2b640 1 -- start start 2023-11-24T06:13:22.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.749+0000 7fa860c2b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c161930 0x7fa85c0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.750+0000 7fa860c2b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85c0ad510 con 0x7fa85c0719c0 2023-11-24T06:13:22.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.750+0000 7fa860c2b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85c0acc50 con 0x7fa85c06d520 2023-11-24T06:13:22.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.750+0000 7fa860c2b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c071e60 con 0x7fa85c161930 2023-11-24T06:13:22.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.750+0000 7fa853fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa85c0719c0 0x7fa85c0ad9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36276/0 (socket says 172.21.15.22:36276) 2023-11-24T06:13:22.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.750+0000 7fa853fff640 1 -- 172.21.15.22:0/51993340 learned_addr learned my addr 172.21.15.22:0/51993340 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:22.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.750+0000 7fa85a59c640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c161930 0x7fa85c0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.750+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676794688 0 0) 0x7fa85c0ad510 con 0x7fa85c0719c0 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.750+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa848003520 con 0x7fa85c0719c0 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186728956 0 0) 0x7fa848003520 con 0x7fa85c0719c0 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c161930 msgr2=0x7fa85c0ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c161930 0x7fa85c0ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 >> v1:172.21.15.31:6789/0 conn(0x7fa85c06d520 legacy=0x7fa85c0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c0acec0 con 0x7fa85c0719c0 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fa844001670 con 0x7fa85c0719c0 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 >> v1:172.21.15.22:6789/0 conn(0x7fa85c0719c0 legacy=0x7fa85c0ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa848003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c161930 0x7fa8480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa848004d00 0x7fa848005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c071e60 con 0x7fa8480039a0 2023-11-24T06:13:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84800ba30 con 0x7fa848004d00 2023-11-24T06:13:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84800bbf0 con 0x7fa85c161930 2023-11-24T06:13:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.751+0000 7fa85a59c640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa848003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.752+0000 7fa85a59c640 1 -- 172.21.15.22:0/51993340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c161930 msgr2=0x7fa8480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.752+0000 7fa85a59c640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c161930 0x7fa8480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.752+0000 7fa85a59c640 1 -- 172.21.15.22:0/51993340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa848004d00 msgr2=0x7fa848005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.752+0000 7fa85a59c640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa848004d00 0x7fa848005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.752+0000 7fa85a59c640 1 -- 172.21.15.22:0/51993340 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa848003520 con 0x7fa8480039a0 2023-11-24T06:13:22.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.753+0000 7fa85a59c640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa848003dc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009a90 tx=0x7fa8480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d4c0546ded9da1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:22.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.753+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c02c6b0 con 0x7fa8480039a0 2023-11-24T06:13:22.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.753+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c02c810 con 0x7fa8480039a0 2023-11-24T06:13:22.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.753+0000 7fa859d9b640 1 -- 172.21.15.22:0/51993340 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c02cba0 con 0x7fa8480039a0 2023-11-24T06:13:22.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.753+0000 7fa860c2b640 1 -- 172.21.15.22:0/51993340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 msgr2=0x7fa848003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.753+0000 7fa860c2b640 1 --2- 172.21.15.22:0/51993340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa848003dc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009a90 tx=0x7fa8480057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.754+0000 7fa85ad9d640 1 -- 172.21.15.22:0/51993340 reap_dead start 2023-11-24T06:13:22.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.754+0000 7fa860c2b640 1 -- 172.21.15.22:0/51993340 shutdown_connections 2023-11-24T06:13:22.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.754+0000 7fa860c2b640 1 -- 172.21.15.22:0/51993340 >> 172.21.15.22:0/51993340 conn(0x7fa85c0b0d80 msgr2=0x7fa85c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:22.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.754+0000 7fa860c2b640 1 -- 172.21.15.22:0/51993340 shutdown_connections 2023-11-24T06:13:22.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.754+0000 7fa860c2b640 1 -- 172.21.15.22:0/51993340 wait complete. 2023-11-24T06:13:22.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.755+0000 7fa860c2b640 1 Processor -- start 2023-11-24T06:13:22.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.756+0000 7fa860c2b640 1 -- start start 2023-11-24T06:13:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa860c2b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa85c1f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa860c2b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa85c150320 0x7fa85c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa860c2b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c0ccee0 0x7fa85c163090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa860c2b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c161110 con 0x7fa8480039a0 2023-11-24T06:13:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa860c2b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c1f7ba0 con 0x7fa85c150320 2023-11-24T06:13:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa860c2b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c1f7e80 con 0x7fa85c0ccee0 2023-11-24T06:13:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa85a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa85c1f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa85a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa85c1f7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56104/0 (socket says 172.21.15.22:56104) 2023-11-24T06:13:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa85a59c640 1 -- 172.21.15.22:0/3531900432 learned_addr learned my addr 172.21.15.22:0/3531900432 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa85a59c640 1 -- 172.21.15.22:0/3531900432 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c0ccee0 msgr2=0x7fa85c163090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa85a59c640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c0ccee0 0x7fa85c163090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa85a59c640 1 -- 172.21.15.22:0/3531900432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa85c150320 msgr2=0x7fa85c160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa85a59c640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa85c150320 0x7fa85c160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.757+0000 7fa85a59c640 1 -- 172.21.15.22:0/3531900432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c1f8160 con 0x7fa8480039a0 2023-11-24T06:13:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.758+0000 7fa85a59c640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa85c1f7500 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa84c02c250 tx=0x7fa84c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.758+0000 7fa852ffd640 1 -- 172.21.15.22:0/3531900432 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c003810 con 0x7fa8480039a0 2023-11-24T06:13:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.758+0000 7fa852ffd640 1 -- 172.21.15.22:0/3531900432 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c003970 con 0x7fa8480039a0 2023-11-24T06:13:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.758+0000 7fa852ffd640 1 -- 172.21.15.22:0/3531900432 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c003d00 con 0x7fa8480039a0 2023-11-24T06:13:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.758+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85c161110 con 0x7fa8480039a0 2023-11-24T06:13:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.758+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c0cb900 con 0x7fa8480039a0 2023-11-24T06:13:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.760+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c074770 con 0x7fa8480039a0 2023-11-24T06:13:22.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.761+0000 7fa852ffd640 1 -- 172.21.15.22:0/3531900432 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa84c047450 con 0x7fa8480039a0 2023-11-24T06:13:22.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.761+0000 7fa852ffd640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa83c06ae40 0x7fa83c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:22.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.762+0000 7fa852ffd640 1 -- 172.21.15.22:0/3531900432 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa84c0ab4e0 con 0x7fa8480039a0 2023-11-24T06:13:22.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.762+0000 7fa853fff640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa83c06ae40 0x7fa83c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.763+0000 7fa853fff640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa83c06ae40 0x7fa83c06d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa844000f60 tx=0x7fa844001570 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:22.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:22.766+0000 7fa852ffd640 1 -- 172.21.15.22:0/3531900432 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa84c076aa0 con 0x7fa8480039a0 2023-11-24T06:13:23.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.028+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa85c0717a0 con 0x7fa8480039a0 2023-11-24T06:13:23.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.033+0000 7fa852ffd640 1 -- 172.21.15.22:0/3531900432 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa84c0044e0 con 0x7fa8480039a0 2023-11-24T06:13:23.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.035+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa83c06ae40 msgr2=0x7fa83c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.035+0000 7fa860c2b640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa83c06ae40 0x7fa83c06d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa844000f60 tx=0x7fa844001570 comp rx=0 tx=0).stop 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.035+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 msgr2=0x7fa85c1f7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.035+0000 7fa860c2b640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa85c1f7500 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa84c02c250 tx=0x7fa84c004730 comp rx=0 tx=0).stop 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.036+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 shutdown_connections 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.036+0000 7fa860c2b640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa83c06ae40 0x7fa83c06d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.036+0000 7fa860c2b640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa85c0ccee0 0x7fa85c163090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.036+0000 7fa860c2b640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa85c150320 0x7fa85c160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.036+0000 7fa860c2b640 1 --2- 172.21.15.22:0/3531900432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8480039a0 0x7fa85c1f7500 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.036+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 >> 172.21.15.22:0/3531900432 conn(0x7fa85c0b0d80 msgr2=0x7fa85c165e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.036+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 shutdown_connections 2023-11-24T06:13:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.036+0000 7fa860c2b640 1 -- 172.21.15.22:0/3531900432 wait complete. 2023-11-24T06:13:23.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-24T06:13:23.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.277+0000 7fc94d573640 1 Processor -- start 2023-11-24T06:13:23.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.278+0000 7fc94d573640 1 -- start start 2023-11-24T06:13:23.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.279+0000 7fc94d573640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948141e80 0x7fc948071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.279+0000 7fc94d573640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc948071650 0x7fc94806cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.279+0000 7fc94d573640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94806cae0 con 0x7fc94815ed20 2023-11-24T06:13:23.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.279+0000 7fc94d573640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9481422e0 con 0x7fc948071650 2023-11-24T06:13:23.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.279+0000 7fc94d573640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc948071e40 con 0x7fc948141e80 2023-11-24T06:13:23.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.280+0000 7fc93ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948141e80 0x7fc948071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.280+0000 7fc93ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948141e80 0x7fc948071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:54380/0 (socket says 172.21.15.22:54380) 2023-11-24T06:13:23.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.280+0000 7fc93ffff640 1 -- 172.21.15.22:0/404636356 learned_addr learned my addr 172.21.15.22:0/404636356 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:23.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.280+0000 7fc94cd72640 1 --2- 172.21.15.22:0/404636356 >> v2:172.21.15.31:3300/0 conn(0x7fc948071650 0x7fc94806cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.280+0000 7fc93ffff640 1 -- 172.21.15.22:0/404636356 >> v2:172.21.15.31:3300/0 conn(0x7fc948071650 msgr2=0x7fc94806cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:23.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.280+0000 7fc93ffff640 1 --2- 172.21.15.22:0/404636356 >> v2:172.21.15.31:3300/0 conn(0x7fc948071650 0x7fc94806cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.280+0000 7fc93ffff640 1 -- 172.21.15.22:0/404636356 >> v1:172.21.15.31:6789/0 conn(0x7fc94815ed20 legacy=0x7fc94815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.280+0000 7fc93ffff640 1 -- 172.21.15.22:0/404636356 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94806c1b0 con 0x7fc948141e80 2023-11-24T06:13:23.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.282+0000 7fc93ffff640 1 --2- 172.21.15.22:0/404636356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948141e80 0x7fc948071110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc930009870 tx=0x7fc93002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6924ce60ba40bd7d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:23.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc9477fe640 1 -- 172.21.15.22:0/404636356 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930030840 con 0x7fc948141e80 2023-11-24T06:13:23.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc9477fe640 1 -- 172.21.15.22:0/404636356 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9300309a0 con 0x7fc948141e80 2023-11-24T06:13:23.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc9477fe640 1 -- 172.21.15.22:0/404636356 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930030d30 con 0x7fc948141e80 2023-11-24T06:13:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc94d573640 1 -- 172.21.15.22:0/404636356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948141e80 msgr2=0x7fc948071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc94d573640 1 --2- 172.21.15.22:0/404636356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948141e80 0x7fc948071110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc930009870 tx=0x7fc93002b980 comp rx=0 tx=0).stop 2023-11-24T06:13:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc94d573640 1 -- 172.21.15.22:0/404636356 shutdown_connections 2023-11-24T06:13:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc94d573640 1 --2- 172.21.15.22:0/404636356 >> v2:172.21.15.31:3300/0 conn(0x7fc948071650 0x7fc94806cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc94d573640 1 --2- 172.21.15.22:0/404636356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948141e80 0x7fc948071110 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc94d573640 1 -- 172.21.15.22:0/404636356 >> 172.21.15.22:0/404636356 conn(0x7fc9480b0840 msgr2=0x7fc9480b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:23.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc94d573640 1 -- 172.21.15.22:0/404636356 shutdown_connections 2023-11-24T06:13:23.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.283+0000 7fc94d573640 1 -- 172.21.15.22:0/404636356 wait complete. 2023-11-24T06:13:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.285+0000 7fc94d573640 1 Processor -- start 2023-11-24T06:13:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.285+0000 7fc94d573640 1 -- start start 2023-11-24T06:13:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.286+0000 7fc94d573640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948071650 0x7fc948140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.286+0000 7fc94d573640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc948141e80 0x7fc94815d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.286+0000 7fc94d573640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94815ed20 0x7fc94813d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.286+0000 7fc94d573640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9481f6810 con 0x7fc94815ed20 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.286+0000 7fc94d573640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9481f7670 con 0x7fc948141e80 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.286+0000 7fc94d573640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9481f6a60 con 0x7fc948071650 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.286+0000 7fc94cd72640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94815ed20 0x7fc94813d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc94cd72640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94815ed20 0x7fc94813d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56114/0 (socket says 172.21.15.22:56114) 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc94cd72640 1 -- 172.21.15.22:0/696504066 learned_addr learned my addr 172.21.15.22:0/696504066 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc947fff640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948071650 0x7fc948140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc93ffff640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc948141e80 0x7fc94815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc94cd72640 1 -- 172.21.15.22:0/696504066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948071650 msgr2=0x7fc948140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc94cd72640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948071650 0x7fc948140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc94cd72640 1 -- 172.21.15.22:0/696504066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc948141e80 msgr2=0x7fc94815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc94cd72640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc948141e80 0x7fc94815d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc94cd72640 1 -- 172.21.15.22:0/696504066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300094d0 con 0x7fc94815ed20 2023-11-24T06:13:23.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.287+0000 7fc94cd72640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94815ed20 0x7fc94813d1f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc940009d30 tx=0x7fc94000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:23.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.288+0000 7fc9457fa640 1 -- 172.21.15.22:0/696504066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940009ba0 con 0x7fc94815ed20 2023-11-24T06:13:23.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.288+0000 7fc9457fa640 1 -- 172.21.15.22:0/696504066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94000f040 con 0x7fc94815ed20 2023-11-24T06:13:23.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.288+0000 7fc9457fa640 1 -- 172.21.15.22:0/696504066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400146c0 con 0x7fc94815ed20 2023-11-24T06:13:23.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.288+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9481f6d40 con 0x7fc94815ed20 2023-11-24T06:13:23.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.288+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9481f7300 con 0x7fc94815ed20 2023-11-24T06:13:23.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.289+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9480ac870 con 0x7fc94815ed20 2023-11-24T06:13:23.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.290+0000 7fc9457fa640 1 -- 172.21.15.22:0/696504066 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc940014820 con 0x7fc94815ed20 2023-11-24T06:13:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.291+0000 7fc9457fa640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc92806ae40 0x7fc92806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.291+0000 7fc9457fa640 1 -- 172.21.15.22:0/696504066 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc940089dc0 con 0x7fc94815ed20 2023-11-24T06:13:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.291+0000 7fc947fff640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc92806ae40 0x7fc92806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.292+0000 7fc947fff640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc92806ae40 0x7fc92806d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc948140b90 tx=0x7fc938009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:23.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.296+0000 7fc9457fa640 1 -- 172.21.15.22:0/696504066 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9400551b0 con 0x7fc94815ed20 2023-11-24T06:13:23.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.562+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc948067d10 con 0x7fc94815ed20 2023-11-24T06:13:23.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.567+0000 7fc9457fa640 1 -- 172.21.15.22:0/696504066 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc9400587d0 con 0x7fc94815ed20 2023-11-24T06:13:23.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc92806ae40 msgr2=0x7fc92806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc92806ae40 0x7fc92806d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc948140b90 tx=0x7fc938009040 comp rx=0 tx=0).stop 2023-11-24T06:13:23.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94815ed20 msgr2=0x7fc94813d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94815ed20 0x7fc94813d1f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc940009d30 tx=0x7fc94000c490 comp rx=0 tx=0).stop 2023-11-24T06:13:23.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 shutdown_connections 2023-11-24T06:13:23.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc92806ae40 0x7fc92806d300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94815ed20 0x7fc94813d1f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc948141e80 0x7fc94815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 --2- 172.21.15.22:0/696504066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc948071650 0x7fc948140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.570+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 >> 172.21.15.22:0/696504066 conn(0x7fc9480b0840 msgr2=0x7fc9480b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:23.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.571+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 shutdown_connections 2023-11-24T06:13:23.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.571+0000 7fc94d573640 1 -- 172.21.15.22:0/696504066 wait complete. 2023-11-24T06:13:23.593 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-24T06:13:23.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.814+0000 7fe6f1467640 1 Processor -- start 2023-11-24T06:13:23.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.815+0000 7fe6f1467640 1 -- start start 2023-11-24T06:13:23.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.816+0000 7fe6f1467640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6ec15d570 0x7fe6ec0d2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.816+0000 7fe6f1467640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ec0d1530 con 0x7fe6ec15d190 2023-11-24T06:13:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.816+0000 7fe6f1467640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ec0d1810 con 0x7fe6ec161b50 2023-11-24T06:13:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.816+0000 7fe6f1467640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0d1310 con 0x7fe6ec15d570 2023-11-24T06:13:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.817+0000 7fe6ebfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe6ec15d190 0x7fe6ec0d0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36292/0 (socket says 172.21.15.22:36292) 2023-11-24T06:13:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.817+0000 7fe6ebfff640 1 -- 172.21.15.22:0/4273307261 learned_addr learned my addr 172.21.15.22:0/4273307261 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.817+0000 7fe6e3fff640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6ec15d570 0x7fe6ec0d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.817+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557606411 0 0) 0x7fe6ec0d1530 con 0x7fe6ec15d190 2023-11-24T06:13:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.817+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d8003520 con 0x7fe6ec15d190 2023-11-24T06:13:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.817+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3306379890 0 0) 0x7fe6d8003520 con 0x7fe6ec15d190 2023-11-24T06:13:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.817+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6ec15d570 msgr2=0x7fe6ec0d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.817+0000 7fe6eb7fe640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6ec15d570 0x7fe6ec0d2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.817+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 >> v1:172.21.15.31:6789/0 conn(0x7fe6ec161b50 legacy=0x7fe6ec0b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0d1af0 con 0x7fe6ec15d190 2023-11-24T06:13:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fe6dc001690 con 0x7fe6ec15d190 2023-11-24T06:13:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 >> v1:172.21.15.22:6789/0 conn(0x7fe6ec15d190 legacy=0x7fe6ec0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6eb7fe640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d8003a10 0x7fe6d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6eb7fe640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d80047c0 0x7fe6d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6eb7fe640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6ec15d570 0x7fe6d80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0d1310 con 0x7fe6d80047c0 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d800bb70 con 0x7fe6d8003a10 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d800bd30 con 0x7fe6ec15d570 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6e3fff640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d80047c0 0x7fe6d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6e3fff640 1 -- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6ec15d570 msgr2=0x7fe6d80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.818+0000 7fe6f0c66640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6ec15d570 0x7fe6d80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.819+0000 7fe6e3fff640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6ec15d570 0x7fe6d80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.819+0000 7fe6e3fff640 1 -- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d8003a10 msgr2=0x7fe6d8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:23.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.819+0000 7fe6e3fff640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d8003a10 0x7fe6d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.819+0000 7fe6e3fff640 1 -- 172.21.15.22:0/4273307261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8003520 con 0x7fe6d80047c0 2023-11-24T06:13:23.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.819+0000 7fe6f0c66640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6ec15d570 0x7fe6d80051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:23.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.820+0000 7fe6e3fff640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d80047c0 0x7fe6d8004c40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009a90 tx=0x7fe6d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421b93e738a9402e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:23.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.820+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d402c680 con 0x7fe6d80047c0 2023-11-24T06:13:23.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.820+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d402c7e0 con 0x7fe6d80047c0 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.820+0000 7fe6eb7fe640 1 -- 172.21.15.22:0/4273307261 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d402cb70 con 0x7fe6d80047c0 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.821+0000 7fe6f1467640 1 -- 172.21.15.22:0/4273307261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d80047c0 msgr2=0x7fe6d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.821+0000 7fe6f1467640 1 --2- 172.21.15.22:0/4273307261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d80047c0 0x7fe6d8004c40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009a90 tx=0x7fe6d80057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.821+0000 7fe6f0c66640 1 -- 172.21.15.22:0/4273307261 reap_dead start 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.821+0000 7fe6f1467640 1 -- 172.21.15.22:0/4273307261 shutdown_connections 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.821+0000 7fe6f1467640 1 -- 172.21.15.22:0/4273307261 >> 172.21.15.22:0/4273307261 conn(0x7fe6ec08cae0 msgr2=0x7fe6ec09c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.821+0000 7fe6f1467640 1 -- 172.21.15.22:0/4273307261 shutdown_connections 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.821+0000 7fe6f1467640 1 -- 172.21.15.22:0/4273307261 wait complete. 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.823+0000 7fe6f1467640 1 Processor -- start 2023-11-24T06:13:23.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.823+0000 7fe6f1467640 1 -- start start 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.824+0000 7fe6f1467640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6d80047c0 0x7fe6ec1f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.824+0000 7fe6f1467640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6ec1f69d0 0x7fe6ec0c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.824+0000 7fe6f1467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6ec1f6e50 0x7fe6ec0c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.824+0000 7fe6f1467640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec151d80 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.824+0000 7fe6f1467640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec1f4360 con 0x7fe6ec1f69d0 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.824+0000 7fe6f1467640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0c9960 con 0x7fe6d80047c0 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.824+0000 7fe6f0c66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6ec1f6e50 0x7fe6ec0c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.824+0000 7fe6f0c66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6ec1f6e50 0x7fe6ec0c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56130/0 (socket says 172.21.15.22:56130) 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.824+0000 7fe6f0c66640 1 -- 172.21.15.22:0/1592224642 learned_addr learned my addr 172.21.15.22:0/1592224642 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6ebfff640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6d80047c0 0x7fe6ec1f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6f0c66640 1 -- 172.21.15.22:0/1592224642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6d80047c0 msgr2=0x7fe6ec1f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6e3fff640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6ec1f69d0 0x7fe6ec0c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6f0c66640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6d80047c0 0x7fe6ec1f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6f0c66640 1 -- 172.21.15.22:0/1592224642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6ec1f69d0 msgr2=0x7fe6ec0c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6f0c66640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6ec1f69d0 0x7fe6ec0c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6f0c66640 1 -- 172.21.15.22:0/1592224642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0b34b0 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6e3fff640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6ec1f69d0 0x7fe6ec0c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6f0c66640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6ec1f6e50 0x7fe6ec0c7230 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0b5c20 tx=0x7fe6e400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6e97fa640 1 -- 172.21.15.22:0/1592224642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4006d50 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6e97fa640 1 -- 172.21.15.22:0/1592224642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4003970 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6e97fa640 1 -- 172.21.15.22:0/1592224642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4003d60 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.825+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec0b3790 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.826+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec0b3d50 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.827+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ec0d2f40 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.828+0000 7fe6e97fa640 1 -- 172.21.15.22:0/1592224642 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6e4005070 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.829+0000 7fe6e97fa640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6cc06ae40 0x7fe6cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:23.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.829+0000 7fe6e97fa640 1 -- 172.21.15.22:0/1592224642 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6e4089250 con 0x7fe6ec1f6e50 2023-11-24T06:13:23.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.829+0000 7fe6ebfff640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6cc06ae40 0x7fe6cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:23.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.830+0000 7fe6ebfff640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6cc06ae40 0x7fe6cc06d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec08b9b0 tx=0x7fe6dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:23.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:23.834+0000 7fe6e97fa640 1 -- 172.21.15.22:0/1592224642 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6e40545b0 con 0x7fe6ec1f6e50 2023-11-24T06:13:24.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.097+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fe6ec04e840 con 0x7fe6ec1f6e50 2023-11-24T06:13:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.102+0000 7fe6e97fa640 1 -- 172.21.15.22:0/1592224642 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe6e4057bd0 con 0x7fe6ec1f6e50 2023-11-24T06:13:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.104+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6cc06ae40 msgr2=0x7fe6cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.104+0000 7fe6f1467640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6cc06ae40 0x7fe6cc06d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec08b9b0 tx=0x7fe6dc009040 comp rx=0 tx=0).stop 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.104+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6ec1f6e50 msgr2=0x7fe6ec0c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.104+0000 7fe6f1467640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6ec1f6e50 0x7fe6ec0c7230 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0b5c20 tx=0x7fe6e400dc00 comp rx=0 tx=0).stop 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.105+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 shutdown_connections 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.105+0000 7fe6f1467640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe6cc06ae40 0x7fe6cc06d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.105+0000 7fe6f1467640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6ec1f6e50 0x7fe6ec0c7230 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.105+0000 7fe6f1467640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6ec1f69d0 0x7fe6ec0c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.105+0000 7fe6f1467640 1 --2- 172.21.15.22:0/1592224642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6d80047c0 0x7fe6ec1f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.105+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 >> 172.21.15.22:0/1592224642 conn(0x7fe6ec08cae0 msgr2=0x7fe6ec0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.105+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 shutdown_connections 2023-11-24T06:13:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.105+0000 7fe6f1467640 1 -- 172.21.15.22:0/1592224642 wait complete. 2023-11-24T06:13:24.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-24T06:13:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.348+0000 7fc3113f4640 1 Processor -- start 2023-11-24T06:13:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.348+0000 7fc3113f4640 1 -- start start 2023-11-24T06:13:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.349+0000 7fc3113f4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc30c1416f0 0x7fc30c15ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.349+0000 7fc3113f4640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c070bf0 con 0x7fc30c141e80 2023-11-24T06:13:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.349+0000 7fc3113f4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c06d850 con 0x7fc30c06d230 2023-11-24T06:13:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.349+0000 7fc3113f4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c06db30 con 0x7fc30c1416f0 2023-11-24T06:13:24.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.350+0000 7fc303fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc30c141e80 0x7fc30c06cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36308/0 (socket says 172.21.15.22:36308) 2023-11-24T06:13:24.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.350+0000 7fc303fff640 1 -- 172.21.15.22:0/2966506758 learned_addr learned my addr 172.21.15.22:0/2966506758 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.350+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621498482 0 0) 0x7fc30c070bf0 con 0x7fc30c141e80 2023-11-24T06:13:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.350+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f8003520 con 0x7fc30c141e80 2023-11-24T06:13:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.350+0000 7fc30bfff640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc30c1416f0 0x7fc30c15ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3035434430 0 0) 0x7fc2f8003520 con 0x7fc30c141e80 2023-11-24T06:13:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc30c1416f0 msgr2=0x7fc30c15ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc30c1416f0 0x7fc30c15ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 >> v1:172.21.15.31:6789/0 conn(0x7fc30c06d230 legacy=0x7fc30c0cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0705a0 con 0x7fc30c141e80 2023-11-24T06:13:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fc2f4001670 con 0x7fc30c141e80 2023-11-24T06:13:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 >> v1:172.21.15.22:6789/0 conn(0x7fc30c141e80 legacy=0x7fc30c06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f8003a10 0x7fc2f8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f80047c0 0x7fc2f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc30c1416f0 0x7fc2f8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c06db30 con 0x7fc2f80047c0 2023-11-24T06:13:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f800bb40 con 0x7fc2f8003a10 2023-11-24T06:13:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f800bd00 con 0x7fc30c1416f0 2023-11-24T06:13:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.351+0000 7fc303fff640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f80047c0 0x7fc2f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.352+0000 7fc303fff640 1 -- 172.21.15.22:0/2966506758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc30c1416f0 msgr2=0x7fc2f8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.352+0000 7fc303fff640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc30c1416f0 0x7fc2f8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.352+0000 7fc303fff640 1 -- 172.21.15.22:0/2966506758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f8003a10 msgr2=0x7fc2f8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.352+0000 7fc303fff640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f8003a10 0x7fc2f8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.352+0000 7fc303fff640 1 -- 172.21.15.22:0/2966506758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8003520 con 0x7fc2f80047c0 2023-11-24T06:13:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.353+0000 7fc303fff640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f80047c0 0x7fc2f8004c40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400c240 tx=0x7fc2f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814922e3cc00d06b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.353+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4005ad0 con 0x7fc2f80047c0 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.353+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4005c50 con 0x7fc2f80047c0 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.353+0000 7fc30b7fe640 1 -- 172.21.15.22:0/2966506758 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f402c8b0 con 0x7fc2f80047c0 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.354+0000 7fc3113f4640 1 -- 172.21.15.22:0/2966506758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f80047c0 msgr2=0x7fc2f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.354+0000 7fc3113f4640 1 --2- 172.21.15.22:0/2966506758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f80047c0 0x7fc2f8004c40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400c240 tx=0x7fc2f80057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.354+0000 7fc310bf3640 1 -- 172.21.15.22:0/2966506758 reap_dead start 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.354+0000 7fc3113f4640 1 -- 172.21.15.22:0/2966506758 shutdown_connections 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.354+0000 7fc3113f4640 1 -- 172.21.15.22:0/2966506758 >> 172.21.15.22:0/2966506758 conn(0x7fc30c0b0840 msgr2=0x7fc30c0b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.354+0000 7fc3113f4640 1 -- 172.21.15.22:0/2966506758 shutdown_connections 2023-11-24T06:13:24.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.354+0000 7fc3113f4640 1 -- 172.21.15.22:0/2966506758 wait complete. 2023-11-24T06:13:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.356+0000 7fc3113f4640 1 Processor -- start 2023-11-24T06:13:24.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.356+0000 7fc3113f4640 1 -- start start 2023-11-24T06:13:24.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc3113f4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2f80047c0 0x7fc30c1f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc3113f4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc30c13ca70 0x7fc30c15da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc3113f4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c144240 0x7fc30c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc3113f4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c15df90 con 0x7fc30c13ca70 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc3113f4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c1f5340 con 0x7fc30c144240 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc3113f4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c13ced0 con 0x7fc2f80047c0 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc303fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc30c13ca70 0x7fc30c15da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc303fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc30c13ca70 0x7fc30c15da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56148/0 (socket says 172.21.15.22:56148) 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc303fff640 1 -- 172.21.15.22:0/1347526429 learned_addr learned my addr 172.21.15.22:0/1347526429 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.357+0000 7fc30bfff640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2f80047c0 0x7fc30c1f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc310bf3640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c144240 0x7fc30c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc303fff640 1 -- 172.21.15.22:0/1347526429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2f80047c0 msgr2=0x7fc30c1f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc303fff640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2f80047c0 0x7fc30c1f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc303fff640 1 -- 172.21.15.22:0/1347526429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c144240 msgr2=0x7fc30c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc303fff640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c144240 0x7fc30c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc303fff640 1 -- 172.21.15.22:0/1347526429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c15e1c0 con 0x7fc30c13ca70 2023-11-24T06:13:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc303fff640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc30c13ca70 0x7fc30c15da50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc2f402c450 tx=0x7fc2f4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc3097fa640 1 -- 172.21.15.22:0/1347526429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4039070 con 0x7fc30c13ca70 2023-11-24T06:13:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc3097fa640 1 -- 172.21.15.22:0/1347526429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f402dd50 con 0x7fc30c13ca70 2023-11-24T06:13:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc3097fa640 1 -- 172.21.15.22:0/1347526429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f403c040 con 0x7fc30c13ca70 2023-11-24T06:13:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.358+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c15e4a0 con 0x7fc30c13ca70 2023-11-24T06:13:24.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.359+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c1f4fd0 con 0x7fc30c13ca70 2023-11-24T06:13:24.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.360+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c1f54f0 con 0x7fc30c13ca70 2023-11-24T06:13:24.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.361+0000 7fc3097fa640 1 -- 172.21.15.22:0/1347526429 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2f4032070 con 0x7fc30c13ca70 2023-11-24T06:13:24.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.361+0000 7fc3097fa640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc2ec06ae40 0x7fc2ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.362+0000 7fc3097fa640 1 -- 172.21.15.22:0/1347526429 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc2f40aa580 con 0x7fc30c13ca70 2023-11-24T06:13:24.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.362+0000 7fc30bfff640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc2ec06ae40 0x7fc2ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.363+0000 7fc30bfff640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc2ec06ae40 0x7fc2ec06d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc006a90 tx=0x7fc2fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:24.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.366+0000 7fc3097fa640 1 -- 172.21.15.22:0/1347526429 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc30c1f54f0 con 0x7fc30c13ca70 2023-11-24T06:13:24.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.626+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc30c1f54f0 con 0x7fc30c13ca70 2023-11-24T06:13:24.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.630+0000 7fc3097fa640 1 -- 172.21.15.22:0/1347526429 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc30c1f54f0 con 0x7fc30c13ca70 2023-11-24T06:13:24.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc2ec06ae40 msgr2=0x7fc2ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc2ec06ae40 0x7fc2ec06d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc006a90 tx=0x7fc2fc008040 comp rx=0 tx=0).stop 2023-11-24T06:13:24.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc30c13ca70 msgr2=0x7fc30c15da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc30c13ca70 0x7fc30c15da50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc2f402c450 tx=0x7fc2f4001a00 comp rx=0 tx=0).stop 2023-11-24T06:13:24.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 shutdown_connections 2023-11-24T06:13:24.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc2ec06ae40 0x7fc2ec06d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc30c144240 0x7fc30c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc30c13ca70 0x7fc30c15da50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 --2- 172.21.15.22:0/1347526429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2f80047c0 0x7fc30c1f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 >> 172.21.15.22:0/1347526429 conn(0x7fc30c0b0840 msgr2=0x7fc30c15ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:24.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 shutdown_connections 2023-11-24T06:13:24.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.633+0000 7fc3113f4640 1 -- 172.21.15.22:0/1347526429 wait complete. 2023-11-24T06:13:24.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-24T06:13:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.873+0000 7fc551333640 1 Processor -- start 2023-11-24T06:13:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.873+0000 7fc551333640 1 -- start start 2023-11-24T06:13:24.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.875+0000 7fc551333640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc54c15a100 0x7fc54c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.875+0000 7fc551333640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc54c0abff0 0x7fc54c0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.875+0000 7fc551333640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c13da30 con 0x7fc54c0ae7e0 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.875+0000 7fc551333640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c0ac840 con 0x7fc54c15a100 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.875+0000 7fc551333640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c0ac560 con 0x7fc54c0abff0 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.875+0000 7fc54affd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc54c15a100 0x7fc54c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.875+0000 7fc54b7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc54c0ae7e0 0x7fc54c06d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36320/0 (socket says 172.21.15.22:36320) 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.875+0000 7fc54b7fe640 1 -- 172.21.15.22:0/2246040118 learned_addr learned my addr 172.21.15.22:0/2246040118 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.875+0000 7fc54affd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc54c15a100 0x7fc54c0b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56152/0 (socket says 172.21.15.22:56152) 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.876+0000 7fc54affd640 1 -- 172.21.15.22:0/2246040118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc54c0abff0 msgr2=0x7fc54c0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.876+0000 7fc54affd640 1 --2- 172.21.15.22:0/2246040118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc54c0abff0 0x7fc54c0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.876+0000 7fc54affd640 1 -- 172.21.15.22:0/2246040118 >> v1:172.21.15.22:6789/0 conn(0x7fc54c0ae7e0 legacy=0x7fc54c06d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.876+0000 7fc54affd640 1 -- 172.21.15.22:0/2246040118 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c070650 con 0x7fc54c15a100 2023-11-24T06:13:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.877+0000 7fc54affd640 1 --2- 172.21.15.22:0/2246040118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c15a100 0x7fc54c0b3290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00bfa0 tx=0x7fc53c02e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669c6e8bb5cb0852 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.877+0000 7fc549ffb640 1 -- 172.21.15.22:0/2246040118 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c02e9b0 con 0x7fc54c15a100 2023-11-24T06:13:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.877+0000 7fc549ffb640 1 -- 172.21.15.22:0/2246040118 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c02eb10 con 0x7fc54c15a100 2023-11-24T06:13:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.877+0000 7fc549ffb640 1 -- 172.21.15.22:0/2246040118 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c02eea0 con 0x7fc54c15a100 2023-11-24T06:13:24.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.878+0000 7fc551333640 1 -- 172.21.15.22:0/2246040118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c15a100 msgr2=0x7fc54c0b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.878+0000 7fc551333640 1 --2- 172.21.15.22:0/2246040118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c15a100 0x7fc54c0b3290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00bfa0 tx=0x7fc53c02e010 comp rx=0 tx=0).stop 2023-11-24T06:13:24.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.878+0000 7fc551333640 1 -- 172.21.15.22:0/2246040118 shutdown_connections 2023-11-24T06:13:24.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.878+0000 7fc551333640 1 --2- 172.21.15.22:0/2246040118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc54c0abff0 0x7fc54c0b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.878+0000 7fc551333640 1 --2- 172.21.15.22:0/2246040118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c15a100 0x7fc54c0b3290 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.878+0000 7fc551333640 1 -- 172.21.15.22:0/2246040118 >> 172.21.15.22:0/2246040118 conn(0x7fc54c0b0d80 msgr2=0x7fc54c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:24.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.878+0000 7fc551333640 1 -- 172.21.15.22:0/2246040118 shutdown_connections 2023-11-24T06:13:24.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.878+0000 7fc551333640 1 -- 172.21.15.22:0/2246040118 wait complete. 2023-11-24T06:13:24.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.880+0000 7fc551333640 1 Processor -- start 2023-11-24T06:13:24.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.880+0000 7fc551333640 1 -- start start 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.881+0000 7fc551333640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c0abff0 0x7fc54c0989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.881+0000 7fc551333640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc54c0ae7e0 0x7fc54c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.881+0000 7fc551333640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc54c15a100 0x7fc54c158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.881+0000 7fc551333640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c098f00 con 0x7fc54c0abff0 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.881+0000 7fc551333640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c15ce20 con 0x7fc54c15a100 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.881+0000 7fc551333640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c15cb40 con 0x7fc54c0ae7e0 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c0abff0 0x7fc54c0989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c0abff0 0x7fc54c0989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56168/0 (socket says 172.21.15.22:56168) 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54affd640 1 -- 172.21.15.22:0/1482366336 learned_addr learned my addr 172.21.15.22:0/1482366336 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54b7fe640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc54c15a100 0x7fc54c158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54a7fc640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc54c0ae7e0 0x7fc54c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54affd640 1 -- 172.21.15.22:0/1482366336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc54c0ae7e0 msgr2=0x7fc54c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54affd640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc54c0ae7e0 0x7fc54c15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54affd640 1 -- 172.21.15.22:0/1482366336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc54c15a100 msgr2=0x7fc54c158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54affd640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc54c15a100 0x7fc54c158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54affd640 1 -- 172.21.15.22:0/1482366336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c00bc80 con 0x7fc54c0abff0 2023-11-24T06:13:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.882+0000 7fc54affd640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c0abff0 0x7fc54c0989c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc53c038040 tx=0x7fc53c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.883+0000 7fc5437fe640 1 -- 172.21.15.22:0/1482366336 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c040660 con 0x7fc54c0abff0 2023-11-24T06:13:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.883+0000 7fc5437fe640 1 -- 172.21.15.22:0/1482366336 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c0407e0 con 0x7fc54c0abff0 2023-11-24T06:13:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.883+0000 7fc5437fe640 1 -- 172.21.15.22:0/1482366336 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c040b90 con 0x7fc54c0abff0 2023-11-24T06:13:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.883+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c0cbb70 con 0x7fc54c0abff0 2023-11-24T06:13:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.883+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c0cc130 con 0x7fc54c0abff0 2023-11-24T06:13:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.884+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c067960 con 0x7fc54c0abff0 2023-11-24T06:13:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.885+0000 7fc5437fe640 1 -- 172.21.15.22:0/1482366336 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc53c040cf0 con 0x7fc54c0abff0 2023-11-24T06:13:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.886+0000 7fc5437fe640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc52c06ae40 0x7fc52c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:24.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.886+0000 7fc5437fe640 1 -- 172.21.15.22:0/1482366336 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc53c0ae3f0 con 0x7fc54c0abff0 2023-11-24T06:13:24.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.886+0000 7fc54a7fc640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc52c06ae40 0x7fc52c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:24.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.887+0000 7fc54a7fc640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc52c06ae40 0x7fc52c06d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0cec90 tx=0x7fc534008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:24.891+0000 7fc5437fe640 1 -- 172.21.15.22:0/1482366336 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc53c079880 con 0x7fc54c0abff0 2023-11-24T06:13:25.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.157+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc54c0cb390 con 0x7fc54c0abff0 2023-11-24T06:13:25.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.161+0000 7fc5437fe640 1 -- 172.21.15.22:0/1482366336 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc53c041400 con 0x7fc54c0abff0 2023-11-24T06:13:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc52c06ae40 msgr2=0x7fc52c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc52c06ae40 0x7fc52c06d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0cec90 tx=0x7fc534008040 comp rx=0 tx=0).stop 2023-11-24T06:13:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c0abff0 msgr2=0x7fc54c0989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c0abff0 0x7fc54c0989c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc53c038040 tx=0x7fc53c004a40 comp rx=0 tx=0).stop 2023-11-24T06:13:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 shutdown_connections 2023-11-24T06:13:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc52c06ae40 0x7fc52c06d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc54c15a100 0x7fc54c158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc54c0ae7e0 0x7fc54c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 --2- 172.21.15.22:0/1482366336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc54c0abff0 0x7fc54c0989c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 >> 172.21.15.22:0/1482366336 conn(0x7fc54c0b0d80 msgr2=0x7fc54c0b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 shutdown_connections 2023-11-24T06:13:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.164+0000 7fc551333640 1 -- 172.21.15.22:0/1482366336 wait complete. 2023-11-24T06:13:25.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.401+0000 7f786e84b640 1 Processor -- start 2023-11-24T06:13:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.401+0000 7f786e84b640 1 -- start start 2023-11-24T06:13:25.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.402+0000 7f786e84b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f786813dfd0 0x7f786815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786e84b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f78680cf050 0x7f78680cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786e84b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f786806c130 0x7f786806c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786e84b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78680cfa40 con 0x7f78680cf050 2023-11-24T06:13:25.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786e84b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786815fa70 con 0x7f786813dfd0 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786e84b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786815ee60 con 0x7f786806c130 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786d048640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f78680cf050 0x7f78680cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786d048640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f78680cf050 0x7f78680cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56172/0 (socket says 172.21.15.22:56172) 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786d048640 1 -- 172.21.15.22:0/2061185232 learned_addr learned my addr 172.21.15.22:0/2061185232 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786d849640 1 --2- 172.21.15.22:0/2061185232 >> v2:172.21.15.31:3300/0 conn(0x7f786813dfd0 0x7f786815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.403+0000 7f786e04a640 1 --2- 172.21.15.22:0/2061185232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f786806c130 0x7f786806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.404+0000 7f786d048640 1 -- 172.21.15.22:0/2061185232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f786806c130 msgr2=0x7f786806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.404+0000 7f786d048640 1 --2- 172.21.15.22:0/2061185232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f786806c130 0x7f786806c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.404+0000 7f786d048640 1 -- 172.21.15.22:0/2061185232 >> v2:172.21.15.31:3300/0 conn(0x7f786813dfd0 msgr2=0x7f786815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.404+0000 7f786d048640 1 --2- 172.21.15.22:0/2061185232 >> v2:172.21.15.31:3300/0 conn(0x7f786813dfd0 0x7f786815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.404+0000 7f786d048640 1 -- 172.21.15.22:0/2061185232 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786815f140 con 0x7f78680cf050 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.405+0000 7f786d048640 1 --2- 172.21.15.22:0/2061185232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78680cf050 0x7f78680cf500 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78680cfc10 tx=0x7f785802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d115b9da8e87045 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.405+0000 7f786c847640 1 -- 172.21.15.22:0/2061185232 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858031870 con 0x7f78680cf050 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.405+0000 7f786c847640 1 -- 172.21.15.22:0/2061185232 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78580319d0 con 0x7f78680cf050 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.405+0000 7f786c847640 1 -- 172.21.15.22:0/2061185232 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858031d60 con 0x7f78680cf050 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.406+0000 7f786e84b640 1 -- 172.21.15.22:0/2061185232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78680cf050 msgr2=0x7f78680cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.406+0000 7f786e84b640 1 --2- 172.21.15.22:0/2061185232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78680cf050 0x7f78680cf500 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78680cfc10 tx=0x7f785802b910 comp rx=0 tx=0).stop 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.406+0000 7f786e84b640 1 -- 172.21.15.22:0/2061185232 shutdown_connections 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.406+0000 7f786e84b640 1 --2- 172.21.15.22:0/2061185232 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f786806c130 0x7f786806c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.406+0000 7f786e84b640 1 --2- 172.21.15.22:0/2061185232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78680cf050 0x7f78680cf500 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.406+0000 7f786e84b640 1 --2- 172.21.15.22:0/2061185232 >> v2:172.21.15.31:3300/0 conn(0x7f786813dfd0 0x7f786815be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.406+0000 7f786e84b640 1 -- 172.21.15.22:0/2061185232 >> 172.21.15.22:0/2061185232 conn(0x7f786806a860 msgr2=0x7f786806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:25.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.406+0000 7f786e84b640 1 -- 172.21.15.22:0/2061185232 shutdown_connections 2023-11-24T06:13:25.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.406+0000 7f786e84b640 1 -- 172.21.15.22:0/2061185232 wait complete. 2023-11-24T06:13:25.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.408+0000 7f786e84b640 1 Processor -- start 2023-11-24T06:13:25.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.408+0000 7f786e84b640 1 -- start start 2023-11-24T06:13:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.409+0000 7f786e84b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786806c130 0x7f78681f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.409+0000 7f786e84b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78680cf050 0x7f78680b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.409+0000 7f786e84b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786813dfd0 0x7f78680b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.409+0000 7f786e84b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78681f6cd0 con 0x7f786813dfd0 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.409+0000 7f786e84b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786813c370 con 0x7f786806c130 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.409+0000 7f786e84b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78681f6050 con 0x7f78680cf050 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.409+0000 7f786e04a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786813dfd0 0x7f78680b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.409+0000 7f786e04a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786813dfd0 0x7f78680b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56184/0 (socket says 172.21.15.22:56184) 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.409+0000 7f786e04a640 1 -- 172.21.15.22:0/3807383479 learned_addr learned my addr 172.21.15.22:0/3807383479 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f786d849640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786806c130 0x7f78681f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f786d048640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78680cf050 0x7f78680b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f786e04a640 1 -- 172.21.15.22:0/3807383479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78680cf050 msgr2=0x7f78680b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f786e04a640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78680cf050 0x7f78680b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f786e04a640 1 -- 172.21.15.22:0/3807383479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786806c130 msgr2=0x7f78681f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f786e04a640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786806c130 0x7f78681f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f786e04a640 1 -- 172.21.15.22:0/3807383479 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78580094d0 con 0x7f786813dfd0 2023-11-24T06:13:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f786d048640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78680cf050 0x7f78680b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f786e04a640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786813dfd0 0x7f78680b2f50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7860007e70 tx=0x7f786000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:25.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.410+0000 7f785e7fc640 1 -- 172.21.15.22:0/3807383479 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860014620 con 0x7f786813dfd0 2023-11-24T06:13:25.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.411+0000 7f785e7fc640 1 -- 172.21.15.22:0/3807383479 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78600147a0 con 0x7f786813dfd0 2023-11-24T06:13:25.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.411+0000 7f785e7fc640 1 -- 172.21.15.22:0/3807383479 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860014b50 con 0x7f786813dfd0 2023-11-24T06:13:25.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.411+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78681f6330 con 0x7f786813dfd0 2023-11-24T06:13:25.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.411+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78681f68f0 con 0x7f786813dfd0 2023-11-24T06:13:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.412+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78681f6e10 con 0x7f786813dfd0 2023-11-24T06:13:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.413+0000 7f785e7fc640 1 -- 172.21.15.22:0/3807383479 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7860014cb0 con 0x7f786813dfd0 2023-11-24T06:13:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.414+0000 7f785e7fc640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f784c06ae40 0x7f784c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.414+0000 7f785e7fc640 1 -- 172.21.15.22:0/3807383479 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7860089cc0 con 0x7f786813dfd0 2023-11-24T06:13:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.414+0000 7f786d849640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f784c06ae40 0x7f784c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.415+0000 7f786d849640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f784c06ae40 0x7f784c06d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7864006fd0 tx=0x7f7864008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.419+0000 7f785e7fc640 1 -- 172.21.15.22:0/3807383479 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78681f6e10 con 0x7f786813dfd0 2023-11-24T06:13:25.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.606+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78681f6e10 con 0x7f786813dfd0 2023-11-24T06:13:25.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.609+0000 7f785e7fc640 1 -- 172.21.15.22:0/3807383479 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12809 (secure 0 0 0) 0x7f78681f6e10 con 0x7f786813dfd0 2023-11-24T06:13:25.611 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:25.612 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":32,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:13:21.428281+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:25.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f784c06ae40 msgr2=0x7f784c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f784c06ae40 0x7f784c06d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7864006fd0 tx=0x7f7864008040 comp rx=0 tx=0).stop 2023-11-24T06:13:25.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786813dfd0 msgr2=0x7f78680b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786813dfd0 0x7f78680b2f50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7860007e70 tx=0x7f786000e4b0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 shutdown_connections 2023-11-24T06:13:25.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f784c06ae40 0x7f784c06d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786813dfd0 0x7f78680b2f50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78680cf050 0x7f78680b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 --2- 172.21.15.22:0/3807383479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f786806c130 0x7f78681f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.611+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 >> 172.21.15.22:0/3807383479 conn(0x7f786806a860 msgr2=0x7f78680afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:25.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.612+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 shutdown_connections 2023-11-24T06:13:25.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.612+0000 7f786e84b640 1 -- 172.21.15.22:0/3807383479 wait complete. 2023-11-24T06:13:25.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:25.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:25.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.855+0000 7f87d359e640 1 Processor -- start 2023-11-24T06:13:25.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.856+0000 7f87d359e640 1 -- start start 2023-11-24T06:13:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.857+0000 7f87d359e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87d4144770 0x7f87d415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.857+0000 7f87d359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87d415f0a0 0x7f87d40ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.857+0000 7f87d359e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d415f930 con 0x7f87d40b35a0 2023-11-24T06:13:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.857+0000 7f87d359e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d40b43b0 con 0x7f87d4144770 2023-11-24T06:13:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.857+0000 7f87d359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d415f510 con 0x7f87d415f0a0 2023-11-24T06:13:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.858+0000 7f87d259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87d4144770 0x7f87d415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.858+0000 7f87d1d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f87d40b35a0 0x7f87d406c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36336/0 (socket says 172.21.15.22:36336) 2023-11-24T06:13:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.858+0000 7f87d1d9b640 1 -- 172.21.15.22:0/1462413869 learned_addr learned my addr 172.21.15.22:0/1462413869 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.858+0000 7f87d2d9d640 1 --2- 172.21.15.22:0/1462413869 >> v2:172.21.15.31:3300/0 conn(0x7f87d415f0a0 0x7f87d40ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.858+0000 7f87d259c640 1 -- 172.21.15.22:0/1462413869 >> v2:172.21.15.31:3300/0 conn(0x7f87d415f0a0 msgr2=0x7f87d40ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.858+0000 7f87d259c640 1 --2- 172.21.15.22:0/1462413869 >> v2:172.21.15.31:3300/0 conn(0x7f87d415f0a0 0x7f87d40ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.858+0000 7f87d259c640 1 -- 172.21.15.22:0/1462413869 >> v1:172.21.15.22:6789/0 conn(0x7f87d40b35a0 legacy=0x7f87d406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.858+0000 7f87d259c640 1 -- 172.21.15.22:0/1462413869 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d40ce9f0 con 0x7f87d4144770 2023-11-24T06:13:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.858+0000 7f87d2d9d640 1 --2- 172.21.15.22:0/1462413869 >> v2:172.21.15.31:3300/0 conn(0x7f87d415f0a0 0x7f87d40ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.859+0000 7f87d259c640 1 --2- 172.21.15.22:0/1462413869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d4144770 0x7f87d415eb60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f87d40700e0 tx=0x7f87c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ac35df775a51a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.860+0000 7f87d159a640 1 -- 172.21.15.22:0/1462413869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c4031830 con 0x7f87d4144770 2023-11-24T06:13:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.860+0000 7f87d159a640 1 -- 172.21.15.22:0/1462413869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c4031990 con 0x7f87d4144770 2023-11-24T06:13:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.860+0000 7f87d159a640 1 -- 172.21.15.22:0/1462413869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c4031d20 con 0x7f87d4144770 2023-11-24T06:13:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.860+0000 7f87d359e640 1 -- 172.21.15.22:0/1462413869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d4144770 msgr2=0x7f87d415eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.860+0000 7f87d359e640 1 --2- 172.21.15.22:0/1462413869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d4144770 0x7f87d415eb60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f87d40700e0 tx=0x7f87c402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.860+0000 7f87d359e640 1 -- 172.21.15.22:0/1462413869 shutdown_connections 2023-11-24T06:13:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.861+0000 7f87d359e640 1 --2- 172.21.15.22:0/1462413869 >> v2:172.21.15.31:3300/0 conn(0x7f87d415f0a0 0x7f87d40ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.861+0000 7f87d359e640 1 --2- 172.21.15.22:0/1462413869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d4144770 0x7f87d415eb60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.861+0000 7f87d359e640 1 -- 172.21.15.22:0/1462413869 >> 172.21.15.22:0/1462413869 conn(0x7f87d40cec10 msgr2=0x7f87d40cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.861+0000 7f87d359e640 1 -- 172.21.15.22:0/1462413869 shutdown_connections 2023-11-24T06:13:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.861+0000 7f87d359e640 1 -- 172.21.15.22:0/1462413869 wait complete. 2023-11-24T06:13:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.862+0000 7f87d359e640 1 Processor -- start 2023-11-24T06:13:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.863+0000 7f87d359e640 1 -- start start 2023-11-24T06:13:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.863+0000 7f87d359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d40b35a0 0x7f87d4140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.863+0000 7f87d359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87d4144770 0x7f87d413a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.863+0000 7f87d359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87d415f0a0 0x7f87d4159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.863+0000 7f87d359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d4158ce0 con 0x7f87d40b35a0 2023-11-24T06:13:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d4158f30 con 0x7f87d4144770 2023-11-24T06:13:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d4159210 con 0x7f87d415f0a0 2023-11-24T06:13:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d40b35a0 0x7f87d4140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d40b35a0 0x7f87d4140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56190/0 (socket says 172.21.15.22:56190) 2023-11-24T06:13:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d259c640 1 -- 172.21.15.22:0/2961364625 learned_addr learned my addr 172.21.15.22:0/2961364625 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d1d9b640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87d4144770 0x7f87d413a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d259c640 1 -- 172.21.15.22:0/2961364625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87d415f0a0 msgr2=0x7f87d4159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d259c640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87d415f0a0 0x7f87d4159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d259c640 1 -- 172.21.15.22:0/2961364625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87d4144770 msgr2=0x7f87d413a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d259c640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87d4144770 0x7f87d413a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d259c640 1 -- 172.21.15.22:0/2961364625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4009400 con 0x7f87d40b35a0 2023-11-24T06:13:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.864+0000 7f87d1d9b640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87d4144770 0x7f87d413a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.865+0000 7f87d259c640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d40b35a0 0x7f87d4140bc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f87c402bee0 tx=0x7f87c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.865+0000 7f87caffd640 1 -- 172.21.15.22:0/2961364625 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c403ba70 con 0x7f87d40b35a0 2023-11-24T06:13:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.865+0000 7f87caffd640 1 -- 172.21.15.22:0/2961364625 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c403bbf0 con 0x7f87d40b35a0 2023-11-24T06:13:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.865+0000 7f87caffd640 1 -- 172.21.15.22:0/2961364625 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c40453f0 con 0x7f87d40b35a0 2023-11-24T06:13:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.865+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d41594f0 con 0x7f87d40b35a0 2023-11-24T06:13:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.865+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d4159ab0 con 0x7f87d40b35a0 2023-11-24T06:13:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.866+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d4159ca0 con 0x7f87d40b35a0 2023-11-24T06:13:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.867+0000 7f87caffd640 1 -- 172.21.15.22:0/2961364625 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87c404e450 con 0x7f87d40b35a0 2023-11-24T06:13:25.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.869+0000 7f87caffd640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87b406ae40 0x7f87b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:25.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.869+0000 7f87caffd640 1 -- 172.21.15.22:0/2961364625 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f87c40ab5d0 con 0x7f87d40b35a0 2023-11-24T06:13:25.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.869+0000 7f87d1d9b640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87b406ae40 0x7f87b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:25.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.870+0000 7f87d1d9b640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87b406ae40 0x7f87b406d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f87d40b0510 tx=0x7f87bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:25.873+0000 7f87caffd640 1 -- 172.21.15.22:0/2961364625 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87c4076930 con 0x7f87d40b35a0 2023-11-24T06:13:26.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.071+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87d404e840 con 0x7f87d40b35a0 2023-11-24T06:13:26.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.072+0000 7f87caffd640 1 -- 172.21.15.22:0/2961364625 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87c4079f50 con 0x7f87d40b35a0 2023-11-24T06:13:26.074 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:13:26.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.074+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87b406ae40 msgr2=0x7f87b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.074+0000 7f87d359e640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87b406ae40 0x7f87b406d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f87d40b0510 tx=0x7f87bc009040 comp rx=0 tx=0).stop 2023-11-24T06:13:26.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.074+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d40b35a0 msgr2=0x7f87d4140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.074+0000 7f87d359e640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d40b35a0 0x7f87d4140bc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f87c402bee0 tx=0x7f87c40046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.075+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 shutdown_connections 2023-11-24T06:13:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.075+0000 7f87d359e640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87b406ae40 0x7f87b406d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.075+0000 7f87d359e640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87d415f0a0 0x7f87d4159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.075+0000 7f87d359e640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87d4144770 0x7f87d413a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.075+0000 7f87d359e640 1 --2- 172.21.15.22:0/2961364625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d40b35a0 0x7f87d4140bc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.075+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 >> 172.21.15.22:0/2961364625 conn(0x7f87d40cec10 msgr2=0x7f87d406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.075+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 shutdown_connections 2023-11-24T06:13:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.075+0000 7f87d359e640 1 -- 172.21.15.22:0/2961364625 wait complete. 2023-11-24T06:13:26.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:13:26.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.317+0000 7fa6cbfff640 1 Processor -- start 2023-11-24T06:13:26.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.317+0000 7fa6cbfff640 1 -- start start 2023-11-24T06:13:26.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.319+0000 7fa6cbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa6cc143570 0x7fa6cc0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.319+0000 7fa6cbfff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc071700 con 0x7fa6cc143950 2023-11-24T06:13:26.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.319+0000 7fa6cbfff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc15b410 con 0x7fa6cc15e6b0 2023-11-24T06:13:26.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.319+0000 7fa6cbfff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6cc15b130 con 0x7fa6cc143570 2023-11-24T06:13:26.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.319+0000 7fa6ca7fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa6cc143950 0x7fa6cc15a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36338/0 (socket says 172.21.15.22:36338) 2023-11-24T06:13:26.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.319+0000 7fa6ca7fc640 1 -- 172.21.15.22:0/852853850 learned_addr learned my addr 172.21.15.22:0/852853850 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6caffd640 1 --2- 172.21.15.22:0/852853850 >> v2:172.21.15.31:3300/0 conn(0x7fa6cc143570 0x7fa6cc0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252524025 0 0) 0x7fa6c0001110 con 0x7fa6cc143950 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b4003520 con 0x7fa6cc143950 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2347695193 0 0) 0x7fa6b4003520 con 0x7fa6cc143950 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 >> v2:172.21.15.31:3300/0 conn(0x7fa6cc143570 msgr2=0x7fa6cc0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 --2- 172.21.15.22:0/852853850 >> v2:172.21.15.31:3300/0 conn(0x7fa6cc143570 0x7fa6cc0cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 >> v1:172.21.15.31:6789/0 conn(0x7fa6cc15e6b0 legacy=0x7fa6cc0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc15dbd0 con 0x7fa6cc143950 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fa6c0001800 con 0x7fa6cc143950 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 >> v1:172.21.15.22:6789/0 conn(0x7fa6cc143950 legacy=0x7fa6cc15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40039e0 0x7fa6b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b40047c0 0x7fa6b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6b40052a0 0x7fa6b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc15b130 con 0x7fa6b40047c0 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b400c1f0 con 0x7fa6b40039e0 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b400c3b0 con 0x7fa6b40052a0 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.320+0000 7fa6ca7fc640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b40047c0 0x7fa6b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.321+0000 7fa6caffd640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40039e0 0x7fa6b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.321+0000 7fa6cb7fe640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6b40052a0 0x7fa6b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.321+0000 7fa6ca7fc640 1 -- 172.21.15.22:0/852853850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6b40052a0 msgr2=0x7fa6b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.321+0000 7fa6ca7fc640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6b40052a0 0x7fa6b400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.321+0000 7fa6ca7fc640 1 -- 172.21.15.22:0/852853850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40039e0 msgr2=0x7fa6b4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.321+0000 7fa6ca7fc640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40039e0 0x7fa6b4003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.321+0000 7fa6ca7fc640 1 -- 172.21.15.22:0/852853850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b4003520 con 0x7fa6b40047c0 2023-11-24T06:13:26.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.321+0000 7fa6cb7fe640 1 -- 172.21.15.22:0/852853850 reap_dead start 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.322+0000 7fa6ca7fc640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b40047c0 0x7fa6b4004c40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc071f70 tx=0x7fa6b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4f76886ea37dfe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.322+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0005ad0 con 0x7fa6b40047c0 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.322+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c0005c50 con 0x7fa6b40047c0 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.322+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/852853850 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c002ca90 con 0x7fa6b40047c0 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.323+0000 7fa6cbfff640 1 -- 172.21.15.22:0/852853850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b40047c0 msgr2=0x7fa6b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.323+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b40047c0 0x7fa6b4004c40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc071f70 tx=0x7fa6b40057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.323+0000 7fa6cbfff640 1 -- 172.21.15.22:0/852853850 shutdown_connections 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.323+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/852853850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b40047c0 0x7fa6b4004c40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.323+0000 7fa6cbfff640 1 -- 172.21.15.22:0/852853850 >> 172.21.15.22:0/852853850 conn(0x7fa6cc06a860 msgr2=0x7fa6cc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.323+0000 7fa6cbfff640 1 -- 172.21.15.22:0/852853850 shutdown_connections 2023-11-24T06:13:26.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.323+0000 7fa6cbfff640 1 -- 172.21.15.22:0/852853850 wait complete. 2023-11-24T06:13:26.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.325+0000 7fa6cbfff640 1 Processor -- start 2023-11-24T06:13:26.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.325+0000 7fa6cbfff640 1 -- start start 2023-11-24T06:13:26.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.326+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40047c0 0x7fa6cc1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.326+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc13f570 0x7fa6cc0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.326+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6cc1e38c0 0x7fa6cc1e8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.326+0000 7fa6cbfff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc159d20 con 0x7fa6cc13f570 2023-11-24T06:13:26.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.326+0000 7fa6cbfff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0cd5a0 con 0x7fa6b40047c0 2023-11-24T06:13:26.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.326+0000 7fa6cbfff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc1e42a0 con 0x7fa6cc1e38c0 2023-11-24T06:13:26.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.326+0000 7fa6ca7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc13f570 0x7fa6cc0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.326+0000 7fa6ca7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc13f570 0x7fa6cc0cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56206/0 (socket says 172.21.15.22:56206) 2023-11-24T06:13:26.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.326+0000 7fa6ca7fc640 1 -- 172.21.15.22:0/1724141599 learned_addr learned my addr 172.21.15.22:0/1724141599 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6cb7fe640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6cc1e38c0 0x7fa6cc1e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6caffd640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40047c0 0x7fa6cc1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6ca7fc640 1 -- 172.21.15.22:0/1724141599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6cc1e38c0 msgr2=0x7fa6cc1e8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6ca7fc640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6cc1e38c0 0x7fa6cc1e8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6ca7fc640 1 -- 172.21.15.22:0/1724141599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40047c0 msgr2=0x7fa6cc1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6ca7fc640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40047c0 0x7fa6cc1597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6ca7fc640 1 -- 172.21.15.22:0/1724141599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0cc2a0 con 0x7fa6cc13f570 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6caffd640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40047c0 0x7fa6cc1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6ca7fc640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc13f570 0x7fa6cc0cd060 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000c300 tx=0x7fa6c0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.327+0000 7fa6b37fe640 1 -- 172.21.15.22:0/1724141599 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0044070 con 0x7fa6cc13f570 2023-11-24T06:13:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.328+0000 7fa6b37fe640 1 -- 172.21.15.22:0/1724141599 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c003a050 con 0x7fa6cc13f570 2023-11-24T06:13:26.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.328+0000 7fa6b37fe640 1 -- 172.21.15.22:0/1724141599 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0004a00 con 0x7fa6cc13f570 2023-11-24T06:13:26.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.328+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc0cc580 con 0x7fa6cc13f570 2023-11-24T06:13:26.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.328+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc0ccb40 con 0x7fa6cc13f570 2023-11-24T06:13:26.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.329+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc0cccd0 con 0x7fa6cc13f570 2023-11-24T06:13:26.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.330+0000 7fa6b37fe640 1 -- 172.21.15.22:0/1724141599 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6c0032070 con 0x7fa6cc13f570 2023-11-24T06:13:26.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.331+0000 7fa6b37fe640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa6b806ae70 0x7fa6b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.331+0000 7fa6b37fe640 1 -- 172.21.15.22:0/1724141599 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa6c00aa460 con 0x7fa6cc13f570 2023-11-24T06:13:26.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.331+0000 7fa6caffd640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa6b806ae70 0x7fa6b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.332+0000 7fa6caffd640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa6b806ae70 0x7fa6b806d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0691e0 tx=0x7fa6bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:26.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.335+0000 7fa6b37fe640 1 -- 172.21.15.22:0/1724141599 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6c00758e0 con 0x7fa6cc13f570 2023-11-24T06:13:26.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.533+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa6cc071700 con 0x7fa6cc13f570 2023-11-24T06:13:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.534+0000 7fa6b37fe640 1 -- 172.21.15.22:0/1724141599 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa6cc071700 con 0x7fa6cc13f570 2023-11-24T06:13:26.537 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:26.537 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-11-24T06:13:26.537 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:26.538 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-11-24T06:13:26.538 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-11-24T06:13:26.538 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:26.538 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-11-24T06:13:26.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa6b806ae70 msgr2=0x7fa6b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa6b806ae70 0x7fa6b806d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0691e0 tx=0x7fa6bc008040 comp rx=0 tx=0).stop 2023-11-24T06:13:26.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc13f570 msgr2=0x7fa6cc0cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc13f570 0x7fa6cc0cd060 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000c300 tx=0x7fa6c0001b90 comp rx=0 tx=0).stop 2023-11-24T06:13:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 shutdown_connections 2023-11-24T06:13:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa6b806ae70 0x7fa6b806d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa6cc1e38c0 0x7fa6cc1e8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc13f570 0x7fa6cc0cd060 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1724141599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b40047c0 0x7fa6cc1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 >> 172.21.15.22:0/1724141599 conn(0x7fa6cc06a860 msgr2=0x7fa6cc0b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 shutdown_connections 2023-11-24T06:13:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.537+0000 7fa6cbfff640 1 -- 172.21.15.22:0/1724141599 wait complete. 2023-11-24T06:13:26.559 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:13:26.559 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:13:26.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.776+0000 7f9f8c91d640 1 Processor -- start 2023-11-24T06:13:26.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.777+0000 7f9f8c91d640 1 -- start start 2023-11-24T06:13:26.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.778+0000 7f9f8c91d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f8815b350 0x7f9f880abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.778+0000 7f9f8c91d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f880adb60 0x7f9f880adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.778+0000 7f9f8c91d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8815b730 con 0x7f9f8809cb30 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.778+0000 7f9f8c91d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f880ac740 con 0x7f9f880adb60 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.778+0000 7f9f8c91d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880ac460 con 0x7f9f8815b350 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.779+0000 7f9f86d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f880adb60 0x7f9f880adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.779+0000 7f9f86d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f880adb60 0x7f9f880adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56212/0 (socket says 172.21.15.22:56212) 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.779+0000 7f9f86d9d640 1 -- 172.21.15.22:0/1842427407 learned_addr learned my addr 172.21.15.22:0/1842427407 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.779+0000 7f9f8659c640 1 --2- 172.21.15.22:0/1842427407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f8815b350 0x7f9f880abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.779+0000 7f9f86d9d640 1 -- 172.21.15.22:0/1842427407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f8815b350 msgr2=0x7f9f880abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.779+0000 7f9f86d9d640 1 --2- 172.21.15.22:0/1842427407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f8815b350 0x7f9f880abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.779+0000 7f9f86d9d640 1 -- 172.21.15.22:0/1842427407 >> v1:172.21.15.22:6789/0 conn(0x7f9f8809cb30 legacy=0x7f9f880b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.779+0000 7f9f86d9d640 1 -- 172.21.15.22:0/1842427407 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f880b2a50 con 0x7f9f880adb60 2023-11-24T06:13:26.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.780+0000 7f9f86d9d640 1 --2- 172.21.15.22:0/1842427407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f880adb60 0x7f9f880adfb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009e50 tx=0x7f9f8002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af524ea9cc0f82d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:26.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f85d9b640 1 -- 172.21.15.22:0/1842427407 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8002cb00 con 0x7f9f880adb60 2023-11-24T06:13:26.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f85d9b640 1 -- 172.21.15.22:0/1842427407 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8002cc60 con 0x7f9f880adb60 2023-11-24T06:13:26.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f85d9b640 1 -- 172.21.15.22:0/1842427407 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800343f0 con 0x7f9f880adb60 2023-11-24T06:13:26.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f8c91d640 1 -- 172.21.15.22:0/1842427407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f880adb60 msgr2=0x7f9f880adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f8c91d640 1 --2- 172.21.15.22:0/1842427407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f880adb60 0x7f9f880adfb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009e50 tx=0x7f9f8002bf60 comp rx=0 tx=0).stop 2023-11-24T06:13:26.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f8c91d640 1 -- 172.21.15.22:0/1842427407 shutdown_connections 2023-11-24T06:13:26.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f8c91d640 1 --2- 172.21.15.22:0/1842427407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f880adb60 0x7f9f880adfb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f8c91d640 1 --2- 172.21.15.22:0/1842427407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f8815b350 0x7f9f880abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f8c91d640 1 -- 172.21.15.22:0/1842427407 >> 172.21.15.22:0/1842427407 conn(0x7f9f880b0ba0 msgr2=0x7f9f880b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:26.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.781+0000 7f9f8c91d640 1 -- 172.21.15.22:0/1842427407 shutdown_connections 2023-11-24T06:13:26.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.782+0000 7f9f8c91d640 1 -- 172.21.15.22:0/1842427407 wait complete. 2023-11-24T06:13:26.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.783+0000 7f9f8c91d640 1 Processor -- start 2023-11-24T06:13:26.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.783+0000 7f9f8c91d640 1 -- start start 2023-11-24T06:13:26.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.784+0000 7f9f8c91d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f8809cb30 0x7f9f88157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.784+0000 7f9f8c91d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f880adb60 0x7f9f8814f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f8c91d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f8815b350 0x7f9f8814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f8c91d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88153cd0 con 0x7f9f8815b350 2023-11-24T06:13:26.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f8c91d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f881539a0 con 0x7f9f880adb60 2023-11-24T06:13:26.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f8c91d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8809b920 con 0x7f9f8809cb30 2023-11-24T06:13:26.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f86d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f8815b350 0x7f9f8814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f86d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f8815b350 0x7f9f8814fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56224/0 (socket says 172.21.15.22:56224) 2023-11-24T06:13:26.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f86d9d640 1 -- 172.21.15.22:0/2572593854 learned_addr learned my addr 172.21.15.22:0/2572593854 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:26.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f86d9d640 1 -- 172.21.15.22:0/2572593854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f8809cb30 msgr2=0x7f9f88157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f86d9d640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f8809cb30 0x7f9f88157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f86d9d640 1 -- 172.21.15.22:0/2572593854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f880adb60 msgr2=0x7f9f8814f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f86d9d640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f880adb60 0x7f9f8814f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.785+0000 7f9f86d9d640 1 -- 172.21.15.22:0/2572593854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009b30 con 0x7f9f8815b350 2023-11-24T06:13:26.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.786+0000 7f9f86d9d640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f8815b350 0x7f9f8814fe10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009e50 tx=0x7f9f80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:26.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.786+0000 7f9f7effd640 1 -- 172.21.15.22:0/2572593854 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80009510 con 0x7f9f8815b350 2023-11-24T06:13:26.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.786+0000 7f9f7effd640 1 -- 172.21.15.22:0/2572593854 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8003e450 con 0x7f9f8815b350 2023-11-24T06:13:26.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.786+0000 7f9f7effd640 1 -- 172.21.15.22:0/2572593854 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8003e800 con 0x7f9f8815b350 2023-11-24T06:13:26.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.786+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f88150420 con 0x7f9f8815b350 2023-11-24T06:13:26.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.786+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f881509e0 con 0x7f9f8815b350 2023-11-24T06:13:26.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.787+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88150bd0 con 0x7f9f8815b350 2023-11-24T06:13:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.788+0000 7f9f7effd640 1 -- 172.21.15.22:0/2572593854 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f8003e960 con 0x7f9f8815b350 2023-11-24T06:13:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.789+0000 7f9f7effd640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f6806ae40 0x7f9f6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.789+0000 7f9f7effd640 1 -- 172.21.15.22:0/2572593854 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f800ac060 con 0x7f9f8815b350 2023-11-24T06:13:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.790+0000 7f9f8659c640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f6806ae40 0x7f9f6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.790+0000 7f9f8659c640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f6806ae40 0x7f9f6806d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9f78006fd0 tx=0x7f9f78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:26.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.794+0000 7f9f7effd640 1 -- 172.21.15.22:0/2572593854 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f800dee90 con 0x7f9f8815b350 2023-11-24T06:13:26.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:26.987+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9f8809d200 con 0x7f9f8815b350 2023-11-24T06:13:27.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.718+0000 7f9f7effd640 1 -- 172.21.15.22:0/2572593854 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9f80077450 con 0x7f9f8815b350 2023-11-24T06:13:27.721 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-11-24T06:13:27.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f6806ae40 msgr2=0x7f9f6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:27.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f6806ae40 0x7f9f6806d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9f78006fd0 tx=0x7f9f78008040 comp rx=0 tx=0).stop 2023-11-24T06:13:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f8815b350 msgr2=0x7f9f8814fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f8815b350 0x7f9f8814fe10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009e50 tx=0x7f9f80004a40 comp rx=0 tx=0).stop 2023-11-24T06:13:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 shutdown_connections 2023-11-24T06:13:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f6806ae40 0x7f9f6806d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f8815b350 0x7f9f8814fe10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f880adb60 0x7f9f8814f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 --2- 172.21.15.22:0/2572593854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f8809cb30 0x7f9f88157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.722+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 >> 172.21.15.22:0/2572593854 conn(0x7f9f880b0ba0 msgr2=0x7f9f8806db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:27.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.723+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 shutdown_connections 2023-11-24T06:13:27.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.723+0000 7f9f8c91d640 1 -- 172.21.15.22:0/2572593854 wait complete. 2023-11-24T06:13:27.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:13:27.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.967+0000 7f887ab2e640 1 Processor -- start 2023-11-24T06:13:27.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.967+0000 7f887ab2e640 1 -- start start 2023-11-24T06:13:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.969+0000 7f887ab2e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f887415efa0 0x7f8874161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.969+0000 7f887ab2e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88740b3080 0x7f887406c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.969+0000 7f887ab2e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887406c9a0 con 0x7f887406da40 2023-11-24T06:13:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.969+0000 7f887ab2e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887406cc80 con 0x7f88740b3080 2023-11-24T06:13:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.969+0000 7f887ab2e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887406cf60 con 0x7f887415efa0 2023-11-24T06:13:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.970+0000 7f887a32d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88740b3080 0x7f887406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.970+0000 7f887a32d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88740b3080 0x7f887406c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56228/0 (socket says 172.21.15.22:56228) 2023-11-24T06:13:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.970+0000 7f887a32d640 1 -- 172.21.15.22:0/3538007946 learned_addr learned my addr 172.21.15.22:0/3538007946 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.970+0000 7f8879b2c640 1 --2- 172.21.15.22:0/3538007946 >> v2:172.21.15.31:3300/0 conn(0x7f887415efa0 0x7f8874161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.970+0000 7f887a32d640 1 -- 172.21.15.22:0/3538007946 >> v2:172.21.15.31:3300/0 conn(0x7f887415efa0 msgr2=0x7f8874161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.970+0000 7f887a32d640 1 --2- 172.21.15.22:0/3538007946 >> v2:172.21.15.31:3300/0 conn(0x7f887415efa0 0x7f8874161ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.970+0000 7f887a32d640 1 -- 172.21.15.22:0/3538007946 >> v1:172.21.15.31:6789/0 conn(0x7f887406da40 legacy=0x7f88740b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.970+0000 7f887a32d640 1 -- 172.21.15.22:0/3538007946 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887406d240 con 0x7f88740b3080 2023-11-24T06:13:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.971+0000 7f887a32d640 1 --2- 172.21.15.22:0/3538007946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88740b3080 0x7f887406c310 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8874070970 tx=0x7f886c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a06ba36173c2404 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f8878b2a640 1 -- 172.21.15.22:0/3538007946 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c02ca80 con 0x7f88740b3080 2023-11-24T06:13:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f8878b2a640 1 -- 172.21.15.22:0/3538007946 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c02cbe0 con 0x7f88740b3080 2023-11-24T06:13:27.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f8878b2a640 1 -- 172.21.15.22:0/3538007946 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0343f0 con 0x7f88740b3080 2023-11-24T06:13:27.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f887ab2e640 1 -- 172.21.15.22:0/3538007946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88740b3080 msgr2=0x7f887406c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:27.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f887ab2e640 1 --2- 172.21.15.22:0/3538007946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88740b3080 0x7f887406c310 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8874070970 tx=0x7f886c02bee0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f887ab2e640 1 -- 172.21.15.22:0/3538007946 shutdown_connections 2023-11-24T06:13:27.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f887ab2e640 1 --2- 172.21.15.22:0/3538007946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88740b3080 0x7f887406c310 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f887ab2e640 1 --2- 172.21.15.22:0/3538007946 >> v2:172.21.15.31:3300/0 conn(0x7f887415efa0 0x7f8874161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f887ab2e640 1 -- 172.21.15.22:0/3538007946 >> 172.21.15.22:0/3538007946 conn(0x7f88740cec10 msgr2=0x7f88740cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:27.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f887ab2e640 1 -- 172.21.15.22:0/3538007946 shutdown_connections 2023-11-24T06:13:27.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.972+0000 7f887ab2e640 1 -- 172.21.15.22:0/3538007946 wait complete. 2023-11-24T06:13:27.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.974+0000 7f887ab2e640 1 Processor -- start 2023-11-24T06:13:27.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.974+0000 7f887ab2e640 1 -- start start 2023-11-24T06:13:27.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.975+0000 7f887ab2e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f887406da40 0x7f887415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:27.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.975+0000 7f887ab2e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88740b3080 0x7f88740b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:27.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.975+0000 7f887ab2e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f887415efa0 0x7f88741f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:27.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.975+0000 7f887ab2e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88741fa450 con 0x7f887406da40 2023-11-24T06:13:27.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.975+0000 7f887ab2e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88740afd70 con 0x7f88740b3080 2023-11-24T06:13:27.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.975+0000 7f887ab2e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88740b0050 con 0x7f887415efa0 2023-11-24T06:13:27.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f8879b2c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f887406da40 0x7f887415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:27.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f8879b2c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f887406da40 0x7f887415cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56240/0 (socket says 172.21.15.22:56240) 2023-11-24T06:13:27.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f8879b2c640 1 -- 172.21.15.22:0/3600643880 learned_addr learned my addr 172.21.15.22:0/3600643880 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:27.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f8879b2c640 1 -- 172.21.15.22:0/3600643880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f887415efa0 msgr2=0x7f88741f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:27.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f887a32d640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f887415efa0 0x7f88741f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:27.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f8879b2c640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f887415efa0 0x7f88741f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f8879b2c640 1 -- 172.21.15.22:0/3600643880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88740b3080 msgr2=0x7f88740b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:27.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f887932b640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88740b3080 0x7f88740b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:27.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f8879b2c640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88740b3080 0x7f88740b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f8879b2c640 1 -- 172.21.15.22:0/3600643880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c009b30 con 0x7f887406da40 2023-11-24T06:13:27.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f887932b640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88740b3080 0x7f88740b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:27.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.976+0000 7f8879b2c640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f887406da40 0x7f887415cda0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f887000d5f0 tx=0x7f887000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:27.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.977+0000 7f886a7fc640 1 -- 172.21.15.22:0/3600643880 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700125f0 con 0x7f887406da40 2023-11-24T06:13:27.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.977+0000 7f886a7fc640 1 -- 172.21.15.22:0/3600643880 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8870012750 con 0x7f887406da40 2023-11-24T06:13:27.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.977+0000 7f886a7fc640 1 -- 172.21.15.22:0/3600643880 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870012b00 con 0x7f887406da40 2023-11-24T06:13:27.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.977+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88740b0330 con 0x7f887406da40 2023-11-24T06:13:27.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.977+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887415d2e0 con 0x7f887406da40 2023-11-24T06:13:27.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.978+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887415d4a0 con 0x7f887406da40 2023-11-24T06:13:27.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.979+0000 7f886a7fc640 1 -- 172.21.15.22:0/3600643880 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8870012c60 con 0x7f887406da40 2023-11-24T06:13:27.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.980+0000 7f886a7fc640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f885806ae40 0x7f885806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:27.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.980+0000 7f886a7fc640 1 -- 172.21.15.22:0/3600643880 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8870089900 con 0x7f887406da40 2023-11-24T06:13:27.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.980+0000 7f887932b640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f885806ae40 0x7f885806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:27.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.981+0000 7f887932b640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f885806ae40 0x7f885806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8874067730 tx=0x7f8864009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:27.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:27.985+0000 7f886a7fc640 1 -- 172.21.15.22:0/3600643880 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8870054b90 con 0x7f887406da40 2023-11-24T06:13:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.180+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f887404e840 con 0x7f887406da40 2023-11-24T06:13:28.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.724+0000 7f886a7fc640 1 -- 172.21.15.22:0/3600643880 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f88700581b0 con 0x7f887406da40 2023-11-24T06:13:28.728 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-11-24T06:13:28.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.729+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f885806ae40 msgr2=0x7f885806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:28.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.729+0000 7f887ab2e640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f885806ae40 0x7f885806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8874067730 tx=0x7f8864009040 comp rx=0 tx=0).stop 2023-11-24T06:13:28.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.729+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f887406da40 msgr2=0x7f887415cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:28.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.729+0000 7f887ab2e640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f887406da40 0x7f887415cda0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f887000d5f0 tx=0x7f887000dab0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.730+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 shutdown_connections 2023-11-24T06:13:28.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.730+0000 7f887ab2e640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f885806ae40 0x7f885806d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.730+0000 7f887ab2e640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f887415efa0 0x7f88741f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.730+0000 7f887ab2e640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88740b3080 0x7f88740b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.730+0000 7f887ab2e640 1 --2- 172.21.15.22:0/3600643880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f887406da40 0x7f887415cda0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.730+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 >> 172.21.15.22:0/3600643880 conn(0x7f88740cec10 msgr2=0x7f88740ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:28.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.730+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 shutdown_connections 2023-11-24T06:13:28.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.730+0000 7f887ab2e640 1 -- 172.21.15.22:0/3600643880 wait complete. 2023-11-24T06:13:28.769 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:13:28.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.957+0000 7f339a968640 1 Processor -- start 2023-11-24T06:13:28.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.958+0000 7f339a968640 1 -- start start 2023-11-24T06:13:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.959+0000 7f339a968640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33940cd150 0x7f339406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.959+0000 7f339a968640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f33940702a0 0x7f339406e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.959+0000 7f339a968640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3394142d50 con 0x7f339406ec60 2023-11-24T06:13:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.959+0000 7f339a968640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33940cd530 con 0x7f33940702a0 2023-11-24T06:13:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.959+0000 7f339a968640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33940706c0 con 0x7f33940cd150 2023-11-24T06:13:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.960+0000 7f338b7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f33940702a0 0x7f339406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.960+0000 7f338b7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f33940702a0 0x7f339406e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56248/0 (socket says 172.21.15.22:56248) 2023-11-24T06:13:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.960+0000 7f338b7fe640 1 -- 172.21.15.22:0/1797987050 learned_addr learned my addr 172.21.15.22:0/1797987050 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:28.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.960+0000 7f3393fff640 1 --2- 172.21.15.22:0/1797987050 >> v2:172.21.15.31:3300/0 conn(0x7f33940cd150 0x7f339406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:28.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.960+0000 7f338b7fe640 1 -- 172.21.15.22:0/1797987050 >> v2:172.21.15.31:3300/0 conn(0x7f33940cd150 msgr2=0x7f339406fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:28.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.960+0000 7f338b7fe640 1 --2- 172.21.15.22:0/1797987050 >> v2:172.21.15.31:3300/0 conn(0x7f33940cd150 0x7f339406fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.960+0000 7f338b7fe640 1 -- 172.21.15.22:0/1797987050 >> v1:172.21.15.22:6789/0 conn(0x7f339406ec60 legacy=0x7f3394160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:28.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.960+0000 7f33937fe640 1 -- 172.21.15.22:0/1797987050 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202810777 0 0) 0x7f3394142d50 con 0x7f339406ec60 2023-11-24T06:13:28.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.960+0000 7f338b7fe640 1 -- 172.21.15.22:0/1797987050 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339406f430 con 0x7f33940702a0 2023-11-24T06:13:28.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.962+0000 7f338b7fe640 1 --2- 172.21.15.22:0/1797987050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 0x7f339406e720 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3394072180 tx=0x7f337c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e881a3d18c6865 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:28.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.962+0000 7f33937fe640 1 -- 172.21.15.22:0/1797987050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c031870 con 0x7f33940702a0 2023-11-24T06:13:28.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.962+0000 7f33937fe640 1 -- 172.21.15.22:0/1797987050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c0319d0 con 0x7f33940702a0 2023-11-24T06:13:28.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.962+0000 7f33937fe640 1 -- 172.21.15.22:0/1797987050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c031d60 con 0x7f33940702a0 2023-11-24T06:13:28.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.962+0000 7f339a968640 1 -- 172.21.15.22:0/1797987050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 msgr2=0x7f339406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.962+0000 7f339a968640 1 --2- 172.21.15.22:0/1797987050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 0x7f339406e720 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3394072180 tx=0x7f337c02b910 comp rx=0 tx=0).stop 2023-11-24T06:13:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.963+0000 7f339a968640 1 -- 172.21.15.22:0/1797987050 shutdown_connections 2023-11-24T06:13:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.963+0000 7f339a968640 1 --2- 172.21.15.22:0/1797987050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 0x7f339406e720 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.963+0000 7f339a968640 1 --2- 172.21.15.22:0/1797987050 >> v2:172.21.15.31:3300/0 conn(0x7f33940cd150 0x7f339406fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.963+0000 7f339a968640 1 -- 172.21.15.22:0/1797987050 >> 172.21.15.22:0/1797987050 conn(0x7f33940cdb20 msgr2=0x7f33940cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.963+0000 7f339a968640 1 -- 172.21.15.22:0/1797987050 shutdown_connections 2023-11-24T06:13:28.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.963+0000 7f339a968640 1 -- 172.21.15.22:0/1797987050 wait complete. 2023-11-24T06:13:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.964+0000 7f339a968640 1 Processor -- start 2023-11-24T06:13:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.965+0000 7f339a968640 1 -- start start 2023-11-24T06:13:28.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.965+0000 7f339a968640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f339406ec60 0x7f3394155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:28.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f339a968640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 0x7f33940b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:28.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f339a968640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33940cd150 0x7f339415f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:28.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f339a968640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940b3ce0 con 0x7f33940702a0 2023-11-24T06:13:28.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f339a968640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940caed0 con 0x7f33940cd150 2023-11-24T06:13:28.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f339a968640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940b3f30 con 0x7f339406ec60 2023-11-24T06:13:28.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f338b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 0x7f33940b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:28.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f338b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 0x7f33940b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56262/0 (socket says 172.21.15.22:56262) 2023-11-24T06:13:28.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f338b7fe640 1 -- 172.21.15.22:0/1517275960 learned_addr learned my addr 172.21.15.22:0/1517275960 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:28.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f3393fff640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f339406ec60 0x7f3394155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:28.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f338b7fe640 1 -- 172.21.15.22:0/1517275960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f339406ec60 msgr2=0x7f3394155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:28.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f338b7fe640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f339406ec60 0x7f3394155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f338b7fe640 1 -- 172.21.15.22:0/1517275960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33940cd150 msgr2=0x7f339415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:28.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f338b7fe640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33940cd150 0x7f339415f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:28.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.966+0000 7f338b7fe640 1 -- 172.21.15.22:0/1517275960 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0094d0 con 0x7f33940702a0 2023-11-24T06:13:28.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.967+0000 7f338b7fe640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 0x7f33940b4a10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f337c034040 tx=0x7f337c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:28.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.967+0000 7f33917fa640 1 -- 172.21.15.22:0/1517275960 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c004230 con 0x7f33940702a0 2023-11-24T06:13:28.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.967+0000 7f33917fa640 1 -- 172.21.15.22:0/1517275960 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c004390 con 0x7f33940702a0 2023-11-24T06:13:28.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.967+0000 7f33917fa640 1 -- 172.21.15.22:0/1517275960 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c03a9f0 con 0x7f33940702a0 2023-11-24T06:13:28.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.967+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33940b4210 con 0x7f33940702a0 2023-11-24T06:13:28.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.967+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3394155d80 con 0x7f33940702a0 2023-11-24T06:13:28.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.969+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33940b4730 con 0x7f33940702a0 2023-11-24T06:13:28.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.970+0000 7f33917fa640 1 -- 172.21.15.22:0/1517275960 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f337c042070 con 0x7f33940702a0 2023-11-24T06:13:28.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.971+0000 7f33917fa640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f337406ae40 0x7f337406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:28.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.971+0000 7f33917fa640 1 -- 172.21.15.22:0/1517275960 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f337c02d040 con 0x7f33940702a0 2023-11-24T06:13:28.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.971+0000 7f3393fff640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f337406ae40 0x7f337406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:28.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.972+0000 7f3393fff640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f337406ae40 0x7f337406d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f339415ca90 tx=0x7f338400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:28.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:28.976+0000 7f33917fa640 1 -- 172.21.15.22:0/1517275960 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33940b4730 con 0x7f33940702a0 2023-11-24T06:13:29.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.207+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f33940b4730 con 0x7f33940702a0 2023-11-24T06:13:29.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.747+0000 7f33917fa640 1 -- 172.21.15.22:0/1517275960 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f33940b4730 con 0x7f33940702a0 2023-11-24T06:13:31.626 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 4 and data pool 5 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f337406ae40 msgr2=0x7f337406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f337406ae40 0x7f337406d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f339415ca90 tx=0x7f338400b040 comp rx=0 tx=0).stop 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 msgr2=0x7f33940b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 0x7f33940b4a10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f337c034040 tx=0x7f337c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 shutdown_connections 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f337406ae40 0x7f337406d300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33940cd150 0x7f339415f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33940702a0 0x7f33940b4a10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 --2- 172.21.15.22:0/1517275960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f339406ec60 0x7f3394155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.751+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 >> 172.21.15.22:0/1517275960 conn(0x7f33940cdb20 msgr2=0x7f339415ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.752+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 shutdown_connections 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:29.752+0000 7f339a968640 1 -- 172.21.15.22:0/1517275960 wait complete. 2023-11-24T06:13:31.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:31.630 INFO:tasks.ceph.mds.c.smithi022.stderr:2023-11-24T06:13:30.687+0000 7f8e6f5c6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:13:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.866+0000 7efe3759e640 1 Processor -- start 2023-11-24T06:13:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.866+0000 7efe3759e640 1 -- start start 2023-11-24T06:13:31.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.867+0000 7efe3759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe3815d5b0 0x7efe380d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:31.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.867+0000 7efe3759e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe380b1650 0x7efe380d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:31.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.867+0000 7efe3759e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe380cf0c0 con 0x7efe380d14a0 2023-11-24T06:13:31.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.867+0000 7efe3759e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe380b01b0 con 0x7efe380b1650 2023-11-24T06:13:31.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe3759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3815d990 con 0x7efe3815d5b0 2023-11-24T06:13:31.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe36d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe380b1650 0x7efe380d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:31.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe36d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe380b1650 0x7efe380d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60026/0 (socket says 172.21.15.22:60026) 2023-11-24T06:13:31.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe36d9d640 1 -- 172.21.15.22:0/1086167083 learned_addr learned my addr 172.21.15.22:0/1086167083 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe35d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efe380d14a0 0x7efe380cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49288/0 (socket says 172.21.15.22:49288) 2023-11-24T06:13:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe3659c640 1 --2- 172.21.15.22:0/1086167083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe3815d5b0 0x7efe380d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe36d9d640 1 -- 172.21.15.22:0/1086167083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe3815d5b0 msgr2=0x7efe380d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe36d9d640 1 --2- 172.21.15.22:0/1086167083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe3815d5b0 0x7efe380d3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe36d9d640 1 -- 172.21.15.22:0/1086167083 >> v1:172.21.15.22:6789/0 conn(0x7efe380d14a0 legacy=0x7efe380cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe36d9d640 1 -- 172.21.15.22:0/1086167083 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380d1e40 con 0x7efe380b1650 2023-11-24T06:13:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.868+0000 7efe3559a640 1 -- 172.21.15.22:0/1086167083 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738979810 0 0) 0x7efe380cf0c0 con 0x7efe380d14a0 2023-11-24T06:13:31.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.870+0000 7efe36d9d640 1 --2- 172.21.15.22:0/1086167083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe380b1650 0x7efe380d1900 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7efe30009870 tx=0x7efe3002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0363f51d21857b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:31.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.870+0000 7efe3559a640 1 -- 172.21.15.22:0/1086167083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30030840 con 0x7efe380b1650 2023-11-24T06:13:31.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.870+0000 7efe3559a640 1 -- 172.21.15.22:0/1086167083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe300309a0 con 0x7efe380b1650 2023-11-24T06:13:31.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.870+0000 7efe3559a640 1 -- 172.21.15.22:0/1086167083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30030d30 con 0x7efe380b1650 2023-11-24T06:13:31.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.870+0000 7efe3759e640 1 -- 172.21.15.22:0/1086167083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe380b1650 msgr2=0x7efe380d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:31.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.870+0000 7efe3759e640 1 --2- 172.21.15.22:0/1086167083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe380b1650 0x7efe380d1900 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7efe30009870 tx=0x7efe3002b980 comp rx=0 tx=0).stop 2023-11-24T06:13:31.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.871+0000 7efe3759e640 1 -- 172.21.15.22:0/1086167083 shutdown_connections 2023-11-24T06:13:31.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.871+0000 7efe3759e640 1 --2- 172.21.15.22:0/1086167083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe380b1650 0x7efe380d1900 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.871+0000 7efe3759e640 1 --2- 172.21.15.22:0/1086167083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe3815d5b0 0x7efe380d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.871+0000 7efe3759e640 1 -- 172.21.15.22:0/1086167083 >> 172.21.15.22:0/1086167083 conn(0x7efe3809c3b0 msgr2=0x7efe380d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:31.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.871+0000 7efe3759e640 1 -- 172.21.15.22:0/1086167083 shutdown_connections 2023-11-24T06:13:31.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.871+0000 7efe3759e640 1 -- 172.21.15.22:0/1086167083 wait complete. 2023-11-24T06:13:31.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.873+0000 7efe3759e640 1 Processor -- start 2023-11-24T06:13:31.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.873+0000 7efe3759e640 1 -- start start 2023-11-24T06:13:31.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe3759e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe380b1650 0x7efe381f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:31.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe3759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe380d14a0 0x7efe381f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:31.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe3759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe3815d5b0 0x7efe381f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe3759e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe381f0880 con 0x7efe3815d5b0 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe3759e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3815f940 con 0x7efe380b1650 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe3759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3815eb80 con 0x7efe380d14a0 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe36d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe3815d5b0 0x7efe381f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe36d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe3815d5b0 0x7efe381f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60032/0 (socket says 172.21.15.22:60032) 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe36d9d640 1 -- 172.21.15.22:0/2473474195 learned_addr learned my addr 172.21.15.22:0/2473474195 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe3659c640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe380b1650 0x7efe381f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.874+0000 7efe35d9b640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe380d14a0 0x7efe381f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe36d9d640 1 -- 172.21.15.22:0/2473474195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe380d14a0 msgr2=0x7efe381f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe36d9d640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe380d14a0 0x7efe381f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe36d9d640 1 -- 172.21.15.22:0/2473474195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe380b1650 msgr2=0x7efe381f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:31.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe36d9d640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe380b1650 0x7efe381f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:31.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe36d9d640 1 -- 172.21.15.22:0/2473474195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe300094d0 con 0x7efe3815d5b0 2023-11-24T06:13:31.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe35d9b640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe380d14a0 0x7efe381f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:31.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe36d9d640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe3815d5b0 0x7efe381f4a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efe300097c0 tx=0x7efe30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:31.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe2effd640 1 -- 172.21.15.22:0/2473474195 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30039c20 con 0x7efe3815d5b0 2023-11-24T06:13:31.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe2effd640 1 -- 172.21.15.22:0/2473474195 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe30039da0 con 0x7efe3815d5b0 2023-11-24T06:13:31.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe2effd640 1 -- 172.21.15.22:0/2473474195 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30043650 con 0x7efe3815d5b0 2023-11-24T06:13:31.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.875+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3815ee60 con 0x7efe3815d5b0 2023-11-24T06:13:31.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.876+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3815f420 con 0x7efe3815d5b0 2023-11-24T06:13:31.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.877+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3808d0b0 con 0x7efe3815d5b0 2023-11-24T06:13:31.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.878+0000 7efe2effd640 1 -- 172.21.15.22:0/2473474195 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe3002f390 con 0x7efe3815d5b0 2023-11-24T06:13:31.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.879+0000 7efe2effd640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe1806ae70 0x7efe1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:31.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.879+0000 7efe2effd640 1 -- 172.21.15.22:0/2473474195 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe300ab930 con 0x7efe3815d5b0 2023-11-24T06:13:31.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.879+0000 7efe3659c640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe1806ae70 0x7efe1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:31.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.880+0000 7efe3659c640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe1806ae70 0x7efe1806d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe280070b0 tx=0x7efe28007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:31.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:31.884+0000 7efe2effd640 1 -- 172.21.15.22:0/2473474195 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe300769d0 con 0x7efe3815d5b0 2023-11-24T06:13:32.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.084+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe3806c750 con 0x7efe3815d5b0 2023-11-24T06:13:32.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.087+0000 7efe2effd640 1 -- 172.21.15.22:0/2473474195 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16521 (secure 0 0 0) 0x7efe30034070 con 0x7efe3815d5b0 2023-11-24T06:13:32.090 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:32.090 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:13:30.762606+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:27.041850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:28.235409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:32.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe1806ae70 msgr2=0x7efe1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe1806ae70 0x7efe1806d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe280070b0 tx=0x7efe28007040 comp rx=0 tx=0).stop 2023-11-24T06:13:32.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe3815d5b0 msgr2=0x7efe381f4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe3815d5b0 0x7efe381f4a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efe300097c0 tx=0x7efe30004730 comp rx=0 tx=0).stop 2023-11-24T06:13:32.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 shutdown_connections 2023-11-24T06:13:32.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe1806ae70 0x7efe1806d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe3815d5b0 0x7efe381f4a60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe380d14a0 0x7efe381f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 --2- 172.21.15.22:0/2473474195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe380b1650 0x7efe381f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.090+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 >> 172.21.15.22:0/2473474195 conn(0x7efe3809c3b0 msgr2=0x7efe380d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:32.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.091+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 shutdown_connections 2023-11-24T06:13:32.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.091+0000 7efe3759e640 1 -- 172.21.15.22:0/2473474195 wait complete. 2023-11-24T06:13:32.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:32.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.325+0000 7f9f2759e640 1 Processor -- start 2023-11-24T06:13:32.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.325+0000 7f9f2759e640 1 -- start start 2023-11-24T06:13:32.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.326+0000 7f9f2759e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f280cf760 0x7f9f2815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.326+0000 7f9f2759e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f28071700 con 0x7f9f28143950 2023-11-24T06:13:32.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.327+0000 7f9f2759e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2815b410 con 0x7f9f28143570 2023-11-24T06:13:32.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.327+0000 7f9f2759e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2815b130 con 0x7f9f280cf760 2023-11-24T06:13:32.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.327+0000 7f9f1ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f280cf760 0x7f9f2815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:32.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.327+0000 7f9f1ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f280cf760 0x7f9f2815a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60042/0 (socket says 172.21.15.22:60042) 2023-11-24T06:13:32.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.327+0000 7f9f1ffff640 1 -- 172.21.15.22:0/1035014435 learned_addr learned my addr 172.21.15.22:0/1035014435 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:32.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.327+0000 7f9f1ffff640 1 -- 172.21.15.22:0/1035014435 >> v1:172.21.15.31:6789/0 conn(0x7f9f28143570 legacy=0x7f9f280cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:32.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.327+0000 7f9f1ffff640 1 -- 172.21.15.22:0/1035014435 >> v1:172.21.15.22:6789/0 conn(0x7f9f28143950 legacy=0x7f9f280b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.327+0000 7f9f1ffff640 1 -- 172.21.15.22:0/1035014435 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2815dbd0 con 0x7f9f280cf760 2023-11-24T06:13:32.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.329+0000 7f9f1ffff640 1 --2- 172.21.15.22:0/1035014435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f280cf760 0x7f9f2815a4b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000bb10 tx=0x7f9f1002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fade45e8420b08d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:32.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.329+0000 7f9f25d9b640 1 -- 172.21.15.22:0/1035014435 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1002ee90 con 0x7f9f280cf760 2023-11-24T06:13:32.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.329+0000 7f9f25d9b640 1 -- 172.21.15.22:0/1035014435 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10036440 con 0x7f9f280cf760 2023-11-24T06:13:32.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.329+0000 7f9f25d9b640 1 -- 172.21.15.22:0/1035014435 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f100367d0 con 0x7f9f280cf760 2023-11-24T06:13:32.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.330+0000 7f9f2759e640 1 -- 172.21.15.22:0/1035014435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f280cf760 msgr2=0x7f9f2815a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.330+0000 7f9f2759e640 1 --2- 172.21.15.22:0/1035014435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f280cf760 0x7f9f2815a4b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000bb10 tx=0x7f9f1002e0e0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.330+0000 7f9f2759e640 1 -- 172.21.15.22:0/1035014435 shutdown_connections 2023-11-24T06:13:32.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.330+0000 7f9f2759e640 1 --2- 172.21.15.22:0/1035014435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f280cf760 0x7f9f2815a4b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.330+0000 7f9f2759e640 1 -- 172.21.15.22:0/1035014435 >> 172.21.15.22:0/1035014435 conn(0x7f9f2806a860 msgr2=0x7f9f2806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:32.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.330+0000 7f9f2759e640 1 -- 172.21.15.22:0/1035014435 shutdown_connections 2023-11-24T06:13:32.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.330+0000 7f9f2759e640 1 -- 172.21.15.22:0/1035014435 wait complete. 2023-11-24T06:13:32.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.331+0000 7f9f2759e640 1 Processor -- start 2023-11-24T06:13:32.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.332+0000 7f9f2759e640 1 -- start start 2023-11-24T06:13:32.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f2759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f280cf760 0x7f9f28148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f2759e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f28143570 0x7f9f28140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f2759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f28143950 0x7f9f280c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f2759e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f281461d0 con 0x7f9f28143950 2023-11-24T06:13:32.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f2759e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28148ab0 con 0x7f9f28143570 2023-11-24T06:13:32.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f2759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28148d90 con 0x7f9f280cf760 2023-11-24T06:13:32.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f26d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f28143950 0x7f9f280c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:32.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f26d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f28143950 0x7f9f280c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60044/0 (socket says 172.21.15.22:60044) 2023-11-24T06:13:32.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f26d9d640 1 -- 172.21.15.22:0/168861050 learned_addr learned my addr 172.21.15.22:0/168861050 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:32.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f26d9d640 1 -- 172.21.15.22:0/168861050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f280cf760 msgr2=0x7f9f28148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f26d9d640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f280cf760 0x7f9f28148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f26d9d640 1 -- 172.21.15.22:0/168861050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f28143570 msgr2=0x7f9f28140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f1ffff640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f28143570 0x7f9f28140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:32.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f26d9d640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f28143570 0x7f9f28140870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.333+0000 7f9f26d9d640 1 -- 172.21.15.22:0/168861050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1000b770 con 0x7f9f28143950 2023-11-24T06:13:32.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.334+0000 7f9f26d9d640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f28143950 0x7f9f280c9fc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000c680 tx=0x7f9f2000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:32.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.334+0000 7f9f1effd640 1 -- 172.21.15.22:0/168861050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f20003b70 con 0x7f9f28143950 2023-11-24T06:13:32.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.334+0000 7f9f1effd640 1 -- 172.21.15.22:0/168861050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f20003cd0 con 0x7f9f28143950 2023-11-24T06:13:32.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.334+0000 7f9f1effd640 1 -- 172.21.15.22:0/168861050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f20005310 con 0x7f9f28143950 2023-11-24T06:13:32.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.334+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f28149070 con 0x7f9f28143950 2023-11-24T06:13:32.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.334+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f281487a0 con 0x7f9f28143950 2023-11-24T06:13:32.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.335+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f280ceaa0 con 0x7f9f28143950 2023-11-24T06:13:32.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.336+0000 7f9f1effd640 1 -- 172.21.15.22:0/168861050 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f20005470 con 0x7f9f28143950 2023-11-24T06:13:32.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.338+0000 7f9f1effd640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f0806ae70 0x7f9f0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.338+0000 7f9f1effd640 1 -- 172.21.15.22:0/168861050 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f20089250 con 0x7f9f28143950 2023-11-24T06:13:32.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.338+0000 7f9f2659c640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f0806ae70 0x7f9f0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:32.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.339+0000 7f9f2659c640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f0806ae70 0x7f9f0806d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9f18001560 tx=0x7f9f18007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.342+0000 7f9f1effd640 1 -- 172.21.15.22:0/168861050 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f20054260 con 0x7f9f28143950 2023-11-24T06:13:32.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.537+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f281466b0 con 0x7f9f28143950 2023-11-24T06:13:32.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.540+0000 7f9f1effd640 1 -- 172.21.15.22:0/168861050 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f9f281466b0 con 0x7f9f28143950 2023-11-24T06:13:32.544 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:32.544 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:13:30.762606+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:27.041850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:28.235409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f0806ae70 msgr2=0x7f9f0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f0806ae70 0x7f9f0806d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9f18001560 tx=0x7f9f18007990 comp rx=0 tx=0).stop 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f28143950 msgr2=0x7f9f280c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f28143950 0x7f9f280c9fc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000c680 tx=0x7f9f2000cb40 comp rx=0 tx=0).stop 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 shutdown_connections 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9f0806ae70 0x7f9f0806d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f28143950 0x7f9f280c9fc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f28143570 0x7f9f28140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 --2- 172.21.15.22:0/168861050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f280cf760 0x7f9f28148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 >> 172.21.15.22:0/168861050 conn(0x7f9f2806a860 msgr2=0x7f9f2806ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 shutdown_connections 2023-11-24T06:13:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.543+0000 7f9f2759e640 1 -- 172.21.15.22:0/168861050 wait complete. 2023-11-24T06:13:32.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:13:32.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.793+0000 7f2a5b189640 1 Processor -- start 2023-11-24T06:13:32.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.794+0000 7f2a5b189640 1 -- start start 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.795+0000 7f2a5b189640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2a54160bd0 0x7f2a540b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.795+0000 7f2a5b189640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2a540b48d0 0x7f2a540b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.795+0000 7f2a5b189640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540b23e0 con 0x7f2a540b3040 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.795+0000 7f2a5b189640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540cdc70 con 0x7f2a540b48d0 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.795+0000 7f2a5b189640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540b2870 con 0x7f2a54160bd0 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.796+0000 7f2a53fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2a540b48d0 0x7f2a540b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.796+0000 7f2a53fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2a540b48d0 0x7f2a540b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60054/0 (socket says 172.21.15.22:60054) 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.796+0000 7f2a59726640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2a540b3040 0x7f2a54166280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49318/0 (socket says 172.21.15.22:49318) 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.796+0000 7f2a53fff640 1 -- 172.21.15.22:0/385298612 learned_addr learned my addr 172.21.15.22:0/385298612 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.796+0000 7f2a58f25640 1 --2- 172.21.15.22:0/385298612 >> v2:172.21.15.31:3300/0 conn(0x7f2a54160bd0 0x7f2a540b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:32.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.796+0000 7f2a53fff640 1 -- 172.21.15.22:0/385298612 >> v2:172.21.15.31:3300/0 conn(0x7f2a54160bd0 msgr2=0x7f2a540b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:32.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.796+0000 7f2a53fff640 1 --2- 172.21.15.22:0/385298612 >> v2:172.21.15.31:3300/0 conn(0x7f2a54160bd0 0x7f2a540b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.796+0000 7f2a53fff640 1 -- 172.21.15.22:0/385298612 >> v1:172.21.15.22:6789/0 conn(0x7f2a540b3040 legacy=0x7f2a54166280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.796+0000 7f2a53fff640 1 -- 172.21.15.22:0/385298612 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540d41b0 con 0x7f2a540b48d0 2023-11-24T06:13:32.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.797+0000 7f2a53fff640 1 --2- 172.21.15.22:0/385298612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b48d0 0x7f2a540b2b00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a540cda60 tx=0x7f2a4802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b832fa89550a652 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:32.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.798+0000 7f2a537fe640 1 -- 172.21.15.22:0/385298612 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4802ca80 con 0x7f2a540b48d0 2023-11-24T06:13:32.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.798+0000 7f2a537fe640 1 -- 172.21.15.22:0/385298612 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4802cbe0 con 0x7f2a540b48d0 2023-11-24T06:13:32.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.798+0000 7f2a537fe640 1 -- 172.21.15.22:0/385298612 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480343f0 con 0x7f2a540b48d0 2023-11-24T06:13:32.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.798+0000 7f2a5b189640 1 -- 172.21.15.22:0/385298612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b48d0 msgr2=0x7f2a540b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.798+0000 7f2a5b189640 1 --2- 172.21.15.22:0/385298612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b48d0 0x7f2a540b2b00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a540cda60 tx=0x7f2a4802bee0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.799+0000 7f2a5b189640 1 -- 172.21.15.22:0/385298612 shutdown_connections 2023-11-24T06:13:32.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.799+0000 7f2a5b189640 1 --2- 172.21.15.22:0/385298612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b48d0 0x7f2a540b2b00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.799+0000 7f2a5b189640 1 --2- 172.21.15.22:0/385298612 >> v2:172.21.15.31:3300/0 conn(0x7f2a54160bd0 0x7f2a540b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.799+0000 7f2a5b189640 1 -- 172.21.15.22:0/385298612 >> 172.21.15.22:0/385298612 conn(0x7f2a5409c5a0 msgr2=0x7f2a540d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:32.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.799+0000 7f2a5b189640 1 -- 172.21.15.22:0/385298612 shutdown_connections 2023-11-24T06:13:32.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.799+0000 7f2a5b189640 1 -- 172.21.15.22:0/385298612 wait complete. 2023-11-24T06:13:32.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.800+0000 7f2a5b189640 1 Processor -- start 2023-11-24T06:13:32.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.801+0000 7f2a5b189640 1 -- start start 2023-11-24T06:13:32.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a5b189640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b3040 0x7f2a541f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a5b189640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a540b48d0 0x7f2a5414da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a5b189640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a54160bd0 0x7f2a5414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a5b189640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540b7e30 con 0x7f2a540b3040 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a5b189640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540b7fc0 con 0x7f2a54160bd0 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a5b189640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5414d770 con 0x7f2a540b48d0 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a58f25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b3040 0x7f2a541f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a58f25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b3040 0x7f2a541f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60060/0 (socket says 172.21.15.22:60060) 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a58f25640 1 -- 172.21.15.22:0/2326868295 learned_addr learned my addr 172.21.15.22:0/2326868295 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a58f25640 1 -- 172.21.15.22:0/2326868295 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a540b48d0 msgr2=0x7f2a5414da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a58f25640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a540b48d0 0x7f2a5414da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a58f25640 1 -- 172.21.15.22:0/2326868295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a54160bd0 msgr2=0x7f2a5414d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a58f25640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a54160bd0 0x7f2a5414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.802+0000 7f2a58f25640 1 -- 172.21.15.22:0/2326868295 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48009b30 con 0x7f2a540b3040 2023-11-24T06:13:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.803+0000 7f2a58f25640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b3040 0x7f2a541f3080 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400d5f0 tx=0x7f2a4400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:32.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.803+0000 7f2a517fa640 1 -- 172.21.15.22:0/2326868295 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440125f0 con 0x7f2a540b3040 2023-11-24T06:13:32.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.803+0000 7f2a517fa640 1 -- 172.21.15.22:0/2326868295 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44012750 con 0x7f2a540b3040 2023-11-24T06:13:32.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.803+0000 7f2a517fa640 1 -- 172.21.15.22:0/2326868295 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44012b00 con 0x7f2a540b3040 2023-11-24T06:13:32.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.803+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a541f36a0 con 0x7f2a540b3040 2023-11-24T06:13:32.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.803+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a541f3c60 con 0x7f2a540b3040 2023-11-24T06:13:32.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.804+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a540a1210 con 0x7f2a540b3040 2023-11-24T06:13:32.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.805+0000 7f2a517fa640 1 -- 172.21.15.22:0/2326868295 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a44012c60 con 0x7f2a540b3040 2023-11-24T06:13:32.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.806+0000 7f2a517fa640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2a4006ae40 0x7f2a4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:32.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.807+0000 7f2a517fa640 1 -- 172.21.15.22:0/2326868295 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a44089b80 con 0x7f2a540b3040 2023-11-24T06:13:32.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.807+0000 7f2a53fff640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2a4006ae40 0x7f2a4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:32.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.808+0000 7f2a53fff640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2a4006ae40 0x7f2a4006d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a48035000 tx=0x7f2a4802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:32.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:32.811+0000 7f2a517fa640 1 -- 172.21.15.22:0/2326868295 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a44054b90 con 0x7f2a540b3040 2023-11-24T06:13:33.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.042+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2a540d1600 con 0x7f2a540b3040 2023-11-24T06:13:33.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.798+0000 7f2a517fa640 1 -- 172.21.15.22:0/2326868295 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2a44089e60 con 0x7f2a540b3040 2023-11-24T06:13:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.801+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2a4006ae40 msgr2=0x7f2a4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.801+0000 7f2a5b189640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2a4006ae40 0x7f2a4006d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a48035000 tx=0x7f2a4802e000 comp rx=0 tx=0).stop 2023-11-24T06:13:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.801+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b3040 msgr2=0x7f2a541f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.801+0000 7f2a5b189640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b3040 0x7f2a541f3080 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400d5f0 tx=0x7f2a4400dab0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.801+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 shutdown_connections 2023-11-24T06:13:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.801+0000 7f2a5b189640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2a4006ae40 0x7f2a4006d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.801+0000 7f2a5b189640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a54160bd0 0x7f2a5414d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.801+0000 7f2a5b189640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a540b48d0 0x7f2a5414da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.801+0000 7f2a5b189640 1 --2- 172.21.15.22:0/2326868295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a540b3040 0x7f2a541f3080 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.802+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 >> 172.21.15.22:0/2326868295 conn(0x7f2a5409c5a0 msgr2=0x7f2a5406ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.802+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 shutdown_connections 2023-11-24T06:13:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:33.802+0000 7f2a5b189640 1 -- 172.21.15.22:0/2326868295 wait complete. 2023-11-24T06:13:33.827 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:13:33.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:13:34.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.053+0000 7fbda359e640 1 Processor -- start 2023-11-24T06:13:34.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.053+0000 7fbda359e640 1 -- start start 2023-11-24T06:13:34.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.054+0000 7fbda359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda40ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.054+0000 7fbda359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbda40d0fa0 0x7fbda40b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.054+0000 7fbda359e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda40c6bf0 con 0x7fbda415d3b0 2023-11-24T06:13:34.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.054+0000 7fbda359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40d13d0 con 0x7fbda40d0fa0 2023-11-24T06:13:34.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.054+0000 7fbda359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40cedc0 con 0x7fbda40d1d90 2023-11-24T06:13:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.055+0000 7fbda1d9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda40ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.055+0000 7fbda1d9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda40ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:44974/0 (socket says 172.21.15.22:44974) 2023-11-24T06:13:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.055+0000 7fbda1d9b640 1 -- 172.21.15.22:0/1613072760 learned_addr learned my addr 172.21.15.22:0/1613072760 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.055+0000 7fbda2d9d640 1 --2- 172.21.15.22:0/1613072760 >> v2:172.21.15.31:3300/0 conn(0x7fbda40d0fa0 0x7fbda40b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.056+0000 7fbda2d9d640 1 -- 172.21.15.22:0/1613072760 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 msgr2=0x7fbda40ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.056+0000 7fbda2d9d640 1 --2- 172.21.15.22:0/1613072760 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda40ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.056+0000 7fbda2d9d640 1 -- 172.21.15.22:0/1613072760 >> v1:172.21.15.31:6789/0 conn(0x7fbda415d3b0 legacy=0x7fbda40d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.056+0000 7fbda2d9d640 1 -- 172.21.15.22:0/1613072760 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40c6e40 con 0x7fbda40d0fa0 2023-11-24T06:13:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.056+0000 7fbda1d9b640 1 --2- 172.21.15.22:0/1613072760 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda40ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.057+0000 7fbda2d9d640 1 --2- 172.21.15.22:0/1613072760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda40d0fa0 0x7fbda40b3ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0097a0 tx=0x7fbd9c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdcf364f06b3836f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda159a640 1 -- 172.21.15.22:0/1613072760 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c031780 con 0x7fbda40d0fa0 2023-11-24T06:13:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda159a640 1 -- 172.21.15.22:0/1613072760 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c0318e0 con 0x7fbda40d0fa0 2023-11-24T06:13:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda159a640 1 -- 172.21.15.22:0/1613072760 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c031c70 con 0x7fbda40d0fa0 2023-11-24T06:13:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda359e640 1 -- 172.21.15.22:0/1613072760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda40d0fa0 msgr2=0x7fbda40b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda359e640 1 --2- 172.21.15.22:0/1613072760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda40d0fa0 0x7fbda40b3ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0097a0 tx=0x7fbd9c02b820 comp rx=0 tx=0).stop 2023-11-24T06:13:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda359e640 1 -- 172.21.15.22:0/1613072760 shutdown_connections 2023-11-24T06:13:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda359e640 1 --2- 172.21.15.22:0/1613072760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda40d0fa0 0x7fbda40b3ca0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda359e640 1 --2- 172.21.15.22:0/1613072760 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda40ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda359e640 1 -- 172.21.15.22:0/1613072760 >> 172.21.15.22:0/1613072760 conn(0x7fbda40d30a0 msgr2=0x7fbda40d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda359e640 1 -- 172.21.15.22:0/1613072760 shutdown_connections 2023-11-24T06:13:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.058+0000 7fbda359e640 1 -- 172.21.15.22:0/1613072760 wait complete. 2023-11-24T06:13:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.060+0000 7fbda359e640 1 Processor -- start 2023-11-24T06:13:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.060+0000 7fbda359e640 1 -- start start 2023-11-24T06:13:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.061+0000 7fbda359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda40d0fa0 0x7fbda40ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.061+0000 7fbda359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda409e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.061+0000 7fbda359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda415d3b0 0x7fbda415b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.061+0000 7fbda359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40cafc0 con 0x7fbda415d3b0 2023-11-24T06:13:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.061+0000 7fbda359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40b70d0 con 0x7fbda40d0fa0 2023-11-24T06:13:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.061+0000 7fbda359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40ca340 con 0x7fbda40d1d90 2023-11-24T06:13:34.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda415d3b0 0x7fbda415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda415d3b0 0x7fbda415b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60066/0 (socket says 172.21.15.22:60066) 2023-11-24T06:13:34.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda2d9d640 1 -- 172.21.15.22:0/3784619299 learned_addr learned my addr 172.21.15.22:0/3784619299 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:34.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda1d9b640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda409e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda259c640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda40d0fa0 0x7fbda40ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda2d9d640 1 -- 172.21.15.22:0/3784619299 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 msgr2=0x7fbda409e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda2d9d640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda409e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda2d9d640 1 -- 172.21.15.22:0/3784619299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda40d0fa0 msgr2=0x7fbda40ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda2d9d640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda40d0fa0 0x7fbda40ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda2d9d640 1 -- 172.21.15.22:0/3784619299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0094d0 con 0x7fbda415d3b0 2023-11-24T06:13:34.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.062+0000 7fbda2d9d640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda415d3b0 0x7fbda415b570 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c034040 tx=0x7fbd9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:34.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.063+0000 7fbd9affd640 1 -- 172.21.15.22:0/3784619299 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c032820 con 0x7fbda415d3b0 2023-11-24T06:13:34.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.063+0000 7fbd9affd640 1 -- 172.21.15.22:0/3784619299 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c032980 con 0x7fbda415d3b0 2023-11-24T06:13:34.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.063+0000 7fbd9affd640 1 -- 172.21.15.22:0/3784619299 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c032d30 con 0x7fbda415d3b0 2023-11-24T06:13:34.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.063+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9c009400 con 0x7fbda415d3b0 2023-11-24T06:13:34.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.063+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda40ca900 con 0x7fbda415d3b0 2023-11-24T06:13:34.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.064+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda40cb100 con 0x7fbda415d3b0 2023-11-24T06:13:34.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.065+0000 7fbd9affd640 1 -- 172.21.15.22:0/3784619299 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd9c04e450 con 0x7fbda415d3b0 2023-11-24T06:13:34.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.066+0000 7fbd9affd640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd8406ae40 0x7fbd8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.066+0000 7fbd9affd640 1 -- 172.21.15.22:0/3784619299 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd9c0ab720 con 0x7fbda415d3b0 2023-11-24T06:13:34.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.066+0000 7fbda259c640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd8406ae40 0x7fbd8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.067+0000 7fbda259c640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd8406ae40 0x7fbd8406d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd940012e0 tx=0x7fbd94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:34.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.071+0000 7fbd9affd640 1 -- 172.21.15.22:0/3784619299 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbda40cb100 con 0x7fbda415d3b0 2023-11-24T06:13:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.303+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbda40cb100 con 0x7fbda415d3b0 2023-11-24T06:13:34.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.801+0000 7fbd9affd640 1 -- 172.21.15.22:0/3784619299 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbda40cb100 con 0x7fbda415d3b0 2023-11-24T06:13:34.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.804+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd8406ae40 msgr2=0x7fbd8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.804+0000 7fbda359e640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd8406ae40 0x7fbd8406d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd940012e0 tx=0x7fbd94009040 comp rx=0 tx=0).stop 2023-11-24T06:13:34.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.804+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda415d3b0 msgr2=0x7fbda415b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.804+0000 7fbda359e640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda415d3b0 0x7fbda415b570 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c034040 tx=0x7fbd9c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.805+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 shutdown_connections 2023-11-24T06:13:34.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.805+0000 7fbda359e640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbd8406ae40 0x7fbd8406d300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.805+0000 7fbda359e640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda415d3b0 0x7fbda415b570 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.805+0000 7fbda359e640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbda40d1d90 0x7fbda409e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.805+0000 7fbda359e640 1 --2- 172.21.15.22:0/3784619299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda40d0fa0 0x7fbda40ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.805+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 >> 172.21.15.22:0/3784619299 conn(0x7fbda40d30a0 msgr2=0x7fbda40d1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:34.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.805+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 shutdown_connections 2023-11-24T06:13:34.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:34.805+0000 7fbda359e640 1 -- 172.21.15.22:0/3784619299 wait complete. 2023-11-24T06:13:34.831 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:13:34.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:35.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.053+0000 7f7d3d8e1640 1 Processor -- start 2023-11-24T06:13:35.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.053+0000 7f7d3d8e1640 1 -- start start 2023-11-24T06:13:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.055+0000 7f7d3d8e1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d38157770 0x7f7d3806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.055+0000 7f7d3d8e1640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d38161670 con 0x7f7d3815df80 2023-11-24T06:13:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.055+0000 7f7d3d8e1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3815e610 con 0x7f7d3806d080 2023-11-24T06:13:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.055+0000 7f7d3d8e1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3815e410 con 0x7f7d38157770 2023-11-24T06:13:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.055+0000 7f7d3d0e0640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7d3815df80 0x7f7d38070720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49324/0 (socket says 172.21.15.22:49324) 2023-11-24T06:13:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d3d0e0640 1 -- 172.21.15.22:0/3916674956 learned_addr learned my addr 172.21.15.22:0/3916674956 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d3c8df640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d38157770 0x7f7d3806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627189209 0 0) 0x7f7d38161670 con 0x7f7d3815df80 2023-11-24T06:13:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d28003520 con 0x7f7d3815df80 2023-11-24T06:13:35.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821621837 0 0) 0x7f7d28003520 con 0x7f7d3815df80 2023-11-24T06:13:35.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d38157770 msgr2=0x7f7d3806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:35.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d377fe640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d38157770 0x7f7d3806cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 >> v1:172.21.15.31:6789/0 conn(0x7f7d3806d080 legacy=0x7f7d3815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38160d40 con 0x7f7d3815df80 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.056+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f7d300019f0 con 0x7f7d3815df80 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 >> v1:172.21.15.22:6789/0 conn(0x7f7d3815df80 legacy=0x7f7d38070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d377fe640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d38157770 0x7f7d28003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d377fe640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d377fe640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d28004d00 0x7f7d28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3815e410 con 0x7f7d28003fe0 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2800bb40 con 0x7f7d28004d00 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2800bd00 con 0x7f7d38157770 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d37fff640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d3c8df640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d38157770 0x7f7d28003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d37fff640 1 -- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d38157770 msgr2=0x7f7d28003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:35.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d37fff640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d38157770 0x7f7d28003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d37fff640 1 -- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d28004d00 msgr2=0x7f7d28005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:35.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d37fff640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d28004d00 0x7f7d28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d37fff640 1 -- 172.21.15.22:0/3916674956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28003520 con 0x7f7d28003fe0 2023-11-24T06:13:35.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.057+0000 7f7d3c8df640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d38157770 0x7f7d28003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.059+0000 7f7d37fff640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d280047c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7d24001750 tx=0x7f7d280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac66e4d27cfa326 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.059+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d240052d0 con 0x7f7d28003fe0 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.059+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2402e050 con 0x7f7d28003fe0 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.059+0000 7f7d377fe640 1 -- 172.21.15.22:0/3916674956 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24003830 con 0x7f7d28003fe0 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.059+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3916674956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 msgr2=0x7f7d280047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.059+0000 7f7d3d8e1640 1 --2- 172.21.15.22:0/3916674956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d280047c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7d24001750 tx=0x7f7d280057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.059+0000 7f7d3d0e0640 1 -- 172.21.15.22:0/3916674956 reap_dead start 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.060+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3916674956 shutdown_connections 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.060+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3916674956 >> 172.21.15.22:0/3916674956 conn(0x7f7d3806a860 msgr2=0x7f7d3806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.060+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3916674956 shutdown_connections 2023-11-24T06:13:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.060+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3916674956 wait complete. 2023-11-24T06:13:35.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.061+0000 7f7d3d8e1640 1 Processor -- start 2023-11-24T06:13:35.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.062+0000 7f7d3d8e1640 1 -- start start 2023-11-24T06:13:35.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.062+0000 7f7d3d8e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d380cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.062+0000 7f7d3d8e1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d380cc7a0 0x7f7d3814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3d8e1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b3580 0x7f7d380b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3d8e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380b3f40 con 0x7f7d28003fe0 2023-11-24T06:13:35.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3d8e1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380cd8e0 con 0x7f7d380b3580 2023-11-24T06:13:35.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3d8e1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380cccd0 con 0x7f7d380cc7a0 2023-11-24T06:13:35.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3c8df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d380cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3c8df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d380cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60080/0 (socket says 172.21.15.22:60080) 2023-11-24T06:13:35.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3c8df640 1 -- 172.21.15.22:0/3806114846 learned_addr learned my addr 172.21.15.22:0/3806114846 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:35.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3c8df640 1 -- 172.21.15.22:0/3806114846 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d380cc7a0 msgr2=0x7f7d3814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3c8df640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d380cc7a0 0x7f7d3814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3c8df640 1 -- 172.21.15.22:0/3806114846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b3580 msgr2=0x7f7d380b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3c8df640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b3580 0x7f7d380b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.063+0000 7f7d3c8df640 1 -- 172.21.15.22:0/3806114846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380ccfb0 con 0x7f7d28003fe0 2023-11-24T06:13:35.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.064+0000 7f7d3c8df640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d380cbd60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0108b0 tx=0x7f7d2c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:35.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.064+0000 7f7d357fa640 1 -- 172.21.15.22:0/3806114846 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c00eb60 con 0x7f7d28003fe0 2023-11-24T06:13:35.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.064+0000 7f7d357fa640 1 -- 172.21.15.22:0/3806114846 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c00ecc0 con 0x7f7d28003fe0 2023-11-24T06:13:35.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.064+0000 7f7d357fa640 1 -- 172.21.15.22:0/3806114846 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c01c400 con 0x7f7d28003fe0 2023-11-24T06:13:35.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.064+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d380cd290 con 0x7f7d28003fe0 2023-11-24T06:13:35.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.064+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d380cc2a0 con 0x7f7d28003fe0 2023-11-24T06:13:35.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.065+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3804e840 con 0x7f7d28003fe0 2023-11-24T06:13:35.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.066+0000 7f7d357fa640 1 -- 172.21.15.22:0/3806114846 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d2c01c560 con 0x7f7d28003fe0 2023-11-24T06:13:35.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.067+0000 7f7d357fa640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7d1c06ae40 0x7f7d1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.067+0000 7f7d357fa640 1 -- 172.21.15.22:0/3806114846 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d2c089cd0 con 0x7f7d28003fe0 2023-11-24T06:13:35.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.067+0000 7f7d37fff640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7d1c06ae40 0x7f7d1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.068+0000 7f7d37fff640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7d1c06ae40 0x7f7d1c06d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7d24033000 tx=0x7f7d2402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:35.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.072+0000 7f7d357fa640 1 -- 172.21.15.22:0/3806114846 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d2c054e20 con 0x7f7d28003fe0 2023-11-24T06:13:35.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.301+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d38155d80 con 0x7f7d28003fe0 2023-11-24T06:13:35.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.303+0000 7f7d357fa640 1 -- 172.21.15.22:0/3806114846 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f7d2c058440 con 0x7f7d28003fe0 2023-11-24T06:13:35.306 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:35.307 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3821411702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3821411702},{"type":"v1","addr":"172.21.15.31:6835","nonce":3821411702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3025908035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3025908035},{"type":"v1","addr":"172.21.15.31:6833","nonce":3025908035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/475244267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":475244267},{"type":"v1","addr":"172.21.15.22:6835","nonce":475244267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:29.209497+0000","modified":"2023-11-24T06:13:34.306159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6837/1515634482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1515634482},{"type":"v1","addr":"172.21.15.22:6837","nonce":1515634482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:13:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 15 2023-11-24T06:13:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.305+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7d1c06ae40 msgr2=0x7f7d1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.305+0000 7f7d3d8e1640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7d1c06ae40 0x7f7d1c06d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7d24033000 tx=0x7f7d2402f000 comp rx=0 tx=0).stop 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.305+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 msgr2=0x7f7d380cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.305+0000 7f7d3d8e1640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d380cbd60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0108b0 tx=0x7f7d2c010d70 comp rx=0 tx=0).stop 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.305+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 shutdown_connections 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.305+0000 7f7d3d8e1640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7d1c06ae40 0x7f7d1c06d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.306+0000 7f7d3d8e1640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d380b3580 0x7f7d380b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.306+0000 7f7d3d8e1640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7d380cc7a0 0x7f7d3814b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.306+0000 7f7d3d8e1640 1 --2- 172.21.15.22:0/3806114846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d28003fe0 0x7f7d380cbd60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.306+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 >> 172.21.15.22:0/3806114846 conn(0x7f7d3806a860 msgr2=0x7f7d380aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.306+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 shutdown_connections 2023-11-24T06:13:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.306+0000 7f7d3d8e1640 1 -- 172.21.15.22:0/3806114846 wait complete. 2023-11-24T06:13:35.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.542+0000 7fd439aff640 1 Processor -- start 2023-11-24T06:13:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.542+0000 7fd439aff640 1 -- start start 2023-11-24T06:13:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.543+0000 7fd439aff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd434160b60 0x7fd4340d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.543+0000 7fd439aff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4340d3cf0 0x7fd4340cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.543+0000 7fd439aff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4340b2b30 con 0x7fd4340afd30 2023-11-24T06:13:35.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.543+0000 7fd439aff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd434160f40 con 0x7fd4340d3cf0 2023-11-24T06:13:35.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.543+0000 7fd439aff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4340b2e10 con 0x7fd434160b60 2023-11-24T06:13:35.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.543+0000 7fd4392fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd4340afd30 0x7fd4340b3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49326/0 (socket says 172.21.15.22:49326) 2023-11-24T06:13:35.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.543+0000 7fd4392fe640 1 -- 172.21.15.22:0/2561290055 learned_addr learned my addr 172.21.15.22:0/2561290055 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:35.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd433fff640 1 --2- 172.21.15.22:0/2561290055 >> v2:172.21.15.22:3300/0 conn(0x7fd4340d3cf0 0x7fd4340cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd438afd640 1 --2- 172.21.15.22:0/2561290055 >> v2:172.21.15.31:3300/0 conn(0x7fd434160b60 0x7fd4340d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd4337fe640 1 -- 172.21.15.22:0/2561290055 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782492757 0 0) 0x7fd4340b2b30 con 0x7fd4340afd30 2023-11-24T06:13:35.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd4337fe640 1 -- 172.21.15.22:0/2561290055 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd420003520 con 0x7fd4340afd30 2023-11-24T06:13:35.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd433fff640 1 -- 172.21.15.22:0/2561290055 >> v2:172.21.15.31:3300/0 conn(0x7fd434160b60 msgr2=0x7fd4340d37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:35.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd433fff640 1 --2- 172.21.15.22:0/2561290055 >> v2:172.21.15.31:3300/0 conn(0x7fd434160b60 0x7fd4340d37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd4337fe640 1 -- 172.21.15.22:0/2561290055 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2313746245 0 0) 0x7fd420003520 con 0x7fd4340afd30 2023-11-24T06:13:35.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd433fff640 1 -- 172.21.15.22:0/2561290055 >> v1:172.21.15.22:6789/0 conn(0x7fd4340afd30 legacy=0x7fd4340b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd433fff640 1 -- 172.21.15.22:0/2561290055 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340b30f0 con 0x7fd4340d3cf0 2023-11-24T06:13:35.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.544+0000 7fd438afd640 1 --2- 172.21.15.22:0/2561290055 >> v2:172.21.15.31:3300/0 conn(0x7fd434160b60 0x7fd4340d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:35.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.545+0000 7fd433fff640 1 --2- 172.21.15.22:0/2561290055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 0x7fd4340cfa90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd43408c850 tx=0x7fd41c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845d2cc6f0db19d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:35.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd4337fe640 1 -- 172.21.15.22:0/2561290055 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c001670 con 0x7fd4340d3cf0 2023-11-24T06:13:35.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd4337fe640 1 -- 172.21.15.22:0/2561290055 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c02e050 con 0x7fd4340d3cf0 2023-11-24T06:13:35.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd4337fe640 1 -- 172.21.15.22:0/2561290055 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c030730 con 0x7fd4340d3cf0 2023-11-24T06:13:35.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd439aff640 1 -- 172.21.15.22:0/2561290055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 msgr2=0x7fd4340cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd439aff640 1 --2- 172.21.15.22:0/2561290055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 0x7fd4340cfa90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd43408c850 tx=0x7fd41c02b710 comp rx=0 tx=0).stop 2023-11-24T06:13:35.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd439aff640 1 -- 172.21.15.22:0/2561290055 shutdown_connections 2023-11-24T06:13:35.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd439aff640 1 --2- 172.21.15.22:0/2561290055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 0x7fd4340cfa90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd439aff640 1 --2- 172.21.15.22:0/2561290055 >> v2:172.21.15.31:3300/0 conn(0x7fd434160b60 0x7fd4340d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd439aff640 1 -- 172.21.15.22:0/2561290055 >> 172.21.15.22:0/2561290055 conn(0x7fd43409c3d0 msgr2=0x7fd4340d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:35.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd439aff640 1 -- 172.21.15.22:0/2561290055 shutdown_connections 2023-11-24T06:13:35.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.546+0000 7fd439aff640 1 -- 172.21.15.22:0/2561290055 wait complete. 2023-11-24T06:13:35.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.548+0000 7fd439aff640 1 Processor -- start 2023-11-24T06:13:35.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.548+0000 7fd439aff640 1 -- start start 2023-11-24T06:13:35.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.549+0000 7fd439aff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4340afd30 0x7fd4340c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.549+0000 7fd439aff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 0x7fd4340c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.549+0000 7fd439aff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd434160b60 0x7fd4340d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.549+0000 7fd439aff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340c9ad0 con 0x7fd4340d3cf0 2023-11-24T06:13:35.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.549+0000 7fd439aff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341e5e30 con 0x7fd4340afd30 2023-11-24T06:13:35.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.549+0000 7fd439aff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341e6110 con 0x7fd434160b60 2023-11-24T06:13:35.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd433fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 0x7fd4340c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd438afd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4340afd30 0x7fd4340c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd433fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 0x7fd4340c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60094/0 (socket says 172.21.15.22:60094) 2023-11-24T06:13:35.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd433fff640 1 -- 172.21.15.22:0/2096788893 learned_addr learned my addr 172.21.15.22:0/2096788893 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:35.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd4392fe640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd434160b60 0x7fd4340d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd433fff640 1 -- 172.21.15.22:0/2096788893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd434160b60 msgr2=0x7fd4340d2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd433fff640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd434160b60 0x7fd4340d2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd433fff640 1 -- 172.21.15.22:0/2096788893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4340afd30 msgr2=0x7fd4340c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd433fff640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4340afd30 0x7fd4340c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.550+0000 7fd433fff640 1 -- 172.21.15.22:0/2096788893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c009400 con 0x7fd4340d3cf0 2023-11-24T06:13:35.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.551+0000 7fd433fff640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 0x7fd4340c9590 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd41c000c00 tx=0x7fd41c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:35.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.551+0000 7fd4317fa640 1 -- 172.21.15.22:0/2096788893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c03b8d0 con 0x7fd4340d3cf0 2023-11-24T06:13:35.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.551+0000 7fd4317fa640 1 -- 172.21.15.22:0/2096788893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c03ba50 con 0x7fd4340d3cf0 2023-11-24T06:13:35.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.551+0000 7fd4317fa640 1 -- 172.21.15.22:0/2096788893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c03be00 con 0x7fd4340d3cf0 2023-11-24T06:13:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.551+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4341e63f0 con 0x7fd4340d3cf0 2023-11-24T06:13:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.551+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4341e69b0 con 0x7fd4340d3cf0 2023-11-24T06:13:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.552+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43404e840 con 0x7fd4340d3cf0 2023-11-24T06:13:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.553+0000 7fd4317fa640 1 -- 172.21.15.22:0/2096788893 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd41c039040 con 0x7fd4340d3cf0 2023-11-24T06:13:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.554+0000 7fd4317fa640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd41406ae40 0x7fd41406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.554+0000 7fd4317fa640 1 -- 172.21.15.22:0/2096788893 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd41c0aae10 con 0x7fd4340d3cf0 2023-11-24T06:13:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.554+0000 7fd438afd640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd41406ae40 0x7fd41406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.555+0000 7fd438afd640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd41406ae40 0x7fd41406d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd424009fd0 tx=0x7fd4240097f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.559+0000 7fd4317fa640 1 -- 172.21.15.22:0/2096788893 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd41c0ae030 con 0x7fd4340d3cf0 2023-11-24T06:13:35.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.759+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd43415dc00 con 0x7fd4340d3cf0 2023-11-24T06:13:35.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.761+0000 7fd4317fa640 1 -- 172.21.15.22:0/2096788893 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fd41c037090 con 0x7fd4340d3cf0 2023-11-24T06:13:35.765 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:35.766 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:13:30.762606+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:27.041850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:28.235409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:35.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd41406ae40 msgr2=0x7fd41406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd41406ae40 0x7fd41406d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd424009fd0 tx=0x7fd4240097f0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 msgr2=0x7fd4340c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 0x7fd4340c9590 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd41c000c00 tx=0x7fd41c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 shutdown_connections 2023-11-24T06:13:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd41406ae40 0x7fd41406d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd434160b60 0x7fd4340d2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340d3cf0 0x7fd4340c9590 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 --2- 172.21.15.22:0/2096788893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4340afd30 0x7fd4340c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 >> 172.21.15.22:0/2096788893 conn(0x7fd43409c3d0 msgr2=0x7fd43415c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:35.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 shutdown_connections 2023-11-24T06:13:35.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:35.764+0000 7fd439aff640 1 -- 172.21.15.22:0/2096788893 wait complete. 2023-11-24T06:13:35.788 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:13:35.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:13:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.015+0000 7f8b4c8ad640 1 Processor -- start 2023-11-24T06:13:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.016+0000 7f8b4c8ad640 1 -- start start 2023-11-24T06:13:36.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.017+0000 7f8b4c8ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b480d14a0 0x7f8b480d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.017+0000 7f8b4c8ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8b480b0640 0x7f8b480b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.017+0000 7f8b4c8ad640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480cf0c0 con 0x7f8b4815d5b0 2023-11-24T06:13:36.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.017+0000 7f8b4c8ad640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480b01b0 con 0x7f8b480b0640 2023-11-24T06:13:36.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.017+0000 7f8b4c8ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4815d990 con 0x7f8b480d14a0 2023-11-24T06:13:36.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.018+0000 7f8b477fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8b4815d5b0 0x7f8b480d3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:53960/0 (socket says 172.21.15.22:53960) 2023-11-24T06:13:36.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.018+0000 7f8b477fe640 1 -- 172.21.15.22:0/3018883884 learned_addr learned my addr 172.21.15.22:0/3018883884 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:36.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.018+0000 7f8b46ffd640 1 --2- 172.21.15.22:0/3018883884 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b480d14a0 0x7f8b480d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.018+0000 7f8b47fff640 1 --2- 172.21.15.22:0/3018883884 >> v2:172.21.15.31:3300/0 conn(0x7f8b480b0640 0x7f8b480b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.019+0000 7f8b46ffd640 1 -- 172.21.15.22:0/3018883884 >> v2:172.21.15.31:3300/0 conn(0x7f8b480b0640 msgr2=0x7f8b480b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.019+0000 7f8b46ffd640 1 --2- 172.21.15.22:0/3018883884 >> v2:172.21.15.31:3300/0 conn(0x7f8b480b0640 0x7f8b480b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.019+0000 7f8b46ffd640 1 -- 172.21.15.22:0/3018883884 >> v1:172.21.15.31:6789/0 conn(0x7f8b4815d5b0 legacy=0x7f8b480d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.019+0000 7f8b46ffd640 1 -- 172.21.15.22:0/3018883884 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480d1e40 con 0x7f8b480d14a0 2023-11-24T06:13:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.019+0000 7f8b47fff640 1 --2- 172.21.15.22:0/3018883884 >> v2:172.21.15.31:3300/0 conn(0x7f8b480b0640 0x7f8b480b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:36.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.021+0000 7f8b46ffd640 1 --2- 172.21.15.22:0/3018883884 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b480d14a0 0x7f8b480d1900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b300097a0 tx=0x7f8b3002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab2d8e86cb1cc327 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:36.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.021+0000 7f8b467fc640 1 -- 172.21.15.22:0/3018883884 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3002d040 con 0x7f8b480d14a0 2023-11-24T06:13:36.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b467fc640 1 -- 172.21.15.22:0/3018883884 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30031810 con 0x7f8b480d14a0 2023-11-24T06:13:36.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b467fc640 1 -- 172.21.15.22:0/3018883884 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30031ba0 con 0x7f8b480d14a0 2023-11-24T06:13:36.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/3018883884 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b480d14a0 msgr2=0x7f8b480d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b4c8ad640 1 --2- 172.21.15.22:0/3018883884 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b480d14a0 0x7f8b480d1900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b300097a0 tx=0x7f8b3002b8b0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/3018883884 shutdown_connections 2023-11-24T06:13:36.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b4c8ad640 1 --2- 172.21.15.22:0/3018883884 >> v2:172.21.15.31:3300/0 conn(0x7f8b480b0640 0x7f8b480b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b4c8ad640 1 --2- 172.21.15.22:0/3018883884 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b480d14a0 0x7f8b480d1900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/3018883884 >> 172.21.15.22:0/3018883884 conn(0x7f8b4809c3b0 msgr2=0x7f8b480d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:36.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/3018883884 shutdown_connections 2023-11-24T06:13:36.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.022+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/3018883884 wait complete. 2023-11-24T06:13:36.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.024+0000 7f8b4c8ad640 1 Processor -- start 2023-11-24T06:13:36.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.024+0000 7f8b4c8ad640 1 -- start start 2023-11-24T06:13:36.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.025+0000 7f8b4c8ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b480b0640 0x7f8b481521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.025+0000 7f8b4c8ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b480d14a0 0x7f8b480c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.025+0000 7f8b4c8ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b4815d5b0 0x7f8b480c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.025+0000 7f8b4c8ad640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480c8410 con 0x7f8b480d14a0 2023-11-24T06:13:36.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.025+0000 7f8b4c8ad640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480b75a0 con 0x7f8b480b0640 2023-11-24T06:13:36.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.025+0000 7f8b4c8ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480b7880 con 0x7f8b4815d5b0 2023-11-24T06:13:36.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b480d14a0 0x7f8b480c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b480d14a0 0x7f8b480c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60110/0 (socket says 172.21.15.22:60110) 2023-11-24T06:13:36.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b46ffd640 1 -- 172.21.15.22:0/656231025 learned_addr learned my addr 172.21.15.22:0/656231025 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:36.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b47fff640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b4815d5b0 0x7f8b480c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b477fe640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b480b0640 0x7f8b481521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b46ffd640 1 -- 172.21.15.22:0/656231025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b4815d5b0 msgr2=0x7f8b480c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b46ffd640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b4815d5b0 0x7f8b480c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b46ffd640 1 -- 172.21.15.22:0/656231025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b480b0640 msgr2=0x7f8b481521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b46ffd640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b480b0640 0x7f8b481521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.026+0000 7f8b46ffd640 1 -- 172.21.15.22:0/656231025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30009400 con 0x7f8b480d14a0 2023-11-24T06:13:36.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.027+0000 7f8b46ffd640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b480d14a0 0x7f8b480c7990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000c00 tx=0x7f8b300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:36.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.027+0000 7f8b3ffff640 1 -- 172.21.15.22:0/656231025 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3003ae60 con 0x7f8b480d14a0 2023-11-24T06:13:36.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.027+0000 7f8b3ffff640 1 -- 172.21.15.22:0/656231025 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30044400 con 0x7f8b480d14a0 2023-11-24T06:13:36.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.027+0000 7f8b3ffff640 1 -- 172.21.15.22:0/656231025 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b300447b0 con 0x7f8b480d14a0 2023-11-24T06:13:36.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.027+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4815db60 con 0x7f8b480d14a0 2023-11-24T06:13:36.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.027+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4815e120 con 0x7f8b480d14a0 2023-11-24T06:13:36.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.028+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4804e840 con 0x7f8b480d14a0 2023-11-24T06:13:36.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.029+0000 7f8b3ffff640 1 -- 172.21.15.22:0/656231025 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b3004d440 con 0x7f8b480d14a0 2023-11-24T06:13:36.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.030+0000 7f8b3ffff640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b2806ae40 0x7f8b2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.030+0000 7f8b3ffff640 1 -- 172.21.15.22:0/656231025 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b300aba60 con 0x7f8b480d14a0 2023-11-24T06:13:36.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.031+0000 7f8b477fe640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b2806ae40 0x7f8b2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.031+0000 7f8b477fe640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b2806ae40 0x7f8b2806d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b4815c5c0 tx=0x7f8b38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:36.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.035+0000 7f8b3ffff640 1 -- 172.21.15.22:0/656231025 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b30076b90 con 0x7f8b480d14a0 2023-11-24T06:13:36.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.224+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b480afe40 con 0x7f8b2806ae40 2023-11-24T06:13:36.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.237+0000 7f8b3ffff640 1 -- 172.21.15.22:0/656231025 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286799 (secure 0 0 0) 0x7f8b3800ec40 con 0x7f8b2806ae40 2023-11-24T06:13:36.243 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b2806ae40 msgr2=0x7f8b2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b2806ae40 0x7f8b2806d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b4815c5c0 tx=0x7f8b38009040 comp rx=0 tx=0).stop 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b480d14a0 msgr2=0x7f8b480c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b480d14a0 0x7f8b480c7990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000c00 tx=0x7f8b300046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 shutdown_connections 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8b2806ae40 0x7f8b2806d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b4815d5b0 0x7f8b480c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b480d14a0 0x7f8b480c7990 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 --2- 172.21.15.22:0/656231025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b480b0640 0x7f8b481521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 >> 172.21.15.22:0/656231025 conn(0x7f8b4809c3b0 msgr2=0x7f8b4806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:36.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 shutdown_connections 2023-11-24T06:13:36.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.244+0000 7f8b4c8ad640 1 -- 172.21.15.22:0/656231025 wait complete. 2023-11-24T06:13:36.269 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2023-11-24T06:13:34.675617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237164,"kb_used_data":4328,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737556,"statfs":{"total":773094113280,"available":772851257344,"internally_reserved":0,"allocated":4431872,"data_stored":2428793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001659"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838528+0000","last_change":"2023-11-24T06:13:29.793006+0000","last_active":"2023-11-24T06:13:30.838528+0000","last_peered":"2023-11-24T06:13:30.838528+0000","last_clean":"2023-11-24T06:13:30.838528+0000","last_became_active":"2023-11-24T06:13:29.792596+0000","last_became_peered":"2023-11-24T06:13:29.792596+0000","last_unstale":"2023-11-24T06:13:30.838528+0000","last_undegraded":"2023-11-24T06:13:30.838528+0000","last_fullsized":"2023-11-24T06:13:30.838528+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:21:34.680483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.842080+0000","last_change":"2023-11-24T06:13:29.783318+0000","last_active":"2023-11-24T06:13:30.842080+0000","last_peered":"2023-11-24T06:13:30.842080+0000","last_clean":"2023-11-24T06:13:30.842080+0000","last_became_active":"2023-11-24T06:13:29.779380+0000","last_became_peered":"2023-11-24T06:13:29.779380+0000","last_unstale":"2023-11-24T06:13:30.842080+0000","last_undegraded":"2023-11-24T06:13:30.842080+0000","last_fullsized":"2023-11-24T06:13:30.842080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:25.615312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.753305+0000","last_change":"2023-11-24T06:13:28.753305+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.753305+0000","last_undegraded":"2023-11-24T06:13:28.753305+0000","last_fullsized":"2023-11-24T06:13:28.753305+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838414+0000","last_change":"2023-11-24T06:13:29.791999+0000","last_active":"2023-11-24T06:13:30.838414+0000","last_peered":"2023-11-24T06:13:30.838414+0000","last_clean":"2023-11-24T06:13:30.838414+0000","last_became_active":"2023-11-24T06:13:29.791598+0000","last_became_peered":"2023-11-24T06:13:29.791598+0000","last_unstale":"2023-11-24T06:13:30.838414+0000","last_undegraded":"2023-11-24T06:13:30.838414+0000","last_fullsized":"2023-11-24T06:13:30.838414+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:39:47.374836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772966+0000","last_change":"2023-11-24T06:13:29.774305+0000","last_active":"2023-11-24T06:13:30.772966+0000","last_peered":"2023-11-24T06:13:30.772966+0000","last_clean":"2023-11-24T06:13:30.772966+0000","last_became_active":"2023-11-24T06:13:29.774032+0000","last_became_peered":"2023-11-24T06:13:29.774032+0000","last_unstale":"2023-11-24T06:13:30.772966+0000","last_undegraded":"2023-11-24T06:13:30.772966+0000","last_fullsized":"2023-11-24T06:13:30.772966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:24.140413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841119+0000","last_change":"2023-11-24T06:13:29.780507+0000","last_active":"2023-11-24T06:13:30.841119+0000","last_peered":"2023-11-24T06:13:30.841119+0000","last_clean":"2023-11-24T06:13:30.841119+0000","last_became_active":"2023-11-24T06:13:29.780227+0000","last_became_peered":"2023-11-24T06:13:29.780227+0000","last_unstale":"2023-11-24T06:13:30.841119+0000","last_undegraded":"2023-11-24T06:13:30.841119+0000","last_fullsized":"2023-11-24T06:13:30.841119+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:58:21.814600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776245+0000","last_change":"2023-11-24T06:13:29.780899+0000","last_active":"2023-11-24T06:13:30.776245+0000","last_peered":"2023-11-24T06:13:30.776245+0000","last_clean":"2023-11-24T06:13:30.776245+0000","last_became_active":"2023-11-24T06:13:29.778145+0000","last_became_peered":"2023-11-24T06:13:29.778145+0000","last_unstale":"2023-11-24T06:13:30.776245+0000","last_undegraded":"2023-11-24T06:13:30.776245+0000","last_fullsized":"2023-11-24T06:13:30.776245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:00:41.474172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.773782+0000","last_change":"2023-11-24T06:13:29.789717+0000","last_active":"2023-11-24T06:13:30.773782+0000","last_peered":"2023-11-24T06:13:30.773782+0000","last_clean":"2023-11-24T06:13:30.773782+0000","last_became_active":"2023-11-24T06:13:29.789361+0000","last_became_peered":"2023-11-24T06:13:29.789361+0000","last_unstale":"2023-11-24T06:13:30.773782+0000","last_undegraded":"2023-11-24T06:13:30.773782+0000","last_fullsized":"2023-11-24T06:13:30.773782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:57.393762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776490+0000","last_change":"2023-11-24T06:13:29.788570+0000","last_active":"2023-11-24T06:13:30.776490+0000","last_peered":"2023-11-24T06:13:30.776490+0000","last_clean":"2023-11-24T06:13:30.776490+0000","last_became_active":"2023-11-24T06:13:29.788272+0000","last_became_peered":"2023-11-24T06:13:29.788272+0000","last_unstale":"2023-11-24T06:13:30.776490+0000","last_undegraded":"2023-11-24T06:13:30.776490+0000","last_fullsized":"2023-11-24T06:13:30.776490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:50.185904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839049+0000","last_change":"2023-11-24T06:13:29.778070+0000","last_active":"2023-11-24T06:13:30.839049+0000","last_peered":"2023-11-24T06:13:30.839049+0000","last_clean":"2023-11-24T06:13:30.839049+0000","last_became_active":"2023-11-24T06:13:29.777719+0000","last_became_peered":"2023-11-24T06:13:29.777719+0000","last_unstale":"2023-11-24T06:13:30.839049+0000","last_undegraded":"2023-11-24T06:13:30.839049+0000","last_fullsized":"2023-11-24T06:13:30.839049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:14:20.193563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775673+0000","last_change":"2023-11-24T06:13:29.800867+0000","last_active":"2023-11-24T06:13:30.775673+0000","last_peered":"2023-11-24T06:13:30.775673+0000","last_clean":"2023-11-24T06:13:30.775673+0000","last_became_active":"2023-11-24T06:13:29.800429+0000","last_became_peered":"2023-11-24T06:13:29.800429+0000","last_unstale":"2023-11-24T06:13:30.775673+0000","last_undegraded":"2023-11-24T06:13:30.775673+0000","last_fullsized":"2023-11-24T06:13:30.775673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:02:46.847345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.752636+0000","last_change":"2023-11-24T06:13:28.752636+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.752636+0000","last_undegraded":"2023-11-24T06:13:28.752636+0000","last_fullsized":"2023-11-24T06:13:28.752636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772455+0000","last_change":"2023-11-24T06:13:29.782052+0000","last_active":"2023-11-24T06:13:30.772455+0000","last_peered":"2023-11-24T06:13:30.772455+0000","last_clean":"2023-11-24T06:13:30.772455+0000","last_became_active":"2023-11-24T06:13:29.781739+0000","last_became_peered":"2023-11-24T06:13:29.781739+0000","last_unstale":"2023-11-24T06:13:30.772455+0000","last_undegraded":"2023-11-24T06:13:30.772455+0000","last_fullsized":"2023-11-24T06:13:30.772455+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:18.179598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841268+0000","last_change":"2023-11-24T06:13:29.772582+0000","last_active":"2023-11-24T06:13:30.841268+0000","last_peered":"2023-11-24T06:13:30.841268+0000","last_clean":"2023-11-24T06:13:30.841268+0000","last_became_active":"2023-11-24T06:13:29.772220+0000","last_became_peered":"2023-11-24T06:13:29.772220+0000","last_unstale":"2023-11-24T06:13:30.841268+0000","last_undegraded":"2023-11-24T06:13:30.841268+0000","last_fullsized":"2023-11-24T06:13:30.841268+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:39:50.689532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.756132+0000","last_change":"2023-11-24T06:13:28.756132+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.756132+0000","last_undegraded":"2023-11-24T06:13:28.756132+0000","last_fullsized":"2023-11-24T06:13:28.756132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776162+0000","last_change":"2023-11-24T06:13:29.782900+0000","last_active":"2023-11-24T06:13:30.776162+0000","last_peered":"2023-11-24T06:13:30.776162+0000","last_clean":"2023-11-24T06:13:30.776162+0000","last_became_active":"2023-11-24T06:13:29.782606+0000","last_became_peered":"2023-11-24T06:13:29.782606+0000","last_unstale":"2023-11-24T06:13:30.776162+0000","last_undegraded":"2023-11-24T06:13:30.776162+0000","last_fullsized":"2023-11-24T06:13:30.776162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:51.670470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775331+0000","last_change":"2023-11-24T06:13:29.788738+0000","last_active":"2023-11-24T06:13:30.775331+0000","last_peered":"2023-11-24T06:13:30.775331+0000","last_clean":"2023-11-24T06:13:30.775331+0000","last_became_active":"2023-11-24T06:13:29.788445+0000","last_became_peered":"2023-11-24T06:13:29.788445+0000","last_unstale":"2023-11-24T06:13:30.775331+0000","last_undegraded":"2023-11-24T06:13:30.775331+0000","last_fullsized":"2023-11-24T06:13:30.775331+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:32.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.842186+0000","last_change":"2023-11-24T06:13:29.787196+0000","last_active":"2023-11-24T06:13:30.842186+0000","last_peered":"2023-11-24T06:13:30.842186+0000","last_clean":"2023-11-24T06:13:30.842186+0000","last_became_active":"2023-11-24T06:13:29.778591+0000","last_became_peered":"2023-11-24T06:13:29.778591+0000","last_unstale":"2023-11-24T06:13:30.842186+0000","last_undegraded":"2023-11-24T06:13:30.842186+0000","last_fullsized":"2023-11-24T06:13:30.842186+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:36:08.292455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841297+0000","last_change":"2023-11-24T06:13:29.802209+0000","last_active":"2023-11-24T06:13:30.841297+0000","last_peered":"2023-11-24T06:13:30.841297+0000","last_clean":"2023-11-24T06:13:30.841297+0000","last_became_active":"2023-11-24T06:13:29.801579+0000","last_became_peered":"2023-11-24T06:13:29.801579+0000","last_unstale":"2023-11-24T06:13:30.841297+0000","last_undegraded":"2023-11-24T06:13:30.841297+0000","last_fullsized":"2023-11-24T06:13:30.841297+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:48.249499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772677+0000","last_change":"2023-11-24T06:13:29.792316+0000","last_active":"2023-11-24T06:13:30.772677+0000","last_peered":"2023-11-24T06:13:30.772677+0000","last_clean":"2023-11-24T06:13:30.772677+0000","last_became_active":"2023-11-24T06:13:29.792004+0000","last_became_peered":"2023-11-24T06:13:29.792004+0000","last_unstale":"2023-11-24T06:13:30.772677+0000","last_undegraded":"2023-11-24T06:13:30.772677+0000","last_fullsized":"2023-11-24T06:13:30.772677+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:09.035971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775155+0000","last_change":"2023-11-24T06:13:29.784929+0000","last_active":"2023-11-24T06:13:30.775155+0000","last_peered":"2023-11-24T06:13:30.775155+0000","last_clean":"2023-11-24T06:13:30.775155+0000","last_became_active":"2023-11-24T06:13:29.783387+0000","last_became_peered":"2023-11-24T06:13:29.783387+0000","last_unstale":"2023-11-24T06:13:30.775155+0000","last_undegraded":"2023-11-24T06:13:30.775155+0000","last_fullsized":"2023-11-24T06:13:30.775155+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:57.393762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.774959+0000","last_change":"2023-11-24T06:13:29.797663+0000","last_active":"2023-11-24T06:13:30.774959+0000","last_peered":"2023-11-24T06:13:30.774959+0000","last_clean":"2023-11-24T06:13:30.774959+0000","last_became_active":"2023-11-24T06:13:29.796672+0000","last_became_peered":"2023-11-24T06:13:29.796672+0000","last_unstale":"2023-11-24T06:13:30.774959+0000","last_undegraded":"2023-11-24T06:13:30.774959+0000","last_fullsized":"2023-11-24T06:13:30.774959+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:08.587094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.837402+0000","last_change":"2023-11-24T06:13:29.784404+0000","last_active":"2023-11-24T06:13:30.837402+0000","last_peered":"2023-11-24T06:13:30.837402+0000","last_clean":"2023-11-24T06:13:30.837402+0000","last_became_active":"2023-11-24T06:13:29.784097+0000","last_became_peered":"2023-11-24T06:13:29.784097+0000","last_unstale":"2023-11-24T06:13:30.837402+0000","last_undegraded":"2023-11-24T06:13:30.837402+0000","last_fullsized":"2023-11-24T06:13:30.837402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:22:24.121665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.754803+0000","last_change":"2023-11-24T06:13:28.754803+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.754803+0000","last_undegraded":"2023-11-24T06:13:28.754803+0000","last_fullsized":"2023-11-24T06:13:28.754803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838667+0000","last_change":"2023-11-24T06:13:29.793557+0000","last_active":"2023-11-24T06:13:30.838667+0000","last_peered":"2023-11-24T06:13:30.838667+0000","last_clean":"2023-11-24T06:13:30.838667+0000","last_became_active":"2023-11-24T06:13:29.792528+0000","last_became_peered":"2023-11-24T06:13:29.792528+0000","last_unstale":"2023-11-24T06:13:30.838667+0000","last_undegraded":"2023-11-24T06:13:30.838667+0000","last_fullsized":"2023-11-24T06:13:30.838667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:37:33.045680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.842422+0000","last_change":"2023-11-24T06:13:29.798826+0000","last_active":"2023-11-24T06:13:30.842422+0000","last_peered":"2023-11-24T06:13:30.842422+0000","last_clean":"2023-11-24T06:13:30.842422+0000","last_became_active":"2023-11-24T06:13:29.796688+0000","last_became_peered":"2023-11-24T06:13:29.796688+0000","last_unstale":"2023-11-24T06:13:30.842422+0000","last_undegraded":"2023-11-24T06:13:30.842422+0000","last_fullsized":"2023-11-24T06:13:30.842422+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:05.932712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840319+0000","last_change":"2023-11-24T06:13:29.795933+0000","last_active":"2023-11-24T06:13:30.840319+0000","last_peered":"2023-11-24T06:13:30.840319+0000","last_clean":"2023-11-24T06:13:30.840319+0000","last_became_active":"2023-11-24T06:13:29.793947+0000","last_became_peered":"2023-11-24T06:13:29.793947+0000","last_unstale":"2023-11-24T06:13:30.840319+0000","last_undegraded":"2023-11-24T06:13:30.840319+0000","last_fullsized":"2023-11-24T06:13:30.840319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:43.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.752143+0000","last_change":"2023-11-24T06:13:28.752143+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.752143+0000","last_undegraded":"2023-11-24T06:13:28.752143+0000","last_fullsized":"2023-11-24T06:13:28.752143+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775559+0000","last_change":"2023-11-24T06:13:29.783702+0000","last_active":"2023-11-24T06:13:30.775559+0000","last_peered":"2023-11-24T06:13:30.775559+0000","last_clean":"2023-11-24T06:13:30.775559+0000","last_became_active":"2023-11-24T06:13:29.783026+0000","last_became_peered":"2023-11-24T06:13:29.783026+0000","last_unstale":"2023-11-24T06:13:30.775559+0000","last_undegraded":"2023-11-24T06:13:30.775559+0000","last_fullsized":"2023-11-24T06:13:30.775559+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:02:46.847345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776572+0000","last_change":"2023-11-24T06:13:29.780275+0000","last_active":"2023-11-24T06:13:30.776572+0000","last_peered":"2023-11-24T06:13:30.776572+0000","last_clean":"2023-11-24T06:13:30.776572+0000","last_became_active":"2023-11-24T06:13:29.776215+0000","last_became_peered":"2023-11-24T06:13:29.776215+0000","last_unstale":"2023-11-24T06:13:30.776572+0000","last_undegraded":"2023-11-24T06:13:30.776572+0000","last_fullsized":"2023-11-24T06:13:30.776572+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:38.224234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838416+0000","last_change":"2023-11-24T06:13:29.773288+0000","last_active":"2023-11-24T06:13:30.838416+0000","last_peered":"2023-11-24T06:13:30.838416+0000","last_clean":"2023-11-24T06:13:30.838416+0000","last_became_active":"2023-11-24T06:13:29.772951+0000","last_became_peered":"2023-11-24T06:13:29.772951+0000","last_unstale":"2023-11-24T06:13:30.838416+0000","last_undegraded":"2023-11-24T06:13:30.838416+0000","last_fullsized":"2023-11-24T06:13:30.838416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:28.471382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775796+0000","last_change":"2023-11-24T06:13:29.790246+0000","last_active":"2023-11-24T06:13:30.775796+0000","last_peered":"2023-11-24T06:13:30.775796+0000","last_clean":"2023-11-24T06:13:30.775796+0000","last_became_active":"2023-11-24T06:13:29.789978+0000","last_became_peered":"2023-11-24T06:13:29.789978+0000","last_unstale":"2023-11-24T06:13:30.775796+0000","last_undegraded":"2023-11-24T06:13:30.775796+0000","last_fullsized":"2023-11-24T06:13:30.775796+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:50.185904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840062+0000","last_change":"2023-11-24T06:13:29.784912+0000","last_active":"2023-11-24T06:13:30.840062+0000","last_peered":"2023-11-24T06:13:30.840062+0000","last_clean":"2023-11-24T06:13:30.840062+0000","last_became_active":"2023-11-24T06:13:29.784572+0000","last_became_peered":"2023-11-24T06:13:29.784572+0000","last_unstale":"2023-11-24T06:13:30.840062+0000","last_undegraded":"2023-11-24T06:13:30.840062+0000","last_fullsized":"2023-11-24T06:13:30.840062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:31.571516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.799947+0000","last_change":"2023-11-24T06:13:28.767609+0000","last_active":"2023-11-24T06:13:29.799947+0000","last_peered":"2023-11-24T06:13:29.799947+0000","last_clean":"2023-11-24T06:13:29.799947+0000","last_became_active":"2023-11-24T06:13:28.767289+0000","last_became_peered":"2023-11-24T06:13:28.767289+0000","last_unstale":"2023-11-24T06:13:29.799947+0000","last_undegraded":"2023-11-24T06:13:29.799947+0000","last_fullsized":"2023-11-24T06:13:29.799947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:55.461050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838741+0000","last_change":"2023-11-24T06:13:29.789135+0000","last_active":"2023-11-24T06:13:30.838741+0000","last_peered":"2023-11-24T06:13:30.838741+0000","last_clean":"2023-11-24T06:13:30.838741+0000","last_became_active":"2023-11-24T06:13:29.788794+0000","last_became_peered":"2023-11-24T06:13:29.788794+0000","last_unstale":"2023-11-24T06:13:30.838741+0000","last_undegraded":"2023-11-24T06:13:30.838741+0000","last_fullsized":"2023-11-24T06:13:30.838741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:22:24.121665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.798703+0000","last_change":"2023-11-24T06:13:28.759947+0000","last_active":"2023-11-24T06:13:29.798703+0000","last_peered":"2023-11-24T06:13:29.798703+0000","last_clean":"2023-11-24T06:13:29.798703+0000","last_became_active":"2023-11-24T06:13:28.759626+0000","last_became_peered":"2023-11-24T06:13:28.759626+0000","last_unstale":"2023-11-24T06:13:29.798703+0000","last_undegraded":"2023-11-24T06:13:29.798703+0000","last_fullsized":"2023-11-24T06:13:29.798703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:55.461050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775438+0000","last_change":"2023-11-24T06:13:29.797785+0000","last_active":"2023-11-24T06:13:30.775438+0000","last_peered":"2023-11-24T06:13:30.775438+0000","last_clean":"2023-11-24T06:13:30.775438+0000","last_became_active":"2023-11-24T06:13:29.797057+0000","last_became_peered":"2023-11-24T06:13:29.797057+0000","last_unstale":"2023-11-24T06:13:30.775438+0000","last_undegraded":"2023-11-24T06:13:30.775438+0000","last_fullsized":"2023-11-24T06:13:30.775438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:32.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.803192+0000","last_change":"2023-11-24T06:13:28.764850+0000","last_active":"2023-11-24T06:13:29.803192+0000","last_peered":"2023-11-24T06:13:29.803192+0000","last_clean":"2023-11-24T06:13:29.803192+0000","last_became_active":"2023-11-24T06:13:28.764542+0000","last_became_peered":"2023-11-24T06:13:28.764542+0000","last_unstale":"2023-11-24T06:13:29.803192+0000","last_undegraded":"2023-11-24T06:13:29.803192+0000","last_fullsized":"2023-11-24T06:13:29.803192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:37.211098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840398+0000","last_change":"2023-11-24T06:13:29.796284+0000","last_active":"2023-11-24T06:13:30.840398+0000","last_peered":"2023-11-24T06:13:30.840398+0000","last_clean":"2023-11-24T06:13:30.840398+0000","last_became_active":"2023-11-24T06:13:29.794570+0000","last_became_peered":"2023-11-24T06:13:29.794570+0000","last_unstale":"2023-11-24T06:13:30.840398+0000","last_undegraded":"2023-11-24T06:13:30.840398+0000","last_fullsized":"2023-11-24T06:13:30.840398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:54.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.790577+0000","last_change":"2023-11-24T06:13:28.751758+0000","last_active":"2023-11-24T06:13:29.790577+0000","last_peered":"2023-11-24T06:13:29.790577+0000","last_clean":"2023-11-24T06:13:29.790577+0000","last_became_active":"2023-11-24T06:13:28.751446+0000","last_became_peered":"2023-11-24T06:13:28.751446+0000","last_unstale":"2023-11-24T06:13:29.790577+0000","last_undegraded":"2023-11-24T06:13:29.790577+0000","last_fullsized":"2023-11-24T06:13:29.790577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:47.576410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776707+0000","last_change":"2023-11-24T06:13:29.790928+0000","last_active":"2023-11-24T06:13:30.776707+0000","last_peered":"2023-11-24T06:13:30.776707+0000","last_clean":"2023-11-24T06:13:30.776707+0000","last_became_active":"2023-11-24T06:13:29.790619+0000","last_became_peered":"2023-11-24T06:13:29.790619+0000","last_unstale":"2023-11-24T06:13:30.776707+0000","last_undegraded":"2023-11-24T06:13:30.776707+0000","last_fullsized":"2023-11-24T06:13:30.776707+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:15.486899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.799738+0000","last_change":"2023-11-24T06:13:28.766608+0000","last_active":"2023-11-24T06:13:29.799738+0000","last_peered":"2023-11-24T06:13:29.799738+0000","last_clean":"2023-11-24T06:13:29.799738+0000","last_became_active":"2023-11-24T06:13:28.766088+0000","last_became_peered":"2023-11-24T06:13:28.766088+0000","last_unstale":"2023-11-24T06:13:29.799738+0000","last_undegraded":"2023-11-24T06:13:29.799738+0000","last_fullsized":"2023-11-24T06:13:29.799738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:25:59.543427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.755531+0000","last_change":"2023-11-24T06:13:28.755531+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.755531+0000","last_undegraded":"2023-11-24T06:13:28.755531+0000","last_fullsized":"2023-11-24T06:13:28.755531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.799853+0000","last_change":"2023-11-24T06:13:28.762810+0000","last_active":"2023-11-24T06:13:29.799853+0000","last_peered":"2023-11-24T06:13:29.799853+0000","last_clean":"2023-11-24T06:13:29.799853+0000","last_became_active":"2023-11-24T06:13:28.762518+0000","last_became_peered":"2023-11-24T06:13:28.762518+0000","last_unstale":"2023-11-24T06:13:29.799853+0000","last_undegraded":"2023-11-24T06:13:29.799853+0000","last_fullsized":"2023-11-24T06:13:29.799853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:26.805511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.774902+0000","last_change":"2023-11-24T06:13:29.784400+0000","last_active":"2023-11-24T06:13:30.774902+0000","last_peered":"2023-11-24T06:13:30.774902+0000","last_clean":"2023-11-24T06:13:30.774902+0000","last_became_active":"2023-11-24T06:13:29.782994+0000","last_became_peered":"2023-11-24T06:13:29.782994+0000","last_unstale":"2023-11-24T06:13:30.774902+0000","last_undegraded":"2023-11-24T06:13:30.774902+0000","last_fullsized":"2023-11-24T06:13:30.774902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:31.571516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.760797+0000","last_change":"2023-11-24T06:13:28.766728+0000","last_active":"2023-11-24T06:13:29.760797+0000","last_peered":"2023-11-24T06:13:29.760797+0000","last_clean":"2023-11-24T06:13:29.760797+0000","last_became_active":"2023-11-24T06:13:28.766410+0000","last_became_peered":"2023-11-24T06:13:28.766410+0000","last_unstale":"2023-11-24T06:13:29.760797+0000","last_undegraded":"2023-11-24T06:13:29.760797+0000","last_fullsized":"2023-11-24T06:13:29.760797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:31.733232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.837459+0000","last_change":"2023-11-24T06:13:29.796707+0000","last_active":"2023-11-24T06:13:30.837459+0000","last_peered":"2023-11-24T06:13:30.837459+0000","last_clean":"2023-11-24T06:13:30.837459+0000","last_became_active":"2023-11-24T06:13:29.795957+0000","last_became_peered":"2023-11-24T06:13:29.795957+0000","last_unstale":"2023-11-24T06:13:30.837459+0000","last_undegraded":"2023-11-24T06:13:30.837459+0000","last_fullsized":"2023-11-24T06:13:30.837459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:52:43.758492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.768085+0000","last_change":"2023-11-24T06:13:28.761662+0000","last_active":"2023-11-24T06:13:29.768085+0000","last_peered":"2023-11-24T06:13:29.768085+0000","last_clean":"2023-11-24T06:13:29.768085+0000","last_became_active":"2023-11-24T06:13:28.761265+0000","last_became_peered":"2023-11-24T06:13:28.761265+0000","last_unstale":"2023-11-24T06:13:29.768085+0000","last_undegraded":"2023-11-24T06:13:29.768085+0000","last_fullsized":"2023-11-24T06:13:29.768085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:55.461050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.749907+0000","last_change":"2023-11-24T06:13:28.749907+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.749907+0000","last_undegraded":"2023-11-24T06:13:28.749907+0000","last_fullsized":"2023-11-24T06:13:28.749907+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.765137+0000","last_change":"2023-11-24T06:13:28.766002+0000","last_active":"2023-11-24T06:13:29.765137+0000","last_peered":"2023-11-24T06:13:29.765137+0000","last_clean":"2023-11-24T06:13:29.765137+0000","last_became_active":"2023-11-24T06:13:28.765709+0000","last_became_peered":"2023-11-24T06:13:28.765709+0000","last_unstale":"2023-11-24T06:13:29.765137+0000","last_undegraded":"2023-11-24T06:13:29.765137+0000","last_fullsized":"2023-11-24T06:13:29.765137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:00:40.461036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.842266+0000","last_change":"2023-11-24T06:13:29.782080+0000","last_active":"2023-11-24T06:13:30.842266+0000","last_peered":"2023-11-24T06:13:30.842266+0000","last_clean":"2023-11-24T06:13:30.842266+0000","last_became_active":"2023-11-24T06:13:29.781708+0000","last_became_peered":"2023-11-24T06:13:29.781708+0000","last_unstale":"2023-11-24T06:13:30.842266+0000","last_undegraded":"2023-11-24T06:13:30.842266+0000","last_fullsized":"2023-11-24T06:13:30.842266+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:10.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.766647+0000","last_change":"2023-11-24T06:13:28.753683+0000","last_active":"2023-11-24T06:13:29.766647+0000","last_peered":"2023-11-24T06:13:29.766647+0000","last_clean":"2023-11-24T06:13:29.766647+0000","last_became_active":"2023-11-24T06:13:28.753442+0000","last_became_peered":"2023-11-24T06:13:28.753442+0000","last_unstale":"2023-11-24T06:13:29.766647+0000","last_undegraded":"2023-11-24T06:13:29.766647+0000","last_fullsized":"2023-11-24T06:13:29.766647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:23.127277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841721+0000","last_change":"2023-11-24T06:13:29.789610+0000","last_active":"2023-11-24T06:13:30.841721+0000","last_peered":"2023-11-24T06:13:30.841721+0000","last_clean":"2023-11-24T06:13:30.841721+0000","last_became_active":"2023-11-24T06:13:29.789431+0000","last_became_peered":"2023-11-24T06:13:29.789431+0000","last_unstale":"2023-11-24T06:13:30.841721+0000","last_undegraded":"2023-11-24T06:13:30.841721+0000","last_fullsized":"2023-11-24T06:13:30.841721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:10.560507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T06:13:28.773299+0000","last_change":"2023-11-24T06:13:28.769056+0000","last_active":"2023-11-24T06:13:28.773299+0000","last_peered":"2023-11-24T06:13:28.773299+0000","last_clean":"2023-11-24T06:13:28.773299+0000","last_became_active":"2023-11-24T06:13:28.768716+0000","last_became_peered":"2023-11-24T06:13:28.768716+0000","last_unstale":"2023-11-24T06:13:28.773299+0000","last_undegraded":"2023-11-24T06:13:28.773299+0000","last_fullsized":"2023-11-24T06:13:28.773299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:26.805511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.753781+0000","last_change":"2023-11-24T06:13:28.753781+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.753781+0000","last_undegraded":"2023-11-24T06:13:28.753781+0000","last_fullsized":"2023-11-24T06:13:28.753781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.805630+0000","last_change":"2023-11-24T06:13:28.765313+0000","last_active":"2023-11-24T06:13:29.805630+0000","last_peered":"2023-11-24T06:13:29.805630+0000","last_clean":"2023-11-24T06:13:29.805630+0000","last_became_active":"2023-11-24T06:13:28.765053+0000","last_became_peered":"2023-11-24T06:13:28.765053+0000","last_unstale":"2023-11-24T06:13:29.805630+0000","last_undegraded":"2023-11-24T06:13:29.805630+0000","last_fullsized":"2023-11-24T06:13:29.805630+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:50.657333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.837763+0000","last_change":"2023-11-24T06:13:29.798604+0000","last_active":"2023-11-24T06:13:30.837763+0000","last_peered":"2023-11-24T06:13:30.837763+0000","last_clean":"2023-11-24T06:13:30.837763+0000","last_became_active":"2023-11-24T06:13:29.798360+0000","last_became_peered":"2023-11-24T06:13:29.798360+0000","last_unstale":"2023-11-24T06:13:30.837763+0000","last_undegraded":"2023-11-24T06:13:30.837763+0000","last_fullsized":"2023-11-24T06:13:30.837763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:34.502578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.800110+0000","last_change":"2023-11-24T06:13:28.760788+0000","last_active":"2023-11-24T06:13:29.800110+0000","last_peered":"2023-11-24T06:13:29.800110+0000","last_clean":"2023-11-24T06:13:29.800110+0000","last_became_active":"2023-11-24T06:13:28.760082+0000","last_became_peered":"2023-11-24T06:13:28.760082+0000","last_unstale":"2023-11-24T06:13:29.800110+0000","last_undegraded":"2023-11-24T06:13:29.800110+0000","last_fullsized":"2023-11-24T06:13:29.800110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:22:23.108529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841682+0000","last_change":"2023-11-24T06:13:29.781165+0000","last_active":"2023-11-24T06:13:30.841682+0000","last_peered":"2023-11-24T06:13:30.841682+0000","last_clean":"2023-11-24T06:13:30.841682+0000","last_became_active":"2023-11-24T06:13:29.780920+0000","last_became_peered":"2023-11-24T06:13:29.780920+0000","last_unstale":"2023-11-24T06:13:30.841682+0000","last_undegraded":"2023-11-24T06:13:30.841682+0000","last_fullsized":"2023-11-24T06:13:30.841682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:27:18.831428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838334+0000","last_change":"2023-11-24T06:13:28.764041+0000","last_active":"2023-11-24T06:13:30.838334+0000","last_peered":"2023-11-24T06:13:30.838334+0000","last_clean":"2023-11-24T06:13:30.838334+0000","last_became_active":"2023-11-24T06:13:28.763649+0000","last_became_peered":"2023-11-24T06:13:28.763649+0000","last_unstale":"2023-11-24T06:13:30.838334+0000","last_undegraded":"2023-11-24T06:13:30.838334+0000","last_fullsized":"2023-11-24T06:13:30.838334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:45.856147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776879+0000","last_change":"2023-11-24T06:13:29.794769+0000","last_active":"2023-11-24T06:13:30.776879+0000","last_peered":"2023-11-24T06:13:30.776879+0000","last_clean":"2023-11-24T06:13:30.776879+0000","last_became_active":"2023-11-24T06:13:29.794396+0000","last_became_peered":"2023-11-24T06:13:29.794396+0000","last_unstale":"2023-11-24T06:13:30.776879+0000","last_undegraded":"2023-11-24T06:13:30.776879+0000","last_fullsized":"2023-11-24T06:13:30.776879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:39:50.689532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.761049+0000","last_change":"2023-11-24T06:13:28.763119+0000","last_active":"2023-11-24T06:13:29.761049+0000","last_peered":"2023-11-24T06:13:29.761049+0000","last_clean":"2023-11-24T06:13:29.761049+0000","last_became_active":"2023-11-24T06:13:28.762841+0000","last_became_peered":"2023-11-24T06:13:28.762841+0000","last_unstale":"2023-11-24T06:13:29.761049+0000","last_undegraded":"2023-11-24T06:13:29.761049+0000","last_fullsized":"2023-11-24T06:13:29.761049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:02:45.834209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838694+0000","last_change":"2023-11-24T06:13:29.782777+0000","last_active":"2023-11-24T06:13:30.838694+0000","last_peered":"2023-11-24T06:13:30.838694+0000","last_clean":"2023-11-24T06:13:30.838694+0000","last_became_active":"2023-11-24T06:13:29.782511+0000","last_became_peered":"2023-11-24T06:13:29.782511+0000","last_unstale":"2023-11-24T06:13:30.838694+0000","last_undegraded":"2023-11-24T06:13:30.838694+0000","last_fullsized":"2023-11-24T06:13:30.838694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:00.556564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.804100+0000","last_change":"2023-11-24T06:13:28.757491+0000","last_active":"2023-11-24T06:13:29.804100+0000","last_peered":"2023-11-24T06:13:29.804100+0000","last_clean":"2023-11-24T06:13:29.804100+0000","last_became_active":"2023-11-24T06:13:28.757219+0000","last_became_peered":"2023-11-24T06:13:28.757219+0000","last_unstale":"2023-11-24T06:13:29.804100+0000","last_undegraded":"2023-11-24T06:13:29.804100+0000","last_fullsized":"2023-11-24T06:13:29.804100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:08.248340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775860+0000","last_change":"2023-11-24T06:13:29.781819+0000","last_active":"2023-11-24T06:13:30.775860+0000","last_peered":"2023-11-24T06:13:30.775860+0000","last_clean":"2023-11-24T06:13:30.775860+0000","last_became_active":"2023-11-24T06:13:29.781425+0000","last_became_peered":"2023-11-24T06:13:29.781425+0000","last_unstale":"2023-11-24T06:13:30.775860+0000","last_undegraded":"2023-11-24T06:13:30.775860+0000","last_fullsized":"2023-11-24T06:13:30.775860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:09.261477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838972+0000","last_change":"2023-11-24T06:13:28.765366+0000","last_active":"2023-11-24T06:13:30.838972+0000","last_peered":"2023-11-24T06:13:30.838972+0000","last_clean":"2023-11-24T06:13:30.838972+0000","last_became_active":"2023-11-24T06:13:28.765081+0000","last_became_peered":"2023-11-24T06:13:28.765081+0000","last_unstale":"2023-11-24T06:13:30.838972+0000","last_undegraded":"2023-11-24T06:13:30.838972+0000","last_fullsized":"2023-11-24T06:13:30.838972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:12.393700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.751342+0000","last_change":"2023-11-24T06:13:28.751342+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.751342+0000","last_undegraded":"2023-11-24T06:13:28.751342+0000","last_fullsized":"2023-11-24T06:13:28.751342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.796079+0000","last_change":"2023-11-24T06:13:28.759791+0000","last_active":"2023-11-24T06:13:29.796079+0000","last_peered":"2023-11-24T06:13:29.796079+0000","last_clean":"2023-11-24T06:13:29.796079+0000","last_became_active":"2023-11-24T06:13:28.759481+0000","last_became_peered":"2023-11-24T06:13:28.759481+0000","last_unstale":"2023-11-24T06:13:29.796079+0000","last_undegraded":"2023-11-24T06:13:29.796079+0000","last_fullsized":"2023-11-24T06:13:29.796079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:17.166462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838781+0000","last_change":"2023-11-24T06:13:29.791815+0000","last_active":"2023-11-24T06:13:30.838781+0000","last_peered":"2023-11-24T06:13:30.838781+0000","last_clean":"2023-11-24T06:13:30.838781+0000","last_became_active":"2023-11-24T06:13:29.791183+0000","last_became_peered":"2023-11-24T06:13:29.791183+0000","last_unstale":"2023-11-24T06:13:30.838781+0000","last_undegraded":"2023-11-24T06:13:30.838781+0000","last_fullsized":"2023-11-24T06:13:30.838781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:57:34.226894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.795265+0000","last_change":"2023-11-24T06:13:28.763764+0000","last_active":"2023-11-24T06:13:29.795265+0000","last_peered":"2023-11-24T06:13:29.795265+0000","last_clean":"2023-11-24T06:13:29.795265+0000","last_became_active":"2023-11-24T06:13:28.761992+0000","last_became_peered":"2023-11-24T06:13:28.761992+0000","last_unstale":"2023-11-24T06:13:29.795265+0000","last_undegraded":"2023-11-24T06:13:29.795265+0000","last_fullsized":"2023-11-24T06:13:29.795265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:47.576410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772609+0000","last_change":"2023-11-24T06:13:29.795211+0000","last_active":"2023-11-24T06:13:30.772609+0000","last_peered":"2023-11-24T06:13:30.772609+0000","last_clean":"2023-11-24T06:13:30.772609+0000","last_became_active":"2023-11-24T06:13:29.794657+0000","last_became_peered":"2023-11-24T06:13:29.794657+0000","last_unstale":"2023-11-24T06:13:30.772609+0000","last_undegraded":"2023-11-24T06:13:30.772609+0000","last_fullsized":"2023-11-24T06:13:30.772609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:55:28.392911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.768968+0000","last_change":"2023-11-24T06:13:28.766102+0000","last_active":"2023-11-24T06:13:29.768968+0000","last_peered":"2023-11-24T06:13:29.768968+0000","last_clean":"2023-11-24T06:13:29.768968+0000","last_became_active":"2023-11-24T06:13:28.765546+0000","last_became_peered":"2023-11-24T06:13:28.765546+0000","last_unstale":"2023-11-24T06:13:29.768968+0000","last_undegraded":"2023-11-24T06:13:29.768968+0000","last_fullsized":"2023-11-24T06:13:29.768968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:27.458246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772957+0000","last_change":"2023-11-24T06:13:29.788033+0000","last_active":"2023-11-24T06:13:30.772957+0000","last_peered":"2023-11-24T06:13:30.772957+0000","last_clean":"2023-11-24T06:13:30.772957+0000","last_became_active":"2023-11-24T06:13:29.787682+0000","last_became_peered":"2023-11-24T06:13:29.787682+0000","last_unstale":"2023-11-24T06:13:30.772957+0000","last_undegraded":"2023-11-24T06:13:30.772957+0000","last_fullsized":"2023-11-24T06:13:30.772957+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:56.474186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.801529+0000","last_change":"2023-11-24T06:13:28.754581+0000","last_active":"2023-11-24T06:13:29.801529+0000","last_peered":"2023-11-24T06:13:29.801529+0000","last_clean":"2023-11-24T06:13:29.801529+0000","last_became_active":"2023-11-24T06:13:28.754302+0000","last_became_peered":"2023-11-24T06:13:28.754302+0000","last_unstale":"2023-11-24T06:13:29.801529+0000","last_undegraded":"2023-11-24T06:13:29.801529+0000","last_fullsized":"2023-11-24T06:13:29.801529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:22.494532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772865+0000","last_change":"2023-11-24T06:13:29.778072+0000","last_active":"2023-11-24T06:13:30.772865+0000","last_peered":"2023-11-24T06:13:30.772865+0000","last_clean":"2023-11-24T06:13:30.772865+0000","last_became_active":"2023-11-24T06:13:29.777760+0000","last_became_peered":"2023-11-24T06:13:29.777760+0000","last_unstale":"2023-11-24T06:13:30.772865+0000","last_undegraded":"2023-11-24T06:13:30.772865+0000","last_fullsized":"2023-11-24T06:13:30.772865+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:13.148760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.758741+0000","last_change":"2023-11-24T06:13:28.767615+0000","last_active":"2023-11-24T06:13:29.758741+0000","last_peered":"2023-11-24T06:13:29.758741+0000","last_clean":"2023-11-24T06:13:29.758741+0000","last_became_active":"2023-11-24T06:13:28.767229+0000","last_became_peered":"2023-11-24T06:13:28.767229+0000","last_unstale":"2023-11-24T06:13:29.758741+0000","last_undegraded":"2023-11-24T06:13:29.758741+0000","last_fullsized":"2023-11-24T06:13:29.758741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:08.022834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.771767+0000","last_change":"2023-11-24T06:13:29.779195+0000","last_active":"2023-11-24T06:13:30.771767+0000","last_peered":"2023-11-24T06:13:30.771767+0000","last_clean":"2023-11-24T06:13:30.771767+0000","last_became_active":"2023-11-24T06:13:29.778736+0000","last_became_peered":"2023-11-24T06:13:29.778736+0000","last_unstale":"2023-11-24T06:13:30.771767+0000","last_undegraded":"2023-11-24T06:13:30.771767+0000","last_fullsized":"2023-11-24T06:13:30.771767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:16:06.084384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.763275+0000","last_change":"2023-11-24T06:13:28.754862+0000","last_active":"2023-11-24T06:13:29.763275+0000","last_peered":"2023-11-24T06:13:29.763275+0000","last_clean":"2023-11-24T06:13:29.763275+0000","last_became_active":"2023-11-24T06:13:28.753829+0000","last_became_peered":"2023-11-24T06:13:28.753829+0000","last_unstale":"2023-11-24T06:13:29.763275+0000","last_undegraded":"2023-11-24T06:13:29.763275+0000","last_fullsized":"2023-11-24T06:13:29.763275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:16:05.071248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775725+0000","last_change":"2023-11-24T06:13:29.779291+0000","last_active":"2023-11-24T06:13:30.775725+0000","last_peered":"2023-11-24T06:13:30.775725+0000","last_clean":"2023-11-24T06:13:30.775725+0000","last_became_active":"2023-11-24T06:13:29.778006+0000","last_became_peered":"2023-11-24T06:13:29.778006+0000","last_unstale":"2023-11-24T06:13:30.775725+0000","last_undegraded":"2023-11-24T06:13:30.775725+0000","last_fullsized":"2023-11-24T06:13:30.775725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:09.261477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T06:13:28.773341+0000","last_change":"2023-11-24T06:13:28.769932+0000","last_active":"2023-11-24T06:13:28.773341+0000","last_peered":"2023-11-24T06:13:28.773341+0000","last_clean":"2023-11-24T06:13:28.773341+0000","last_became_active":"2023-11-24T06:13:28.769659+0000","last_became_peered":"2023-11-24T06:13:28.769659+0000","last_unstale":"2023-11-24T06:13:28.773341+0000","last_undegraded":"2023-11-24T06:13:28.773341+0000","last_fullsized":"2023-11-24T06:13:28.773341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:12.135624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772888+0000","last_change":"2023-11-24T06:13:29.786139+0000","last_active":"2023-11-24T06:13:30.772888+0000","last_peered":"2023-11-24T06:13:30.772888+0000","last_clean":"2023-11-24T06:13:30.772888+0000","last_became_active":"2023-11-24T06:13:29.785804+0000","last_became_peered":"2023-11-24T06:13:29.785804+0000","last_unstale":"2023-11-24T06:13:30.772888+0000","last_undegraded":"2023-11-24T06:13:30.772888+0000","last_fullsized":"2023-11-24T06:13:30.772888+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:27.818647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839146+0000","last_change":"2023-11-24T06:13:28.767862+0000","last_active":"2023-11-24T06:13:30.839146+0000","last_peered":"2023-11-24T06:13:30.839146+0000","last_clean":"2023-11-24T06:13:30.839146+0000","last_became_active":"2023-11-24T06:13:28.767053+0000","last_became_peered":"2023-11-24T06:13:28.767053+0000","last_unstale":"2023-11-24T06:13:30.839146+0000","last_undegraded":"2023-11-24T06:13:30.839146+0000","last_fullsized":"2023-11-24T06:13:30.839146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:32:21.177219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-11-24T06:13:28.749481+0000","last_change":"2023-11-24T06:13:28.749481+0000","last_active":"2023-11-24T06:13:28.718571+0000","last_peered":"2023-11-24T06:13:28.718571+0000","last_clean":"2023-11-24T06:13:28.718571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:13:28.749481+0000","last_undegraded":"2023-11-24T06:13:28.749481+0000","last_fullsized":"2023-11-24T06:13:28.749481+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.766775+0000","last_change":"2023-11-24T06:13:28.754949+0000","last_active":"2023-11-24T06:13:29.766775+0000","last_peered":"2023-11-24T06:13:29.766775+0000","last_clean":"2023-11-24T06:13:29.766775+0000","last_became_active":"2023-11-24T06:13:28.754398+0000","last_became_peered":"2023-11-24T06:13:28.754398+0000","last_unstale":"2023-11-24T06:13:29.766775+0000","last_undegraded":"2023-11-24T06:13:29.766775+0000","last_fullsized":"2023-11-24T06:13:29.766775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:27.458246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839740+0000","last_change":"2023-11-24T06:13:29.787641+0000","last_active":"2023-11-24T06:13:30.839740+0000","last_peered":"2023-11-24T06:13:30.839740+0000","last_clean":"2023-11-24T06:13:30.839740+0000","last_became_active":"2023-11-24T06:13:29.787367+0000","last_became_peered":"2023-11-24T06:13:29.787367+0000","last_unstale":"2023-11-24T06:13:30.839740+0000","last_undegraded":"2023-11-24T06:13:30.839740+0000","last_fullsized":"2023-11-24T06:13:30.839740+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:07.310392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839049+0000","last_change":"2023-11-24T06:13:28.758217+0000","last_active":"2023-11-24T06:13:30.839049+0000","last_peered":"2023-11-24T06:13:30.839049+0000","last_clean":"2023-11-24T06:13:30.839049+0000","last_became_active":"2023-11-24T06:13:28.757597+0000","last_became_peered":"2023-11-24T06:13:28.757597+0000","last_unstale":"2023-11-24T06:13:30.839049+0000","last_undegraded":"2023-11-24T06:13:30.839049+0000","last_fullsized":"2023-11-24T06:13:30.839049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:27.514642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838453+0000","last_change":"2023-11-24T06:13:29.781920+0000","last_active":"2023-11-24T06:13:30.838453+0000","last_peered":"2023-11-24T06:13:30.838453+0000","last_clean":"2023-11-24T06:13:30.838453+0000","last_became_active":"2023-11-24T06:13:29.780119+0000","last_became_peered":"2023-11-24T06:13:29.780119+0000","last_unstale":"2023-11-24T06:13:30.838453+0000","last_undegraded":"2023-11-24T06:13:30.838453+0000","last_fullsized":"2023-11-24T06:13:30.838453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:23.507668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.767024+0000","last_change":"2023-11-24T06:13:28.760518+0000","last_active":"2023-11-24T06:13:29.767024+0000","last_peered":"2023-11-24T06:13:29.767024+0000","last_clean":"2023-11-24T06:13:29.767024+0000","last_became_active":"2023-11-24T06:13:28.760209+0000","last_became_peered":"2023-11-24T06:13:28.760209+0000","last_unstale":"2023-11-24T06:13:29.767024+0000","last_undegraded":"2023-11-24T06:13:29.767024+0000","last_fullsized":"2023-11-24T06:13:29.767024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:21:33.667347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839179+0000","last_change":"2023-11-24T06:13:29.785610+0000","last_active":"2023-11-24T06:13:30.839179+0000","last_peered":"2023-11-24T06:13:30.839179+0000","last_clean":"2023-11-24T06:13:30.839179+0000","last_became_active":"2023-11-24T06:13:29.785299+0000","last_became_peered":"2023-11-24T06:13:29.785299+0000","last_unstale":"2023-11-24T06:13:30.839179+0000","last_undegraded":"2023-11-24T06:13:30.839179+0000","last_fullsized":"2023-11-24T06:13:30.839179+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:47.158151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838557+0000","last_change":"2023-11-24T06:13:28.759524+0000","last_active":"2023-11-24T06:13:30.838557+0000","last_peered":"2023-11-24T06:13:30.838557+0000","last_clean":"2023-11-24T06:13:30.838557+0000","last_became_active":"2023-11-24T06:13:28.759227+0000","last_became_peered":"2023-11-24T06:13:28.759227+0000","last_unstale":"2023-11-24T06:13:30.838557+0000","last_undegraded":"2023-11-24T06:13:30.838557+0000","last_fullsized":"2023-11-24T06:13:30.838557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:42:37.504829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840011+0000","last_change":"2023-11-24T06:13:29.783005+0000","last_active":"2023-11-24T06:13:30.840011+0000","last_peered":"2023-11-24T06:13:30.840011+0000","last_clean":"2023-11-24T06:13:30.840011+0000","last_became_active":"2023-11-24T06:13:29.780034+0000","last_became_peered":"2023-11-24T06:13:29.780034+0000","last_unstale":"2023-11-24T06:13:30.840011+0000","last_undegraded":"2023-11-24T06:13:30.840011+0000","last_fullsized":"2023-11-24T06:13:30.840011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:15.486899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.763654+0000","last_change":"2023-11-24T06:13:28.764120+0000","last_active":"2023-11-24T06:13:29.763654+0000","last_peered":"2023-11-24T06:13:29.763654+0000","last_clean":"2023-11-24T06:13:29.763654+0000","last_became_active":"2023-11-24T06:13:28.763763+0000","last_became_peered":"2023-11-24T06:13:28.763763+0000","last_unstale":"2023-11-24T06:13:29.763654+0000","last_undegraded":"2023-11-24T06:13:29.763654+0000","last_fullsized":"2023-11-24T06:13:29.763654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:55:27.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.774409+0000","last_change":"2023-11-24T06:13:29.782637+0000","last_active":"2023-11-24T06:13:30.774409+0000","last_peered":"2023-11-24T06:13:30.774409+0000","last_clean":"2023-11-24T06:13:30.774409+0000","last_became_active":"2023-11-24T06:13:29.782258+0000","last_became_peered":"2023-11-24T06:13:29.782258+0000","last_unstale":"2023-11-24T06:13:30.774409+0000","last_undegraded":"2023-11-24T06:13:30.774409+0000","last_fullsized":"2023-11-24T06:13:30.774409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:07.310392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.761884+0000","last_change":"2023-11-24T06:13:28.764852+0000","last_active":"2023-11-24T06:13:29.761884+0000","last_peered":"2023-11-24T06:13:29.761884+0000","last_clean":"2023-11-24T06:13:29.761884+0000","last_became_active":"2023-11-24T06:13:28.764555+0000","last_became_peered":"2023-11-24T06:13:28.764555+0000","last_unstale":"2023-11-24T06:13:29.761884+0000","last_undegraded":"2023-11-24T06:13:29.761884+0000","last_fullsized":"2023-11-24T06:13:29.761884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:49.172768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776824+0000","last_change":"2023-11-24T06:13:29.783190+0000","last_active":"2023-11-24T06:13:30.776824+0000","last_peered":"2023-11-24T06:13:30.776824+0000","last_clean":"2023-11-24T06:13:30.776824+0000","last_became_active":"2023-11-24T06:13:29.782885+0000","last_became_peered":"2023-11-24T06:13:29.782885+0000","last_unstale":"2023-11-24T06:13:30.776824+0000","last_undegraded":"2023-11-24T06:13:30.776824+0000","last_fullsized":"2023-11-24T06:13:30.776824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:58:21.814600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.760757+0000","last_change":"2023-11-24T06:13:28.768982+0000","last_active":"2023-11-24T06:13:29.760757+0000","last_peered":"2023-11-24T06:13:29.760757+0000","last_clean":"2023-11-24T06:13:29.760757+0000","last_became_active":"2023-11-24T06:13:28.768648+0000","last_became_peered":"2023-11-24T06:13:28.768648+0000","last_unstale":"2023-11-24T06:13:29.760757+0000","last_undegraded":"2023-11-24T06:13:29.760757+0000","last_fullsized":"2023-11-24T06:13:29.760757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:23.127277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.770321+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:13:29.770321+0000","last_peered":"2023-11-24T06:13:29.770321+0000","last_clean":"2023-11-24T06:13:29.770321+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:13:29.770321+0000","last_undegraded":"2023-11-24T06:13:29.770321+0000","last_fullsized":"2023-11-24T06:13:29.770321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476759,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":144048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.177},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.4990000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.3959999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.286}]},{"osd":4,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.4330000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.022},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.349}]},{"osd":7,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.778,"5min":2.778,"15min":2.778},"last":1.236},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":4.7779999999999996,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.4750000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":747581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.353},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.3979999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.708}]},{"osd":2,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.474}]},{"osd":3,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.6359999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.244},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.7370000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.8100000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.534},{"interface":"front","average":{"1min":1.73,"5min":1.73,"15min":1.73},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.8660000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":157739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.306}]},{"osd":1,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7949999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.3560000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.234}]},{"osd":5,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.587,"15min":1.587},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.673,"5min":1.673,"15min":1.673},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.179}]},{"osd":7,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.669,"5min":2.669,"15min":2.669},"last":1.446}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":157227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.296}]},{"osd":1,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.573},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.4279999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5409999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.8400000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.7130000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.6519999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.7669999999999999,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.891}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":158757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.495},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.399,"5min":2.399,"15min":2.399},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.88200000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0629999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.0109999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":405504,"data_stored":157193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.0680000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.2440000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.234},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.98699999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":3.3399999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.5169999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.1020000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":3.7349999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.6479999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.1599999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":4.101,"5min":4.101,"15min":4.101},"last":1.462}]},{"osd":7,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.7869999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.395},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.6040000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":747491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.92500000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.167},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":0.77100000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.766,"5min":3.766,"15min":3.766},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.96599999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.7010000000000001,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.528}]},{"osd":7,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.383},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.4870000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":158757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.274}]},{"osd":2,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.022},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.1819999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.339},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4770000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.794},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.429}]},{"osd":5,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.5579999999999998,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.7589999999999999},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.7430000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6869999999999998,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.653},{"interface":"front","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":2.1259999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":3.1200000000000001,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.393},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":2.2130000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:13:36.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:13:36.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.537+0000 7f2cf114e640 1 Processor -- start 2023-11-24T06:13:36.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.537+0000 7f2cf114e640 1 -- start start 2023-11-24T06:13:36.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.538+0000 7f2cf114e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2cec15d5b0 0x7f2cec0d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.538+0000 7f2cf114e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0d14a0 0x7f2cec0d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.538+0000 7f2cf114e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec0cf0c0 con 0x7f2cec0cf7a0 2023-11-24T06:13:36.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.539+0000 7f2cf114e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec0b01b0 con 0x7f2cec15d5b0 2023-11-24T06:13:36.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.539+0000 7f2cf114e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec15d990 con 0x7f2cec0d14a0 2023-11-24T06:13:36.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.539+0000 7f2cebfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2cec15d5b0 0x7f2cec0d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.539+0000 7f2cebfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2cec15d5b0 0x7f2cec0d3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60114/0 (socket says 172.21.15.22:60114) 2023-11-24T06:13:36.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.539+0000 7f2cebfff640 1 -- 172.21.15.22:0/384426552 learned_addr learned my addr 172.21.15.22:0/384426552 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.539+0000 7f2ceb7fe640 1 --2- 172.21.15.22:0/384426552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0d14a0 0x7f2cec0d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.539+0000 7f2cebfff640 1 -- 172.21.15.22:0/384426552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0d14a0 msgr2=0x7f2cec0d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.539+0000 7f2cebfff640 1 --2- 172.21.15.22:0/384426552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0d14a0 0x7f2cec0d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.539+0000 7f2cebfff640 1 -- 172.21.15.22:0/384426552 >> v1:172.21.15.31:6789/0 conn(0x7f2cec0cf7a0 legacy=0x7f2cec0cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.540+0000 7f2cebfff640 1 -- 172.21.15.22:0/384426552 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec0d1e40 con 0x7f2cec15d5b0 2023-11-24T06:13:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.541+0000 7f2cebfff640 1 --2- 172.21.15.22:0/384426552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 0x7f2cec0d3990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009e50 tx=0x7f2cdc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac13140a80c7e83b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:36.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.541+0000 7f2ceaffd640 1 -- 172.21.15.22:0/384426552 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc02caf0 con 0x7f2cec15d5b0 2023-11-24T06:13:36.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.541+0000 7f2ceaffd640 1 -- 172.21.15.22:0/384426552 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc02cc50 con 0x7f2cec15d5b0 2023-11-24T06:13:36.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.541+0000 7f2ceaffd640 1 -- 172.21.15.22:0/384426552 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0343f0 con 0x7f2cec15d5b0 2023-11-24T06:13:36.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.542+0000 7f2cf114e640 1 -- 172.21.15.22:0/384426552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 msgr2=0x7f2cec0d3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.542+0000 7f2cf114e640 1 --2- 172.21.15.22:0/384426552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 0x7f2cec0d3990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009e50 tx=0x7f2cdc02bf50 comp rx=0 tx=0).stop 2023-11-24T06:13:36.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.542+0000 7f2cf114e640 1 -- 172.21.15.22:0/384426552 shutdown_connections 2023-11-24T06:13:36.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.542+0000 7f2cf114e640 1 --2- 172.21.15.22:0/384426552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0d14a0 0x7f2cec0d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.542+0000 7f2cf114e640 1 --2- 172.21.15.22:0/384426552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 0x7f2cec0d3990 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.542+0000 7f2cf114e640 1 -- 172.21.15.22:0/384426552 >> 172.21.15.22:0/384426552 conn(0x7f2cec09c3b0 msgr2=0x7f2cec0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:36.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.542+0000 7f2cf114e640 1 -- 172.21.15.22:0/384426552 shutdown_connections 2023-11-24T06:13:36.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.542+0000 7f2cf114e640 1 -- 172.21.15.22:0/384426552 wait complete. 2023-11-24T06:13:36.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.544+0000 7f2cf114e640 1 Processor -- start 2023-11-24T06:13:36.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.544+0000 7f2cf114e640 1 -- start start 2023-11-24T06:13:36.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.545+0000 7f2cf114e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0cf7a0 0x7f2cec15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.545+0000 7f2cf114e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cec0d14a0 0x7f2cec0b8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.545+0000 7f2cf114e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 0x7f2cec0b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.545+0000 7f2cf114e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec15a920 con 0x7f2cec15d5b0 2023-11-24T06:13:36.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.545+0000 7f2cf114e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0c8a60 con 0x7f2cec0d14a0 2023-11-24T06:13:36.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.545+0000 7f2cf114e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0c8d40 con 0x7f2cec0cf7a0 2023-11-24T06:13:36.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.545+0000 7f2cf094d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 0x7f2cec0b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.545+0000 7f2cf094d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 0x7f2cec0b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60116/0 (socket says 172.21.15.22:60116) 2023-11-24T06:13:36.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.545+0000 7f2cf094d640 1 -- 172.21.15.22:0/1994325921 learned_addr learned my addr 172.21.15.22:0/1994325921 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2cebfff640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0cf7a0 0x7f2cec15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2ceb7fe640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cec0d14a0 0x7f2cec0b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2cf094d640 1 -- 172.21.15.22:0/1994325921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0cf7a0 msgr2=0x7f2cec15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2cf094d640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0cf7a0 0x7f2cec15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2cf094d640 1 -- 172.21.15.22:0/1994325921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cec0d14a0 msgr2=0x7f2cec0b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2cf094d640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cec0d14a0 0x7f2cec0b8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2cf094d640 1 -- 172.21.15.22:0/1994325921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc009b30 con 0x7f2cec15d5b0 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2ceb7fe640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cec0d14a0 0x7f2cec0b8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2cf094d640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 0x7f2cec0b5c40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400c390 tx=0x7f2ce400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:36.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2ce8ff9640 1 -- 172.21.15.22:0/1994325921 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40052d0 con 0x7f2cec15d5b0 2023-11-24T06:13:36.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2ce8ff9640 1 -- 172.21.15.22:0/1994325921 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4005430 con 0x7f2cec15d5b0 2023-11-24T06:13:36.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2ce8ff9640 1 -- 172.21.15.22:0/1994325921 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4003810 con 0x7f2cec15d5b0 2023-11-24T06:13:36.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.546+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec0c9020 con 0x7f2cec15d5b0 2023-11-24T06:13:36.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.547+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec0b8c90 con 0x7f2cec15d5b0 2023-11-24T06:13:36.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.548+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec0b8eb0 con 0x7f2cec15d5b0 2023-11-24T06:13:36.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.549+0000 7f2ce8ff9640 1 -- 172.21.15.22:0/1994325921 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ce4003970 con 0x7f2cec15d5b0 2023-11-24T06:13:36.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.550+0000 7f2ce8ff9640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ccc06ae40 0x7f2ccc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:36.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.550+0000 7f2ce8ff9640 1 -- 172.21.15.22:0/1994325921 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ce4088bd0 con 0x7f2cec15d5b0 2023-11-24T06:13:36.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.550+0000 7f2cebfff640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ccc06ae40 0x7f2ccc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:36.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.551+0000 7f2cebfff640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ccc06ae40 0x7f2ccc06d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc035000 tx=0x7f2cdc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:36.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.555+0000 7f2ce8ff9640 1 -- 172.21.15.22:0/1994325921 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ce4053be0 con 0x7f2cec15d5b0 2023-11-24T06:13:36.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.747+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2cec09c9a0 con 0x7f2ccc06ae40 2023-11-24T06:13:36.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.773+0000 7f2ce8ff9640 1 -- 172.21.15.22:0/1994325921 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287629 (secure 0 0 0) 0x7f2cec09c9a0 con 0x7f2ccc06ae40 2023-11-24T06:13:36.781 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:36.782 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:13:36.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.779+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ccc06ae40 msgr2=0x7f2ccc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.779+0000 7f2cf114e640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ccc06ae40 0x7f2ccc06d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc035000 tx=0x7f2cdc030000 comp rx=0 tx=0).stop 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 msgr2=0x7f2cec0b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 0x7f2cec0b5c40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400c390 tx=0x7f2ce400c850 comp rx=0 tx=0).stop 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 shutdown_connections 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ccc06ae40 0x7f2ccc06d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cec15d5b0 0x7f2cec0b5c40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cec0d14a0 0x7f2cec0b8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 --2- 172.21.15.22:0/1994325921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2cec0cf7a0 0x7f2cec15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 >> 172.21.15.22:0/1994325921 conn(0x7f2cec09c3b0 msgr2=0x7f2cec0b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 shutdown_connections 2023-11-24T06:13:36.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:36.780+0000 7f2cf114e640 1 -- 172.21.15.22:0/1994325921 wait complete. 2023-11-24T06:13:36.803 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-11-24T06:13:36.676606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237196,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737524,"statfs":{"total":773094113280,"available":772851224576,"internally_reserved":0,"allocated":4464640,"data_stored":2442540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.949583"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838528+0000","last_change":"2023-11-24T06:13:29.793006+0000","last_active":"2023-11-24T06:13:30.838528+0000","last_peered":"2023-11-24T06:13:30.838528+0000","last_clean":"2023-11-24T06:13:30.838528+0000","last_became_active":"2023-11-24T06:13:29.792596+0000","last_became_peered":"2023-11-24T06:13:29.792596+0000","last_unstale":"2023-11-24T06:13:30.838528+0000","last_undegraded":"2023-11-24T06:13:30.838528+0000","last_fullsized":"2023-11-24T06:13:30.838528+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:21:34.680483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.842080+0000","last_change":"2023-11-24T06:13:29.783318+0000","last_active":"2023-11-24T06:13:30.842080+0000","last_peered":"2023-11-24T06:13:30.842080+0000","last_clean":"2023-11-24T06:13:30.842080+0000","last_became_active":"2023-11-24T06:13:29.779380+0000","last_became_peered":"2023-11-24T06:13:29.779380+0000","last_unstale":"2023-11-24T06:13:30.842080+0000","last_undegraded":"2023-11-24T06:13:30.842080+0000","last_fullsized":"2023-11-24T06:13:30.842080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:25.615312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839411+0000","last_change":"2023-11-24T06:13:29.799006+0000","last_active":"2023-11-24T06:13:30.839411+0000","last_peered":"2023-11-24T06:13:30.839411+0000","last_clean":"2023-11-24T06:13:30.839411+0000","last_became_active":"2023-11-24T06:13:29.797999+0000","last_became_peered":"2023-11-24T06:13:29.797999+0000","last_unstale":"2023-11-24T06:13:30.839411+0000","last_undegraded":"2023-11-24T06:13:30.839411+0000","last_fullsized":"2023-11-24T06:13:30.839411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:15.486899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838414+0000","last_change":"2023-11-24T06:13:29.791999+0000","last_active":"2023-11-24T06:13:30.838414+0000","last_peered":"2023-11-24T06:13:30.838414+0000","last_clean":"2023-11-24T06:13:30.838414+0000","last_became_active":"2023-11-24T06:13:29.791598+0000","last_became_peered":"2023-11-24T06:13:29.791598+0000","last_unstale":"2023-11-24T06:13:30.838414+0000","last_undegraded":"2023-11-24T06:13:30.838414+0000","last_fullsized":"2023-11-24T06:13:30.838414+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:39:47.374836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772966+0000","last_change":"2023-11-24T06:13:29.774305+0000","last_active":"2023-11-24T06:13:30.772966+0000","last_peered":"2023-11-24T06:13:30.772966+0000","last_clean":"2023-11-24T06:13:30.772966+0000","last_became_active":"2023-11-24T06:13:29.774032+0000","last_became_peered":"2023-11-24T06:13:29.774032+0000","last_unstale":"2023-11-24T06:13:30.772966+0000","last_undegraded":"2023-11-24T06:13:30.772966+0000","last_fullsized":"2023-11-24T06:13:30.772966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:24.140413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841119+0000","last_change":"2023-11-24T06:13:29.780507+0000","last_active":"2023-11-24T06:13:30.841119+0000","last_peered":"2023-11-24T06:13:30.841119+0000","last_clean":"2023-11-24T06:13:30.841119+0000","last_became_active":"2023-11-24T06:13:29.780227+0000","last_became_peered":"2023-11-24T06:13:29.780227+0000","last_unstale":"2023-11-24T06:13:30.841119+0000","last_undegraded":"2023-11-24T06:13:30.841119+0000","last_fullsized":"2023-11-24T06:13:30.841119+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:58:21.814600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776245+0000","last_change":"2023-11-24T06:13:29.780899+0000","last_active":"2023-11-24T06:13:30.776245+0000","last_peered":"2023-11-24T06:13:30.776245+0000","last_clean":"2023-11-24T06:13:30.776245+0000","last_became_active":"2023-11-24T06:13:29.778145+0000","last_became_peered":"2023-11-24T06:13:29.778145+0000","last_unstale":"2023-11-24T06:13:30.776245+0000","last_undegraded":"2023-11-24T06:13:30.776245+0000","last_fullsized":"2023-11-24T06:13:30.776245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:00:41.474172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.773782+0000","last_change":"2023-11-24T06:13:29.789717+0000","last_active":"2023-11-24T06:13:30.773782+0000","last_peered":"2023-11-24T06:13:30.773782+0000","last_clean":"2023-11-24T06:13:30.773782+0000","last_became_active":"2023-11-24T06:13:29.789361+0000","last_became_peered":"2023-11-24T06:13:29.789361+0000","last_unstale":"2023-11-24T06:13:30.773782+0000","last_undegraded":"2023-11-24T06:13:30.773782+0000","last_fullsized":"2023-11-24T06:13:30.773782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:57.393762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776490+0000","last_change":"2023-11-24T06:13:29.788570+0000","last_active":"2023-11-24T06:13:30.776490+0000","last_peered":"2023-11-24T06:13:30.776490+0000","last_clean":"2023-11-24T06:13:30.776490+0000","last_became_active":"2023-11-24T06:13:29.788272+0000","last_became_peered":"2023-11-24T06:13:29.788272+0000","last_unstale":"2023-11-24T06:13:30.776490+0000","last_undegraded":"2023-11-24T06:13:30.776490+0000","last_fullsized":"2023-11-24T06:13:30.776490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:50.185904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839049+0000","last_change":"2023-11-24T06:13:29.778070+0000","last_active":"2023-11-24T06:13:30.839049+0000","last_peered":"2023-11-24T06:13:30.839049+0000","last_clean":"2023-11-24T06:13:30.839049+0000","last_became_active":"2023-11-24T06:13:29.777719+0000","last_became_peered":"2023-11-24T06:13:29.777719+0000","last_unstale":"2023-11-24T06:13:30.839049+0000","last_undegraded":"2023-11-24T06:13:30.839049+0000","last_fullsized":"2023-11-24T06:13:30.839049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:14:20.193563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775673+0000","last_change":"2023-11-24T06:13:29.800867+0000","last_active":"2023-11-24T06:13:30.775673+0000","last_peered":"2023-11-24T06:13:30.775673+0000","last_clean":"2023-11-24T06:13:30.775673+0000","last_became_active":"2023-11-24T06:13:29.800429+0000","last_became_peered":"2023-11-24T06:13:29.800429+0000","last_unstale":"2023-11-24T06:13:30.775673+0000","last_undegraded":"2023-11-24T06:13:30.775673+0000","last_fullsized":"2023-11-24T06:13:30.775673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:02:46.847345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839319+0000","last_change":"2023-11-24T06:13:29.781198+0000","last_active":"2023-11-24T06:13:30.839319+0000","last_peered":"2023-11-24T06:13:30.839319+0000","last_clean":"2023-11-24T06:13:30.839319+0000","last_became_active":"2023-11-24T06:13:29.780893+0000","last_became_peered":"2023-11-24T06:13:29.780893+0000","last_unstale":"2023-11-24T06:13:30.839319+0000","last_undegraded":"2023-11-24T06:13:30.839319+0000","last_fullsized":"2023-11-24T06:13:30.839319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:00:41.474172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772455+0000","last_change":"2023-11-24T06:13:29.782052+0000","last_active":"2023-11-24T06:13:30.772455+0000","last_peered":"2023-11-24T06:13:30.772455+0000","last_clean":"2023-11-24T06:13:30.772455+0000","last_became_active":"2023-11-24T06:13:29.781739+0000","last_became_peered":"2023-11-24T06:13:29.781739+0000","last_unstale":"2023-11-24T06:13:30.772455+0000","last_undegraded":"2023-11-24T06:13:30.772455+0000","last_fullsized":"2023-11-24T06:13:30.772455+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:18.179598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841268+0000","last_change":"2023-11-24T06:13:29.772582+0000","last_active":"2023-11-24T06:13:30.841268+0000","last_peered":"2023-11-24T06:13:30.841268+0000","last_clean":"2023-11-24T06:13:30.841268+0000","last_became_active":"2023-11-24T06:13:29.772220+0000","last_became_peered":"2023-11-24T06:13:29.772220+0000","last_unstale":"2023-11-24T06:13:30.841268+0000","last_undegraded":"2023-11-24T06:13:30.841268+0000","last_fullsized":"2023-11-24T06:13:30.841268+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:39:50.689532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.837941+0000","last_change":"2023-11-24T06:13:29.783469+0000","last_active":"2023-11-24T06:13:30.837941+0000","last_peered":"2023-11-24T06:13:30.837941+0000","last_clean":"2023-11-24T06:13:30.837941+0000","last_became_active":"2023-11-24T06:13:29.780286+0000","last_became_peered":"2023-11-24T06:13:29.780286+0000","last_unstale":"2023-11-24T06:13:30.837941+0000","last_undegraded":"2023-11-24T06:13:30.837941+0000","last_fullsized":"2023-11-24T06:13:30.837941+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:50.185904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776162+0000","last_change":"2023-11-24T06:13:29.782900+0000","last_active":"2023-11-24T06:13:30.776162+0000","last_peered":"2023-11-24T06:13:30.776162+0000","last_clean":"2023-11-24T06:13:30.776162+0000","last_became_active":"2023-11-24T06:13:29.782606+0000","last_became_peered":"2023-11-24T06:13:29.782606+0000","last_unstale":"2023-11-24T06:13:30.776162+0000","last_undegraded":"2023-11-24T06:13:30.776162+0000","last_fullsized":"2023-11-24T06:13:30.776162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:51.670470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775331+0000","last_change":"2023-11-24T06:13:29.788738+0000","last_active":"2023-11-24T06:13:30.775331+0000","last_peered":"2023-11-24T06:13:30.775331+0000","last_clean":"2023-11-24T06:13:30.775331+0000","last_became_active":"2023-11-24T06:13:29.788445+0000","last_became_peered":"2023-11-24T06:13:29.788445+0000","last_unstale":"2023-11-24T06:13:30.775331+0000","last_undegraded":"2023-11-24T06:13:30.775331+0000","last_fullsized":"2023-11-24T06:13:30.775331+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:32.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.842186+0000","last_change":"2023-11-24T06:13:29.787196+0000","last_active":"2023-11-24T06:13:30.842186+0000","last_peered":"2023-11-24T06:13:30.842186+0000","last_clean":"2023-11-24T06:13:30.842186+0000","last_became_active":"2023-11-24T06:13:29.778591+0000","last_became_peered":"2023-11-24T06:13:29.778591+0000","last_unstale":"2023-11-24T06:13:30.842186+0000","last_undegraded":"2023-11-24T06:13:30.842186+0000","last_fullsized":"2023-11-24T06:13:30.842186+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:36:08.292455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841297+0000","last_change":"2023-11-24T06:13:29.802209+0000","last_active":"2023-11-24T06:13:30.841297+0000","last_peered":"2023-11-24T06:13:30.841297+0000","last_clean":"2023-11-24T06:13:30.841297+0000","last_became_active":"2023-11-24T06:13:29.801579+0000","last_became_peered":"2023-11-24T06:13:29.801579+0000","last_unstale":"2023-11-24T06:13:30.841297+0000","last_undegraded":"2023-11-24T06:13:30.841297+0000","last_fullsized":"2023-11-24T06:13:30.841297+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:48.249499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772677+0000","last_change":"2023-11-24T06:13:29.792316+0000","last_active":"2023-11-24T06:13:30.772677+0000","last_peered":"2023-11-24T06:13:30.772677+0000","last_clean":"2023-11-24T06:13:30.772677+0000","last_became_active":"2023-11-24T06:13:29.792004+0000","last_became_peered":"2023-11-24T06:13:29.792004+0000","last_unstale":"2023-11-24T06:13:30.772677+0000","last_undegraded":"2023-11-24T06:13:30.772677+0000","last_fullsized":"2023-11-24T06:13:30.772677+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:09.035971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775155+0000","last_change":"2023-11-24T06:13:29.784929+0000","last_active":"2023-11-24T06:13:30.775155+0000","last_peered":"2023-11-24T06:13:30.775155+0000","last_clean":"2023-11-24T06:13:30.775155+0000","last_became_active":"2023-11-24T06:13:29.783387+0000","last_became_peered":"2023-11-24T06:13:29.783387+0000","last_unstale":"2023-11-24T06:13:30.775155+0000","last_undegraded":"2023-11-24T06:13:30.775155+0000","last_fullsized":"2023-11-24T06:13:30.775155+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:57.393762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.774959+0000","last_change":"2023-11-24T06:13:29.797663+0000","last_active":"2023-11-24T06:13:30.774959+0000","last_peered":"2023-11-24T06:13:30.774959+0000","last_clean":"2023-11-24T06:13:30.774959+0000","last_became_active":"2023-11-24T06:13:29.796672+0000","last_became_peered":"2023-11-24T06:13:29.796672+0000","last_unstale":"2023-11-24T06:13:30.774959+0000","last_undegraded":"2023-11-24T06:13:30.774959+0000","last_fullsized":"2023-11-24T06:13:30.774959+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:08.587094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.837402+0000","last_change":"2023-11-24T06:13:29.784404+0000","last_active":"2023-11-24T06:13:30.837402+0000","last_peered":"2023-11-24T06:13:30.837402+0000","last_clean":"2023-11-24T06:13:30.837402+0000","last_became_active":"2023-11-24T06:13:29.784097+0000","last_became_peered":"2023-11-24T06:13:29.784097+0000","last_unstale":"2023-11-24T06:13:30.837402+0000","last_undegraded":"2023-11-24T06:13:30.837402+0000","last_fullsized":"2023-11-24T06:13:30.837402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:22:24.121665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838882+0000","last_change":"2023-11-24T06:13:29.777374+0000","last_active":"2023-11-24T06:13:30.838882+0000","last_peered":"2023-11-24T06:13:30.838882+0000","last_clean":"2023-11-24T06:13:30.838882+0000","last_became_active":"2023-11-24T06:13:29.777033+0000","last_became_peered":"2023-11-24T06:13:29.777033+0000","last_unstale":"2023-11-24T06:13:30.838882+0000","last_undegraded":"2023-11-24T06:13:30.838882+0000","last_fullsized":"2023-11-24T06:13:30.838882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:51.670470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838667+0000","last_change":"2023-11-24T06:13:29.793557+0000","last_active":"2023-11-24T06:13:30.838667+0000","last_peered":"2023-11-24T06:13:30.838667+0000","last_clean":"2023-11-24T06:13:30.838667+0000","last_became_active":"2023-11-24T06:13:29.792528+0000","last_became_peered":"2023-11-24T06:13:29.792528+0000","last_unstale":"2023-11-24T06:13:30.838667+0000","last_undegraded":"2023-11-24T06:13:30.838667+0000","last_fullsized":"2023-11-24T06:13:30.838667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:37:33.045680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.842422+0000","last_change":"2023-11-24T06:13:29.798826+0000","last_active":"2023-11-24T06:13:30.842422+0000","last_peered":"2023-11-24T06:13:30.842422+0000","last_clean":"2023-11-24T06:13:30.842422+0000","last_became_active":"2023-11-24T06:13:29.796688+0000","last_became_peered":"2023-11-24T06:13:29.796688+0000","last_unstale":"2023-11-24T06:13:30.842422+0000","last_undegraded":"2023-11-24T06:13:30.842422+0000","last_fullsized":"2023-11-24T06:13:30.842422+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:05.932712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840319+0000","last_change":"2023-11-24T06:13:29.795933+0000","last_active":"2023-11-24T06:13:30.840319+0000","last_peered":"2023-11-24T06:13:30.840319+0000","last_clean":"2023-11-24T06:13:30.840319+0000","last_became_active":"2023-11-24T06:13:29.793947+0000","last_became_peered":"2023-11-24T06:13:29.793947+0000","last_unstale":"2023-11-24T06:13:30.840319+0000","last_undegraded":"2023-11-24T06:13:30.840319+0000","last_fullsized":"2023-11-24T06:13:30.840319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:43.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839453+0000","last_change":"2023-11-24T06:13:29.784520+0000","last_active":"2023-11-24T06:13:30.839453+0000","last_peered":"2023-11-24T06:13:30.839453+0000","last_clean":"2023-11-24T06:13:30.839453+0000","last_became_active":"2023-11-24T06:13:29.779603+0000","last_became_peered":"2023-11-24T06:13:29.779603+0000","last_unstale":"2023-11-24T06:13:30.839453+0000","last_undegraded":"2023-11-24T06:13:30.839453+0000","last_fullsized":"2023-11-24T06:13:30.839453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:58:21.814600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775559+0000","last_change":"2023-11-24T06:13:29.783702+0000","last_active":"2023-11-24T06:13:30.775559+0000","last_peered":"2023-11-24T06:13:30.775559+0000","last_clean":"2023-11-24T06:13:30.775559+0000","last_became_active":"2023-11-24T06:13:29.783026+0000","last_became_peered":"2023-11-24T06:13:29.783026+0000","last_unstale":"2023-11-24T06:13:30.775559+0000","last_undegraded":"2023-11-24T06:13:30.775559+0000","last_fullsized":"2023-11-24T06:13:30.775559+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:02:46.847345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776572+0000","last_change":"2023-11-24T06:13:29.780275+0000","last_active":"2023-11-24T06:13:30.776572+0000","last_peered":"2023-11-24T06:13:30.776572+0000","last_clean":"2023-11-24T06:13:30.776572+0000","last_became_active":"2023-11-24T06:13:29.776215+0000","last_became_peered":"2023-11-24T06:13:29.776215+0000","last_unstale":"2023-11-24T06:13:30.776572+0000","last_undegraded":"2023-11-24T06:13:30.776572+0000","last_fullsized":"2023-11-24T06:13:30.776572+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:38.224234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838416+0000","last_change":"2023-11-24T06:13:29.773288+0000","last_active":"2023-11-24T06:13:30.838416+0000","last_peered":"2023-11-24T06:13:30.838416+0000","last_clean":"2023-11-24T06:13:30.838416+0000","last_became_active":"2023-11-24T06:13:29.772951+0000","last_became_peered":"2023-11-24T06:13:29.772951+0000","last_unstale":"2023-11-24T06:13:30.838416+0000","last_undegraded":"2023-11-24T06:13:30.838416+0000","last_fullsized":"2023-11-24T06:13:30.838416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:28.471382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775796+0000","last_change":"2023-11-24T06:13:29.790246+0000","last_active":"2023-11-24T06:13:30.775796+0000","last_peered":"2023-11-24T06:13:30.775796+0000","last_clean":"2023-11-24T06:13:30.775796+0000","last_became_active":"2023-11-24T06:13:29.789978+0000","last_became_peered":"2023-11-24T06:13:29.789978+0000","last_unstale":"2023-11-24T06:13:30.775796+0000","last_undegraded":"2023-11-24T06:13:30.775796+0000","last_fullsized":"2023-11-24T06:13:30.775796+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:50.185904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840062+0000","last_change":"2023-11-24T06:13:29.784912+0000","last_active":"2023-11-24T06:13:30.840062+0000","last_peered":"2023-11-24T06:13:30.840062+0000","last_clean":"2023-11-24T06:13:30.840062+0000","last_became_active":"2023-11-24T06:13:29.784572+0000","last_became_peered":"2023-11-24T06:13:29.784572+0000","last_unstale":"2023-11-24T06:13:30.840062+0000","last_undegraded":"2023-11-24T06:13:30.840062+0000","last_fullsized":"2023-11-24T06:13:30.840062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:31.571516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.799947+0000","last_change":"2023-11-24T06:13:28.767609+0000","last_active":"2023-11-24T06:13:29.799947+0000","last_peered":"2023-11-24T06:13:29.799947+0000","last_clean":"2023-11-24T06:13:29.799947+0000","last_became_active":"2023-11-24T06:13:28.767289+0000","last_became_peered":"2023-11-24T06:13:28.767289+0000","last_unstale":"2023-11-24T06:13:29.799947+0000","last_undegraded":"2023-11-24T06:13:29.799947+0000","last_fullsized":"2023-11-24T06:13:29.799947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:55.461050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838741+0000","last_change":"2023-11-24T06:13:29.789135+0000","last_active":"2023-11-24T06:13:30.838741+0000","last_peered":"2023-11-24T06:13:30.838741+0000","last_clean":"2023-11-24T06:13:30.838741+0000","last_became_active":"2023-11-24T06:13:29.788794+0000","last_became_peered":"2023-11-24T06:13:29.788794+0000","last_unstale":"2023-11-24T06:13:30.838741+0000","last_undegraded":"2023-11-24T06:13:30.838741+0000","last_fullsized":"2023-11-24T06:13:30.838741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:22:24.121665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.798703+0000","last_change":"2023-11-24T06:13:28.759947+0000","last_active":"2023-11-24T06:13:29.798703+0000","last_peered":"2023-11-24T06:13:29.798703+0000","last_clean":"2023-11-24T06:13:29.798703+0000","last_became_active":"2023-11-24T06:13:28.759626+0000","last_became_peered":"2023-11-24T06:13:28.759626+0000","last_unstale":"2023-11-24T06:13:29.798703+0000","last_undegraded":"2023-11-24T06:13:29.798703+0000","last_fullsized":"2023-11-24T06:13:29.798703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:55.461050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775438+0000","last_change":"2023-11-24T06:13:29.797785+0000","last_active":"2023-11-24T06:13:30.775438+0000","last_peered":"2023-11-24T06:13:30.775438+0000","last_clean":"2023-11-24T06:13:30.775438+0000","last_became_active":"2023-11-24T06:13:29.797057+0000","last_became_peered":"2023-11-24T06:13:29.797057+0000","last_unstale":"2023-11-24T06:13:30.775438+0000","last_undegraded":"2023-11-24T06:13:30.775438+0000","last_fullsized":"2023-11-24T06:13:30.775438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:32.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.803192+0000","last_change":"2023-11-24T06:13:28.764850+0000","last_active":"2023-11-24T06:13:29.803192+0000","last_peered":"2023-11-24T06:13:29.803192+0000","last_clean":"2023-11-24T06:13:29.803192+0000","last_became_active":"2023-11-24T06:13:28.764542+0000","last_became_peered":"2023-11-24T06:13:28.764542+0000","last_unstale":"2023-11-24T06:13:29.803192+0000","last_undegraded":"2023-11-24T06:13:29.803192+0000","last_fullsized":"2023-11-24T06:13:29.803192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:37.211098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840398+0000","last_change":"2023-11-24T06:13:29.796284+0000","last_active":"2023-11-24T06:13:30.840398+0000","last_peered":"2023-11-24T06:13:30.840398+0000","last_clean":"2023-11-24T06:13:30.840398+0000","last_became_active":"2023-11-24T06:13:29.794570+0000","last_became_peered":"2023-11-24T06:13:29.794570+0000","last_unstale":"2023-11-24T06:13:30.840398+0000","last_undegraded":"2023-11-24T06:13:30.840398+0000","last_fullsized":"2023-11-24T06:13:30.840398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:54.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.790577+0000","last_change":"2023-11-24T06:13:28.751758+0000","last_active":"2023-11-24T06:13:29.790577+0000","last_peered":"2023-11-24T06:13:29.790577+0000","last_clean":"2023-11-24T06:13:29.790577+0000","last_became_active":"2023-11-24T06:13:28.751446+0000","last_became_peered":"2023-11-24T06:13:28.751446+0000","last_unstale":"2023-11-24T06:13:29.790577+0000","last_undegraded":"2023-11-24T06:13:29.790577+0000","last_fullsized":"2023-11-24T06:13:29.790577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:47.576410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776707+0000","last_change":"2023-11-24T06:13:29.790928+0000","last_active":"2023-11-24T06:13:30.776707+0000","last_peered":"2023-11-24T06:13:30.776707+0000","last_clean":"2023-11-24T06:13:30.776707+0000","last_became_active":"2023-11-24T06:13:29.790619+0000","last_became_peered":"2023-11-24T06:13:29.790619+0000","last_unstale":"2023-11-24T06:13:30.776707+0000","last_undegraded":"2023-11-24T06:13:30.776707+0000","last_fullsized":"2023-11-24T06:13:30.776707+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:15.486899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.799738+0000","last_change":"2023-11-24T06:13:28.766608+0000","last_active":"2023-11-24T06:13:29.799738+0000","last_peered":"2023-11-24T06:13:29.799738+0000","last_clean":"2023-11-24T06:13:29.799738+0000","last_became_active":"2023-11-24T06:13:28.766088+0000","last_became_peered":"2023-11-24T06:13:28.766088+0000","last_unstale":"2023-11-24T06:13:29.799738+0000","last_undegraded":"2023-11-24T06:13:29.799738+0000","last_fullsized":"2023-11-24T06:13:29.799738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:25:59.543427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.837883+0000","last_change":"2023-11-24T06:13:29.783129+0000","last_active":"2023-11-24T06:13:30.837883+0000","last_peered":"2023-11-24T06:13:30.837883+0000","last_clean":"2023-11-24T06:13:30.837883+0000","last_became_active":"2023-11-24T06:13:29.782864+0000","last_became_peered":"2023-11-24T06:13:29.782864+0000","last_unstale":"2023-11-24T06:13:30.837883+0000","last_undegraded":"2023-11-24T06:13:30.837883+0000","last_fullsized":"2023-11-24T06:13:30.837883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:09.261477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.799853+0000","last_change":"2023-11-24T06:13:28.762810+0000","last_active":"2023-11-24T06:13:29.799853+0000","last_peered":"2023-11-24T06:13:29.799853+0000","last_clean":"2023-11-24T06:13:29.799853+0000","last_became_active":"2023-11-24T06:13:28.762518+0000","last_became_peered":"2023-11-24T06:13:28.762518+0000","last_unstale":"2023-11-24T06:13:29.799853+0000","last_undegraded":"2023-11-24T06:13:29.799853+0000","last_fullsized":"2023-11-24T06:13:29.799853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:26.805511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.774902+0000","last_change":"2023-11-24T06:13:29.784400+0000","last_active":"2023-11-24T06:13:30.774902+0000","last_peered":"2023-11-24T06:13:30.774902+0000","last_clean":"2023-11-24T06:13:30.774902+0000","last_became_active":"2023-11-24T06:13:29.782994+0000","last_became_peered":"2023-11-24T06:13:29.782994+0000","last_unstale":"2023-11-24T06:13:30.774902+0000","last_undegraded":"2023-11-24T06:13:30.774902+0000","last_fullsized":"2023-11-24T06:13:30.774902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:31.571516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.760797+0000","last_change":"2023-11-24T06:13:28.766728+0000","last_active":"2023-11-24T06:13:29.760797+0000","last_peered":"2023-11-24T06:13:29.760797+0000","last_clean":"2023-11-24T06:13:29.760797+0000","last_became_active":"2023-11-24T06:13:28.766410+0000","last_became_peered":"2023-11-24T06:13:28.766410+0000","last_unstale":"2023-11-24T06:13:29.760797+0000","last_undegraded":"2023-11-24T06:13:29.760797+0000","last_fullsized":"2023-11-24T06:13:29.760797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:31.733232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.837459+0000","last_change":"2023-11-24T06:13:29.796707+0000","last_active":"2023-11-24T06:13:30.837459+0000","last_peered":"2023-11-24T06:13:30.837459+0000","last_clean":"2023-11-24T06:13:30.837459+0000","last_became_active":"2023-11-24T06:13:29.795957+0000","last_became_peered":"2023-11-24T06:13:29.795957+0000","last_unstale":"2023-11-24T06:13:30.837459+0000","last_undegraded":"2023-11-24T06:13:30.837459+0000","last_fullsized":"2023-11-24T06:13:30.837459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:52:43.758492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.768085+0000","last_change":"2023-11-24T06:13:28.761662+0000","last_active":"2023-11-24T06:13:29.768085+0000","last_peered":"2023-11-24T06:13:29.768085+0000","last_clean":"2023-11-24T06:13:29.768085+0000","last_became_active":"2023-11-24T06:13:28.761265+0000","last_became_peered":"2023-11-24T06:13:28.761265+0000","last_unstale":"2023-11-24T06:13:29.768085+0000","last_undegraded":"2023-11-24T06:13:29.768085+0000","last_fullsized":"2023-11-24T06:13:29.768085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:55.461050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839855+0000","last_change":"2023-11-24T06:13:29.780601+0000","last_active":"2023-11-24T06:13:30.839855+0000","last_peered":"2023-11-24T06:13:30.839855+0000","last_clean":"2023-11-24T06:13:30.839855+0000","last_became_active":"2023-11-24T06:13:29.780142+0000","last_became_peered":"2023-11-24T06:13:29.780142+0000","last_unstale":"2023-11-24T06:13:30.839855+0000","last_undegraded":"2023-11-24T06:13:30.839855+0000","last_fullsized":"2023-11-24T06:13:30.839855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:39:50.689532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.765137+0000","last_change":"2023-11-24T06:13:28.766002+0000","last_active":"2023-11-24T06:13:29.765137+0000","last_peered":"2023-11-24T06:13:29.765137+0000","last_clean":"2023-11-24T06:13:29.765137+0000","last_became_active":"2023-11-24T06:13:28.765709+0000","last_became_peered":"2023-11-24T06:13:28.765709+0000","last_unstale":"2023-11-24T06:13:29.765137+0000","last_undegraded":"2023-11-24T06:13:29.765137+0000","last_fullsized":"2023-11-24T06:13:29.765137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:00:40.461036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.842266+0000","last_change":"2023-11-24T06:13:29.782080+0000","last_active":"2023-11-24T06:13:30.842266+0000","last_peered":"2023-11-24T06:13:30.842266+0000","last_clean":"2023-11-24T06:13:30.842266+0000","last_became_active":"2023-11-24T06:13:29.781708+0000","last_became_peered":"2023-11-24T06:13:29.781708+0000","last_unstale":"2023-11-24T06:13:30.842266+0000","last_undegraded":"2023-11-24T06:13:30.842266+0000","last_fullsized":"2023-11-24T06:13:30.842266+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:10.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.766647+0000","last_change":"2023-11-24T06:13:28.753683+0000","last_active":"2023-11-24T06:13:29.766647+0000","last_peered":"2023-11-24T06:13:29.766647+0000","last_clean":"2023-11-24T06:13:29.766647+0000","last_became_active":"2023-11-24T06:13:28.753442+0000","last_became_peered":"2023-11-24T06:13:28.753442+0000","last_unstale":"2023-11-24T06:13:29.766647+0000","last_undegraded":"2023-11-24T06:13:29.766647+0000","last_fullsized":"2023-11-24T06:13:29.766647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:23.127277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841721+0000","last_change":"2023-11-24T06:13:29.789610+0000","last_active":"2023-11-24T06:13:30.841721+0000","last_peered":"2023-11-24T06:13:30.841721+0000","last_clean":"2023-11-24T06:13:30.841721+0000","last_became_active":"2023-11-24T06:13:29.789431+0000","last_became_peered":"2023-11-24T06:13:29.789431+0000","last_unstale":"2023-11-24T06:13:30.841721+0000","last_undegraded":"2023-11-24T06:13:30.841721+0000","last_fullsized":"2023-11-24T06:13:30.841721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:45:10.560507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.804176+0000","last_change":"2023-11-24T06:13:28.769056+0000","last_active":"2023-11-24T06:13:29.804176+0000","last_peered":"2023-11-24T06:13:29.804176+0000","last_clean":"2023-11-24T06:13:29.804176+0000","last_became_active":"2023-11-24T06:13:28.768716+0000","last_became_peered":"2023-11-24T06:13:28.768716+0000","last_unstale":"2023-11-24T06:13:29.804176+0000","last_undegraded":"2023-11-24T06:13:29.804176+0000","last_fullsized":"2023-11-24T06:13:29.804176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:02:45.834209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839401+0000","last_change":"2023-11-24T06:13:29.801058+0000","last_active":"2023-11-24T06:13:30.839401+0000","last_peered":"2023-11-24T06:13:30.839401+0000","last_clean":"2023-11-24T06:13:30.839401+0000","last_became_active":"2023-11-24T06:13:29.800586+0000","last_became_peered":"2023-11-24T06:13:29.800586+0000","last_unstale":"2023-11-24T06:13:30.839401+0000","last_undegraded":"2023-11-24T06:13:30.839401+0000","last_fullsized":"2023-11-24T06:13:30.839401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:38.224234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.805630+0000","last_change":"2023-11-24T06:13:28.765313+0000","last_active":"2023-11-24T06:13:29.805630+0000","last_peered":"2023-11-24T06:13:29.805630+0000","last_clean":"2023-11-24T06:13:29.805630+0000","last_became_active":"2023-11-24T06:13:28.765053+0000","last_became_peered":"2023-11-24T06:13:28.765053+0000","last_unstale":"2023-11-24T06:13:29.805630+0000","last_undegraded":"2023-11-24T06:13:29.805630+0000","last_fullsized":"2023-11-24T06:13:29.805630+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:30:50.657333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.837763+0000","last_change":"2023-11-24T06:13:29.798604+0000","last_active":"2023-11-24T06:13:30.837763+0000","last_peered":"2023-11-24T06:13:30.837763+0000","last_clean":"2023-11-24T06:13:30.837763+0000","last_became_active":"2023-11-24T06:13:29.798360+0000","last_became_peered":"2023-11-24T06:13:29.798360+0000","last_unstale":"2023-11-24T06:13:30.837763+0000","last_undegraded":"2023-11-24T06:13:30.837763+0000","last_fullsized":"2023-11-24T06:13:30.837763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:34.502578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.800110+0000","last_change":"2023-11-24T06:13:28.760788+0000","last_active":"2023-11-24T06:13:29.800110+0000","last_peered":"2023-11-24T06:13:29.800110+0000","last_clean":"2023-11-24T06:13:29.800110+0000","last_became_active":"2023-11-24T06:13:28.760082+0000","last_became_peered":"2023-11-24T06:13:28.760082+0000","last_unstale":"2023-11-24T06:13:29.800110+0000","last_undegraded":"2023-11-24T06:13:29.800110+0000","last_fullsized":"2023-11-24T06:13:29.800110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:22:23.108529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.841682+0000","last_change":"2023-11-24T06:13:29.781165+0000","last_active":"2023-11-24T06:13:30.841682+0000","last_peered":"2023-11-24T06:13:30.841682+0000","last_clean":"2023-11-24T06:13:30.841682+0000","last_became_active":"2023-11-24T06:13:29.780920+0000","last_became_peered":"2023-11-24T06:13:29.780920+0000","last_unstale":"2023-11-24T06:13:30.841682+0000","last_undegraded":"2023-11-24T06:13:30.841682+0000","last_fullsized":"2023-11-24T06:13:30.841682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:27:18.831428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838334+0000","last_change":"2023-11-24T06:13:28.764041+0000","last_active":"2023-11-24T06:13:30.838334+0000","last_peered":"2023-11-24T06:13:30.838334+0000","last_clean":"2023-11-24T06:13:30.838334+0000","last_became_active":"2023-11-24T06:13:28.763649+0000","last_became_peered":"2023-11-24T06:13:28.763649+0000","last_unstale":"2023-11-24T06:13:30.838334+0000","last_undegraded":"2023-11-24T06:13:30.838334+0000","last_fullsized":"2023-11-24T06:13:30.838334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:26:45.856147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776879+0000","last_change":"2023-11-24T06:13:29.794769+0000","last_active":"2023-11-24T06:13:30.776879+0000","last_peered":"2023-11-24T06:13:30.776879+0000","last_clean":"2023-11-24T06:13:30.776879+0000","last_became_active":"2023-11-24T06:13:29.794396+0000","last_became_peered":"2023-11-24T06:13:29.794396+0000","last_unstale":"2023-11-24T06:13:30.776879+0000","last_undegraded":"2023-11-24T06:13:30.776879+0000","last_fullsized":"2023-11-24T06:13:30.776879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:39:50.689532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.761049+0000","last_change":"2023-11-24T06:13:28.763119+0000","last_active":"2023-11-24T06:13:29.761049+0000","last_peered":"2023-11-24T06:13:29.761049+0000","last_clean":"2023-11-24T06:13:29.761049+0000","last_became_active":"2023-11-24T06:13:28.762841+0000","last_became_peered":"2023-11-24T06:13:28.762841+0000","last_unstale":"2023-11-24T06:13:29.761049+0000","last_undegraded":"2023-11-24T06:13:29.761049+0000","last_fullsized":"2023-11-24T06:13:29.761049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:02:45.834209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838694+0000","last_change":"2023-11-24T06:13:29.782777+0000","last_active":"2023-11-24T06:13:30.838694+0000","last_peered":"2023-11-24T06:13:30.838694+0000","last_clean":"2023-11-24T06:13:30.838694+0000","last_became_active":"2023-11-24T06:13:29.782511+0000","last_became_peered":"2023-11-24T06:13:29.782511+0000","last_unstale":"2023-11-24T06:13:30.838694+0000","last_undegraded":"2023-11-24T06:13:30.838694+0000","last_fullsized":"2023-11-24T06:13:30.838694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:00.556564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.804100+0000","last_change":"2023-11-24T06:13:28.757491+0000","last_active":"2023-11-24T06:13:29.804100+0000","last_peered":"2023-11-24T06:13:29.804100+0000","last_clean":"2023-11-24T06:13:29.804100+0000","last_became_active":"2023-11-24T06:13:28.757219+0000","last_became_peered":"2023-11-24T06:13:28.757219+0000","last_unstale":"2023-11-24T06:13:29.804100+0000","last_undegraded":"2023-11-24T06:13:29.804100+0000","last_fullsized":"2023-11-24T06:13:29.804100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:08.248340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775860+0000","last_change":"2023-11-24T06:13:29.781819+0000","last_active":"2023-11-24T06:13:30.775860+0000","last_peered":"2023-11-24T06:13:30.775860+0000","last_clean":"2023-11-24T06:13:30.775860+0000","last_became_active":"2023-11-24T06:13:29.781425+0000","last_became_peered":"2023-11-24T06:13:29.781425+0000","last_unstale":"2023-11-24T06:13:30.775860+0000","last_undegraded":"2023-11-24T06:13:30.775860+0000","last_fullsized":"2023-11-24T06:13:30.775860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:09.261477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838972+0000","last_change":"2023-11-24T06:13:28.765366+0000","last_active":"2023-11-24T06:13:30.838972+0000","last_peered":"2023-11-24T06:13:30.838972+0000","last_clean":"2023-11-24T06:13:30.838972+0000","last_became_active":"2023-11-24T06:13:28.765081+0000","last_became_peered":"2023-11-24T06:13:28.765081+0000","last_unstale":"2023-11-24T06:13:30.838972+0000","last_undegraded":"2023-11-24T06:13:30.838972+0000","last_fullsized":"2023-11-24T06:13:30.838972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:12.393700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840031+0000","last_change":"2023-11-24T06:13:29.790889+0000","last_active":"2023-11-24T06:13:30.840031+0000","last_peered":"2023-11-24T06:13:30.840031+0000","last_clean":"2023-11-24T06:13:30.840031+0000","last_became_active":"2023-11-24T06:13:29.790110+0000","last_became_peered":"2023-11-24T06:13:29.790110+0000","last_unstale":"2023-11-24T06:13:30.840031+0000","last_undegraded":"2023-11-24T06:13:30.840031+0000","last_fullsized":"2023-11-24T06:13:30.840031+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:48.249499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.796079+0000","last_change":"2023-11-24T06:13:28.759791+0000","last_active":"2023-11-24T06:13:29.796079+0000","last_peered":"2023-11-24T06:13:29.796079+0000","last_clean":"2023-11-24T06:13:29.796079+0000","last_became_active":"2023-11-24T06:13:28.759481+0000","last_became_peered":"2023-11-24T06:13:28.759481+0000","last_unstale":"2023-11-24T06:13:29.796079+0000","last_undegraded":"2023-11-24T06:13:29.796079+0000","last_fullsized":"2023-11-24T06:13:29.796079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:17.166462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838781+0000","last_change":"2023-11-24T06:13:29.791815+0000","last_active":"2023-11-24T06:13:30.838781+0000","last_peered":"2023-11-24T06:13:30.838781+0000","last_clean":"2023-11-24T06:13:30.838781+0000","last_became_active":"2023-11-24T06:13:29.791183+0000","last_became_peered":"2023-11-24T06:13:29.791183+0000","last_unstale":"2023-11-24T06:13:30.838781+0000","last_undegraded":"2023-11-24T06:13:30.838781+0000","last_fullsized":"2023-11-24T06:13:30.838781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:57:34.226894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.795265+0000","last_change":"2023-11-24T06:13:28.763764+0000","last_active":"2023-11-24T06:13:29.795265+0000","last_peered":"2023-11-24T06:13:29.795265+0000","last_clean":"2023-11-24T06:13:29.795265+0000","last_became_active":"2023-11-24T06:13:28.761992+0000","last_became_peered":"2023-11-24T06:13:28.761992+0000","last_unstale":"2023-11-24T06:13:29.795265+0000","last_undegraded":"2023-11-24T06:13:29.795265+0000","last_fullsized":"2023-11-24T06:13:29.795265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:18:47.576410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772609+0000","last_change":"2023-11-24T06:13:29.795211+0000","last_active":"2023-11-24T06:13:30.772609+0000","last_peered":"2023-11-24T06:13:30.772609+0000","last_clean":"2023-11-24T06:13:30.772609+0000","last_became_active":"2023-11-24T06:13:29.794657+0000","last_became_peered":"2023-11-24T06:13:29.794657+0000","last_unstale":"2023-11-24T06:13:30.772609+0000","last_undegraded":"2023-11-24T06:13:30.772609+0000","last_fullsized":"2023-11-24T06:13:30.772609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:55:28.392911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.768968+0000","last_change":"2023-11-24T06:13:28.766102+0000","last_active":"2023-11-24T06:13:29.768968+0000","last_peered":"2023-11-24T06:13:29.768968+0000","last_clean":"2023-11-24T06:13:29.768968+0000","last_became_active":"2023-11-24T06:13:28.765546+0000","last_became_peered":"2023-11-24T06:13:28.765546+0000","last_unstale":"2023-11-24T06:13:29.768968+0000","last_undegraded":"2023-11-24T06:13:29.768968+0000","last_fullsized":"2023-11-24T06:13:29.768968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:27.458246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772957+0000","last_change":"2023-11-24T06:13:29.788033+0000","last_active":"2023-11-24T06:13:30.772957+0000","last_peered":"2023-11-24T06:13:30.772957+0000","last_clean":"2023-11-24T06:13:30.772957+0000","last_became_active":"2023-11-24T06:13:29.787682+0000","last_became_peered":"2023-11-24T06:13:29.787682+0000","last_unstale":"2023-11-24T06:13:30.772957+0000","last_undegraded":"2023-11-24T06:13:30.772957+0000","last_fullsized":"2023-11-24T06:13:30.772957+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:56.474186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.801529+0000","last_change":"2023-11-24T06:13:28.754581+0000","last_active":"2023-11-24T06:13:29.801529+0000","last_peered":"2023-11-24T06:13:29.801529+0000","last_clean":"2023-11-24T06:13:29.801529+0000","last_became_active":"2023-11-24T06:13:28.754302+0000","last_became_peered":"2023-11-24T06:13:28.754302+0000","last_unstale":"2023-11-24T06:13:29.801529+0000","last_undegraded":"2023-11-24T06:13:29.801529+0000","last_fullsized":"2023-11-24T06:13:29.801529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:22.494532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772865+0000","last_change":"2023-11-24T06:13:29.778072+0000","last_active":"2023-11-24T06:13:30.772865+0000","last_peered":"2023-11-24T06:13:30.772865+0000","last_clean":"2023-11-24T06:13:30.772865+0000","last_became_active":"2023-11-24T06:13:29.777760+0000","last_became_peered":"2023-11-24T06:13:29.777760+0000","last_unstale":"2023-11-24T06:13:30.772865+0000","last_undegraded":"2023-11-24T06:13:30.772865+0000","last_fullsized":"2023-11-24T06:13:30.772865+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:13.148760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.758741+0000","last_change":"2023-11-24T06:13:28.767615+0000","last_active":"2023-11-24T06:13:29.758741+0000","last_peered":"2023-11-24T06:13:29.758741+0000","last_clean":"2023-11-24T06:13:29.758741+0000","last_became_active":"2023-11-24T06:13:28.767229+0000","last_became_peered":"2023-11-24T06:13:28.767229+0000","last_unstale":"2023-11-24T06:13:29.758741+0000","last_undegraded":"2023-11-24T06:13:29.758741+0000","last_fullsized":"2023-11-24T06:13:29.758741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:08.022834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.771767+0000","last_change":"2023-11-24T06:13:29.779195+0000","last_active":"2023-11-24T06:13:30.771767+0000","last_peered":"2023-11-24T06:13:30.771767+0000","last_clean":"2023-11-24T06:13:30.771767+0000","last_became_active":"2023-11-24T06:13:29.778736+0000","last_became_peered":"2023-11-24T06:13:29.778736+0000","last_unstale":"2023-11-24T06:13:30.771767+0000","last_undegraded":"2023-11-24T06:13:30.771767+0000","last_fullsized":"2023-11-24T06:13:30.771767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:16:06.084384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.763275+0000","last_change":"2023-11-24T06:13:28.754862+0000","last_active":"2023-11-24T06:13:29.763275+0000","last_peered":"2023-11-24T06:13:29.763275+0000","last_clean":"2023-11-24T06:13:29.763275+0000","last_became_active":"2023-11-24T06:13:28.753829+0000","last_became_peered":"2023-11-24T06:13:28.753829+0000","last_unstale":"2023-11-24T06:13:29.763275+0000","last_undegraded":"2023-11-24T06:13:29.763275+0000","last_fullsized":"2023-11-24T06:13:29.763275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:16:05.071248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.775725+0000","last_change":"2023-11-24T06:13:29.779291+0000","last_active":"2023-11-24T06:13:30.775725+0000","last_peered":"2023-11-24T06:13:30.775725+0000","last_clean":"2023-11-24T06:13:30.775725+0000","last_became_active":"2023-11-24T06:13:29.778006+0000","last_became_peered":"2023-11-24T06:13:29.778006+0000","last_unstale":"2023-11-24T06:13:30.775725+0000","last_undegraded":"2023-11-24T06:13:30.775725+0000","last_fullsized":"2023-11-24T06:13:30.775725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:54:09.261477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.769131+0000","last_change":"2023-11-24T06:13:28.769932+0000","last_active":"2023-11-24T06:13:29.769131+0000","last_peered":"2023-11-24T06:13:29.769131+0000","last_clean":"2023-11-24T06:13:29.769131+0000","last_became_active":"2023-11-24T06:13:28.769659+0000","last_became_peered":"2023-11-24T06:13:28.769659+0000","last_unstale":"2023-11-24T06:13:29.769131+0000","last_undegraded":"2023-11-24T06:13:29.769131+0000","last_fullsized":"2023-11-24T06:13:29.769131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:25:59.543427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.772888+0000","last_change":"2023-11-24T06:13:29.786139+0000","last_active":"2023-11-24T06:13:30.772888+0000","last_peered":"2023-11-24T06:13:30.772888+0000","last_clean":"2023-11-24T06:13:30.772888+0000","last_became_active":"2023-11-24T06:13:29.785804+0000","last_became_peered":"2023-11-24T06:13:29.785804+0000","last_unstale":"2023-11-24T06:13:30.772888+0000","last_undegraded":"2023-11-24T06:13:30.772888+0000","last_fullsized":"2023-11-24T06:13:30.772888+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:27.818647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839146+0000","last_change":"2023-11-24T06:13:28.767862+0000","last_active":"2023-11-24T06:13:30.839146+0000","last_peered":"2023-11-24T06:13:30.839146+0000","last_clean":"2023-11-24T06:13:30.839146+0000","last_became_active":"2023-11-24T06:13:28.767053+0000","last_became_peered":"2023-11-24T06:13:28.767053+0000","last_unstale":"2023-11-24T06:13:30.839146+0000","last_undegraded":"2023-11-24T06:13:30.839146+0000","last_fullsized":"2023-11-24T06:13:30.839146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:32:21.177219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840183+0000","last_change":"2023-11-24T06:13:29.795476+0000","last_active":"2023-11-24T06:13:30.840183+0000","last_peered":"2023-11-24T06:13:30.840183+0000","last_clean":"2023-11-24T06:13:30.840183+0000","last_became_active":"2023-11-24T06:13:29.794810+0000","last_became_peered":"2023-11-24T06:13:29.794810+0000","last_unstale":"2023-11-24T06:13:30.840183+0000","last_undegraded":"2023-11-24T06:13:30.840183+0000","last_fullsized":"2023-11-24T06:13:30.840183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:27:18.831428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.766775+0000","last_change":"2023-11-24T06:13:28.754949+0000","last_active":"2023-11-24T06:13:29.766775+0000","last_peered":"2023-11-24T06:13:29.766775+0000","last_clean":"2023-11-24T06:13:29.766775+0000","last_became_active":"2023-11-24T06:13:28.754398+0000","last_became_peered":"2023-11-24T06:13:28.754398+0000","last_unstale":"2023-11-24T06:13:29.766775+0000","last_undegraded":"2023-11-24T06:13:29.766775+0000","last_fullsized":"2023-11-24T06:13:29.766775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:27.458246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839740+0000","last_change":"2023-11-24T06:13:29.787641+0000","last_active":"2023-11-24T06:13:30.839740+0000","last_peered":"2023-11-24T06:13:30.839740+0000","last_clean":"2023-11-24T06:13:30.839740+0000","last_became_active":"2023-11-24T06:13:29.787367+0000","last_became_peered":"2023-11-24T06:13:29.787367+0000","last_unstale":"2023-11-24T06:13:30.839740+0000","last_undegraded":"2023-11-24T06:13:30.839740+0000","last_fullsized":"2023-11-24T06:13:30.839740+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:07.310392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839049+0000","last_change":"2023-11-24T06:13:28.758217+0000","last_active":"2023-11-24T06:13:30.839049+0000","last_peered":"2023-11-24T06:13:30.839049+0000","last_clean":"2023-11-24T06:13:30.839049+0000","last_became_active":"2023-11-24T06:13:28.757597+0000","last_became_peered":"2023-11-24T06:13:28.757597+0000","last_unstale":"2023-11-24T06:13:30.839049+0000","last_undegraded":"2023-11-24T06:13:30.839049+0000","last_fullsized":"2023-11-24T06:13:30.839049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:27.514642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838453+0000","last_change":"2023-11-24T06:13:29.781920+0000","last_active":"2023-11-24T06:13:30.838453+0000","last_peered":"2023-11-24T06:13:30.838453+0000","last_clean":"2023-11-24T06:13:30.838453+0000","last_became_active":"2023-11-24T06:13:29.780119+0000","last_became_peered":"2023-11-24T06:13:29.780119+0000","last_unstale":"2023-11-24T06:13:30.838453+0000","last_undegraded":"2023-11-24T06:13:30.838453+0000","last_fullsized":"2023-11-24T06:13:30.838453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:17:23.507668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.767024+0000","last_change":"2023-11-24T06:13:28.760518+0000","last_active":"2023-11-24T06:13:29.767024+0000","last_peered":"2023-11-24T06:13:29.767024+0000","last_clean":"2023-11-24T06:13:29.767024+0000","last_became_active":"2023-11-24T06:13:28.760209+0000","last_became_peered":"2023-11-24T06:13:28.760209+0000","last_unstale":"2023-11-24T06:13:29.767024+0000","last_undegraded":"2023-11-24T06:13:29.767024+0000","last_fullsized":"2023-11-24T06:13:29.767024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:21:33.667347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.839179+0000","last_change":"2023-11-24T06:13:29.785610+0000","last_active":"2023-11-24T06:13:30.839179+0000","last_peered":"2023-11-24T06:13:30.839179+0000","last_clean":"2023-11-24T06:13:30.839179+0000","last_became_active":"2023-11-24T06:13:29.785299+0000","last_became_peered":"2023-11-24T06:13:29.785299+0000","last_unstale":"2023-11-24T06:13:30.839179+0000","last_undegraded":"2023-11-24T06:13:30.839179+0000","last_fullsized":"2023-11-24T06:13:30.839179+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:47.158151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.838557+0000","last_change":"2023-11-24T06:13:28.759524+0000","last_active":"2023-11-24T06:13:30.838557+0000","last_peered":"2023-11-24T06:13:30.838557+0000","last_clean":"2023-11-24T06:13:30.838557+0000","last_became_active":"2023-11-24T06:13:28.759227+0000","last_became_peered":"2023-11-24T06:13:28.759227+0000","last_unstale":"2023-11-24T06:13:30.838557+0000","last_undegraded":"2023-11-24T06:13:30.838557+0000","last_fullsized":"2023-11-24T06:13:30.838557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:42:37.504829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.840011+0000","last_change":"2023-11-24T06:13:29.783005+0000","last_active":"2023-11-24T06:13:30.840011+0000","last_peered":"2023-11-24T06:13:30.840011+0000","last_clean":"2023-11-24T06:13:30.840011+0000","last_became_active":"2023-11-24T06:13:29.780034+0000","last_became_peered":"2023-11-24T06:13:29.780034+0000","last_unstale":"2023-11-24T06:13:30.840011+0000","last_undegraded":"2023-11-24T06:13:30.840011+0000","last_fullsized":"2023-11-24T06:13:30.840011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:15.486899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.763654+0000","last_change":"2023-11-24T06:13:28.764120+0000","last_active":"2023-11-24T06:13:29.763654+0000","last_peered":"2023-11-24T06:13:29.763654+0000","last_clean":"2023-11-24T06:13:29.763654+0000","last_became_active":"2023-11-24T06:13:28.763763+0000","last_became_peered":"2023-11-24T06:13:28.763763+0000","last_unstale":"2023-11-24T06:13:29.763654+0000","last_undegraded":"2023-11-24T06:13:29.763654+0000","last_fullsized":"2023-11-24T06:13:29.763654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:55:27.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.774409+0000","last_change":"2023-11-24T06:13:29.782637+0000","last_active":"2023-11-24T06:13:30.774409+0000","last_peered":"2023-11-24T06:13:30.774409+0000","last_clean":"2023-11-24T06:13:30.774409+0000","last_became_active":"2023-11-24T06:13:29.782258+0000","last_became_peered":"2023-11-24T06:13:29.782258+0000","last_unstale":"2023-11-24T06:13:30.774409+0000","last_undegraded":"2023-11-24T06:13:30.774409+0000","last_fullsized":"2023-11-24T06:13:30.774409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:07.310392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.761884+0000","last_change":"2023-11-24T06:13:28.764852+0000","last_active":"2023-11-24T06:13:29.761884+0000","last_peered":"2023-11-24T06:13:29.761884+0000","last_clean":"2023-11-24T06:13:29.761884+0000","last_became_active":"2023-11-24T06:13:28.764555+0000","last_became_peered":"2023-11-24T06:13:28.764555+0000","last_unstale":"2023-11-24T06:13:29.761884+0000","last_undegraded":"2023-11-24T06:13:29.761884+0000","last_fullsized":"2023-11-24T06:13:29.761884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:49.172768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:13:30.776824+0000","last_change":"2023-11-24T06:13:29.783190+0000","last_active":"2023-11-24T06:13:30.776824+0000","last_peered":"2023-11-24T06:13:30.776824+0000","last_clean":"2023-11-24T06:13:30.776824+0000","last_became_active":"2023-11-24T06:13:29.782885+0000","last_became_peered":"2023-11-24T06:13:29.782885+0000","last_unstale":"2023-11-24T06:13:30.776824+0000","last_undegraded":"2023-11-24T06:13:30.776824+0000","last_fullsized":"2023-11-24T06:13:30.776824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.718571+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.718571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:58:21.814600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.760757+0000","last_change":"2023-11-24T06:13:28.768982+0000","last_active":"2023-11-24T06:13:29.760757+0000","last_peered":"2023-11-24T06:13:29.760757+0000","last_clean":"2023-11-24T06:13:29.760757+0000","last_became_active":"2023-11-24T06:13:28.768648+0000","last_became_peered":"2023-11-24T06:13:28.768648+0000","last_unstale":"2023-11-24T06:13:29.760757+0000","last_undegraded":"2023-11-24T06:13:29.760757+0000","last_fullsized":"2023-11-24T06:13:29.760757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:27.705434+0000","last_clean_scrub_stamp":"2023-11-24T06:13:27.705434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:23.127277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:13:29.770321+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:13:29.770321+0000","last_peered":"2023-11-24T06:13:29.770321+0000","last_clean":"2023-11-24T06:13:29.770321+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:13:29.770321+0000","last_undegraded":"2023-11-24T06:13:29.770321+0000","last_fullsized":"2023-11-24T06:13:29.770321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476760,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":157795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.3640000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.3300000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.0529999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.88},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.121}]},{"osd":6,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.53}]},{"osd":7,"last update":"Fri Nov 24 06:12:54 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.778,"5min":2.778,"15min":2.778},"last":1.298},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":4.7779999999999996,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.5800000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":747581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.353},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.3979999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.708}]},{"osd":2,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.474}]},{"osd":3,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.6359999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.244},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.7370000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.8100000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:12:49 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.534},{"interface":"front","average":{"1min":1.73,"5min":1.73,"15min":1.73},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.8660000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":157739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.306}]},{"osd":1,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7949999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.3560000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.234}]},{"osd":5,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.587,"15min":1.587},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.673,"5min":1.673,"15min":1.673},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.179}]},{"osd":7,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.669,"5min":2.669,"15min":2.669},"last":1.446}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":157227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.296}]},{"osd":1,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.573},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.4279999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5409999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.8400000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.7130000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.6519999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.738,"5min":1.738,"15min":1.738},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.7669999999999999,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.891}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":158757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.495},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.399,"5min":2.399,"15min":2.399},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.88200000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0629999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:12:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.0109999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":405504,"data_stored":157193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.0680000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.2440000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.234},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.98699999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":3.3399999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.5169999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.1020000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":3.7349999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.6479999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:12:53 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.1599999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":4.101,"5min":4.101,"15min":4.101},"last":1.462}]},{"osd":7,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.7869999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.395},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.6040000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":747491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.92500000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.167},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":0.77100000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.766,"5min":3.766,"15min":3.766},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.96599999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.7010000000000001,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.528}]},{"osd":7,"last update":"Fri Nov 24 06:12:48 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.383},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.4870000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":158757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.274}]},{"osd":2,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.022},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.1819999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.339},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4770000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.794},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.429}]},{"osd":5,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.5579999999999998,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.7589999999999999},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.7430000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6869999999999998,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.653},{"interface":"front","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":2.1259999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":3.1200000000000001,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.393},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":2.2130000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:13:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:13:36.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:13:37.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.081+0000 7fb2d9f0f640 1 Processor -- start 2023-11-24T06:13:37.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.082+0000 7fb2d9f0f640 1 -- start start 2023-11-24T06:13:37.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.083+0000 7fb2d9f0f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cd440 0x7fb2d4071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.083+0000 7fb2d9f0f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb2d406ab50 0x7fb2d40af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.083+0000 7fb2d9f0f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d40cfe50 con 0x7fb2d40cc920 2023-11-24T06:13:37.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.083+0000 7fb2d9f0f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40723c0 con 0x7fb2d406ab50 2023-11-24T06:13:37.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.083+0000 7fb2d9f0f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40ccd60 con 0x7fb2d40cd440 2023-11-24T06:13:37.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.084+0000 7fb2d3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb2d406ab50 0x7fb2d40af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.084+0000 7fb2d37fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cd440 0x7fb2d4071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.084+0000 7fb2d2ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb2d40cc920 0x7fb2d406a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:53974/0 (socket says 172.21.15.22:53974) 2023-11-24T06:13:37.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.084+0000 7fb2d2ffd640 1 -- 172.21.15.22:0/4134793709 learned_addr learned my addr 172.21.15.22:0/4134793709 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:37.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.084+0000 7fb2d3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb2d406ab50 0x7fb2d40af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:42858/0 (socket says 172.21.15.22:42858) 2023-11-24T06:13:37.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.085+0000 7fb2d3fff640 1 -- 172.21.15.22:0/4134793709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cd440 msgr2=0x7fb2d4071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:37.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.085+0000 7fb2d3fff640 1 --2- 172.21.15.22:0/4134793709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cd440 0x7fb2d4071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.085+0000 7fb2d3fff640 1 -- 172.21.15.22:0/4134793709 >> v1:172.21.15.31:6789/0 conn(0x7fb2d40cc920 legacy=0x7fb2d406a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.085+0000 7fb2d3fff640 1 -- 172.21.15.22:0/4134793709 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40cf260 con 0x7fb2d406ab50 2023-11-24T06:13:37.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.086+0000 7fb2d3fff640 1 --2- 172.21.15.22:0/4134793709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2d406ab50 0x7fb2d40af1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009d90 tx=0x7fb2cc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90ee6864e4583c67 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.087+0000 7fb2d27fc640 1 -- 172.21.15.22:0/4134793709 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc02cc50 con 0x7fb2d406ab50 2023-11-24T06:13:37.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.087+0000 7fb2d27fc640 1 -- 172.21.15.22:0/4134793709 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc02cdb0 con 0x7fb2d406ab50 2023-11-24T06:13:37.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.087+0000 7fb2d27fc640 1 -- 172.21.15.22:0/4134793709 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc034660 con 0x7fb2d406ab50 2023-11-24T06:13:37.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.088+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/4134793709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2d406ab50 msgr2=0x7fb2d40af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.088+0000 7fb2d9f0f640 1 --2- 172.21.15.22:0/4134793709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2d406ab50 0x7fb2d40af1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009d90 tx=0x7fb2cc02bea0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.088+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/4134793709 shutdown_connections 2023-11-24T06:13:37.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.088+0000 7fb2d9f0f640 1 --2- 172.21.15.22:0/4134793709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2d406ab50 0x7fb2d40af1a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.088+0000 7fb2d9f0f640 1 --2- 172.21.15.22:0/4134793709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cd440 0x7fb2d4071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.088+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/4134793709 >> 172.21.15.22:0/4134793709 conn(0x7fb2d40b1c90 msgr2=0x7fb2d40b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:37.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.088+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/4134793709 shutdown_connections 2023-11-24T06:13:37.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.088+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/4134793709 wait complete. 2023-11-24T06:13:37.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.090+0000 7fb2d9f0f640 1 Processor -- start 2023-11-24T06:13:37.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.090+0000 7fb2d9f0f640 1 -- start start 2023-11-24T06:13:37.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.091+0000 7fb2d9f0f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d406ab50 0x7fb2d40b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.091+0000 7fb2d9f0f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cc920 0x7fb2d40c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.091+0000 7fb2d9f0f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2d40cd440 0x7fb2d40c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.091+0000 7fb2d9f0f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40c5790 con 0x7fb2d406ab50 2023-11-24T06:13:37.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.091+0000 7fb2d9f0f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40c5300 con 0x7fb2d40cd440 2023-11-24T06:13:37.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.091+0000 7fb2d9f0f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40c46f0 con 0x7fb2d40cc920 2023-11-24T06:13:37.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.091+0000 7fb2d37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d406ab50 0x7fb2d40b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.091+0000 7fb2d37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d406ab50 0x7fb2d40b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60126/0 (socket says 172.21.15.22:60126) 2023-11-24T06:13:37.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.091+0000 7fb2d37fe640 1 -- 172.21.15.22:0/879833086 learned_addr learned my addr 172.21.15.22:0/879833086 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:37.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2d3fff640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2d40cd440 0x7fb2d40c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2d2ffd640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cc920 0x7fb2d40c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2d37fe640 1 -- 172.21.15.22:0/879833086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cc920 msgr2=0x7fb2d40c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2d37fe640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cc920 0x7fb2d40c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2d37fe640 1 -- 172.21.15.22:0/879833086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2d40cd440 msgr2=0x7fb2d40c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2d37fe640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2d40cd440 0x7fb2d40c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2d37fe640 1 -- 172.21.15.22:0/879833086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc009a70 con 0x7fb2d406ab50 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2d37fe640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d406ab50 0x7fb2d40b4ae0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00e9e0 tx=0x7fb2bc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2cbfff640 1 -- 172.21.15.22:0/879833086 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc009670 con 0x7fb2d406ab50 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2cbfff640 1 -- 172.21.15.22:0/879833086 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc00c9d0 con 0x7fb2d406ab50 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d40c49d0 con 0x7fb2d406ab50 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.092+0000 7fb2cbfff640 1 -- 172.21.15.22:0/879833086 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00cd80 con 0x7fb2d406ab50 2023-11-24T06:13:37.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.093+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d40c4f90 con 0x7fb2d406ab50 2023-11-24T06:13:37.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.094+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d40cc320 con 0x7fb2d406ab50 2023-11-24T06:13:37.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.095+0000 7fb2cbfff640 1 -- 172.21.15.22:0/879833086 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2bc013470 con 0x7fb2d406ab50 2023-11-24T06:13:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.096+0000 7fb2cbfff640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb2b406ae40 0x7fb2b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.096+0000 7fb2cbfff640 1 -- 172.21.15.22:0/879833086 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2bc0898b0 con 0x7fb2d406ab50 2023-11-24T06:13:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.096+0000 7fb2d2ffd640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb2b406ae40 0x7fb2b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.096+0000 7fb2d2ffd640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb2b406ae40 0x7fb2b406d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40cb220 tx=0x7fb2c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.100+0000 7fb2cbfff640 1 -- 172.21.15.22:0/879833086 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2bc0548d0 con 0x7fb2d406ab50 2023-11-24T06:13:37.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.360+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb2d4067960 con 0x7fb2d406ab50 2023-11-24T06:13:37.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.364+0000 7fb2cbfff640 1 -- 172.21.15.22:0/879833086 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb2bc057ef0 con 0x7fb2d406ab50 2023-11-24T06:13:37.368 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2023-11-24T06:13:37.368 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBvPmBlp6jYJxAA527jQJV49tBf9Am4wak0NA== 2023-11-24T06:13:37.368 INFO:teuthology.orchestra.run.smithi022.stdout: caps mds = "allow" 2023-11-24T06:13:37.368 INFO:teuthology.orchestra.run.smithi022.stdout: caps mon = "allow r" 2023-11-24T06:13:37.368 INFO:teuthology.orchestra.run.smithi022.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:13:37.368 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb2b406ae40 msgr2=0x7fb2b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb2b406ae40 0x7fb2b406d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40cb220 tx=0x7fb2c4009040 comp rx=0 tx=0).stop 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d406ab50 msgr2=0x7fb2d40b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d406ab50 0x7fb2d40b4ae0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00e9e0 tx=0x7fb2bc00eea0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 shutdown_connections 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb2b406ae40 0x7fb2b406d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2d40cd440 0x7fb2d40c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2d40cc920 0x7fb2d40c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 --2- 172.21.15.22:0/879833086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d406ab50 0x7fb2d40b4ae0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 >> 172.21.15.22:0/879833086 conn(0x7fb2d40b1c90 msgr2=0x7fb2d40d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:37.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 shutdown_connections 2023-11-24T06:13:37.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.367+0000 7fb2d9f0f640 1 -- 172.21.15.22:0/879833086 wait complete. 2023-11-24T06:13:37.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.599+0000 7fa49e747640 1 Processor -- start 2023-11-24T06:13:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.600+0000 7fa49e747640 1 -- start start 2023-11-24T06:13:37.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.601+0000 7fa49e747640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4980d14a0 0x7fa4980d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.601+0000 7fa49e747640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980b0640 0x7fa4980b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.601+0000 7fa49e747640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4980cf0c0 con 0x7fa49815d5b0 2023-11-24T06:13:37.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.601+0000 7fa49e747640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4980b01b0 con 0x7fa4980d14a0 2023-11-24T06:13:37.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.601+0000 7fa49e747640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49815d990 con 0x7fa4980b0640 2023-11-24T06:13:37.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.602+0000 7fa49cf44640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4980d14a0 0x7fa4980d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.602+0000 7fa49cf44640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4980d14a0 0x7fa4980d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60140/0 (socket says 172.21.15.22:60140) 2023-11-24T06:13:37.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.602+0000 7fa49cf44640 1 -- 172.21.15.22:0/1782181544 learned_addr learned my addr 172.21.15.22:0/1782181544 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:37.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.602+0000 7fa49df46640 1 --2- 172.21.15.22:0/1782181544 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980b0640 0x7fa4980b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.602+0000 7fa49cf44640 1 -- 172.21.15.22:0/1782181544 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980b0640 msgr2=0x7fa4980b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.602+0000 7fa49cf44640 1 --2- 172.21.15.22:0/1782181544 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980b0640 0x7fa4980b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.602+0000 7fa49cf44640 1 -- 172.21.15.22:0/1782181544 >> v1:172.21.15.22:6789/0 conn(0x7fa49815d5b0 legacy=0x7fa4980d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.602+0000 7fa49cf44640 1 -- 172.21.15.22:0/1782181544 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4980d1e40 con 0x7fa4980d14a0 2023-11-24T06:13:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.604+0000 7fa49cf44640 1 --2- 172.21.15.22:0/1782181544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980d14a0 0x7fa4980d1900 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa494009870 tx=0x7fa49402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adebab615ed52e46 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.604+0000 7fa48ffff640 1 -- 172.21.15.22:0/1782181544 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494030840 con 0x7fa4980d14a0 2023-11-24T06:13:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.604+0000 7fa48ffff640 1 -- 172.21.15.22:0/1782181544 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4940309a0 con 0x7fa4980d14a0 2023-11-24T06:13:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.604+0000 7fa48ffff640 1 -- 172.21.15.22:0/1782181544 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494030d30 con 0x7fa4980d14a0 2023-11-24T06:13:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.604+0000 7fa49e747640 1 -- 172.21.15.22:0/1782181544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980d14a0 msgr2=0x7fa4980d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.604+0000 7fa49e747640 1 --2- 172.21.15.22:0/1782181544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980d14a0 0x7fa4980d1900 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa494009870 tx=0x7fa49402b980 comp rx=0 tx=0).stop 2023-11-24T06:13:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.605+0000 7fa49e747640 1 -- 172.21.15.22:0/1782181544 shutdown_connections 2023-11-24T06:13:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.605+0000 7fa49e747640 1 --2- 172.21.15.22:0/1782181544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980d14a0 0x7fa4980d1900 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.605+0000 7fa49e747640 1 --2- 172.21.15.22:0/1782181544 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980b0640 0x7fa4980b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.605+0000 7fa49e747640 1 -- 172.21.15.22:0/1782181544 >> 172.21.15.22:0/1782181544 conn(0x7fa49809c3b0 msgr2=0x7fa4980d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.605+0000 7fa49e747640 1 -- 172.21.15.22:0/1782181544 shutdown_connections 2023-11-24T06:13:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.605+0000 7fa49e747640 1 -- 172.21.15.22:0/1782181544 wait complete. 2023-11-24T06:13:37.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.606+0000 7fa49e747640 1 Processor -- start 2023-11-24T06:13:37.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.607+0000 7fa49e747640 1 -- start start 2023-11-24T06:13:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49e747640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980b0640 0x7fa4980ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49e747640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980d14a0 0x7fa498151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49e747640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49815d5b0 0x7fa49815ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49e747640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980cb480 con 0x7fa4980b0640 2023-11-24T06:13:37.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49e747640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980c9720 con 0x7fa49815d5b0 2023-11-24T06:13:37.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49e747640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980cab50 con 0x7fa4980d14a0 2023-11-24T06:13:37.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49d745640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980b0640 0x7fa4980ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49d745640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980b0640 0x7fa4980ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60142/0 (socket says 172.21.15.22:60142) 2023-11-24T06:13:37.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49d745640 1 -- 172.21.15.22:0/2642542742 learned_addr learned my addr 172.21.15.22:0/2642542742 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:37.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49df46640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49815d5b0 0x7fa49815ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49cf44640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980d14a0 0x7fa498151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49d745640 1 -- 172.21.15.22:0/2642542742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980d14a0 msgr2=0x7fa498151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49d745640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980d14a0 0x7fa498151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49d745640 1 -- 172.21.15.22:0/2642542742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49815d5b0 msgr2=0x7fa49815ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49d745640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49815d5b0 0x7fa49815ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49d745640 1 -- 172.21.15.22:0/2642542742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4940094d0 con 0x7fa4980b0640 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.608+0000 7fa49df46640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49815d5b0 0x7fa49815ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.609+0000 7fa49d745640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980b0640 0x7fa4980ccb10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c450 tx=0x7fa48800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.609+0000 7fa48dffb640 1 -- 172.21.15.22:0/2642542742 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4880052d0 con 0x7fa4980b0640 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.609+0000 7fa48dffb640 1 -- 172.21.15.22:0/2642542742 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa488005430 con 0x7fa4980b0640 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.609+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4980cae30 con 0x7fa4980b0640 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.609+0000 7fa48dffb640 1 -- 172.21.15.22:0/2642542742 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488012870 con 0x7fa4980b0640 2023-11-24T06:13:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.609+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4981521a0 con 0x7fa4980b0640 2023-11-24T06:13:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.610+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49804e840 con 0x7fa4980b0640 2023-11-24T06:13:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.611+0000 7fa48dffb640 1 -- 172.21.15.22:0/2642542742 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4880129d0 con 0x7fa4980b0640 2023-11-24T06:13:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.612+0000 7fa48dffb640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa48406ae70 0x7fa48406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.612+0000 7fa48dffb640 1 -- 172.21.15.22:0/2642542742 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa488089120 con 0x7fa4980b0640 2023-11-24T06:13:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.613+0000 7fa49cf44640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa48406ae70 0x7fa48406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.613+0000 7fa49cf44640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa48406ae70 0x7fa48406d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa494036000 tx=0x7fa49403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.617+0000 7fa48dffb640 1 -- 172.21.15.22:0/2642542742 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4880541c0 con 0x7fa4980b0640 2023-11-24T06:13:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.857+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4980678d0 con 0x7fa4980b0640 2023-11-24T06:13:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.858+0000 7fa48dffb640 1 -- 172.21.15.22:0/2642542742 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fa4880577e0 con 0x7fa4980b0640 2023-11-24T06:13:37.862 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:37.862 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3821411702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3821411702},{"type":"v1","addr":"172.21.15.31:6835","nonce":3821411702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3025908035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3025908035},{"type":"v1","addr":"172.21.15.31:6833","nonce":3025908035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/475244267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":475244267},{"type":"v1","addr":"172.21.15.22:6835","nonce":475244267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:29.209497+0000","modified":"2023-11-24T06:13:34.306159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6837/1515634482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1515634482},{"type":"v1","addr":"172.21.15.22:6837","nonce":1515634482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:13:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 15 2023-11-24T06:13:37.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa48406ae70 msgr2=0x7fa48406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa48406ae70 0x7fa48406d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa494036000 tx=0x7fa49403b040 comp rx=0 tx=0).stop 2023-11-24T06:13:37.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980b0640 msgr2=0x7fa4980ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980b0640 0x7fa4980ccb10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c450 tx=0x7fa48800c910 comp rx=0 tx=0).stop 2023-11-24T06:13:37.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 shutdown_connections 2023-11-24T06:13:37.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa48406ae70 0x7fa48406d330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49815d5b0 0x7fa49815ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4980d14a0 0x7fa498151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 --2- 172.21.15.22:0/2642542742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4980b0640 0x7fa4980ccb10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.861+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 >> 172.21.15.22:0/2642542742 conn(0x7fa49809c3b0 msgr2=0x7fa4980d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.862+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 shutdown_connections 2023-11-24T06:13:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:37.862+0000 7fa49e747640 1 -- 172.21.15.22:0/2642542742 wait complete. 2023-11-24T06:13:38.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:13:29.209497+0000', 'modified': '2023-11-24T06:13:34.306159+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5280}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5280': {'gid': 5280, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6837/1515634482', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6836', 'nonce': 1515634482}, {'type': 'v1', 'addr': '172.21.15.22:6837', 'nonce': 1515634482}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:13:38.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:13:38.287 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-24T06:13:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.518+0000 7f06fedfa640 1 Processor -- start 2023-11-24T06:13:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.519+0000 7f06fedfa640 1 -- start start 2023-11-24T06:13:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.520+0000 7f06fedfa640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06f80cf710 0x7f06f80cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.520+0000 7f06fedfa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80d1670 0x7f06f80d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.520+0000 7f06fedfa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f80d04b0 con 0x7f06f815d5d0 2023-11-24T06:13:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.520+0000 7f06fedfa640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80ce4e0 con 0x7f06f80cf710 2023-11-24T06:13:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.520+0000 7f06fedfa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80cf010 con 0x7f06f80d1670 2023-11-24T06:13:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.521+0000 7f06fd5f7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06f80cf710 0x7f06f80cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.521+0000 7f06fd5f7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06f80cf710 0x7f06f80cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60154/0 (socket says 172.21.15.22:60154) 2023-11-24T06:13:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.521+0000 7f06fd5f7640 1 -- 172.21.15.22:0/923099977 learned_addr learned my addr 172.21.15.22:0/923099977 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.521+0000 7f06fe5f9640 1 --2- 172.21.15.22:0/923099977 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80d1670 0x7f06f80d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.521+0000 7f06fd5f7640 1 -- 172.21.15.22:0/923099977 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80d1670 msgr2=0x7f06f80d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.521+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/923099977 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80d1670 0x7f06f80d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.521+0000 7f06fd5f7640 1 -- 172.21.15.22:0/923099977 >> v1:172.21.15.31:6789/0 conn(0x7f06f815d5d0 legacy=0x7f06f80ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.521+0000 7f06fd5f7640 1 -- 172.21.15.22:0/923099977 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80cdb80 con 0x7f06f80cf710 2023-11-24T06:13:38.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.523+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/923099977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80cf710 0x7f06f80cfb70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009870 tx=0x7f06e802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb59cb1bfae7cda4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.523+0000 7f06fcdf6640 1 -- 172.21.15.22:0/923099977 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e80317c0 con 0x7f06f80cf710 2023-11-24T06:13:38.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.523+0000 7f06fcdf6640 1 -- 172.21.15.22:0/923099977 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e8031920 con 0x7f06f80cf710 2023-11-24T06:13:38.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.523+0000 7f06fcdf6640 1 -- 172.21.15.22:0/923099977 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8031cb0 con 0x7f06f80cf710 2023-11-24T06:13:38.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.524+0000 7f06fedfa640 1 -- 172.21.15.22:0/923099977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80cf710 msgr2=0x7f06f80cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.524+0000 7f06fedfa640 1 --2- 172.21.15.22:0/923099977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80cf710 0x7f06f80cfb70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009870 tx=0x7f06e802b860 comp rx=0 tx=0).stop 2023-11-24T06:13:38.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.524+0000 7f06fedfa640 1 -- 172.21.15.22:0/923099977 shutdown_connections 2023-11-24T06:13:38.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.524+0000 7f06fedfa640 1 --2- 172.21.15.22:0/923099977 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80d1670 0x7f06f80d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.524+0000 7f06fedfa640 1 --2- 172.21.15.22:0/923099977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80cf710 0x7f06f80cfb70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.524+0000 7f06fedfa640 1 -- 172.21.15.22:0/923099977 >> 172.21.15.22:0/923099977 conn(0x7f06f809c3d0 msgr2=0x7f06f80d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.524+0000 7f06fedfa640 1 -- 172.21.15.22:0/923099977 shutdown_connections 2023-11-24T06:13:38.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.524+0000 7f06fedfa640 1 -- 172.21.15.22:0/923099977 wait complete. 2023-11-24T06:13:38.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.526+0000 7f06fedfa640 1 Processor -- start 2023-11-24T06:13:38.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.526+0000 7f06fedfa640 1 -- start start 2023-11-24T06:13:38.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fedfa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80cf710 0x7f06f80b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fedfa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80d1670 0x7f06f80b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fedfa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f815d5d0 0x7f06f815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fedfa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f81f6790 con 0x7f06f80d1670 2023-11-24T06:13:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fedfa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f81f69e0 con 0x7f06f815d5d0 2023-11-24T06:13:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fedfa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f81f6cc0 con 0x7f06f80cf710 2023-11-24T06:13:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fd5f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80d1670 0x7f06f80b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fd5f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80d1670 0x7f06f80b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60166/0 (socket says 172.21.15.22:60166) 2023-11-24T06:13:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fd5f7640 1 -- 172.21.15.22:0/2588218012 learned_addr learned my addr 172.21.15.22:0/2588218012 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:38.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fddf8640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80cf710 0x7f06f80b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fe5f9640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f815d5d0 0x7f06f815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fd5f7640 1 -- 172.21.15.22:0/2588218012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80cf710 msgr2=0x7f06f80b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.527+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80cf710 0x7f06f80b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.528+0000 7f06fd5f7640 1 -- 172.21.15.22:0/2588218012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f815d5d0 msgr2=0x7f06f815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.528+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f815d5d0 0x7f06f815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.528+0000 7f06fd5f7640 1 -- 172.21.15.22:0/2588218012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e80094d0 con 0x7f06f80d1670 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.528+0000 7f06fddf8640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80cf710 0x7f06f80b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.528+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80d1670 0x7f06f80b1400 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f06e80090b0 tx=0x7f06e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.528+0000 7f06ee7fc640 1 -- 172.21.15.22:0/2588218012 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8032860 con 0x7f06f80d1670 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.528+0000 7f06ee7fc640 1 -- 172.21.15.22:0/2588218012 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e80329e0 con 0x7f06f80d1670 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.528+0000 7f06ee7fc640 1 -- 172.21.15.22:0/2588218012 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8032d90 con 0x7f06f80d1670 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.528+0000 7f06fedfa640 1 -- 172.21.15.22:0/2588218012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f81f6fa0 con 0x7f06f80d1670 2023-11-24T06:13:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.529+0000 7f06fedfa640 1 -- 172.21.15.22:0/2588218012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f815df60 con 0x7f06f80d1670 2023-11-24T06:13:38.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.531+0000 7f06ee7fc640 1 -- 172.21.15.22:0/2588218012 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06e804d3f0 con 0x7f06f80d1670 2023-11-24T06:13:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.531+0000 7f06ee7fc640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f06dc06ae40 0x7f06dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.532+0000 7f06ee7fc640 1 -- 172.21.15.22:0/2588218012 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06e80ab400 con 0x7f06f80d1670 2023-11-24T06:13:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.532+0000 7f06fddf8640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f06dc06ae40 0x7f06dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.532+0000 7f0702bf9740 1 Processor -- start 2023-11-24T06:13:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.532+0000 7f06fddf8640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f06dc06ae40 0x7f06dc06d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f06f4003eb0 tx=0x7f06f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.533+0000 7f0702bf9740 1 -- start start 2023-11-24T06:13:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.533+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea19f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.533+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea19e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.533+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 0x5581ea1e2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.533+0000 7f0702bf9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea0fd880 con 0x5581ea19f070 2023-11-24T06:13:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.533+0000 7f0702bf9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea10cae0 con 0x5581ea199d70 2023-11-24T06:13:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.533+0000 7f0702bf9740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581ea10a1d0 con 0x5581ea19e7b0 2023-11-24T06:13:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fddf8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fddf8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea19f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60170/0 (socket says 172.21.15.22:60170) 2023-11-24T06:13:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fddf8640 1 -- 172.21.15.22:0/1932648780 learned_addr learned my addr 172.21.15.22:0/1932648780 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/1932648780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fe5f9640 1 --2- 172.21.15.22:0/1932648780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 0x5581ea1e2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fddf8640 1 -- 172.21.15.22:0/1932648780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 msgr2=0x5581ea1e2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fddf8640 1 --2- 172.21.15.22:0/1932648780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 0x5581ea1e2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fddf8640 1 -- 172.21.15.22:0/1932648780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 msgr2=0x5581ea19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fddf8640 1 --2- 172.21.15.22:0/1932648780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea19e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.534+0000 7f06fddf8640 1 -- 172.21.15.22:0/1932648780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581ea0cd860 con 0x5581ea19f070 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.535+0000 7f06fddf8640 1 --2- 172.21.15.22:0/1932648780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea19f450 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f06f400da90 tx=0x7f06f4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8962a7f4b27902a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.535+0000 7f06db7fe640 1 -- 172.21.15.22:0/1932648780 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4014db0 con 0x5581ea19f070 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.535+0000 7f06db7fe640 1 -- 172.21.15.22:0/1932648780 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f401f400 con 0x5581ea19f070 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.535+0000 7f06db7fe640 1 -- 172.21.15.22:0/1932648780 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f401f7b0 con 0x5581ea19f070 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.536+0000 7f0702bf9740 1 -- 172.21.15.22:0/1932648780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 msgr2=0x5581ea19f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.536+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1932648780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea19f450 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f06f400da90 tx=0x7f06f4010000 comp rx=0 tx=0).stop 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.536+0000 7f0702bf9740 1 -- 172.21.15.22:0/1932648780 shutdown_connections 2023-11-24T06:13:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.536+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1932648780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 0x5581ea1e2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.536+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1932648780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.536+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1932648780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea19f450 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.536+0000 7f0702bf9740 1 -- 172.21.15.22:0/1932648780 >> 172.21.15.22:0/1932648780 conn(0x5581ea160c70 msgr2=0x5581ea1e4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.536+0000 7f0702bf9740 1 -- 172.21.15.22:0/1932648780 shutdown_connections 2023-11-24T06:13:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.536+0000 7f0702bf9740 1 -- 172.21.15.22:0/1932648780 wait complete. 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.537+0000 7f0702bf9740 1 -- start start 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.537+0000 7f0702bf9740 1 Processor -- start 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea199d70 0x5581ea1dd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea19e7b0 0x5581ea1de150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1e0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f0702bf9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea105ac0 con 0x5581ea19f070 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f0702bf9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea0a22f0 con 0x5581ea19e7b0 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f0702bf9740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581ea0bfc70 con 0x5581ea199d70 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f0702bf9740 10 client.0 _ll_register_callbacks cb 0x5581ea0c43b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f06fe5f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f06fe5f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1e0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60174/0 (socket says 172.21.15.22:60174) 2023-11-24T06:13:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.538+0000 7f06fe5f9640 1 -- 172.21.15.22:0/1171848913 learned_addr learned my addr 172.21.15.22:0/1171848913 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06fddf8640 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea199d70 0x5581ea1dd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea19e7b0 0x5581ea1de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06fe5f9640 1 -- 172.21.15.22:0/1171848913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea199d70 msgr2=0x5581ea1dd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06fe5f9640 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea199d70 0x5581ea1dd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06fe5f9640 1 -- 172.21.15.22:0/1171848913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea19e7b0 msgr2=0x5581ea1de150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06fe5f9640 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea19e7b0 0x5581ea1de150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06fe5f9640 1 -- 172.21.15.22:0/1171848913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f400d7d0 con 0x5581ea19f070 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea19e7b0 0x5581ea1de150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06fe5f9640 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1e0090 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f06f00079d0 tx=0x7f06f0007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819e1a415f252a49 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06d8ff9640 1 -- 172.21.15.22:0/1171848913 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0010a10 con 0x5581ea19f070 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f06d8ff9640 1 -- 172.21.15.22:0/1171848913 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06f0010b70 con 0x5581ea19f070 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.539+0000 7f0702bf9740 1 -- 172.21.15.22:0/1171848913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581ea0feaa0 con 0x5581ea19f070 2023-11-24T06:13:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f06d8ff9640 1 -- 172.21.15.22:0/1171848913 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06f0010d30 con 0x5581ea19f070 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f0702bf9740 10 client.5457 fetch_fsmap learned FSMap version 15 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f0702bf9740 1 -- 172.21.15.22:0/1171848913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5581ea104140 con 0x5581ea19f070 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f06d8ff9640 1 -- 172.21.15.22:0/1171848913 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5581ea0feaa0 con 0x5581ea19f070 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f06d8ff9640 1 -- 172.21.15.22:0/1171848913 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f06f0017430 con 0x5581ea19f070 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f0702bf9740 10 client.5457 fetch_fsmap finished waiting for FSMap version 15 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f0702bf9740 10 client.5457 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f0702bf9740 20 client.5457 populate_metadata read hostname 'smithi022' 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] conn(0x5581ea1e0aa0 0x5581ea2020d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f0702bf9740 4 client.5457 mds_command: new command op to 5280 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:13:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.540+0000 7f0702bf9740 1 -- 172.21.15.22:0/1171848913 --> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581ea0fe7c0 con 0x5581ea1e0aa0 2023-11-24T06:13:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.541+0000 7f06fddf8640 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] conn(0x5581ea1e0aa0 0x5581ea2020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.541+0000 7f06fddf8640 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] conn(0x5581ea1e0aa0 0x5581ea2020d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f79223bcd88bdbb7 server_cookie=7b504a99bb642540 in_seq=0 out_seq=0 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.541+0000 7f06d8ff9640 10 client.5457 ms_handle_connect on v2:172.21.15.22:6836/1515634482 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f06d8ff9640 1 -- 172.21.15.22:0/1171848913 <== mds.0 v2:172.21.15.22:6836/1515634482 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5581ea0fe7c0 con 0x5581ea1e0aa0 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f06d8ff9640 10 client.5457 handle_command_reply: tid=0 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 client.5457 shutdown 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 -- 172.21.15.22:0/1171848913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 msgr2=0x5581ea1e0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1e0090 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f06f00079d0 tx=0x7f06f0007e90 comp rx=0 tx=0).stop 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 -- 172.21.15.22:0/1171848913 shutdown_connections 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] conn(0x5581ea1e0aa0 0x5581ea2020d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1e0090 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea19e7b0 0x5581ea1de150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 --2- 172.21.15.22:0/1171848913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea199d70 0x5581ea1dd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f06d8ff9640 0 client.5457 ms_handle_reset on v2:172.21.15.22:6836/1515634482 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 -- 172.21.15.22:0/1171848913 >> 172.21.15.22:0/1171848913 conn(0x5581ea160c70 msgr2=0x5581ea198dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.542+0000 7f0702bf9740 1 -- 172.21.15.22:0/1171848913 shutdown_connections 2023-11-24T06:13:38.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.543+0000 7f0702bf9740 1 -- 172.21.15.22:0/1171848913 wait complete. 2023-11-24T06:13:38.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.543+0000 7f0702bf9740 20 client.5457 trim_cache size 0 max 16384 2023-11-24T06:13:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.560+0000 7f0702bf9740 1 Processor -- start 2023-11-24T06:13:38.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.560+0000 7f0702bf9740 1 -- start start 2023-11-24T06:13:38.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea1db570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19e7b0 0x5581ea1a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19f070 0x5581ea1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f0702bf9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581e9e68f20 con 0x5581ea19e7b0 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f0702bf9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea1e02c0 con 0x5581ea199d70 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f0702bf9740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581ea19e5f0 con 0x5581ea19f070 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f06fd5f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19e7b0 0x5581ea1a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f06fd5f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19e7b0 0x5581ea1a00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60190/0 (socket says 172.21.15.22:60190) 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f06fd5f7640 1 -- 172.21.15.22:0/2442085408 learned_addr learned my addr 172.21.15.22:0/2442085408 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f06fd5f7640 1 -- 172.21.15.22:0/2442085408 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19f070 msgr2=0x5581ea1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/2442085408 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19f070 0x5581ea1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f06fddf8640 1 --2- 172.21.15.22:0/2442085408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea1db570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.561+0000 7f06fd5f7640 1 -- 172.21.15.22:0/2442085408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 msgr2=0x5581ea1db570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.562+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/2442085408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea1db570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.562+0000 7f06fd5f7640 1 -- 172.21.15.22:0/2442085408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581ea0a1b80 con 0x5581ea19e7b0 2023-11-24T06:13:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.562+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/2442085408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19e7b0 0x5581ea1a00a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f06e80765d0 tx=0x7f06e8079f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f6ba8498c5ef1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.562+0000 7f06dbfff640 1 -- 172.21.15.22:0/2442085408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e807a0d0 con 0x5581ea19e7b0 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.562+0000 7f06dbfff640 1 -- 172.21.15.22:0/2442085408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e807e220 con 0x5581ea19e7b0 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.562+0000 7f06dbfff640 1 -- 172.21.15.22:0/2442085408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e80823d0 con 0x5581ea19e7b0 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 -- 172.21.15.22:0/2442085408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19e7b0 msgr2=0x5581ea1a00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 --2- 172.21.15.22:0/2442085408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19e7b0 0x5581ea1a00a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f06e80765d0 tx=0x7f06e8079f60 comp rx=0 tx=0).stop 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 -- 172.21.15.22:0/2442085408 shutdown_connections 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 --2- 172.21.15.22:0/2442085408 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19f070 0x5581ea1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 --2- 172.21.15.22:0/2442085408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19e7b0 0x5581ea1a00a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 --2- 172.21.15.22:0/2442085408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea1db570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 -- 172.21.15.22:0/2442085408 >> 172.21.15.22:0/2442085408 conn(0x5581ea160c70 msgr2=0x5581ea1dd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 -- 172.21.15.22:0/2442085408 shutdown_connections 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 -- 172.21.15.22:0/2442085408 wait complete. 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.563+0000 7f0702bf9740 1 -- start start 2023-11-24T06:13:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.564+0000 7f0702bf9740 1 Processor -- start 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea1e3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 0x5581ea1e3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f0702bf9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f0702bf9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea1c9510 con 0x5581ea19f070 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f0702bf9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ea1c6980 con 0x5581ea199d70 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f0702bf9740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581ea1c6bd0 con 0x5581ea19e7b0 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f0702bf9740 10 client.0 _ll_register_callbacks cb 0x7f06f00096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f06fe5f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f06fe5f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60204/0 (socket says 172.21.15.22:60204) 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f06fe5f9640 1 -- 172.21.15.22:0/164685211 learned_addr learned my addr 172.21.15.22:0/164685211 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f06fe5f9640 1 -- 172.21.15.22:0/164685211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 msgr2=0x5581ea1e3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f06fd5f7640 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 0x5581ea1e3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f06fe5f9640 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 0x5581ea1e3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f06fe5f9640 1 -- 172.21.15.22:0/164685211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 msgr2=0x5581ea1e3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.565+0000 7f06fe5f9640 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea1e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.566+0000 7f06fe5f9640 1 -- 172.21.15.22:0/164685211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f815df60 con 0x5581ea19f070 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.566+0000 7f06fe5f9640 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1f6a10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f06f00079d0 tx=0x7f06f0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddf61357151e0da server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.566+0000 7f06d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.566+0000 7f06d8ff9640 1 -- 172.21.15.22:0/164685211 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0017430 con 0x5581ea19f070 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.566+0000 7f06d8ff9640 1 -- 172.21.15.22:0/164685211 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06f00178a0 con 0x5581ea19f070 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.566+0000 7f0702bf9740 1 -- 172.21.15.22:0/164685211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06f401f400 con 0x5581ea19f070 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.566+0000 7f06d8ff9640 1 -- 172.21.15.22:0/164685211 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06f0017590 con 0x5581ea19f070 2023-11-24T06:13:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.566+0000 7f0702bf9740 10 client.5463 fetch_fsmap learned FSMap version 15 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.566+0000 7f0702bf9740 1 -- 172.21.15.22:0/164685211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5581ea0c7170 con 0x5581ea19f070 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.567+0000 7f06d8ff9640 1 -- 172.21.15.22:0/164685211 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f401f400 con 0x5581ea19f070 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.567+0000 7f06d8ff9640 1 -- 172.21.15.22:0/164685211 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f06f0030070 con 0x5581ea19f070 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.567+0000 7f0702bf9740 10 client.5463 fetch_fsmap finished waiting for FSMap version 15 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.567+0000 7f0702bf9740 10 client.5463 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.567+0000 7f0702bf9740 20 client.5463 populate_metadata read hostname 'smithi022' 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.567+0000 7f0702bf9740 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] conn(0x5581ea1f7140 0x5581ea1da7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.567+0000 7f0702bf9740 4 client.5463 mds_command: new command op to 5280 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.567+0000 7f0702bf9740 1 -- 172.21.15.22:0/164685211 --> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5581e9e066c0 con 0x5581ea1f7140 2023-11-24T06:13:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.567+0000 7f06fddf8640 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] conn(0x5581ea1f7140 0x5581ea1da7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f06fddf8640 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] conn(0x5581ea1f7140 0x5581ea1da7d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=860159ec6d6a58dd server_cookie=dfc2d01c5ed233c0 in_seq=0 out_seq=0 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f06d8ff9640 10 client.5463 ms_handle_connect on v2:172.21.15.22:6836/1515634482 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f06d8ff9640 1 -- 172.21.15.22:0/164685211 <== mds.0 v2:172.21.15.22:6836/1515634482 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5581e9e066c0 con 0x5581ea1f7140 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f06d8ff9640 10 client.5463 handle_command_reply: tid=0 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 client.5463 shutdown 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 -- 172.21.15.22:0/164685211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 msgr2=0x5581ea1f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1f6a10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f06f00079d0 tx=0x7f06f0004ab0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 -- 172.21.15.22:0/164685211 shutdown_connections 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.22:6836/1515634482,v1:172.21.15.22:6837/1515634482] conn(0x5581ea1f7140 0x5581ea1da7d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5581ea19f070 0x5581ea1f6a10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5581ea19e7b0 0x5581ea1e3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 --2- 172.21.15.22:0/164685211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581ea199d70 0x5581ea1e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f06d8ff9640 0 client.5463 ms_handle_reset on v2:172.21.15.22:6836/1515634482 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 -- 172.21.15.22:0/164685211 >> 172.21.15.22:0/164685211 conn(0x5581ea160c70 msgr2=0x5581ea1e8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 -- 172.21.15.22:0/164685211 shutdown_connections 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.568+0000 7f0702bf9740 1 -- 172.21.15.22:0/164685211 wait complete. 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f0702bf9740 20 client.5463 trim_cache size 0 max 16384 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d0664f6f-6758-42fa-85ad-04f9384b4bc8", 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 5280, 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-11-24T06:13:38.576 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-11-24T06:13:38.577 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-11-24T06:13:38.577 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 8.8188662339999997, 2023-11-24T06:13:38.577 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 15, 2023-11-24T06:13:38.577 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 36, 2023-11-24T06:13:38.577 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 36, 2023-11-24T06:13:38.577 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 18.622754267000001 2023-11-24T06:13:38.577 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 -- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f06dc06ae40 msgr2=0x7f06dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f06dc06ae40 0x7f06dc06d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f06f4003eb0 tx=0x7f06f4009040 comp rx=0 tx=0).stop 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 -- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80d1670 msgr2=0x7f06f80b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80d1670 0x7f06f80b1400 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f06e80090b0 tx=0x7f06e80046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 -- 172.21.15.22:0/2588218012 shutdown_connections 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f06dc06ae40 0x7f06dc06d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06f815d5d0 0x7f06f815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f80d1670 0x7f06f80b1400 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 --2- 172.21.15.22:0/2588218012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06f80cf710 0x7f06f80b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 -- 172.21.15.22:0/2588218012 >> 172.21.15.22:0/2588218012 conn(0x7f06f809c3d0 msgr2=0x7f06f80ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 -- 172.21.15.22:0/2588218012 shutdown_connections 2023-11-24T06:13:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.569+0000 7f06fedfa640 1 -- 172.21.15.22:0/2588218012 wait complete. 2023-11-24T06:13:38.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.803+0000 7f3e0f260640 1 Processor -- start 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.803+0000 7f3e0f260640 1 -- start start 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.805+0000 7f3e0f260640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813dfd0 0x7f3e0815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.805+0000 7f3e0f260640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e080cf050 0x7f3e080cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.805+0000 7f3e0f260640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e0806c130 0x7f3e0806c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.805+0000 7f3e0f260640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e080cfa10 con 0x7f3e080cf050 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.805+0000 7f3e0f260640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0815fa70 con 0x7f3e0806c130 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.805+0000 7f3e0f260640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0815ee60 con 0x7f3e0813dfd0 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.805+0000 7f3e0da5d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e080cf050 0x7f3e080cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.805+0000 7f3e0da5d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e080cf050 0x7f3e080cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60212/0 (socket says 172.21.15.22:60212) 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.805+0000 7f3e0da5d640 1 -- 172.21.15.22:0/886065144 learned_addr learned my addr 172.21.15.22:0/886065144 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.806+0000 7f3e0ea5f640 1 --2- 172.21.15.22:0/886065144 >> v2:172.21.15.31:3300/0 conn(0x7f3e0806c130 0x7f3e0806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.806+0000 7f3e0e25e640 1 --2- 172.21.15.22:0/886065144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813dfd0 0x7f3e0815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.806+0000 7f3e0da5d640 1 -- 172.21.15.22:0/886065144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813dfd0 msgr2=0x7f3e0815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.806+0000 7f3e0da5d640 1 --2- 172.21.15.22:0/886065144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813dfd0 0x7f3e0815be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.806+0000 7f3e0da5d640 1 -- 172.21.15.22:0/886065144 >> v2:172.21.15.31:3300/0 conn(0x7f3e0806c130 msgr2=0x7f3e0806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.806+0000 7f3e0da5d640 1 --2- 172.21.15.22:0/886065144 >> v2:172.21.15.31:3300/0 conn(0x7f3e0806c130 0x7f3e0806c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.806+0000 7f3e0da5d640 1 -- 172.21.15.22:0/886065144 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0815f140 con 0x7f3e080cf050 2023-11-24T06:13:38.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.806+0000 7f3e0ea5f640 1 --2- 172.21.15.22:0/886065144 >> v2:172.21.15.31:3300/0 conn(0x7f3e0806c130 0x7f3e0806c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.807+0000 7f3e0da5d640 1 --2- 172.21.15.22:0/886065144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e080cf050 0x7f3e080cf4d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3e0806d520 tx=0x7f3df802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93618ffe86e53dc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.807+0000 7f3e0d25c640 1 -- 172.21.15.22:0/886065144 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8031870 con 0x7f3e080cf050 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.807+0000 7f3e0d25c640 1 -- 172.21.15.22:0/886065144 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df80319d0 con 0x7f3e080cf050 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.807+0000 7f3e0d25c640 1 -- 172.21.15.22:0/886065144 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8031d60 con 0x7f3e080cf050 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.808+0000 7f3e0f260640 1 -- 172.21.15.22:0/886065144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e080cf050 msgr2=0x7f3e080cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.808+0000 7f3e0f260640 1 --2- 172.21.15.22:0/886065144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e080cf050 0x7f3e080cf4d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3e0806d520 tx=0x7f3df802b910 comp rx=0 tx=0).stop 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.808+0000 7f3e0f260640 1 -- 172.21.15.22:0/886065144 shutdown_connections 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.808+0000 7f3e0f260640 1 --2- 172.21.15.22:0/886065144 >> v2:172.21.15.31:3300/0 conn(0x7f3e0806c130 0x7f3e0806c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.808+0000 7f3e0f260640 1 --2- 172.21.15.22:0/886065144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e080cf050 0x7f3e080cf4d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.808+0000 7f3e0f260640 1 --2- 172.21.15.22:0/886065144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813dfd0 0x7f3e0815be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.808+0000 7f3e0f260640 1 -- 172.21.15.22:0/886065144 >> 172.21.15.22:0/886065144 conn(0x7f3e0806a860 msgr2=0x7f3e0806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.808+0000 7f3e0f260640 1 -- 172.21.15.22:0/886065144 shutdown_connections 2023-11-24T06:13:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.808+0000 7f3e0f260640 1 -- 172.21.15.22:0/886065144 wait complete. 2023-11-24T06:13:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.810+0000 7f3e0f260640 1 Processor -- start 2023-11-24T06:13:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.810+0000 7f3e0f260640 1 -- start start 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.811+0000 7f3e0f260640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e0806c130 0x7f3e08154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.811+0000 7f3e0f260640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e080cf050 0x7f3e08158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.811+0000 7f3e0f260640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813dfd0 0x7f3e08155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.811+0000 7f3e0f260640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0815c650 con 0x7f3e0806c130 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.811+0000 7f3e0f260640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0815d940 con 0x7f3e080cf050 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.811+0000 7f3e0f260640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0815c8a0 con 0x7f3e0813dfd0 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.811+0000 7f3e0e25e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e0806c130 0x7f3e08154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.811+0000 7f3e0e25e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e0806c130 0x7f3e08154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60226/0 (socket says 172.21.15.22:60226) 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.811+0000 7f3e0e25e640 1 -- 172.21.15.22:0/84683888 learned_addr learned my addr 172.21.15.22:0/84683888 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0da5d640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e080cf050 0x7f3e08158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0e25e640 1 -- 172.21.15.22:0/84683888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813dfd0 msgr2=0x7f3e08155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0e25e640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813dfd0 0x7f3e08155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0e25e640 1 -- 172.21.15.22:0/84683888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e080cf050 msgr2=0x7f3e08158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0e25e640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e080cf050 0x7f3e08158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0e25e640 1 -- 172.21.15.22:0/84683888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80094d0 con 0x7f3e0806c130 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0da5d640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e080cf050 0x7f3e08158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0e25e640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e0806c130 0x7f3e08154940 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c7f0 tx=0x7f3e0400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3dfeffd640 1 -- 172.21.15.22:0/84683888 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04004220 con 0x7f3e0806c130 2023-11-24T06:13:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3dfeffd640 1 -- 172.21.15.22:0/84683888 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04004380 con 0x7f3e0806c130 2023-11-24T06:13:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0815cb80 con 0x7f3e0806c130 2023-11-24T06:13:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3dfeffd640 1 -- 172.21.15.22:0/84683888 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04007840 con 0x7f3e0806c130 2023-11-24T06:13:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.812+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0815d140 con 0x7f3e0806c130 2023-11-24T06:13:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.814+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0804e840 con 0x7f3e0806c130 2023-11-24T06:13:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.815+0000 7f3dfeffd640 1 -- 172.21.15.22:0/84683888 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e04007bb0 con 0x7f3e0806c130 2023-11-24T06:13:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.815+0000 7f3dfeffd640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3dec06ae40 0x7f3dec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.816+0000 7f3dfeffd640 1 -- 172.21.15.22:0/84683888 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e04089580 con 0x7f3e0806c130 2023-11-24T06:13:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.816+0000 7f3e0da5d640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3dec06ae40 0x7f3dec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.817+0000 7f3e0da5d640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3dec06ae40 0x7f3dec06d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3df8036000 tx=0x7f3df803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:38.820+0000 7f3dfeffd640 1 -- 172.21.15.22:0/84683888 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e04054590 con 0x7f3e0806c130 2023-11-24T06:13:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.058+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3e080ce9a0 con 0x7f3e0806c130 2023-11-24T06:13:39.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.059+0000 7f3dfeffd640 1 -- 172.21.15.22:0/84683888 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3e04007e60 con 0x7f3e0806c130 2023-11-24T06:13:39.063 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:13:39.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.062+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3dec06ae40 msgr2=0x7f3dec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:39.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.062+0000 7f3e0f260640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3dec06ae40 0x7f3dec06d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3df8036000 tx=0x7f3df803c040 comp rx=0 tx=0).stop 2023-11-24T06:13:39.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e0806c130 msgr2=0x7f3e08154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:39.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e0806c130 0x7f3e08154940 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c7f0 tx=0x7f3e0400ccb0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 shutdown_connections 2023-11-24T06:13:39.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3dec06ae40 0x7f3dec06d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813dfd0 0x7f3e08155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e080cf050 0x7f3e08158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 --2- 172.21.15.22:0/84683888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e0806c130 0x7f3e08154940 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 >> 172.21.15.22:0/84683888 conn(0x7f3e0806a860 msgr2=0x7f3e08140b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 shutdown_connections 2023-11-24T06:13:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:39.063+0000 7f3e0f260640 1 -- 172.21.15.22:0/84683888 wait complete. 2023-11-24T06:13:39.086 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:13:39.086 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:13:39.086 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-11-24T06:13:39.086 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:13:39.086 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:39.086 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:13:39.086 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:13:39.087 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:13:39.087 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:13:39.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:39.087 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-11-24T06:13:39.140 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:13:39.140 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:13:39.140 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-11-24T06:13:39.141 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42191sec preferred_lft 42191sec 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 12:91:dd:4c:3b:77 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::5c65:45ff:fef2:bf3b/64 scope link 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:39.142 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:13:39.143 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 42:17:0d:d1:91:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:13:39.143 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::4017:dff:fed1:9132/64 scope link 2023-11-24T06:13:39.143 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:39.143 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:13:39.143 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 12:91:dd:4c:3b:77 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:13:39.143 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::1091:ddff:fe4c:3b77/64 scope link 2023-11-24T06:13:39.143 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:39.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:39.144 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:13:39.240 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-11-24T06:13:39.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:39.245 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-11-24T06:13:39.302 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-11-24T06:13:39.303 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:13:39.303 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:13:39.303 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:13:39.303 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:13:39.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:39.303 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:13:39.303 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:13:39.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:13:39.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:13:39.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:13:39.304 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:13:39.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:39.504 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-11-24T06:13:39.560 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:13:39.560 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:13:39.561 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:13:39.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:39.561 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-11-24T06:13:39.665 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T06:13:39.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:13:39.666 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:39.728 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:13:39.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:13:39.729 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:39.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:13:39.896 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:13:39.957 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:13:39.957 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:13:39.957 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:13:39.957 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:13:39.957 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:13:39.957 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:13:39.957 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:13:39.957 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:13:39.957 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:13:39.958 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:13:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:13:39.960 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:13:39.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:39.961 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:13:40.023 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T06:13:40.023 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T06:13:40.029 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:13:40.108 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:13:40.151 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:13:40.151 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:13:40.151 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:13:40.151 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:13:40.151 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:13:40.151 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:13:40.151 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:13:40.151 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:13:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:13:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:13:40.154 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:13:40.154 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:13:40.154 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:13:40.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:40.155 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:13:40.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:2023-11-24T06:13:40.221+0000 7f328b647480 -1 init, newargv = 0x55a9dd1b0a80 newargc=15 2023-11-24T06:13:40.225 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[101566]: starting ceph client 2023-11-24T06:13:40.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[101566]: starting fuse 2023-11-24T06:13:40.244 INFO:teuthology.orchestra.run.smithi022.stdout:41 2023-11-24T06:13:40.244 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> import re 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> import os 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2023-11-24T06:13:40.245 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> return f 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.0")) 2023-11-24T06:13:40.246 DEBUG:teuthology.orchestra.run.smithi022:> ' 2023-11-24T06:13:40.448 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.0.101566.asok 2023-11-24T06:13:40.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:13:40.464 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.101566.asok 2023-11-24T06:13:40.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:40.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.101566.asok status 2023-11-24T06:13:40.716 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:13:40.716 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "0", 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "101566", 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/" 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 5472, 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2023-11-24T06:13:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 5472 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2794430297 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:13:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2794430297 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.5472 192.168.0.1:0/2794430297", 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.1:0/2794430297", 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 1, 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 15, 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 36, 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2023-11-24T06:13:40.719 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:13:40.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:40.732 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2023-11-24T06:13:40.732 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:40.789 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2023-11-24T06:13:40.789 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:40.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:40.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:40.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:13:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.118+0000 7f77fa92e640 1 Processor -- start 2023-11-24T06:13:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.118+0000 7f77fa92e640 1 -- start start 2023-11-24T06:13:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.120+0000 7f77fa92e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f77f413dfd0 0x7f77f415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.120+0000 7f77fa92e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f77f40cf050 0x7f77f40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.120+0000 7f77fa92e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f406c130 0x7f77f406c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.120+0000 7f77fa92e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f40cfa40 con 0x7f77f413dfd0 2023-11-24T06:13:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.120+0000 7f77fa92e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f415fa70 con 0x7f77f40cf050 2023-11-24T06:13:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.120+0000 7f77fa92e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f415ee60 con 0x7f77f406c130 2023-11-24T06:13:41.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77f992c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f77f413dfd0 0x7f77f415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77f992c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f77f413dfd0 0x7f77f415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34986/0 (socket says 172.21.15.22:34986) 2023-11-24T06:13:41.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77f992c640 1 -- 172.21.15.22:0/1563694701 learned_addr learned my addr 172.21.15.22:0/1563694701 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:41.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77fa12d640 1 --2- 172.21.15.22:0/1563694701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f406c130 0x7f77f406c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77f912b640 1 --2- 172.21.15.22:0/1563694701 >> v2:172.21.15.31:3300/0 conn(0x7f77f40cf050 0x7f77f40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77f992c640 1 -- 172.21.15.22:0/1563694701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f406c130 msgr2=0x7f77f406c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:41.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77f992c640 1 --2- 172.21.15.22:0/1563694701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f406c130 0x7f77f406c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77f992c640 1 -- 172.21.15.22:0/1563694701 >> v2:172.21.15.31:3300/0 conn(0x7f77f40cf050 msgr2=0x7f77f40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:41.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77f992c640 1 --2- 172.21.15.22:0/1563694701 >> v2:172.21.15.31:3300/0 conn(0x7f77f40cf050 0x7f77f40cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.121+0000 7f77f992c640 1 -- 172.21.15.22:0/1563694701 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f415f140 con 0x7f77f413dfd0 2023-11-24T06:13:41.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.122+0000 7f77f992c640 1 --2- 172.21.15.22:0/1563694701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f413dfd0 0x7f77f415be70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f77f406e070 tx=0x7f77f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bc4e56e2867b5b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:41.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.123+0000 7f77f892a640 1 -- 172.21.15.22:0/1563694701 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0031870 con 0x7f77f413dfd0 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.123+0000 7f77f892a640 1 -- 172.21.15.22:0/1563694701 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f00319d0 con 0x7f77f413dfd0 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.123+0000 7f77f892a640 1 -- 172.21.15.22:0/1563694701 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0031d60 con 0x7f77f413dfd0 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.123+0000 7f77fa92e640 1 -- 172.21.15.22:0/1563694701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f413dfd0 msgr2=0x7f77f415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.123+0000 7f77fa92e640 1 --2- 172.21.15.22:0/1563694701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f413dfd0 0x7f77f415be70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f77f406e070 tx=0x7f77f002b910 comp rx=0 tx=0).stop 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.123+0000 7f77fa92e640 1 -- 172.21.15.22:0/1563694701 shutdown_connections 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.123+0000 7f77fa92e640 1 --2- 172.21.15.22:0/1563694701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f406c130 0x7f77f406c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.123+0000 7f77fa92e640 1 --2- 172.21.15.22:0/1563694701 >> v2:172.21.15.31:3300/0 conn(0x7f77f40cf050 0x7f77f40cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.123+0000 7f77fa92e640 1 --2- 172.21.15.22:0/1563694701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f413dfd0 0x7f77f415be70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.124+0000 7f77fa92e640 1 -- 172.21.15.22:0/1563694701 >> 172.21.15.22:0/1563694701 conn(0x7f77f406a860 msgr2=0x7f77f406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.124+0000 7f77fa92e640 1 -- 172.21.15.22:0/1563694701 shutdown_connections 2023-11-24T06:13:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.124+0000 7f77fa92e640 1 -- 172.21.15.22:0/1563694701 wait complete. 2023-11-24T06:13:41.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.126+0000 7f77fa92e640 1 Processor -- start 2023-11-24T06:13:41.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.126+0000 7f77fa92e640 1 -- start start 2023-11-24T06:13:41.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77fa92e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f406c130 0x7f77f41e4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77fa92e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77f40cf050 0x7f77f41f1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77fa92e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f413dfd0 0x7f77f41f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77fa92e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f4157490 con 0x7f77f406c130 2023-11-24T06:13:41.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77fa92e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f4156600 con 0x7f77f40cf050 2023-11-24T06:13:41.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77fa92e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f4156810 con 0x7f77f413dfd0 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77f992c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f406c130 0x7f77f41e4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77f992c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f406c130 0x7f77f41e4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34988/0 (socket says 172.21.15.22:34988) 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77f992c640 1 -- 172.21.15.22:0/3833895345 learned_addr learned my addr 172.21.15.22:0/3833895345 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77f912b640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77f40cf050 0x7f77f41f1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.127+0000 7f77fa12d640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f413dfd0 0x7f77f41f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77f992c640 1 -- 172.21.15.22:0/3833895345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f413dfd0 msgr2=0x7f77f41f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77f992c640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f413dfd0 0x7f77f41f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77f992c640 1 -- 172.21.15.22:0/3833895345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77f40cf050 msgr2=0x7f77f41f1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77f992c640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77f40cf050 0x7f77f41f1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77f992c640 1 -- 172.21.15.22:0/3833895345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f00094d0 con 0x7f77f406c130 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77fa12d640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f413dfd0 0x7f77f41f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:41.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77f992c640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f406c130 0x7f77f41e4d70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f77f00090b0 tx=0x7f77f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:41.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77ea7fc640 1 -- 172.21.15.22:0/3833895345 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f003aca0 con 0x7f77f406c130 2023-11-24T06:13:41.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77ea7fc640 1 -- 172.21.15.22:0/3833895345 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f003ae00 con 0x7f77f406c130 2023-11-24T06:13:41.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77ea7fc640 1 -- 172.21.15.22:0/3833895345 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0044630 con 0x7f77f406c130 2023-11-24T06:13:41.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.128+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f4156af0 con 0x7f77f406c130 2023-11-24T06:13:41.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.129+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f41570b0 con 0x7f77f406c130 2023-11-24T06:13:41.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.130+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f41575d0 con 0x7f77f406c130 2023-11-24T06:13:41.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.131+0000 7f77ea7fc640 1 -- 172.21.15.22:0/3833895345 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77f004d450 con 0x7f77f406c130 2023-11-24T06:13:41.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.131+0000 7f77ea7fc640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77d806ae40 0x7f77d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.132+0000 7f77ea7fc640 1 -- 172.21.15.22:0/3833895345 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77f002d040 con 0x7f77f406c130 2023-11-24T06:13:41.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.132+0000 7f77f912b640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77d806ae40 0x7f77d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.132+0000 7f77f912b640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77d806ae40 0x7f77d806d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77f41e7a60 tx=0x7f77e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:41.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.139+0000 7f77ea7fc640 1 -- 172.21.15.22:0/3833895345 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77f0076c30 con 0x7f77f406c130 2023-11-24T06:13:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.378+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f77f40cf800 con 0x7f77f406c130 2023-11-24T06:13:41.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.378+0000 7f77ea7fc640 1 -- 172.21.15.22:0/3833895345 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f77f0035070 con 0x7f77f406c130 2023-11-24T06:13:41.381 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:13:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77d806ae40 msgr2=0x7f77d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77d806ae40 0x7f77d806d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77f41e7a60 tx=0x7f77e4008040 comp rx=0 tx=0).stop 2023-11-24T06:13:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f406c130 msgr2=0x7f77f41e4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f406c130 0x7f77f41e4d70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f77f00090b0 tx=0x7f77f00046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 shutdown_connections 2023-11-24T06:13:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77d806ae40 0x7f77d806d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77f413dfd0 0x7f77f41f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77f40cf050 0x7f77f41f1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 --2- 172.21.15.22:0/3833895345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77f406c130 0x7f77f41e4d70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.381+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 >> 172.21.15.22:0/3833895345 conn(0x7f77f406a860 msgr2=0x7f77f40cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.382+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 shutdown_connections 2023-11-24T06:13:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:41.382+0000 7f77fa92e640 1 -- 172.21.15.22:0/3833895345 wait complete. 2023-11-24T06:13:41.402 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:13:41.402 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:13:41.402 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-11-24T06:13:41.402 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:13:41.402 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:13:41.402 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:13:41.402 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:13:41.402 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:13:41.403 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:13:41.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:41.403 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-11-24T06:13:41.468 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:13:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:13:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:13:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-24T06:13:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:41.469 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-11-24T06:13:41.469 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42180sec preferred_lft 42180sec 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-11-24T06:13:41.471 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:13:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:5c:4a:a6:48:09 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:13:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c062:1fff:fe91:be78/64 scope link 2023-11-24T06:13:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:41.471 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:13:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:5c:4a:a6:48:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:13:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c45c:4aff:fea6:4809/64 scope link 2023-11-24T06:13:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:41.472 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:13:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether e2:ba:d2:fd:ba:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:13:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::e0ba:d2ff:fefd:bac8/64 scope link 2023-11-24T06:13:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:41.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:41.473 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:13:41.569 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-11-24T06:13:41.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:41.574 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-11-24T06:13:41.634 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-11-24T06:13:41.634 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:13:41.634 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:13:41.634 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:13:41.634 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:13:41.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:41.635 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:13:41.635 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:13:41.635 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:13:41.635 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:13:41.635 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:13:41.635 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:41.832 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-24T06:13:41.886 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:13:41.886 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:13:41.887 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:13:41.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:41.887 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-11-24T06:13:41.990 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T06:13:41.990 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:13:41.990 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:13:42.047 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:13:42.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:13:42.047 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:13:42.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:13:42.207 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:13:42.269 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:13:42.269 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:13:42.269 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:13:42.269 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:13:42.270 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:13:42.271 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:13:42.272 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:13:42.272 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:13:42.272 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:13:42.272 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:13:42.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:42.273 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:13:42.329 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T06:13:42.329 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T06:13:42.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:13:42.414 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:13:42.458 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:13:42.458 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:13:42.458 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:13:42.458 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:13:42.458 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:13:42.458 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:13:42.459 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:13:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:13:42.461 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:13:42.461 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:13:42.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:42.462 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:13:42.527 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:2023-11-24T06:13:42.524+0000 7f0cf8810480 -1 init, newargv = 0x56078d854b20 newargc=15 2023-11-24T06:13:42.527 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[95278]: starting ceph client 2023-11-24T06:13:42.540 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[95278]: starting fuse 2023-11-24T06:13:42.549 INFO:teuthology.orchestra.run.smithi031.stdout:41 2023-11-24T06:13:42.550 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T06:13:42.550 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:13:42.550 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2023-11-24T06:13:42.550 DEBUG:teuthology.orchestra.run.smithi031:> import re 2023-11-24T06:13:42.550 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-11-24T06:13:42.550 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-11-24T06:13:42.550 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:13:42.550 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2023-11-24T06:13:42.550 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T06:13:42.550 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2023-11-24T06:13:42.551 DEBUG:teuthology.orchestra.run.smithi031:> return f 2023-11-24T06:13:42.552 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:13:42.552 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:13:42.552 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.1")) 2023-11-24T06:13:42.552 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-11-24T06:13:42.759 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.1.95278.asok 2023-11-24T06:13:42.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:13:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:13:42.776 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.95278.asok 2023-11-24T06:13:42.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:42.777 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.95278.asok status 2023-11-24T06:13:43.033 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-24T06:13:43.033 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "1", 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "95278", 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4978, 2023-11-24T06:13:43.034 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4978 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 459823 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:13:43.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 459823 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4978 192.168.0.1:0/459823", 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/459823", 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 15, 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 36, 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2023-11-24T06:13:43.036 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-24T06:13:43.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:43.049 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2023-11-24T06:13:43.049 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T06:13:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2023-11-24T06:13:43.108 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T06:13:43.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:43.108 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:13:43.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:13:43.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.456+0000 7f727889a640 1 Processor -- start 2023-11-24T06:13:43.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.456+0000 7f727889a640 1 -- start start 2023-11-24T06:13:43.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.458+0000 7f727889a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f72740cfa30 0x7f72740cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.458+0000 7f727889a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740d1fd0 0x7f72740ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.458+0000 7f727889a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740b2980 con 0x7f72740d0e00 2023-11-24T06:13:43.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.458+0000 7f727889a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740d0350 con 0x7f72740cfa30 2023-11-24T06:13:43.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.458+0000 7f727889a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72740cf220 con 0x7f72740d1fd0 2023-11-24T06:13:43.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.458+0000 7f727359e640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f72740d0e00 0x7f72740d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41134/0 (socket says 172.21.15.22:41134) 2023-11-24T06:13:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.458+0000 7f727359e640 1 -- 172.21.15.22:0/3219280373 learned_addr learned my addr 172.21.15.22:0/3219280373 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:43.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f7272d9d640 1 --2- 172.21.15.22:0/3219280373 >> v2:172.21.15.31:3300/0 conn(0x7f72740cfa30 0x7f72740cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f726bfff640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740d1fd0 0x7f72740ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541657864 0 0) 0x7f72740b2980 con 0x7f72740d0e00 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7260003520 con 0x7f72740d0e00 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3884755238 0 0) 0x7f7260003520 con 0x7f72740d0e00 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740d1fd0 msgr2=0x7f72740ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f727259c640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740d1fd0 0x7f72740ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 >> v2:172.21.15.31:3300/0 conn(0x7f72740cfa30 msgr2=0x7f72740cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f727259c640 1 --2- 172.21.15.22:0/3219280373 >> v2:172.21.15.31:3300/0 conn(0x7f72740cfa30 0x7f72740cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.459+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740cf500 con 0x7f72740d0e00 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f726c0019f0 con 0x7f72740d0e00 2023-11-24T06:13:43.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 >> v1:172.21.15.22:6789/0 conn(0x7f72740d0e00 legacy=0x7f72740d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f727259c640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f7260003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f727259c640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72600047c0 0x7f7260004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f727259c640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740d1fd0 0x7f7260005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740d0350 con 0x7f72600039e0 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740cf220 con 0x7f72600047c0 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726000b980 con 0x7f72740d1fd0 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f7272d9d640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f7260003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f726bfff640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72600047c0 0x7f7260004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f7272d9d640 1 -- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740d1fd0 msgr2=0x7f7260005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f7272d9d640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72740d1fd0 0x7f7260005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f7272d9d640 1 -- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72600047c0 msgr2=0x7f7260004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f7272d9d640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72600047c0 0x7f7260004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.460+0000 7f7272d9d640 1 -- 172.21.15.22:0/3219280373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7260003520 con 0x7f72600039e0 2023-11-24T06:13:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.461+0000 7f7272d9d640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f7260003e00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7264009af0 tx=0x7f72600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a2168d8665a9c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.462+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726402c710 con 0x7f72600039e0 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.462+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726402c870 con 0x7f72600039e0 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.462+0000 7f727259c640 1 -- 172.21.15.22:0/3219280373 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726402cc00 con 0x7f72600039e0 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.462+0000 7f727889a640 1 -- 172.21.15.22:0/3219280373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 msgr2=0x7f7260003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.462+0000 7f727889a640 1 --2- 172.21.15.22:0/3219280373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f7260003e00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7264009af0 tx=0x7f72600057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.462+0000 7f727359e640 1 -- 172.21.15.22:0/3219280373 reap_dead start 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.463+0000 7f727889a640 1 -- 172.21.15.22:0/3219280373 shutdown_connections 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.463+0000 7f727889a640 1 -- 172.21.15.22:0/3219280373 >> 172.21.15.22:0/3219280373 conn(0x7f72740d3020 msgr2=0x7f72740d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.463+0000 7f727889a640 1 -- 172.21.15.22:0/3219280373 shutdown_connections 2023-11-24T06:13:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.463+0000 7f727889a640 1 -- 172.21.15.22:0/3219280373 wait complete. 2023-11-24T06:13:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.464+0000 7f727889a640 1 Processor -- start 2023-11-24T06:13:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.465+0000 7f727889a640 1 -- start start 2023-11-24T06:13:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f727889a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f72740cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f727889a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72741499b0 0x7f72741f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f727889a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415ab00 0x7f727415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f727889a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727415b4f0 con 0x7f72600039e0 2023-11-24T06:13:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f727889a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740ca680 con 0x7f727415ab00 2023-11-24T06:13:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f727889a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72740cc130 con 0x7f72741499b0 2023-11-24T06:13:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f7272d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f72740cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f7272d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f72740cba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35006/0 (socket says 172.21.15.22:35006) 2023-11-24T06:13:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f7272d9d640 1 -- 172.21.15.22:0/4221096227 learned_addr learned my addr 172.21.15.22:0/4221096227 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f7272d9d640 1 -- 172.21.15.22:0/4221096227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72741499b0 msgr2=0x7f72741f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f7272d9d640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72741499b0 0x7f72741f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f7272d9d640 1 -- 172.21.15.22:0/4221096227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415ab00 msgr2=0x7f727415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f7272d9d640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415ab00 0x7f727415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.466+0000 7f7272d9d640 1 -- 172.21.15.22:0/4221096227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740cc410 con 0x7f72600039e0 2023-11-24T06:13:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.467+0000 7f7272d9d640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f72740cba50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7264000c00 tx=0x7f7264004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.467+0000 7f726b7fe640 1 -- 172.21.15.22:0/4221096227 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264003810 con 0x7f72600039e0 2023-11-24T06:13:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.467+0000 7f726b7fe640 1 -- 172.21.15.22:0/4221096227 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726402de90 con 0x7f72600039e0 2023-11-24T06:13:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.467+0000 7f726b7fe640 1 -- 172.21.15.22:0/4221096227 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264003bb0 con 0x7f72600039e0 2023-11-24T06:13:43.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.467+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72740cc6f0 con 0x7f72600039e0 2023-11-24T06:13:43.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.467+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72740cccb0 con 0x7f72600039e0 2023-11-24T06:13:43.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.468+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72740d0a40 con 0x7f72600039e0 2023-11-24T06:13:43.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.469+0000 7f726b7fe640 1 -- 172.21.15.22:0/4221096227 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7264003d10 con 0x7f72600039e0 2023-11-24T06:13:43.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.470+0000 7f726b7fe640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.470+0000 7f726b7fe640 1 -- 172.21.15.22:0/4221096227 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72640ab470 con 0x7f72600039e0 2023-11-24T06:13:43.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.470+0000 7f726bfff640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.471+0000 7f726bfff640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f72740cb7e0 tx=0x7f725c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.475+0000 7f726b7fe640 1 -- 172.21.15.22:0/4221096227 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7264076510 con 0x7f72600039e0 2023-11-24T06:13:43.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.706+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f727404e840 con 0x7f72600039e0 2023-11-24T06:13:43.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.751+0000 7f726b7fe640 1 -- 172.21.15.22:0/4221096227 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 136+0+0 (secure 0 0 0) 0x7f7264079b30 con 0x7f72600039e0 2023-11-24T06:13:43.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 msgr2=0x7f725406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f72740cb7e0 tx=0x7f725c008040 comp rx=0 tx=0).stop 2023-11-24T06:13:43.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 msgr2=0x7f72740cba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f72740cba50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7264000c00 tx=0x7f7264004730 comp rx=0 tx=0).stop 2023-11-24T06:13:43.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 shutdown_connections 2023-11-24T06:13:43.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f725406ae40 0x7f725406d300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f727415ab00 0x7f727415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72741499b0 0x7f72741f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 --2- 172.21.15.22:0/4221096227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72600039e0 0x7f72740cba50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 >> 172.21.15.22:0/4221096227 conn(0x7f72740d3020 msgr2=0x7f727406b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:43.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 shutdown_connections 2023-11-24T06:13:43.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.754+0000 7f727889a640 1 -- 172.21.15.22:0/4221096227 wait complete. 2023-11-24T06:13:43.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:13:43.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.979+0000 7ff2771ff640 1 Processor -- start 2023-11-24T06:13:43.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.979+0000 7ff2771ff640 1 -- start start 2023-11-24T06:13:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.981+0000 7ff2771ff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2701416f0 0x7ff27015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.981+0000 7ff2771ff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff27006d230 0x7ff27015f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.981+0000 7ff2771ff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff270070bf0 con 0x7ff270141e80 2023-11-24T06:13:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.981+0000 7ff2771ff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27006db30 con 0x7ff2701416f0 2023-11-24T06:13:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.981+0000 7ff2771ff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27006d660 con 0x7ff27006d230 2023-11-24T06:13:43.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.982+0000 7ff2769fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff27006d230 0x7ff27015f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.982+0000 7ff2769fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff27006d230 0x7ff27015f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:36432/0 (socket says 172.21.15.22:36432) 2023-11-24T06:13:43.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.982+0000 7ff2769fe640 1 -- 172.21.15.22:0/1468993518 learned_addr learned my addr 172.21.15.22:0/1468993518 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:43.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.982+0000 7ff2761fd640 1 --2- 172.21.15.22:0/1468993518 >> v2:172.21.15.31:3300/0 conn(0x7ff2701416f0 0x7ff27015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.982+0000 7ff2769fe640 1 -- 172.21.15.22:0/1468993518 >> v2:172.21.15.31:3300/0 conn(0x7ff2701416f0 msgr2=0x7ff27015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:43.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.982+0000 7ff2769fe640 1 --2- 172.21.15.22:0/1468993518 >> v2:172.21.15.31:3300/0 conn(0x7ff2701416f0 0x7ff27015ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.983+0000 7ff2769fe640 1 -- 172.21.15.22:0/1468993518 >> v1:172.21.15.31:6789/0 conn(0x7ff270141e80 legacy=0x7ff27006cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.983+0000 7ff2769fe640 1 -- 172.21.15.22:0/1468993518 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27006d850 con 0x7ff27006d230 2023-11-24T06:13:43.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.984+0000 7ff2769fe640 1 --2- 172.21.15.22:0/1468993518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff27006d230 0x7ff27015f290 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff268009e50 tx=0x7ff26802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682bd7a78c08c004 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:43.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.984+0000 7ff2751fb640 1 -- 172.21.15.22:0/1468993518 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26802cb00 con 0x7ff27006d230 2023-11-24T06:13:43.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.985+0000 7ff2751fb640 1 -- 172.21.15.22:0/1468993518 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26802cc60 con 0x7ff27006d230 2023-11-24T06:13:43.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.985+0000 7ff2751fb640 1 -- 172.21.15.22:0/1468993518 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680343f0 con 0x7ff27006d230 2023-11-24T06:13:43.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.985+0000 7ff2771ff640 1 -- 172.21.15.22:0/1468993518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff27006d230 msgr2=0x7ff27015f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.985+0000 7ff2771ff640 1 --2- 172.21.15.22:0/1468993518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff27006d230 0x7ff27015f290 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff268009e50 tx=0x7ff26802bf60 comp rx=0 tx=0).stop 2023-11-24T06:13:43.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.985+0000 7ff2771ff640 1 -- 172.21.15.22:0/1468993518 shutdown_connections 2023-11-24T06:13:43.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.985+0000 7ff2771ff640 1 --2- 172.21.15.22:0/1468993518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff27006d230 0x7ff27015f290 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.985+0000 7ff2771ff640 1 --2- 172.21.15.22:0/1468993518 >> v2:172.21.15.31:3300/0 conn(0x7ff2701416f0 0x7ff27015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.985+0000 7ff2771ff640 1 -- 172.21.15.22:0/1468993518 >> 172.21.15.22:0/1468993518 conn(0x7ff2700b0840 msgr2=0x7ff2700b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:43.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.985+0000 7ff2771ff640 1 -- 172.21.15.22:0/1468993518 shutdown_connections 2023-11-24T06:13:43.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.986+0000 7ff2771ff640 1 -- 172.21.15.22:0/1468993518 wait complete. 2023-11-24T06:13:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.988+0000 7ff2771ff640 1 Processor -- start 2023-11-24T06:13:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.988+0000 7ff2771ff640 1 -- start start 2023-11-24T06:13:43.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.989+0000 7ff2771ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff27006d230 0x7ff27015c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.989+0000 7ff2771ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2701416f0 0x7ff270139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.989+0000 7ff2771ff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff270141e80 0x7ff27013e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.989+0000 7ff2771ff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270137380 con 0x7ff27006d230 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.989+0000 7ff2771ff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270136770 con 0x7ff2701416f0 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.989+0000 7ff2771ff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff270136a50 con 0x7ff270141e80 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.989+0000 7ff2761fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff27006d230 0x7ff27015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2761fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff27006d230 0x7ff27015c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35014/0 (socket says 172.21.15.22:35014) 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2761fd640 1 -- 172.21.15.22:0/794000126 learned_addr learned my addr 172.21.15.22:0/794000126 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2769fe640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff270141e80 0x7ff27013e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2759fc640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2701416f0 0x7ff270139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2761fd640 1 -- 172.21.15.22:0/794000126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff270141e80 msgr2=0x7ff27013e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2761fd640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff270141e80 0x7ff27013e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2761fd640 1 -- 172.21.15.22:0/794000126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2701416f0 msgr2=0x7ff270139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2761fd640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2701416f0 0x7ff270139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2761fd640 1 -- 172.21.15.22:0/794000126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268009b30 con 0x7ff27006d230 2023-11-24T06:13:43.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.990+0000 7ff2761fd640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff27006d230 0x7ff27015c120 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00e9b0 tx=0x7ff26c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:43.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.991+0000 7ff266ffd640 1 -- 172.21.15.22:0/794000126 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c009670 con 0x7ff27006d230 2023-11-24T06:13:43.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.991+0000 7ff266ffd640 1 -- 172.21.15.22:0/794000126 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c00c9a0 con 0x7ff27006d230 2023-11-24T06:13:43.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.991+0000 7ff266ffd640 1 -- 172.21.15.22:0/794000126 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c00cd50 con 0x7ff27006d230 2023-11-24T06:13:43.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.991+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff270136d30 con 0x7ff27006d230 2023-11-24T06:13:43.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.991+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27015c660 con 0x7ff27006d230 2023-11-24T06:13:43.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.992+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27004e840 con 0x7ff27006d230 2023-11-24T06:13:43.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.993+0000 7ff266ffd640 1 -- 172.21.15.22:0/794000126 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff26c013470 con 0x7ff27006d230 2023-11-24T06:13:43.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.994+0000 7ff266ffd640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff25406ae40 0x7ff25406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:43.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.994+0000 7ff266ffd640 1 -- 172.21.15.22:0/794000126 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff26c0898c0 con 0x7ff27006d230 2023-11-24T06:13:43.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.994+0000 7ff2759fc640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff25406ae40 0x7ff25406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:43.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:43.995+0000 7ff2759fc640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff25406ae40 0x7ff25406d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff2700cc960 tx=0x7ff260009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:44.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.000+0000 7ff266ffd640 1 -- 172.21.15.22:0/794000126 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff26c054970 con 0x7ff27006d230 2023-11-24T06:13:44.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.219+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff270140650 con 0x7ff25406ae40 2023-11-24T06:13:44.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.222+0000 7ff266ffd640 1 -- 172.21.15.22:0/794000126 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff270140650 con 0x7ff25406ae40 2023-11-24T06:13:44.225 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-11-24T06:13:44.225 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:13:44.225 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-11-24T06:13:44.225 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:13:44.225 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-11-24T06:13:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.224+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff25406ae40 msgr2=0x7ff25406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.224+0000 7ff2771ff640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff25406ae40 0x7ff25406d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff2700cc960 tx=0x7ff260009040 comp rx=0 tx=0).stop 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.224+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff27006d230 msgr2=0x7ff27015c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.224+0000 7ff2771ff640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff27006d230 0x7ff27015c120 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00e9b0 tx=0x7ff26c00ee70 comp rx=0 tx=0).stop 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.225+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 shutdown_connections 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.225+0000 7ff2771ff640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff25406ae40 0x7ff25406d300 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.225+0000 7ff2771ff640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff270141e80 0x7ff27013e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.225+0000 7ff2771ff640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2701416f0 0x7ff270139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.225+0000 7ff2771ff640 1 --2- 172.21.15.22:0/794000126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff27006d230 0x7ff27015c120 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.225+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 >> 172.21.15.22:0/794000126 conn(0x7ff2700b0840 msgr2=0x7ff27015ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.225+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 shutdown_connections 2023-11-24T06:13:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.225+0000 7ff2771ff640 1 -- 172.21.15.22:0/794000126 wait complete. 2023-11-24T06:13:44.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:13:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.460+0000 7f23969ba640 1 Processor -- start 2023-11-24T06:13:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.460+0000 7f23969ba640 1 -- start start 2023-11-24T06:13:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.461+0000 7f23969ba640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f239015d340 0x7f23900d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.461+0000 7f23969ba640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900cef30 con 0x7f23900cdbb0 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.461+0000 7f23969ba640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900d11a0 con 0x7f23900d1d90 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.461+0000 7f23969ba640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23900ce320 con 0x7f239015d340 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.462+0000 7f23959b8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f239015d340 0x7f23900d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.462+0000 7f23951b7640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f23900cdbb0 0x7f23900d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41150/0 (socket says 172.21.15.22:41150) 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.462+0000 7f23951b7640 1 -- 172.21.15.22:0/3295963134 learned_addr learned my addr 172.21.15.22:0/3295963134 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.463+0000 7f23959b8640 1 -- 172.21.15.22:0/3295963134 >> v1:172.21.15.31:6789/0 conn(0x7f23900d1d90 legacy=0x7f23900b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.463+0000 7f23959b8640 1 -- 172.21.15.22:0/3295963134 >> v1:172.21.15.22:6789/0 conn(0x7f23900cdbb0 legacy=0x7f23900d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.463+0000 7f23959b8640 1 -- 172.21.15.22:0/3295963134 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900ce600 con 0x7f239015d340 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.464+0000 7f23959b8640 1 --2- 172.21.15.22:0/3295963134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f239015d340 0x7f23900d00b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f238c0097a0 tx=0x7f238c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b3582701f429b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.464+0000 7f23949b6640 1 -- 172.21.15.22:0/3295963134 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c030610 con 0x7f239015d340 2023-11-24T06:13:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.464+0000 7f23949b6640 1 -- 172.21.15.22:0/3295963134 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c030770 con 0x7f239015d340 2023-11-24T06:13:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.464+0000 7f23949b6640 1 -- 172.21.15.22:0/3295963134 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c030b00 con 0x7f239015d340 2023-11-24T06:13:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.465+0000 7f23969ba640 1 -- 172.21.15.22:0/3295963134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f239015d340 msgr2=0x7f23900d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.465+0000 7f23969ba640 1 --2- 172.21.15.22:0/3295963134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f239015d340 0x7f23900d00b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f238c0097a0 tx=0x7f238c02b960 comp rx=0 tx=0).stop 2023-11-24T06:13:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.465+0000 7f23969ba640 1 -- 172.21.15.22:0/3295963134 shutdown_connections 2023-11-24T06:13:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.465+0000 7f23969ba640 1 --2- 172.21.15.22:0/3295963134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f239015d340 0x7f23900d00b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.465+0000 7f23969ba640 1 -- 172.21.15.22:0/3295963134 >> 172.21.15.22:0/3295963134 conn(0x7f239009c370 msgr2=0x7f23900d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.465+0000 7f23969ba640 1 -- 172.21.15.22:0/3295963134 shutdown_connections 2023-11-24T06:13:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.465+0000 7f23969ba640 1 -- 172.21.15.22:0/3295963134 wait complete. 2023-11-24T06:13:44.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.467+0000 7f23969ba640 1 Processor -- start 2023-11-24T06:13:44.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.467+0000 7f23969ba640 1 -- start start 2023-11-24T06:13:44.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.468+0000 7f23969ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23900cdbb0 0x7f23901f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.468+0000 7f23969ba640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23900d1d90 0x7f239015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.468+0000 7f23969ba640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f239015d340 0x7f239015f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.468+0000 7f23969ba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239015df60 con 0x7f23900cdbb0 2023-11-24T06:13:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.468+0000 7f23969ba640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239015e200 con 0x7f239015d340 2023-11-24T06:13:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.468+0000 7f23969ba640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239015e4e0 con 0x7f23900d1d90 2023-11-24T06:13:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.468+0000 7f23959b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23900cdbb0 0x7f23901f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.468+0000 7f23959b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23900cdbb0 0x7f23901f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35038/0 (socket says 172.21.15.22:35038) 2023-11-24T06:13:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.468+0000 7f23959b8640 1 -- 172.21.15.22:0/1068078762 learned_addr learned my addr 172.21.15.22:0/1068078762 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23951b7640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23900d1d90 0x7f239015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23961b9640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f239015d340 0x7f239015f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23959b8640 1 -- 172.21.15.22:0/1068078762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23900d1d90 msgr2=0x7f239015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23959b8640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23900d1d90 0x7f239015da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23959b8640 1 -- 172.21.15.22:0/1068078762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f239015d340 msgr2=0x7f239015f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23959b8640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f239015d340 0x7f239015f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23959b8640 1 -- 172.21.15.22:0/1068078762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c009400 con 0x7f23900cdbb0 2023-11-24T06:13:44.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23961b9640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f239015d340 0x7f239015f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:44.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23959b8640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23900cdbb0 0x7f23901f2930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f238c02bf70 tx=0x7f238c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:44.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23827fc640 1 -- 172.21.15.22:0/1068078762 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c03e040 con 0x7f23900cdbb0 2023-11-24T06:13:44.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23827fc640 1 -- 172.21.15.22:0/1068078762 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c039cb0 con 0x7f23900cdbb0 2023-11-24T06:13:44.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.469+0000 7f23827fc640 1 -- 172.21.15.22:0/1068078762 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c044630 con 0x7f23900cdbb0 2023-11-24T06:13:44.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.470+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239015e7c0 con 0x7f23900cdbb0 2023-11-24T06:13:44.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.470+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239015ed80 con 0x7f23900cdbb0 2023-11-24T06:13:44.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.471+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2390067d70 con 0x7f23900cdbb0 2023-11-24T06:13:44.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.472+0000 7f23827fc640 1 -- 172.21.15.22:0/1068078762 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f238c043390 con 0x7f23900cdbb0 2023-11-24T06:13:44.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.473+0000 7f23827fc640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f237406ae70 0x7f237406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.473+0000 7f23827fc640 1 -- 172.21.15.22:0/1068078762 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f238c0ab910 con 0x7f23900cdbb0 2023-11-24T06:13:44.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.473+0000 7f23951b7640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f237406ae70 0x7f237406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.474+0000 7f23951b7640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f237406ae70 0x7f237406d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23900d2650 tx=0x7f2384009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:44.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.478+0000 7f23827fc640 1 -- 172.21.15.22:0/1068078762 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f238c0769b0 con 0x7f23900cdbb0 2023-11-24T06:13:44.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.675+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f239004e840 con 0x7f23900cdbb0 2023-11-24T06:13:44.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.676+0000 7f23827fc640 1 -- 172.21.15.22:0/1068078762 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f238c079fd0 con 0x7f23900cdbb0 2023-11-24T06:13:44.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f237406ae70 msgr2=0x7f237406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f237406ae70 0x7f237406d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23900d2650 tx=0x7f2384009040 comp rx=0 tx=0).stop 2023-11-24T06:13:44.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23900cdbb0 msgr2=0x7f23901f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23900cdbb0 0x7f23901f2930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f238c02bf70 tx=0x7f238c004730 comp rx=0 tx=0).stop 2023-11-24T06:13:44.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 shutdown_connections 2023-11-24T06:13:44.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f237406ae70 0x7f237406d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f239015d340 0x7f239015f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23900d1d90 0x7f239015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 --2- 172.21.15.22:0/1068078762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23900cdbb0 0x7f23901f2930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 >> 172.21.15.22:0/1068078762 conn(0x7f239009c370 msgr2=0x7f23900b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:44.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 shutdown_connections 2023-11-24T06:13:44.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:44.679+0000 7f23969ba640 1 -- 172.21.15.22:0/1068078762 wait complete. 2023-11-24T06:13:44.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:44.702 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp1834/subvol426) 2023-11-24T06:13:44.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:44.816 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2023-11-24T06:13:44.872 INFO:teuthology.orchestra.run.smithi022.stdout:cephfs_data 2023-11-24T06:13:44.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:44.872 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp1834/subvol426) 2023-11-24T06:13:44.988 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:13:44.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp1834/subvol426/.meta 2023-11-24T06:13:45.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol426 subvol_grp1834 2023-11-24T06:13:45.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.380+0000 7f2a039dc640 1 Processor -- start 2023-11-24T06:13:45.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.381+0000 7f2a039dc640 1 -- start start 2023-11-24T06:13:45.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.382+0000 7f2a039dc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f29fc09cb30 0x7f29fc0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.382+0000 7f2a039dc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 0x7f29fc0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.382+0000 7f2a039dc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc15b730 con 0x7f29fc15b350 2023-11-24T06:13:45.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.382+0000 7f2a039dc640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc0ac740 con 0x7f29fc09cb30 2023-11-24T06:13:45.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.382+0000 7f2a039dc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc0ac460 con 0x7f29fc0adb60 2023-11-24T06:13:45.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.383+0000 7f2a00f77640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f29fc09cb30 0x7f29fc0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.383+0000 7f2a00f77640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f29fc09cb30 0x7f29fc0abe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35040/0 (socket says 172.21.15.22:35040) 2023-11-24T06:13:45.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.383+0000 7f2a00f77640 1 -- 172.21.15.22:0/2162143183 learned_addr learned my addr 172.21.15.22:0/2162143183 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:45.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.383+0000 7f2a01f79640 1 --2- 172.21.15.22:0/2162143183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 0x7f29fc0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.383+0000 7f2a00f77640 1 -- 172.21.15.22:0/2162143183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 msgr2=0x7f29fc0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:45.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.383+0000 7f2a00f77640 1 --2- 172.21.15.22:0/2162143183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 0x7f29fc0adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.383+0000 7f2a00f77640 1 -- 172.21.15.22:0/2162143183 >> v1:172.21.15.31:6789/0 conn(0x7f29fc15b350 legacy=0x7f29fc0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:45.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.383+0000 7f2a00f77640 1 -- 172.21.15.22:0/2162143183 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0b2a50 con 0x7f29fc09cb30 2023-11-24T06:13:45.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.384+0000 7f2a00f77640 1 --2- 172.21.15.22:0/2162143183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 0x7f29fc0abe80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009870 tx=0x7f29f002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56099006c37895e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.385+0000 7f29effff640 1 -- 172.21.15.22:0/2162143183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0031640 con 0x7f29fc09cb30 2023-11-24T06:13:45.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.385+0000 7f29effff640 1 -- 172.21.15.22:0/2162143183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f00317a0 con 0x7f29fc09cb30 2023-11-24T06:13:45.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.385+0000 7f29effff640 1 -- 172.21.15.22:0/2162143183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0031b30 con 0x7f29fc09cb30 2023-11-24T06:13:45.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.386+0000 7f2a039dc640 1 -- 172.21.15.22:0/2162143183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 msgr2=0x7f29fc0abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.386+0000 7f2a039dc640 1 --2- 172.21.15.22:0/2162143183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 0x7f29fc0abe80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009870 tx=0x7f29f002b8f0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.386+0000 7f2a039dc640 1 -- 172.21.15.22:0/2162143183 shutdown_connections 2023-11-24T06:13:45.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.386+0000 7f2a039dc640 1 --2- 172.21.15.22:0/2162143183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 0x7f29fc0adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.386+0000 7f2a039dc640 1 --2- 172.21.15.22:0/2162143183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 0x7f29fc0abe80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.386+0000 7f2a039dc640 1 -- 172.21.15.22:0/2162143183 >> 172.21.15.22:0/2162143183 conn(0x7f29fc0b0ba0 msgr2=0x7f29fc0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:45.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.386+0000 7f2a039dc640 1 -- 172.21.15.22:0/2162143183 shutdown_connections 2023-11-24T06:13:45.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.386+0000 7f2a039dc640 1 -- 172.21.15.22:0/2162143183 wait complete. 2023-11-24T06:13:45.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.388+0000 7f2a039dc640 1 Processor -- start 2023-11-24T06:13:45.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.388+0000 7f2a039dc640 1 -- start start 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a039dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 0x7f29fc149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a039dc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 0x7f29fc14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a039dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29fc15b350 0x7f29fc0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a039dc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc14b9d0 con 0x7f29fc09cb30 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a039dc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc14bcb0 con 0x7f29fc15b350 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a039dc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc14bf90 con 0x7f29fc0adb60 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a01778640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 0x7f29fc149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a01778640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 0x7f29fc149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35052/0 (socket says 172.21.15.22:35052) 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a01778640 1 -- 172.21.15.22:0/1860701096 learned_addr learned my addr 172.21.15.22:0/1860701096 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a00f77640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 0x7f29fc14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a01f79640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29fc15b350 0x7f29fc0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a01778640 1 -- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 msgr2=0x7f29fc14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a01778640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 0x7f29fc14d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a01778640 1 -- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29fc15b350 msgr2=0x7f29fc0714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a01778640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29fc15b350 0x7f29fc0714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.389+0000 7f2a01778640 1 -- 172.21.15.22:0/1860701096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f00094d0 con 0x7f29fc09cb30 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.390+0000 7f2a00f77640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 0x7f29fc14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.390+0000 7f2a01f79640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29fc15b350 0x7f29fc0714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.390+0000 7f2a01778640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 0x7f29fc149830 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f29f800b3f0 tx=0x7f29f800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.390+0000 7f29edffb640 1 -- 172.21.15.22:0/1860701096 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8011830 con 0x7f29fc09cb30 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.390+0000 7f29edffb640 1 -- 172.21.15.22:0/1860701096 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f8011990 con 0x7f29fc09cb30 2023-11-24T06:13:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.390+0000 7f29edffb640 1 -- 172.21.15.22:0/1860701096 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8011d40 con 0x7f29fc09cb30 2023-11-24T06:13:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.390+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc14c270 con 0x7f29fc09cb30 2023-11-24T06:13:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.390+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc14b680 con 0x7f29fc09cb30 2023-11-24T06:13:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.392+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc14d9d0 con 0x7f29fc09cb30 2023-11-24T06:13:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.392+0000 7f29edffb640 1 -- 172.21.15.22:0/1860701096 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f29f801a400 con 0x7f29fc09cb30 2023-11-24T06:13:45.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.394+0000 7f29edffb640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f29e006ae40 0x7f29e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.394+0000 7f29edffb640 1 -- 172.21.15.22:0/1860701096 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29f80894d0 con 0x7f29fc09cb30 2023-11-24T06:13:45.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.394+0000 7f2a00f77640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f29e006ae40 0x7f29e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.395+0000 7f2a00f77640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f29e006ae40 0x7f29e006d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f29f0036000 tx=0x7f29f003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.399+0000 7f29edffb640 1 -- 172.21.15.22:0/1860701096 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f29f8054570 con 0x7f29fc09cb30 2023-11-24T06:13:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.624+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol426", "group_name": "subvol_grp1834", "target": ["mon-mgr", ""]}) v1 -- 0x7f29fc0ae4f0 con 0x7f29e006ae40 2023-11-24T06:13:45.637 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:45.634+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:45.637 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:45.634+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:45.637 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:45.634+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:45.637 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:45.634+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:45.637 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:45.634+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:45.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.690+0000 7f29edffb640 1 -- 172.21.15.22:0/1860701096 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f29f0031a10 con 0x7f29e006ae40 2023-11-24T06:13:45.693 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/subvol_grp1834/subvol426 2023-11-24T06:13:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f29e006ae40 msgr2=0x7f29e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f29e006ae40 0x7f29e006d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f29f0036000 tx=0x7f29f003c040 comp rx=0 tx=0).stop 2023-11-24T06:13:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 msgr2=0x7f29fc149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 0x7f29fc149830 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f29f800b3f0 tx=0x7f29f800b8b0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 shutdown_connections 2023-11-24T06:13:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f29e006ae40 0x7f29e006d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29fc15b350 0x7f29fc0714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f29fc0adb60 0x7f29fc14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 --2- 172.21.15.22:0/1860701096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29fc09cb30 0x7f29fc149830 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 >> 172.21.15.22:0/1860701096 conn(0x7f29fc0b0ba0 msgr2=0x7f29fc0afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.693+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 shutdown_connections 2023-11-24T06:13:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.694+0000 7f2a039dc640 1 -- 172.21.15.22:0/1860701096 wait complete. 2023-11-24T06:13:45.717 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol426 subvol_grp1834 2023-11-24T06:13:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.935+0000 7f61c5c8c640 1 Processor -- start 2023-11-24T06:13:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.935+0000 7f61c5c8c640 1 -- start start 2023-11-24T06:13:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.937+0000 7f61c5c8c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c015efa0 0x7f61c0161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.937+0000 7f61c5c8c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61c006da40 0x7f61c006c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.937+0000 7f61c5c8c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c006c9a0 con 0x7f61c00b2970 2023-11-24T06:13:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.937+0000 7f61c5c8c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c006cc80 con 0x7f61c006da40 2023-11-24T06:13:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.937+0000 7f61c5c8c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c006cf60 con 0x7f61c015efa0 2023-11-24T06:13:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.938+0000 7f61bffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61c006da40 0x7f61c006c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.938+0000 7f61c548b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f61c00b2970 0x7f61c01650f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41160/0 (socket says 172.21.15.22:41160) 2023-11-24T06:13:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.938+0000 7f61c548b640 1 -- 172.21.15.22:0/991509839 learned_addr learned my addr 172.21.15.22:0/991509839 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.938+0000 7f61c4c8a640 1 --2- 172.21.15.22:0/991509839 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c015efa0 0x7f61c0161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.938+0000 7f61bffff640 1 -- 172.21.15.22:0/991509839 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c015efa0 msgr2=0x7f61c0161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.938+0000 7f61bffff640 1 --2- 172.21.15.22:0/991509839 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c015efa0 0x7f61c0161ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.938+0000 7f61bffff640 1 -- 172.21.15.22:0/991509839 >> v1:172.21.15.22:6789/0 conn(0x7f61c00b2970 legacy=0x7f61c01650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.938+0000 7f61bffff640 1 -- 172.21.15.22:0/991509839 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c006d240 con 0x7f61c006da40 2023-11-24T06:13:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.938+0000 7f61bf7fe640 1 -- 172.21.15.22:0/991509839 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572217510 0 0) 0x7f61c006c9a0 con 0x7f61c00b2970 2023-11-24T06:13:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.940+0000 7f61bffff640 1 --2- 172.21.15.22:0/991509839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006da40 0x7f61c006c310 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0097a0 tx=0x7f61ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e739e8d5795bc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.940+0000 7f61bf7fe640 1 -- 172.21.15.22:0/991509839 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac031830 con 0x7f61c006da40 2023-11-24T06:13:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.940+0000 7f61bf7fe640 1 -- 172.21.15.22:0/991509839 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac031990 con 0x7f61c006da40 2023-11-24T06:13:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.940+0000 7f61bf7fe640 1 -- 172.21.15.22:0/991509839 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac031d20 con 0x7f61c006da40 2023-11-24T06:13:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.941+0000 7f61c5c8c640 1 -- 172.21.15.22:0/991509839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006da40 msgr2=0x7f61c006c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.941+0000 7f61c5c8c640 1 --2- 172.21.15.22:0/991509839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006da40 0x7f61c006c310 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0097a0 tx=0x7f61ac02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.941+0000 7f61c5c8c640 1 -- 172.21.15.22:0/991509839 shutdown_connections 2023-11-24T06:13:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.941+0000 7f61c5c8c640 1 --2- 172.21.15.22:0/991509839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c006da40 0x7f61c006c310 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.941+0000 7f61c5c8c640 1 --2- 172.21.15.22:0/991509839 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c015efa0 0x7f61c0161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.941+0000 7f61c5c8c640 1 -- 172.21.15.22:0/991509839 >> 172.21.15.22:0/991509839 conn(0x7f61c00cec10 msgr2=0x7f61c00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.941+0000 7f61c5c8c640 1 -- 172.21.15.22:0/991509839 shutdown_connections 2023-11-24T06:13:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.941+0000 7f61c5c8c640 1 -- 172.21.15.22:0/991509839 wait complete. 2023-11-24T06:13:45.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.943+0000 7f61c5c8c640 1 Processor -- start 2023-11-24T06:13:45.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.943+0000 7f61c5c8c640 1 -- start start 2023-11-24T06:13:45.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.944+0000 7f61c5c8c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c006da40 0x7f61c0071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.944+0000 7f61c5c8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00b2970 0x7f61c01636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.944+0000 7f61c5c8c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c015efa0 0x7f61c014cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.944+0000 7f61c5c8c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00b0950 con 0x7f61c015efa0 2023-11-24T06:13:45.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.944+0000 7f61c5c8c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0072170 con 0x7f61c00b2970 2023-11-24T06:13:45.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.944+0000 7f61c5c8c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00cf050 con 0x7f61c006da40 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.944+0000 7f61c548b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c015efa0 0x7f61c014cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.944+0000 7f61c548b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c015efa0 0x7f61c014cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35092/0 (socket says 172.21.15.22:35092) 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.944+0000 7f61c548b640 1 -- 172.21.15.22:0/995020036 learned_addr learned my addr 172.21.15.22:0/995020036 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61bffff640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00b2970 0x7f61c01636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61c4c8a640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c006da40 0x7f61c0071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61c548b640 1 -- 172.21.15.22:0/995020036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c006da40 msgr2=0x7f61c0071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61c548b640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c006da40 0x7f61c0071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61c548b640 1 -- 172.21.15.22:0/995020036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00b2970 msgr2=0x7f61c01636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61c548b640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00b2970 0x7f61c01636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61c548b640 1 -- 172.21.15.22:0/995020036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac009400 con 0x7f61c015efa0 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61c4c8a640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c006da40 0x7f61c0071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61c548b640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c015efa0 0x7f61c014cb00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c810 tx=0x7f61b800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61bd7fa640 1 -- 172.21.15.22:0/995020036 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800a640 con 0x7f61c015efa0 2023-11-24T06:13:45.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61bd7fa640 1 -- 172.21.15.22:0/995020036 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b800a7c0 con 0x7f61c015efa0 2023-11-24T06:13:45.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61bd7fa640 1 -- 172.21.15.22:0/995020036 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800ab70 con 0x7f61c015efa0 2023-11-24T06:13:45.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.945+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c00cf330 con 0x7f61c015efa0 2023-11-24T06:13:45.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.946+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c00b05e0 con 0x7f61c015efa0 2023-11-24T06:13:45.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.947+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c01f72e0 con 0x7f61c015efa0 2023-11-24T06:13:45.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.948+0000 7f61bd7fa640 1 -- 172.21.15.22:0/995020036 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61b800acd0 con 0x7f61c015efa0 2023-11-24T06:13:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.949+0000 7f61bd7fa640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a406ae40 0x7f61a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.949+0000 7f61bd7fa640 1 -- 172.21.15.22:0/995020036 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61b8088b40 con 0x7f61c015efa0 2023-11-24T06:13:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.950+0000 7f61c4c8a640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a406ae40 0x7f61a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.950+0000 7f61c4c8a640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a406ae40 0x7f61a406d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f61b4006fd0 tx=0x7f61b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:45.954+0000 7f61bd7fa640 1 -- 172.21.15.22:0/995020036 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61b8053b50 con 0x7f61c015efa0 2023-11-24T06:13:46.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.177+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol426", "group_name": "subvol_grp1834", "target": ["mon-mgr", ""]}) v1 -- 0x7f61c00b0180 con 0x7f61a406ae40 2023-11-24T06:13:46.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.186+0000 7f61bd7fa640 1 -- 172.21.15.22:0/995020036 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f61b4009550 con 0x7f61a406ae40 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/subvol_grp1834/subvol426 2023-11-24T06:13:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.188+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a406ae40 msgr2=0x7f61a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.188+0000 7f61c5c8c640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a406ae40 0x7f61a406d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f61b4006fd0 tx=0x7f61b4008040 comp rx=0 tx=0).stop 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.188+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c015efa0 msgr2=0x7f61c014cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.188+0000 7f61c5c8c640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c015efa0 0x7f61c014cb00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c810 tx=0x7f61b800ccd0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.189+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 shutdown_connections 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.189+0000 7f61c5c8c640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f61a406ae40 0x7f61a406d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.189+0000 7f61c5c8c640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c015efa0 0x7f61c014cb00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.189+0000 7f61c5c8c640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61c00b2970 0x7f61c01636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.189+0000 7f61c5c8c640 1 --2- 172.21.15.22:0/995020036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61c006da40 0x7f61c0071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.189+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 >> 172.21.15.22:0/995020036 conn(0x7f61c00cec10 msgr2=0x7f61c015cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.189+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 shutdown_connections 2023-11-24T06:13:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:46.189+0000 7f61c5c8c640 1 -- 172.21.15.22:0/995020036 wait complete. 2023-11-24T06:13:46.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:46.210 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/bbf25c5a10f4b060853bdf7631ab0167.meta) 2023-11-24T06:13:49.971 INFO:teuthology.orchestra.run.smithi022.stdout:[GLOBAL] 2023-11-24T06:13:49.971 INFO:teuthology.orchestra.run.smithi022.stdout:version = 1 2023-11-24T06:13:49.971 INFO:teuthology.orchestra.run.smithi022.stdout:type = subvolume 2023-11-24T06:13:49.972 INFO:teuthology.orchestra.run.smithi022.stdout:path = /volumes/subvol_grp1834/subvol426 2023-11-24T06:13:49.972 INFO:teuthology.orchestra.run.smithi022.stdout:state = complete 2023-11-24T06:13:49.972 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:49.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol426 subvol_grp1834 2023-11-24T06:13:50.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.209+0000 7fc39359e640 1 Processor -- start 2023-11-24T06:13:50.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.209+0000 7fc39359e640 1 -- start start 2023-11-24T06:13:50.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.211+0000 7fc39359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc394153ea0 0x7fc3940ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.211+0000 7fc39359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394154280 0x7fc39415d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.211+0000 7fc39359e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940ce650 con 0x7fc394070850 2023-11-24T06:13:50.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.211+0000 7fc39359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39415ddd0 con 0x7fc394153ea0 2023-11-24T06:13:50.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.211+0000 7fc39359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39415e0a0 con 0x7fc394154280 2023-11-24T06:13:50.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.212+0000 7fc39259c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc394153ea0 0x7fc3940ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.212+0000 7fc391d9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394154280 0x7fc39415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.212+0000 7fc39259c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc394153ea0 0x7fc3940ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:59870/0 (socket says 172.21.15.22:59870) 2023-11-24T06:13:50.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.212+0000 7fc39259c640 1 -- 172.21.15.22:0/2618532061 learned_addr learned my addr 172.21.15.22:0/2618532061 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:50.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.213+0000 7fc39259c640 1 -- 172.21.15.22:0/2618532061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394154280 msgr2=0x7fc39415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:50.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.213+0000 7fc39259c640 1 --2- 172.21.15.22:0/2618532061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394154280 0x7fc39415d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.213+0000 7fc39259c640 1 -- 172.21.15.22:0/2618532061 >> v1:172.21.15.31:6789/0 conn(0x7fc394070850 legacy=0x7fc394071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.213+0000 7fc39259c640 1 -- 172.21.15.22:0/2618532061 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39415e380 con 0x7fc394153ea0 2023-11-24T06:13:50.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.214+0000 7fc39259c640 1 --2- 172.21.15.22:0/2618532061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 0x7fc3940ad450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc384009870 tx=0x7fc38402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83df49746123ea57 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.214+0000 7fc39159a640 1 -- 172.21.15.22:0/2618532061 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384030840 con 0x7fc394153ea0 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39159a640 1 -- 172.21.15.22:0/2618532061 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3840309a0 con 0x7fc394153ea0 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39159a640 1 -- 172.21.15.22:0/2618532061 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384030d30 con 0x7fc394153ea0 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39359e640 1 -- 172.21.15.22:0/2618532061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 msgr2=0x7fc3940ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39359e640 1 --2- 172.21.15.22:0/2618532061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 0x7fc3940ad450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc384009870 tx=0x7fc38402b980 comp rx=0 tx=0).stop 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39359e640 1 -- 172.21.15.22:0/2618532061 shutdown_connections 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39359e640 1 --2- 172.21.15.22:0/2618532061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394154280 0x7fc39415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39359e640 1 --2- 172.21.15.22:0/2618532061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 0x7fc3940ad450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39359e640 1 -- 172.21.15.22:0/2618532061 >> 172.21.15.22:0/2618532061 conn(0x7fc3940cec10 msgr2=0x7fc3940cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39359e640 1 -- 172.21.15.22:0/2618532061 shutdown_connections 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.215+0000 7fc39359e640 1 -- 172.21.15.22:0/2618532061 wait complete. 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.217+0000 7fc39359e640 1 Processor -- start 2023-11-24T06:13:50.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.217+0000 7fc39359e640 1 -- start start 2023-11-24T06:13:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.218+0000 7fc39359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394070850 0x7fc39414c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.218+0000 7fc39359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 0x7fc394137d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.218+0000 7fc39359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc394154280 0x7fc394155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.218+0000 7fc39359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940aefd0 con 0x7fc394154280 2023-11-24T06:13:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.218+0000 7fc39359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940b1830 con 0x7fc394153ea0 2023-11-24T06:13:50.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.218+0000 7fc39359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940b12d0 con 0x7fc394070850 2023-11-24T06:13:50.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc392d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc394154280 0x7fc394155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc392d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc394154280 0x7fc394155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35104/0 (socket says 172.21.15.22:35104) 2023-11-24T06:13:50.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc392d9d640 1 -- 172.21.15.22:0/2257982192 learned_addr learned my addr 172.21.15.22:0/2257982192 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:50.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc39259c640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394070850 0x7fc39414c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc391d9b640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 0x7fc394137d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc392d9d640 1 -- 172.21.15.22:0/2257982192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394070850 msgr2=0x7fc39414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc392d9d640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394070850 0x7fc39414c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc392d9d640 1 -- 172.21.15.22:0/2257982192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 msgr2=0x7fc394137d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc392d9d640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 0x7fc394137d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc392d9d640 1 -- 172.21.15.22:0/2257982192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3840094d0 con 0x7fc394154280 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.219+0000 7fc391d9b640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 0x7fc394137d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.220+0000 7fc392d9d640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc394154280 0x7fc394155940 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c7a0 tx=0x7fc38c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.220+0000 7fc382ffd640 1 -- 172.21.15.22:0/2257982192 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c003b70 con 0x7fc394154280 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.220+0000 7fc382ffd640 1 -- 172.21.15.22:0/2257982192 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c003cf0 con 0x7fc394154280 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.220+0000 7fc382ffd640 1 -- 172.21.15.22:0/2257982192 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c003ea0 con 0x7fc394154280 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.220+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39414dad0 con 0x7fc394154280 2023-11-24T06:13:50.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.220+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3940aea10 con 0x7fc394154280 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.221+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39404e840 con 0x7fc394154280 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.222+0000 7fc382ffd640 1 -- 172.21.15.22:0/2257982192 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fc38c00aa90 con 0x7fc394154280 2023-11-24T06:13:50.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.223+0000 7fc382ffd640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc37406aed0 0x7fc37406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.223+0000 7fc382ffd640 1 -- 172.21.15.22:0/2257982192 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc38c089430 con 0x7fc394154280 2023-11-24T06:13:50.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.224+0000 7fc39259c640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc37406aed0 0x7fc37406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.224+0000 7fc39259c640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc37406aed0 0x7fc37406d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc384036000 tx=0x7fc384008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.228+0000 7fc382ffd640 1 -- 172.21.15.22:0/2257982192 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc38c054480 con 0x7fc394154280 2023-11-24T06:13:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.449+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol426", "group_name": "subvol_grp1834", "target": ["mon-mgr", ""]}) v1 -- 0x7fc394070330 con 0x7fc37406aed0 2023-11-24T06:13:50.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.483+0000 7fc382ffd640 1 -- 172.21.15.22:0/2257982192 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc384030c80 con 0x7fc37406aed0 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc37406aed0 msgr2=0x7fc37406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc37406aed0 0x7fc37406d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc384036000 tx=0x7fc384008030 comp rx=0 tx=0).stop 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc394154280 msgr2=0x7fc394155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc394154280 0x7fc394155940 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c7a0 tx=0x7fc38c00cc60 comp rx=0 tx=0).stop 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 shutdown_connections 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc37406aed0 0x7fc37406d390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc394154280 0x7fc394155940 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc394153ea0 0x7fc394137d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 --2- 172.21.15.22:0/2257982192 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc394070850 0x7fc39414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 >> 172.21.15.22:0/2257982192 conn(0x7fc3940cec10 msgr2=0x7fc3940ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 shutdown_connections 2023-11-24T06:13:50.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.486+0000 7fc39359e640 1 -- 172.21.15.22:0/2257982192 wait complete. 2023-11-24T06:13:50.493 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.491+0000 7fed0ebfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.493 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.491+0000 7fed0ebfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.493 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.491+0000 7fed0ebfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.494 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.491+0000 7fed0ebfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.494 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.491+0000 7fed0ebfe640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:50.510 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-24T06:13:50.517 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.512+0000 7fed0dbfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.517 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.512+0000 7fed0dbfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.517 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.512+0000 7fed0dbfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.517 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.512+0000 7fed0dbfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.518 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:13:50.512+0000 7fed0dbfc640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:13:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:2 2023-11-24T06:13:50.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp1834 2023-11-24T06:13:50.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.767+0000 7f44d574e640 1 Processor -- start 2023-11-24T06:13:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.767+0000 7f44d574e640 1 -- start start 2023-11-24T06:13:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.769+0000 7f44d574e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44d00714e0 0x7f44d006a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.769+0000 7f44d574e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d00b3290 con 0x7f44d00b2eb0 2023-11-24T06:13:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.769+0000 7f44d574e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d015e350 con 0x7f44d01618d0 2023-11-24T06:13:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.769+0000 7f44d574e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d0161d10 con 0x7f44d00714e0 2023-11-24T06:13:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.769+0000 7f44cffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f44d00b2eb0 0x7f44d015d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41170/0 (socket says 172.21.15.22:41170) 2023-11-24T06:13:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.769+0000 7f44cffff640 1 -- 172.21.15.22:0/2263469942 learned_addr learned my addr 172.21.15.22:0/2263469942 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.769+0000 7f44d4f4d640 1 --2- 172.21.15.22:0/2263469942 >> v2:172.21.15.22:3300/0 conn(0x7f44d00714e0 0x7f44d006a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.770+0000 7f44ceffd640 1 -- 172.21.15.22:0/2263469942 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721661900 0 0) 0x7f44d00b3290 con 0x7f44d00b2eb0 2023-11-24T06:13:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.770+0000 7f44ceffd640 1 -- 172.21.15.22:0/2263469942 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b8003520 con 0x7f44d00b2eb0 2023-11-24T06:13:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.770+0000 7f44d4f4d640 1 -- 172.21.15.22:0/2263469942 >> v1:172.21.15.31:6789/0 conn(0x7f44d01618d0 legacy=0x7f44d0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.770+0000 7f44d4f4d640 1 -- 172.21.15.22:0/2263469942 >> v1:172.21.15.22:6789/0 conn(0x7f44d00b2eb0 legacy=0x7f44d015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.770+0000 7f44d4f4d640 1 -- 172.21.15.22:0/2263469942 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d015e630 con 0x7f44d00714e0 2023-11-24T06:13:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.771+0000 7f44d4f4d640 1 --2- 172.21.15.22:0/2263469942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00714e0 0x7f44d006a440 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f44c80097a0 tx=0x7f44c802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac15ba1fdc88eaf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.771+0000 7f44ceffd640 1 -- 172.21.15.22:0/2263469942 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8030610 con 0x7f44d00714e0 2023-11-24T06:13:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.772+0000 7f44ceffd640 1 -- 172.21.15.22:0/2263469942 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c8030770 con 0x7f44d00714e0 2023-11-24T06:13:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.772+0000 7f44ceffd640 1 -- 172.21.15.22:0/2263469942 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8030ae0 con 0x7f44d00714e0 2023-11-24T06:13:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.772+0000 7f44d574e640 1 -- 172.21.15.22:0/2263469942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00714e0 msgr2=0x7f44d006a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.772+0000 7f44d574e640 1 --2- 172.21.15.22:0/2263469942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00714e0 0x7f44d006a440 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f44c80097a0 tx=0x7f44c802b960 comp rx=0 tx=0).stop 2023-11-24T06:13:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.772+0000 7f44d574e640 1 -- 172.21.15.22:0/2263469942 shutdown_connections 2023-11-24T06:13:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.772+0000 7f44d574e640 1 --2- 172.21.15.22:0/2263469942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00714e0 0x7f44d006a440 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.772+0000 7f44d574e640 1 -- 172.21.15.22:0/2263469942 >> 172.21.15.22:0/2263469942 conn(0x7f44d00b15c0 msgr2=0x7f44d00b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.772+0000 7f44d574e640 1 -- 172.21.15.22:0/2263469942 shutdown_connections 2023-11-24T06:13:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.772+0000 7f44d574e640 1 -- 172.21.15.22:0/2263469942 wait complete. 2023-11-24T06:13:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.774+0000 7f44d574e640 1 Processor -- start 2023-11-24T06:13:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.774+0000 7f44d574e640 1 -- start start 2023-11-24T06:13:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.775+0000 7f44d574e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44d00714e0 0x7f44d0149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.775+0000 7f44d574e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00b2eb0 0x7f44d015f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.775+0000 7f44d574e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44d01618d0 0x7f44d015fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.775+0000 7f44d574e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d014b160 con 0x7f44d00b2eb0 2023-11-24T06:13:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.775+0000 7f44d574e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d01495c0 con 0x7f44d00714e0 2023-11-24T06:13:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.775+0000 7f44d574e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d01f3e60 con 0x7f44d01618d0 2023-11-24T06:13:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44cf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00b2eb0 0x7f44d015f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44cf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00b2eb0 0x7f44d015f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35162/0 (socket says 172.21.15.22:35162) 2023-11-24T06:13:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44cf7fe640 1 -- 172.21.15.22:0/1056614851 learned_addr learned my addr 172.21.15.22:0/1056614851 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44cffff640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44d00714e0 0x7f44d0149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44d4f4d640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44d01618d0 0x7f44d015fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44cf7fe640 1 -- 172.21.15.22:0/1056614851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44d01618d0 msgr2=0x7f44d015fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44cf7fe640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44d01618d0 0x7f44d015fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44cf7fe640 1 -- 172.21.15.22:0/1056614851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44d00714e0 msgr2=0x7f44d0149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44cf7fe640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44d00714e0 0x7f44d0149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.776+0000 7f44cf7fe640 1 -- 172.21.15.22:0/1056614851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c8009400 con 0x7f44d00b2eb0 2023-11-24T06:13:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.777+0000 7f44cf7fe640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00b2eb0 0x7f44d015f980 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c3f0 tx=0x7f44c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.777+0000 7f44ccff9640 1 -- 172.21.15.22:0/1056614851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c40052d0 con 0x7f44d00b2eb0 2023-11-24T06:13:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.777+0000 7f44ccff9640 1 -- 172.21.15.22:0/1056614851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c4005470 con 0x7f44d00b2eb0 2023-11-24T06:13:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.777+0000 7f44ccff9640 1 -- 172.21.15.22:0/1056614851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4006a60 con 0x7f44d00b2eb0 2023-11-24T06:13:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.777+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d014e490 con 0x7f44d00b2eb0 2023-11-24T06:13:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.777+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d014b690 con 0x7f44d00b2eb0 2023-11-24T06:13:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.778+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d004e840 con 0x7f44d00b2eb0 2023-11-24T06:13:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.779+0000 7f44ccff9640 1 -- 172.21.15.22:0/1056614851 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f44c4006bc0 con 0x7f44d00b2eb0 2023-11-24T06:13:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.780+0000 7f44ccff9640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f44bc06aed0 0x7f44bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.780+0000 7f44ccff9640 1 -- 172.21.15.22:0/1056614851 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44c40889a0 con 0x7f44d00b2eb0 2023-11-24T06:13:50.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.780+0000 7f44cffff640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f44bc06aed0 0x7f44bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.781+0000 7f44cffff640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f44bc06aed0 0x7f44bc06d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f44c0001560 tx=0x7f44c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:50.785+0000 7f44ccff9640 1 -- 172.21.15.22:0/1056614851 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44c40539f0 con 0x7f44d00b2eb0 2023-11-24T06:13:50.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:50.837 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:51.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.010+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp1834", "target": ["mon-mgr", ""]}) v1 -- 0x7f44d00ae3c0 con 0x7f44bc06aed0 2023-11-24T06:13:51.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.021+0000 7f44ccff9640 1 -- 172.21.15.22:0/1056614851 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f44d00ae3c0 con 0x7f44bc06aed0 2023-11-24T06:13:51.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f44bc06aed0 msgr2=0x7f44bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f44bc06aed0 0x7f44bc06d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f44c0001560 tx=0x7f44c0009040 comp rx=0 tx=0).stop 2023-11-24T06:13:51.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00b2eb0 msgr2=0x7f44d015f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00b2eb0 0x7f44d015f980 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c3f0 tx=0x7f44c400c8b0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 shutdown_connections 2023-11-24T06:13:51.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f44bc06aed0 0x7f44bc06d390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44d01618d0 0x7f44d015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d00b2eb0 0x7f44d015f980 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 --2- 172.21.15.22:0/1056614851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44d00714e0 0x7f44d0149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.023+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 >> 172.21.15.22:0/1056614851 conn(0x7f44d00b15c0 msgr2=0x7f44d006ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:51.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.024+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 shutdown_connections 2023-11-24T06:13:51.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.024+0000 7f44d574e640 1 -- 172.21.15.22:0/1056614851 wait complete. 2023-11-24T06:13:51.044 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:13:51.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:13:51.160 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:13:51.289 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:13:51.289 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:13:51.289 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:51.354 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:51.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.582+0000 7f7536b99640 1 Processor -- start 2023-11-24T06:13:51.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.582+0000 7f7536b99640 1 -- start start 2023-11-24T06:13:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.584+0000 7f7536b99640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753013dfd0 0x7f753015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.584+0000 7f7536b99640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f75300cf050 0x7f75300cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.584+0000 7f7536b99640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f753006c130 0x7f753006c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.584+0000 7f7536b99640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75300cfa10 con 0x7f753006c130 2023-11-24T06:13:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.584+0000 7f7536b99640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753015fa70 con 0x7f75300cf050 2023-11-24T06:13:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.584+0000 7f7536b99640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753015ee60 con 0x7f753013dfd0 2023-11-24T06:13:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.584+0000 7f7536398640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f753006c130 0x7f753006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.584+0000 7f7536398640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f753006c130 0x7f753006c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43376/0 (socket says 172.21.15.22:43376) 2023-11-24T06:13:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.584+0000 7f7536398640 1 -- 172.21.15.22:0/2868119279 learned_addr learned my addr 172.21.15.22:0/2868119279 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.585+0000 7f7535b97640 1 --2- 172.21.15.22:0/2868119279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753013dfd0 0x7f753015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.585+0000 7f7535396640 1 --2- 172.21.15.22:0/2868119279 >> v2:172.21.15.31:3300/0 conn(0x7f75300cf050 0x7f75300cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.585+0000 7f7536398640 1 -- 172.21.15.22:0/2868119279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753013dfd0 msgr2=0x7f753015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.585+0000 7f7536398640 1 --2- 172.21.15.22:0/2868119279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753013dfd0 0x7f753015be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.585+0000 7f7536398640 1 -- 172.21.15.22:0/2868119279 >> v2:172.21.15.31:3300/0 conn(0x7f75300cf050 msgr2=0x7f75300cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.585+0000 7f7536398640 1 --2- 172.21.15.22:0/2868119279 >> v2:172.21.15.31:3300/0 conn(0x7f75300cf050 0x7f75300cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.585+0000 7f7536398640 1 -- 172.21.15.22:0/2868119279 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753015f140 con 0x7f753006c130 2023-11-24T06:13:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.586+0000 7f7536398640 1 --2- 172.21.15.22:0/2868119279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753006c130 0x7f753006c580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f75300cfc40 tx=0x7f752802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41500dc5d831552e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7534b95640 1 -- 172.21.15.22:0/2868119279 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528031860 con 0x7f753006c130 2023-11-24T06:13:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7534b95640 1 -- 172.21.15.22:0/2868119279 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75280319c0 con 0x7f753006c130 2023-11-24T06:13:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7534b95640 1 -- 172.21.15.22:0/2868119279 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528031d50 con 0x7f753006c130 2023-11-24T06:13:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7536b99640 1 -- 172.21.15.22:0/2868119279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753006c130 msgr2=0x7f753006c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7536b99640 1 --2- 172.21.15.22:0/2868119279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753006c130 0x7f753006c580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f75300cfc40 tx=0x7f752802b900 comp rx=0 tx=0).stop 2023-11-24T06:13:51.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7536b99640 1 -- 172.21.15.22:0/2868119279 shutdown_connections 2023-11-24T06:13:51.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7536b99640 1 --2- 172.21.15.22:0/2868119279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753006c130 0x7f753006c580 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7536b99640 1 --2- 172.21.15.22:0/2868119279 >> v2:172.21.15.31:3300/0 conn(0x7f75300cf050 0x7f75300cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7536b99640 1 --2- 172.21.15.22:0/2868119279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753013dfd0 0x7f753015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.587+0000 7f7536b99640 1 -- 172.21.15.22:0/2868119279 >> 172.21.15.22:0/2868119279 conn(0x7f753006a860 msgr2=0x7f753006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:51.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.588+0000 7f7536b99640 1 -- 172.21.15.22:0/2868119279 shutdown_connections 2023-11-24T06:13:51.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.588+0000 7f7536b99640 1 -- 172.21.15.22:0/2868119279 wait complete. 2023-11-24T06:13:51.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.589+0000 7f7536b99640 1 Processor -- start 2023-11-24T06:13:51.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.589+0000 7f7536b99640 1 -- start start 2023-11-24T06:13:51.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.590+0000 7f7536b99640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753006c130 0x7f7530154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.590+0000 7f7536b99640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300cf050 0x7f753015e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.590+0000 7f7536b99640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753013dfd0 0x7f75300b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.590+0000 7f7536b99640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753015c980 con 0x7f753013dfd0 2023-11-24T06:13:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.590+0000 7f7536b99640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753015bd70 con 0x7f75300cf050 2023-11-24T06:13:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.590+0000 7f7536b99640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753015c050 con 0x7f753006c130 2023-11-24T06:13:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7536398640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753013dfd0 0x7f75300b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7536398640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753013dfd0 0x7f75300b2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43392/0 (socket says 172.21.15.22:43392) 2023-11-24T06:13:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7536398640 1 -- 172.21.15.22:0/1220847818 learned_addr learned my addr 172.21.15.22:0/1220847818 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7535b97640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753006c130 0x7f7530154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7535396640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300cf050 0x7f753015e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7536398640 1 -- 172.21.15.22:0/1220847818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753006c130 msgr2=0x7f7530154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7536398640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753006c130 0x7f7530154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7536398640 1 -- 172.21.15.22:0/1220847818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300cf050 msgr2=0x7f753015e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7536398640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300cf050 0x7f753015e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7536398640 1 -- 172.21.15.22:0/1220847818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75280094d0 con 0x7f753013dfd0 2023-11-24T06:13:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.591+0000 7f7535396640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300cf050 0x7f753015e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.592+0000 7f7536398640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753013dfd0 0x7f75300b2e20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f75280090b0 tx=0x7f75280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.592+0000 7f752e7fc640 1 -- 172.21.15.22:0/1220847818 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752803ac60 con 0x7f753013dfd0 2023-11-24T06:13:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.592+0000 7f752e7fc640 1 -- 172.21.15.22:0/1220847818 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752803adc0 con 0x7f753013dfd0 2023-11-24T06:13:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.592+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753015c330 con 0x7f753013dfd0 2023-11-24T06:13:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.592+0000 7f752e7fc640 1 -- 172.21.15.22:0/1220847818 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528044630 con 0x7f753013dfd0 2023-11-24T06:13:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.592+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753015ce10 con 0x7f753013dfd0 2023-11-24T06:13:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.593+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753015caf0 con 0x7f753013dfd0 2023-11-24T06:13:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.594+0000 7f752e7fc640 1 -- 172.21.15.22:0/1220847818 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f752804d450 con 0x7f753013dfd0 2023-11-24T06:13:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.595+0000 7f752e7fc640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f751c06b020 0x7f751c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.595+0000 7f752e7fc640 1 -- 172.21.15.22:0/1220847818 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75280abf60 con 0x7f753013dfd0 2023-11-24T06:13:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.595+0000 7f7535b97640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f751c06b020 0x7f751c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.596+0000 7f7535b97640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f751c06b020 0x7f751c06d4e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7520007130 tx=0x7f7520007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.600+0000 7f752e7fc640 1 -- 172.21.15.22:0/1220847818 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7528076c70 con 0x7f753013dfd0 2023-11-24T06:13:51.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.794+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f753004e840 con 0x7f753013dfd0 2023-11-24T06:13:51.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.796+0000 7f752e7fc640 1 -- 172.21.15.22:0/1220847818 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f7528035070 con 0x7f753013dfd0 2023-11-24T06:13:51.800 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:51.800 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:13:30.762606+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:27.041850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:28.235409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:51.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f751c06b020 msgr2=0x7f751c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f751c06b020 0x7f751c06d4e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7520007130 tx=0x7f7520007040 comp rx=0 tx=0).stop 2023-11-24T06:13:51.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753013dfd0 msgr2=0x7f75300b2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753013dfd0 0x7f75300b2e20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f75280090b0 tx=0x7f75280046c0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 shutdown_connections 2023-11-24T06:13:51.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f751c06b020 0x7f751c06d4e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f753013dfd0 0x7f75300b2e20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300cf050 0x7f753015e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 --2- 172.21.15.22:0/1220847818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f753006c130 0x7f7530154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 >> 172.21.15.22:0/1220847818 conn(0x7f753006a860 msgr2=0x7f753015a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:51.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 shutdown_connections 2023-11-24T06:13:51.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:51.799+0000 7f7536b99640 1 -- 172.21.15.22:0/1220847818 wait complete. 2023-11-24T06:13:51.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:27.041850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:28.235409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:51.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:52.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.040+0000 7f954af43640 1 Processor -- start 2023-11-24T06:13:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.040+0000 7f954af43640 1 -- start start 2023-11-24T06:13:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.042+0000 7f954af43640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95441439b0 0x7f9544070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.042+0000 7f954af43640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9544070d40 con 0x7f95440b4140 2023-11-24T06:13:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.042+0000 7f954af43640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9544071020 con 0x7f95441435d0 2023-11-24T06:13:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.042+0000 7f954af43640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9544071300 con 0x7f95441439b0 2023-11-24T06:13:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.042+0000 7f9549740640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f95440b4140 0x7f9544070050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36470/0 (socket says 172.21.15.22:36470) 2023-11-24T06:13:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.042+0000 7f9549740640 1 -- 172.21.15.22:0/2933088511 learned_addr learned my addr 172.21.15.22:0/2933088511 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f954a742640 1 --2- 172.21.15.22:0/2933088511 >> v2:172.21.15.31:3300/0 conn(0x7f95441439b0 0x7f9544070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645168894 0 0) 0x7f9544070d40 con 0x7f95440b4140 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9530005730 con 0x7f95440b4140 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 836787752 0 0) 0x7f9530005730 con 0x7f95440b4140 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 >> v2:172.21.15.31:3300/0 conn(0x7f95441439b0 msgr2=0x7f9544070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 --2- 172.21.15.22:0/2933088511 >> v2:172.21.15.31:3300/0 conn(0x7f95441439b0 0x7f9544070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 >> v1:172.21.15.31:6789/0 conn(0x7f95441435d0 legacy=0x7f95440b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440715e0 con 0x7f95440b4140 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f9534001670 con 0x7f95440b4140 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 >> v1:172.21.15.22:6789/0 conn(0x7f95440b4140 legacy=0x7f9544070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.043+0000 7f9548f3f640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f9530006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9548f3f640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300069d0 0x7f9530006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9548f3f640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95300074b0 0x7f953000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544071300 con 0x7f9530005c40 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953000e380 con 0x7f95300069d0 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953000e540 con 0x7f95300074b0 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9549f41640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f9530006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9549740640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300069d0 0x7f9530006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9549f41640 1 -- 172.21.15.22:0/2933088511 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95300074b0 msgr2=0x7f953000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9549f41640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95300074b0 0x7f953000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9549f41640 1 -- 172.21.15.22:0/2933088511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300069d0 msgr2=0x7f9530006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9549f41640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95300069d0 0x7f9530006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f9549f41640 1 -- 172.21.15.22:0/2933088511 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530005730 con 0x7f9530005c40 2023-11-24T06:13:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.044+0000 7f954a742640 1 -- 172.21.15.22:0/2933088511 reap_dead start 2023-11-24T06:13:52.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.046+0000 7f9549f41640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f9530006060 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9540001e50 tx=0x7f9530007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcc7ab593ea7322 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.046+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540003b70 con 0x7f9530005c40 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.046+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9540003cd0 con 0x7f9530005c40 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.046+0000 7f9548f3f640 1 -- 172.21.15.22:0/2933088511 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540005310 con 0x7f9530005c40 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.046+0000 7f954af43640 1 -- 172.21.15.22:0/2933088511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 msgr2=0x7f9530006060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.046+0000 7f954af43640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f9530006060 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9540001e50 tx=0x7f9530007a00 comp rx=0 tx=0).stop 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.047+0000 7f954af43640 1 -- 172.21.15.22:0/2933088511 shutdown_connections 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.047+0000 7f954af43640 1 --2- 172.21.15.22:0/2933088511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f9530006060 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.047+0000 7f954af43640 1 -- 172.21.15.22:0/2933088511 >> 172.21.15.22:0/2933088511 conn(0x7f95440cec10 msgr2=0x7f95440cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.047+0000 7f954af43640 1 -- 172.21.15.22:0/2933088511 shutdown_connections 2023-11-24T06:13:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.047+0000 7f954af43640 1 -- 172.21.15.22:0/2933088511 wait complete. 2023-11-24T06:13:52.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.048+0000 7f954af43640 1 Processor -- start 2023-11-24T06:13:52.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.049+0000 7f954af43640 1 -- start start 2023-11-24T06:13:52.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f954af43640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f95440c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f954af43640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9544141700 0x7f9544141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f954af43640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95440c9db0 0x7f95440ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f954af43640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544142710 con 0x7f9530005c40 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f954af43640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95440c9030 con 0x7f95440c9db0 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f954af43640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9544142430 con 0x7f9544141700 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f9549f41640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f95440c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f9549f41640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f95440c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43412/0 (socket says 172.21.15.22:43412) 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f9549f41640 1 -- 172.21.15.22:0/2247610999 learned_addr learned my addr 172.21.15.22:0/2247610999 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f9549f41640 1 -- 172.21.15.22:0/2247610999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9544141700 msgr2=0x7f9544141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f9549f41640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9544141700 0x7f9544141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f9549f41640 1 -- 172.21.15.22:0/2247610999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95440c9db0 msgr2=0x7f95440ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.050+0000 7f954a742640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95440c9db0 0x7f95440ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.051+0000 7f9549f41640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95440c9db0 0x7f95440ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.051+0000 7f9549f41640 1 -- 172.21.15.22:0/2247610999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440c92d0 con 0x7f9530005c40 2023-11-24T06:13:52.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.051+0000 7f954a742640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95440c9db0 0x7f95440ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:52.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.051+0000 7f9549f41640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f95440c72b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f954002bf70 tx=0x7f95400014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.051+0000 7f953a7fc640 1 -- 172.21.15.22:0/2247610999 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954003e070 con 0x7f9530005c40 2023-11-24T06:13:52.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.051+0000 7f953a7fc640 1 -- 172.21.15.22:0/2247610999 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954002f440 con 0x7f9530005c40 2023-11-24T06:13:52.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.051+0000 7f953a7fc640 1 -- 172.21.15.22:0/2247610999 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954002f7b0 con 0x7f9530005c40 2023-11-24T06:13:52.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.051+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95440c95b0 con 0x7f9530005c40 2023-11-24T06:13:52.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.051+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95441420a0 con 0x7f9530005c40 2023-11-24T06:13:52.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.053+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954404e840 con 0x7f9530005c40 2023-11-24T06:13:52.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.054+0000 7f953a7fc640 1 -- 172.21.15.22:0/2247610999 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f954002f910 con 0x7f9530005c40 2023-11-24T06:13:52.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.055+0000 7f953a7fc640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f952806b020 0x7f952806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.055+0000 7f953a7fc640 1 -- 172.21.15.22:0/2247610999 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95400aadc0 con 0x7f9530005c40 2023-11-24T06:13:52.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.055+0000 7f9549740640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f952806b020 0x7f952806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.056+0000 7f9549740640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f952806b020 0x7f952806d4e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9544142fe0 tx=0x7f9534000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.059+0000 7f953a7fc640 1 -- 172.21.15.22:0/2247610999 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9540075b90 con 0x7f9530005c40 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.251+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95440af7c0 con 0x7f9530005c40 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.252+0000 7f953a7fc640 1 -- 172.21.15.22:0/2247610999 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9540047020 con 0x7f9530005c40 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:13:52.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.254+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f952806b020 msgr2=0x7f952806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.254+0000 7f954af43640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f952806b020 0x7f952806d4e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9544142fe0 tx=0x7f9534000ed0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 msgr2=0x7f95440c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f95440c72b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f954002bf70 tx=0x7f95400014a0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 shutdown_connections 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f952806b020 0x7f952806d4e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95440c9db0 0x7f95440ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9544141700 0x7f9544141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 --2- 172.21.15.22:0/2247610999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530005c40 0x7f95440c72b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 >> 172.21.15.22:0/2247610999 conn(0x7f95440cec10 msgr2=0x7f95440af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 shutdown_connections 2023-11-24T06:13:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.255+0000 7f954af43640 1 -- 172.21.15.22:0/2247610999 wait complete. 2023-11-24T06:13:52.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.496+0000 7fbc97fff640 1 Processor -- start 2023-11-24T06:13:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.496+0000 7fbc97fff640 1 -- start start 2023-11-24T06:13:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.498+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9806d9e0 0x7fbc98165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.498+0000 7fbc97fff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9815f930 con 0x7fbc9815f270 2023-11-24T06:13:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.498+0000 7fbc97fff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc980b3b10 con 0x7fbc98144770 2023-11-24T06:13:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.498+0000 7fbc97fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980b43b0 con 0x7fbc9806d9e0 2023-11-24T06:13:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.498+0000 7fbc967fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbc9815f270 0x7fbc980cd4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36478/0 (socket says 172.21.15.22:36478) 2023-11-24T06:13:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.498+0000 7fbc967fc640 1 -- 172.21.15.22:0/1899381719 learned_addr learned my addr 172.21.15.22:0/1899381719 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.498+0000 7fbc977fe640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9806d9e0 0x7fbc98165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.498+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407169259 0 0) 0x7fbc9815f930 con 0x7fbc9815f270 2023-11-24T06:13:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.498+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc80003520 con 0x7fbc9815f270 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1190244907 0 0) 0x7fbc80003520 con 0x7fbc9815f270 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9806d9e0 msgr2=0x7fbc98165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9806d9e0 0x7fbc98165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 >> v1:172.21.15.31:6789/0 conn(0x7fbc98144770 legacy=0x7fbc9815eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc980b3df0 con 0x7fbc9815f270 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fbc8c001670 con 0x7fbc9815f270 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 >> v1:172.21.15.22:6789/0 conn(0x7fbc9815f270 legacy=0x7fbc980cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc80003a10 0x7fbc80003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9806d9e0 0x7fbc80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980b43b0 con 0x7fbc800047c0 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8000ba80 con 0x7fbc80003a10 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8000bc40 con 0x7fbc9806d9e0 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.499+0000 7fbc967fc640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.500+0000 7fbc96ffd640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc80003a10 0x7fbc80003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.500+0000 7fbc967fc640 1 -- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9806d9e0 msgr2=0x7fbc80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.500+0000 7fbc967fc640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9806d9e0 0x7fbc80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.500+0000 7fbc967fc640 1 -- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc80003a10 msgr2=0x7fbc80003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.500+0000 7fbc967fc640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc80003a10 0x7fbc80003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.500+0000 7fbc967fc640 1 -- 172.21.15.22:0/1899381719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc80003520 con 0x7fbc800047c0 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.500+0000 7fbc96ffd640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc80003a10 0x7fbc80003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.501+0000 7fbc967fc640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc80004c40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c240 tx=0x7fbc800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e46a0b584a807bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.501+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c005ad0 con 0x7fbc800047c0 2023-11-24T06:13:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.501+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c005c30 con 0x7fbc800047c0 2023-11-24T06:13:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.501+0000 7fbc95ffb640 1 -- 172.21.15.22:0/1899381719 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c02c8b0 con 0x7fbc800047c0 2023-11-24T06:13:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.502+0000 7fbc97fff640 1 -- 172.21.15.22:0/1899381719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 msgr2=0x7fbc80004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.502+0000 7fbc97fff640 1 --2- 172.21.15.22:0/1899381719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc80004c40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c240 tx=0x7fbc800057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.502+0000 7fbc977fe640 1 -- 172.21.15.22:0/1899381719 reap_dead start 2023-11-24T06:13:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.502+0000 7fbc97fff640 1 -- 172.21.15.22:0/1899381719 shutdown_connections 2023-11-24T06:13:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.502+0000 7fbc97fff640 1 -- 172.21.15.22:0/1899381719 >> 172.21.15.22:0/1899381719 conn(0x7fbc980cec10 msgr2=0x7fbc980cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.502+0000 7fbc97fff640 1 -- 172.21.15.22:0/1899381719 shutdown_connections 2023-11-24T06:13:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.502+0000 7fbc97fff640 1 -- 172.21.15.22:0/1899381719 wait complete. 2023-11-24T06:13:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.504+0000 7fbc97fff640 1 Processor -- start 2023-11-24T06:13:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.504+0000 7fbc97fff640 1 -- start start 2023-11-24T06:13:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc981f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc98142ca0 0x7fbc98143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9814da10 0x7fbc9814de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc97fff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9814b600 con 0x7fbc800047c0 2023-11-24T06:13:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc97fff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98143660 con 0x7fbc98142ca0 2023-11-24T06:13:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc97fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc981f35d0 con 0x7fbc9814da10 2023-11-24T06:13:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc96ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc981f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc96ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc981f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43424/0 (socket says 172.21.15.22:43424) 2023-11-24T06:13:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc96ffd640 1 -- 172.21.15.22:0/664639084 learned_addr learned my addr 172.21.15.22:0/664639084 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc96ffd640 1 -- 172.21.15.22:0/664639084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9814da10 msgr2=0x7fbc9814de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc967fc640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc98142ca0 0x7fbc98143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc96ffd640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9814da10 0x7fbc9814de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc96ffd640 1 -- 172.21.15.22:0/664639084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc98142ca0 msgr2=0x7fbc98143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.505+0000 7fbc96ffd640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc98142ca0 0x7fbc98143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.506+0000 7fbc96ffd640 1 -- 172.21.15.22:0/664639084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc981f2ca0 con 0x7fbc800047c0 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.506+0000 7fbc96ffd640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc981f2480 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800d770 tx=0x7fbc8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.506+0000 7fbc7f7fe640 1 -- 172.21.15.22:0/664639084 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88005270 con 0x7fbc800047c0 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.506+0000 7fbc7f7fe640 1 -- 172.21.15.22:0/664639084 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc880053f0 con 0x7fbc800047c0 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.506+0000 7fbc7f7fe640 1 -- 172.21.15.22:0/664639084 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800b8f0 con 0x7fbc800047c0 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.506+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc981f2f80 con 0x7fbc800047c0 2023-11-24T06:13:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.506+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc981f29c0 con 0x7fbc800047c0 2023-11-24T06:13:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.507+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9804e840 con 0x7fbc800047c0 2023-11-24T06:13:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.508+0000 7fbc7f7fe640 1 -- 172.21.15.22:0/664639084 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbc8800ba50 con 0x7fbc800047c0 2023-11-24T06:13:52.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.509+0000 7fbc7f7fe640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc8406b020 0x7fbc8406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.510+0000 7fbc7f7fe640 1 -- 172.21.15.22:0/664639084 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc88089930 con 0x7fbc800047c0 2023-11-24T06:13:52.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.510+0000 7fbc967fc640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc8406b020 0x7fbc8406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.510+0000 7fbc967fc640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc8406b020 0x7fbc8406d4e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c034000 tx=0x7fbc8c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.514+0000 7fbc7f7fe640 1 -- 172.21.15.22:0/664639084 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc880545b0 con 0x7fbc800047c0 2023-11-24T06:13:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.709+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc980cba90 con 0x7fbc800047c0 2023-11-24T06:13:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.710+0000 7fbc7f7fe640 1 -- 172.21.15.22:0/664639084 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc88019310 con 0x7fbc800047c0 2023-11-24T06:13:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:13:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc8406b020 msgr2=0x7fbc8406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc8406b020 0x7fbc8406d4e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c034000 tx=0x7fbc8c009030 comp rx=0 tx=0).stop 2023-11-24T06:13:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 msgr2=0x7fbc981f2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc981f2480 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800d770 tx=0x7fbc8800dc30 comp rx=0 tx=0).stop 2023-11-24T06:13:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 shutdown_connections 2023-11-24T06:13:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc8406b020 0x7fbc8406d4e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc9814da10 0x7fbc9814de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc98142ca0 0x7fbc98143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 --2- 172.21.15.22:0/664639084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc800047c0 0x7fbc981f2480 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 >> 172.21.15.22:0/664639084 conn(0x7fbc980cec10 msgr2=0x7fbc9815d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 shutdown_connections 2023-11-24T06:13:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.713+0000 7fbc97fff640 1 -- 172.21.15.22:0/664639084 wait complete. 2023-11-24T06:13:52.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:52.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.956+0000 7fce81d78640 1 Processor -- start 2023-11-24T06:13:52.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.956+0000 7fce81d78640 1 -- start start 2023-11-24T06:13:52.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.958+0000 7fce81d78640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c09cb30 0x7fce7c0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.958+0000 7fce81d78640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce7c0adb60 0x7fce7c0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.958+0000 7fce81d78640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c15b730 con 0x7fce7c15b350 2023-11-24T06:13:52.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.958+0000 7fce81d78640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c0ac740 con 0x7fce7c0adb60 2023-11-24T06:13:52.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.958+0000 7fce81d78640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0ac460 con 0x7fce7c09cb30 2023-11-24T06:13:52.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.959+0000 7fce7b7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fce7c15b350 0x7fce7c0b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36488/0 (socket says 172.21.15.22:36488) 2023-11-24T06:13:52.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.959+0000 7fce7b7fe640 1 -- 172.21.15.22:0/9784011 learned_addr learned my addr 172.21.15.22:0/9784011 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.959+0000 7fce73fff640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c09cb30 0x7fce7c0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.959+0000 7fce7bfff640 1 --2- 172.21.15.22:0/9784011 >> v2:172.21.15.31:3300/0 conn(0x7fce7c0adb60 0x7fce7c0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.959+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923926135 0 0) 0x7fce6c001110 con 0x7fce7c15b350 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.959+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce68003520 con 0x7fce7c15b350 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3612441729 0 0) 0x7fce68003520 con 0x7fce7c15b350 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c09cb30 msgr2=0x7fce7c0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c09cb30 0x7fce7c0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 >> v2:172.21.15.31:3300/0 conn(0x7fce7c0adb60 msgr2=0x7fce7c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 --2- 172.21.15.22:0/9784011 >> v2:172.21.15.31:3300/0 conn(0x7fce7c0adb60 0x7fce7c0adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c0b2a50 con 0x7fce7c15b350 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fce6c001800 con 0x7fce7c15b350 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 >> v1:172.21.15.22:6789/0 conn(0x7fce7c15b350 legacy=0x7fce7c0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce68003970 0x7fce68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c09cb30 0x7fce680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68004d00 0x7fce68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0ac740 con 0x7fce68004d00 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0ac460 con 0x7fce68003970 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6800b980 con 0x7fce7c09cb30 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.960+0000 7fce7bfff640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68004d00 0x7fce68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.961+0000 7fce73fff640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c09cb30 0x7fce680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.961+0000 7fce7b7fe640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce68003970 0x7fce68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.961+0000 7fce7bfff640 1 -- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c09cb30 msgr2=0x7fce680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.961+0000 7fce7bfff640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c09cb30 0x7fce680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.961+0000 7fce7bfff640 1 -- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce68003970 msgr2=0x7fce68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.961+0000 7fce7bfff640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce68003970 0x7fce68003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.961+0000 7fce7bfff640 1 -- 172.21.15.22:0/9784011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68003520 con 0x7fce68004d00 2023-11-24T06:13:52.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.961+0000 7fce7b7fe640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce68003970 0x7fce68003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.962+0000 7fce7bfff640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68004d00 0x7fce68005180 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fce74009fc0 tx=0x7fce680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8da974f4ab3f54 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.962+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7402cc60 con 0x7fce68004d00 2023-11-24T06:13:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.962+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7400f040 con 0x7fce68004d00 2023-11-24T06:13:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.962+0000 7fce7affd640 1 -- 172.21.15.22:0/9784011 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74034440 con 0x7fce68004d00 2023-11-24T06:13:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.963+0000 7fce81d78640 1 -- 172.21.15.22:0/9784011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68004d00 msgr2=0x7fce68005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.963+0000 7fce81d78640 1 --2- 172.21.15.22:0/9784011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68004d00 0x7fce68005180 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fce74009fc0 tx=0x7fce680057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.963+0000 7fce7bfff640 1 -- 172.21.15.22:0/9784011 reap_dead start 2023-11-24T06:13:52.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.963+0000 7fce81d78640 1 -- 172.21.15.22:0/9784011 shutdown_connections 2023-11-24T06:13:52.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.963+0000 7fce81d78640 1 -- 172.21.15.22:0/9784011 >> 172.21.15.22:0/9784011 conn(0x7fce7c0b0ba0 msgr2=0x7fce7c0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.963+0000 7fce81d78640 1 -- 172.21.15.22:0/9784011 shutdown_connections 2023-11-24T06:13:52.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.963+0000 7fce81d78640 1 -- 172.21.15.22:0/9784011 wait complete. 2023-11-24T06:13:52.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.965+0000 7fce81d78640 1 Processor -- start 2023-11-24T06:13:52.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.965+0000 7fce81d78640 1 -- start start 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.966+0000 7fce81d78640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c1360d0 0x7fce7c1364b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.966+0000 7fce81d78640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce7c151eb0 0x7fce7c153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.966+0000 7fce81d78640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c152330 0x7fce7c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.966+0000 7fce81d78640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c150bc0 con 0x7fce7c151eb0 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.966+0000 7fce81d78640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c150e10 con 0x7fce7c1360d0 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.966+0000 7fce81d78640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c1510f0 con 0x7fce7c152330 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce73fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce7c151eb0 0x7fce7c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce73fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce7c151eb0 0x7fce7c153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43428/0 (socket says 172.21.15.22:43428) 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce73fff640 1 -- 172.21.15.22:0/12859431 learned_addr learned my addr 172.21.15.22:0/12859431 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:52.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce7b7fe640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c1360d0 0x7fce7c1364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce73fff640 1 -- 172.21.15.22:0/12859431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c152330 msgr2=0x7fce7c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce73fff640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c152330 0x7fce7c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce73fff640 1 -- 172.21.15.22:0/12859431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c1360d0 msgr2=0x7fce7c1364b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce73fff640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c1360d0 0x7fce7c1364b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce73fff640 1 -- 172.21.15.22:0/12859431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c1513d0 con 0x7fce7c151eb0 2023-11-24T06:13:52.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.967+0000 7fce73fff640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce7c151eb0 0x7fce7c153080 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fce64011600 tx=0x7fce64011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.968+0000 7fce78ff9640 1 -- 172.21.15.22:0/12859431 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64015870 con 0x7fce7c151eb0 2023-11-24T06:13:52.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.968+0000 7fce78ff9640 1 -- 172.21.15.22:0/12859431 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce640159d0 con 0x7fce7c151eb0 2023-11-24T06:13:52.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.968+0000 7fce78ff9640 1 -- 172.21.15.22:0/12859431 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64015d40 con 0x7fce7c151eb0 2023-11-24T06:13:52.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.968+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c1516b0 con 0x7fce7c151eb0 2023-11-24T06:13:52.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.968+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c13ce80 con 0x7fce7c151eb0 2023-11-24T06:13:52.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.969+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c09d200 con 0x7fce7c151eb0 2023-11-24T06:13:52.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.970+0000 7fce78ff9640 1 -- 172.21.15.22:0/12859431 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fce6400f490 con 0x7fce7c151eb0 2023-11-24T06:13:52.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.971+0000 7fce78ff9640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce5c06b020 0x7fce5c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.971+0000 7fce78ff9640 1 -- 172.21.15.22:0/12859431 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce64089de0 con 0x7fce7c151eb0 2023-11-24T06:13:52.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.971+0000 7fce7b7fe640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce5c06b020 0x7fce5c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.972+0000 7fce7b7fe640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce5c06b020 0x7fce5c06d4e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fce6c001930 tx=0x7fce6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:52.975+0000 7fce78ff9640 1 -- 172.21.15.22:0/12859431 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce64054b70 con 0x7fce7c151eb0 2023-11-24T06:13:53.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.167+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce7c04e920 con 0x7fce7c151eb0 2023-11-24T06:13:53.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.168+0000 7fce78ff9640 1 -- 172.21.15.22:0/12859431 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce640220a0 con 0x7fce7c151eb0 2023-11-24T06:13:53.171 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:13:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce5c06b020 msgr2=0x7fce5c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce5c06b020 0x7fce5c06d4e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fce6c001930 tx=0x7fce6c009040 comp rx=0 tx=0).stop 2023-11-24T06:13:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce7c151eb0 msgr2=0x7fce7c153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce7c151eb0 0x7fce7c153080 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fce64011600 tx=0x7fce64011ac0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 shutdown_connections 2023-11-24T06:13:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fce5c06b020 0x7fce5c06d4e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce7c152330 0x7fce7c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce7c151eb0 0x7fce7c153080 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 --2- 172.21.15.22:0/12859431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce7c1360d0 0x7fce7c1364b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 >> 172.21.15.22:0/12859431 conn(0x7fce7c0b0ba0 msgr2=0x7fce7c071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 shutdown_connections 2023-11-24T06:13:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.171+0000 7fce81d78640 1 -- 172.21.15.22:0/12859431 wait complete. 2023-11-24T06:13:53.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:13:53.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.410+0000 7f36883ea640 1 Processor -- start 2023-11-24T06:13:53.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.410+0000 7f36883ea640 1 -- start start 2023-11-24T06:13:53.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.411+0000 7f36883ea640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36800b3b60 0x7f368006d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.411+0000 7f36883ea640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f368006da60 0x7f3680071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.411+0000 7f36883ea640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800ae8a0 con 0x7f36800715d0 2023-11-24T06:13:53.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.411+0000 7f36883ea640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368006dee0 con 0x7f36800b3b60 2023-11-24T06:13:53.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.411+0000 7f36883ea640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800ad400 con 0x7f368006da60 2023-11-24T06:13:53.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.412+0000 7f3686186640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36800b3b60 0x7f368006d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.412+0000 7f3685985640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f368006da60 0x7f3680071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.412+0000 7f3686186640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36800b3b60 0x7f368006d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43442/0 (socket says 172.21.15.22:43442) 2023-11-24T06:13:53.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.412+0000 7f3686186640 1 -- 172.21.15.22:0/18339292 learned_addr learned my addr 172.21.15.22:0/18339292 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:53.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.412+0000 7f3686186640 1 -- 172.21.15.22:0/18339292 >> v2:172.21.15.31:3300/0 conn(0x7f368006da60 msgr2=0x7f3680071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:53.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.412+0000 7f3686186640 1 --2- 172.21.15.22:0/18339292 >> v2:172.21.15.31:3300/0 conn(0x7f368006da60 0x7f3680071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.413+0000 7f3686186640 1 -- 172.21.15.22:0/18339292 >> v1:172.21.15.31:6789/0 conn(0x7f36800715d0 legacy=0x7f3680161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.413+0000 7f3686186640 1 -- 172.21.15.22:0/18339292 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800acb50 con 0x7f36800b3b60 2023-11-24T06:13:53.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.414+0000 7f3686186640 1 --2- 172.21.15.22:0/18339292 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36800b3b60 0x7f368006d520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f368006bdb0 tx=0x7f367c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9049a81566f6a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.414+0000 7f3685184640 1 -- 172.21.15.22:0/18339292 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c030860 con 0x7f36800b3b60 2023-11-24T06:13:53.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.414+0000 7f3685184640 1 -- 172.21.15.22:0/18339292 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0309c0 con 0x7f36800b3b60 2023-11-24T06:13:53.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.414+0000 7f3685184640 1 -- 172.21.15.22:0/18339292 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c030d50 con 0x7f36800b3b60 2023-11-24T06:13:53.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.415+0000 7f36883ea640 1 -- 172.21.15.22:0/18339292 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36800b3b60 msgr2=0x7f368006d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.415+0000 7f36883ea640 1 --2- 172.21.15.22:0/18339292 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36800b3b60 0x7f368006d520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f368006bdb0 tx=0x7f367c02b9a0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.415+0000 7f36883ea640 1 -- 172.21.15.22:0/18339292 shutdown_connections 2023-11-24T06:13:53.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.415+0000 7f36883ea640 1 --2- 172.21.15.22:0/18339292 >> v2:172.21.15.31:3300/0 conn(0x7f368006da60 0x7f3680071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.415+0000 7f36883ea640 1 --2- 172.21.15.22:0/18339292 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36800b3b60 0x7f368006d520 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.415+0000 7f36883ea640 1 -- 172.21.15.22:0/18339292 >> 172.21.15.22:0/18339292 conn(0x7f36800b0d80 msgr2=0x7f36800b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:53.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.415+0000 7f36883ea640 1 -- 172.21.15.22:0/18339292 shutdown_connections 2023-11-24T06:13:53.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.415+0000 7f36883ea640 1 -- 172.21.15.22:0/18339292 wait complete. 2023-11-24T06:13:53.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.417+0000 7f36883ea640 1 Processor -- start 2023-11-24T06:13:53.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.417+0000 7f36883ea640 1 -- start start 2023-11-24T06:13:53.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.418+0000 7f36883ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f368006da60 0x7f368014c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.418+0000 7f36883ea640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36800715d0 0x7f368015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.418+0000 7f36883ea640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36800b3b60 0x7f368015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.418+0000 7f36883ea640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800cb010 con 0x7f368006da60 2023-11-24T06:13:53.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.418+0000 7f36883ea640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800c9fb0 con 0x7f36800b3b60 2023-11-24T06:13:53.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.418+0000 7f36883ea640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800ca250 con 0x7f36800715d0 2023-11-24T06:13:53.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.418+0000 7f3686186640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f368006da60 0x7f368014c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.418+0000 7f3686186640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f368006da60 0x7f368014c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43446/0 (socket says 172.21.15.22:43446) 2023-11-24T06:13:53.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.418+0000 7f3686186640 1 -- 172.21.15.22:0/1755824749 learned_addr learned my addr 172.21.15.22:0/1755824749 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:53.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3685985640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36800715d0 0x7f368015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3686987640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36800b3b60 0x7f368015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3686186640 1 -- 172.21.15.22:0/1755824749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36800715d0 msgr2=0x7f368015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3686186640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36800715d0 0x7f368015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3686186640 1 -- 172.21.15.22:0/1755824749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36800b3b60 msgr2=0x7f368015cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3686186640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36800b3b60 0x7f368015cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3686186640 1 -- 172.21.15.22:0/1755824749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c0094d0 con 0x7f368006da60 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3686186640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f368006da60 0x7f368014c1d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f367c02b9e0 tx=0x7f367c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3676ffd640 1 -- 172.21.15.22:0/1755824749 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c039c90 con 0x7f368006da60 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3676ffd640 1 -- 172.21.15.22:0/1755824749 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c039e10 con 0x7f368006da60 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f3676ffd640 1 -- 172.21.15.22:0/1755824749 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c043640 con 0x7f368006da60 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.419+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36800ca530 con 0x7f368006da60 2023-11-24T06:13:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.420+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36800caaf0 con 0x7f368006da60 2023-11-24T06:13:53.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.421+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3680074770 con 0x7f368006da60 2023-11-24T06:13:53.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.422+0000 7f3676ffd640 1 -- 172.21.15.22:0/1755824749 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f367c0437a0 con 0x7f368006da60 2023-11-24T06:13:53.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.422+0000 7f3676ffd640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f366406b020 0x7f366406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.423+0000 7f3676ffd640 1 -- 172.21.15.22:0/1755824749 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f367c03e070 con 0x7f368006da60 2023-11-24T06:13:53.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.423+0000 7f3685985640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f366406b020 0x7f366406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.424+0000 7f3685985640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f366406b020 0x7f366406d4e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f368006d4a0 tx=0x7f3670008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.427+0000 7f3676ffd640 1 -- 172.21.15.22:0/1755824749 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f367c077800 con 0x7f368006da60 2023-11-24T06:13:53.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.637+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f368006e320 con 0x7f368006da60 2023-11-24T06:13:53.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.638+0000 7f3676ffd640 1 -- 172.21.15.22:0/1755824749 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f367c034070 con 0x7f368006da60 2023-11-24T06:13:53.641 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f366406b020 msgr2=0x7f366406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f366406b020 0x7f366406d4e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f368006d4a0 tx=0x7f3670008040 comp rx=0 tx=0).stop 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f368006da60 msgr2=0x7f368014c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f368006da60 0x7f368014c1d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f367c02b9e0 tx=0x7f367c004730 comp rx=0 tx=0).stop 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 shutdown_connections 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f366406b020 0x7f366406d4e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36800b3b60 0x7f368015cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36800715d0 0x7f368015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 --2- 172.21.15.22:0/1755824749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f368006da60 0x7f368014c1d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 >> 172.21.15.22:0/1755824749 conn(0x7f36800b0d80 msgr2=0x7f36800b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 shutdown_connections 2023-11-24T06:13:53.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:53.641+0000 7f36883ea640 1 -- 172.21.15.22:0/1755824749 wait complete. 2023-11-24T06:13:53.661 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2023-11-24T06:13:53.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:53.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:53.747 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[101566]: fuse finished with error 0 and tester_r 0 2023-11-24T06:13:53.751 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:13:53.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:53.752 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:13:53.828 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:13:53.828 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:53.869 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.048+0000 7fb862a1c640 1 Processor -- start 2023-11-24T06:13:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.048+0000 7fb862a1c640 1 -- start start 2023-11-24T06:13:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.050+0000 7fb862a1c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb85c0abff0 0x7fb85c0b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.050+0000 7fb862a1c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c15c360 con 0x7fb85c06d520 2023-11-24T06:13:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.050+0000 7fb862a1c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c15ba30 con 0x7fb85c0ad720 2023-11-24T06:13:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.050+0000 7fb862a1c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c0b41a0 con 0x7fb85c0abff0 2023-11-24T06:13:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.050+0000 7fb85bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb85c06d520 0x7fb85c06d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36492/0 (socket says 172.21.15.22:36492) 2023-11-24T06:13:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.050+0000 7fb85bfff640 1 -- 172.21.15.22:0/2211083866 learned_addr learned my addr 172.21.15.22:0/2211083866 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb860fb9640 1 --2- 172.21.15.22:0/2211083866 >> v2:172.21.15.31:3300/0 conn(0x7fb85c0abff0 0x7fb85c0b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611552541 0 0) 0x7fb85c15c360 con 0x7fb85c06d520 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb848003520 con 0x7fb85c06d520 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1182353110 0 0) 0x7fb848003520 con 0x7fb85c06d520 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 >> v2:172.21.15.31:3300/0 conn(0x7fb85c0abff0 msgr2=0x7fb85c0b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 --2- 172.21.15.22:0/2211083866 >> v2:172.21.15.31:3300/0 conn(0x7fb85c0abff0 0x7fb85c0b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 >> v1:172.21.15.31:6789/0 conn(0x7fb85c0ad720 legacy=0x7fb85c0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c15bd10 con 0x7fb85c06d520 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fb84c001670 con 0x7fb85c06d520 2023-11-24T06:13:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 >> v1:172.21.15.22:6789/0 conn(0x7fb85c06d520 legacy=0x7fb85c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848003970 0x7fb848003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8480047c0 0x7fb848004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848005180 0x7fb84800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84800bff0 con 0x7fb848005180 2023-11-24T06:13:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84800c160 con 0x7fb848003970 2023-11-24T06:13:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.051+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84800c320 con 0x7fb8480047c0 2023-11-24T06:13:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.052+0000 7fb860fb9640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848005180 0x7fb84800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.052+0000 7fb85bfff640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848003970 0x7fb848003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.052+0000 7fb8537fe640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8480047c0 0x7fb848004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.052+0000 7fb860fb9640 1 -- 172.21.15.22:0/2211083866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8480047c0 msgr2=0x7fb848004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.052+0000 7fb860fb9640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8480047c0 0x7fb848004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.052+0000 7fb860fb9640 1 -- 172.21.15.22:0/2211083866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848003970 msgr2=0x7fb848003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.052+0000 7fb860fb9640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848003970 0x7fb848003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.052+0000 7fb860fb9640 1 -- 172.21.15.22:0/2211083866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848003520 con 0x7fb848005180 2023-11-24T06:13:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.052+0000 7fb8537fe640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8480047c0 0x7fb848004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.053+0000 7fb860fb9640 1 -- 172.21.15.22:0/2211083866 reap_dead start 2023-11-24T06:13:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.053+0000 7fb860fb9640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848005180 0x7fb84800b980 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb854009ac0 tx=0x7fb8480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff1deec80ff2086 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.053+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854004020 con 0x7fb848005180 2023-11-24T06:13:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.054+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb854004180 con 0x7fb848005180 2023-11-24T06:13:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.054+0000 7fb85b7fe640 1 -- 172.21.15.22:0/2211083866 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85402c710 con 0x7fb848005180 2023-11-24T06:13:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.054+0000 7fb862a1c640 1 -- 172.21.15.22:0/2211083866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848005180 msgr2=0x7fb84800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.054+0000 7fb862a1c640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848005180 0x7fb84800b980 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb854009ac0 tx=0x7fb8480057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.054+0000 7fb862a1c640 1 -- 172.21.15.22:0/2211083866 shutdown_connections 2023-11-24T06:13:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.054+0000 7fb862a1c640 1 --2- 172.21.15.22:0/2211083866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848005180 0x7fb84800b980 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.054+0000 7fb862a1c640 1 -- 172.21.15.22:0/2211083866 >> 172.21.15.22:0/2211083866 conn(0x7fb85c0b0d80 msgr2=0x7fb85c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.054+0000 7fb862a1c640 1 -- 172.21.15.22:0/2211083866 shutdown_connections 2023-11-24T06:13:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.054+0000 7fb862a1c640 1 -- 172.21.15.22:0/2211083866 wait complete. 2023-11-24T06:13:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.056+0000 7fb862a1c640 1 Processor -- start 2023-11-24T06:13:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.056+0000 7fb862a1c640 1 -- start start 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.057+0000 7fb862a1c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848005180 0x7fb85c14d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.057+0000 7fb862a1c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb85c0b3550 0x7fb85c0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.057+0000 7fb862a1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c15da90 0x7fb85c15df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.057+0000 7fb862a1c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1f4990 con 0x7fb85c15da90 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.057+0000 7fb862a1c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1f3de0 con 0x7fb848005180 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.057+0000 7fb862a1c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0b3f10 con 0x7fb85c0b3550 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.057+0000 7fb860fb9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c15da90 0x7fb85c15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.057+0000 7fb860fb9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c15da90 0x7fb85c15df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43464/0 (socket says 172.21.15.22:43464) 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.057+0000 7fb860fb9640 1 -- 172.21.15.22:0/3655776763 learned_addr learned my addr 172.21.15.22:0/3655776763 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.058+0000 7fb8537fe640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb85c0b3550 0x7fb85c0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.058+0000 7fb860fb9640 1 -- 172.21.15.22:0/3655776763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb85c0b3550 msgr2=0x7fb85c0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.058+0000 7fb860fb9640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb85c0b3550 0x7fb85c0b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.058+0000 7fb85bfff640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848005180 0x7fb85c14d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.058+0000 7fb860fb9640 1 -- 172.21.15.22:0/3655776763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848005180 msgr2=0x7fb85c14d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.058+0000 7fb860fb9640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848005180 0x7fb85c14d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.058+0000 7fb860fb9640 1 -- 172.21.15.22:0/3655776763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c14d950 con 0x7fb85c15da90 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.058+0000 7fb860fb9640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c15da90 0x7fb85c15df10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb85402c380 tx=0x7fb854004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.058+0000 7fb8597fa640 1 -- 172.21.15.22:0/3655776763 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85403a070 con 0x7fb85c15da90 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.059+0000 7fb8597fa640 1 -- 172.21.15.22:0/3655776763 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8540042f0 con 0x7fb85c15da90 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.059+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c1f3ff0 con 0x7fb85c15da90 2023-11-24T06:13:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.059+0000 7fb8597fa640 1 -- 172.21.15.22:0/3655776763 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854003610 con 0x7fb85c15da90 2023-11-24T06:13:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.059+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c1f45b0 con 0x7fb85c15da90 2023-11-24T06:13:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.060+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c074770 con 0x7fb85c15da90 2023-11-24T06:13:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.061+0000 7fb8597fa640 1 -- 172.21.15.22:0/3655776763 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb854003770 con 0x7fb85c15da90 2023-11-24T06:13:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.062+0000 7fb8597fa640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb83c06aff0 0x7fb83c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.062+0000 7fb8597fa640 1 -- 172.21.15.22:0/3655776763 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8540aa4a0 con 0x7fb85c15da90 2023-11-24T06:13:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.062+0000 7fb85bfff640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb83c06aff0 0x7fb83c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.063+0000 7fb85bfff640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb83c06aff0 0x7fb83c06d4b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb84c001200 tx=0x7fb84c001150 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.066+0000 7fb8597fa640 1 -- 172.21.15.22:0/3655776763 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb854075230 con 0x7fb85c15da90 2023-11-24T06:13:54.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.255+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb85c15eb70 con 0x7fb85c15da90 2023-11-24T06:13:54.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.258+0000 7fb8597fa640 1 -- 172.21.15.22:0/3655776763 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fb854078850 con 0x7fb85c15da90 2023-11-24T06:13:54.261 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:54.261 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:13:30.762606+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:27.041850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:28.235409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:54.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.260+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb83c06aff0 msgr2=0x7fb83c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.260+0000 7fb862a1c640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb83c06aff0 0x7fb83c06d4b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb84c001200 tx=0x7fb84c001150 comp rx=0 tx=0).stop 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.260+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c15da90 msgr2=0x7fb85c15df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.260+0000 7fb862a1c640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c15da90 0x7fb85c15df10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb85402c380 tx=0x7fb854004730 comp rx=0 tx=0).stop 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.261+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 shutdown_connections 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.261+0000 7fb862a1c640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb83c06aff0 0x7fb83c06d4b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.261+0000 7fb862a1c640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c15da90 0x7fb85c15df10 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.261+0000 7fb862a1c640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb85c0b3550 0x7fb85c0b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.261+0000 7fb862a1c640 1 --2- 172.21.15.22:0/3655776763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848005180 0x7fb85c14d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.261+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 >> 172.21.15.22:0/3655776763 conn(0x7fb85c0b0d80 msgr2=0x7fb85c0aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.261+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 shutdown_connections 2023-11-24T06:13:54.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.261+0000 7fb862a1c640 1 -- 172.21.15.22:0/3655776763 wait complete. 2023-11-24T06:13:54.283 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:27.041850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:28.235409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:54.283 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:54.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.494+0000 7f411ea2e640 1 Processor -- start 2023-11-24T06:13:54.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.495+0000 7f411ea2e640 1 -- start start 2023-11-24T06:13:54.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.496+0000 7f411ea2e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f41180d1d90 0x7f41180ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411ea2e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41180c6bf0 con 0x7f41180d0fa0 2023-11-24T06:13:54.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411ea2e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41180d13f0 con 0x7f411815d3b0 2023-11-24T06:13:54.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411ea2e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41180cedc0 con 0x7f41180d1d90 2023-11-24T06:13:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411d22b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f41180d1d90 0x7f41180ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411d22b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f41180d1d90 0x7f41180ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43474/0 (socket says 172.21.15.22:43474) 2023-11-24T06:13:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411e22d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f41180d0fa0 0x7f41180b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36504/0 (socket says 172.21.15.22:36504) 2023-11-24T06:13:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411d22b640 1 -- 172.21.15.22:0/3798451030 learned_addr learned my addr 172.21.15.22:0/3798451030 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411d22b640 1 -- 172.21.15.22:0/3798451030 >> v1:172.21.15.31:6789/0 conn(0x7f411815d3b0 legacy=0x7f41180d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411d22b640 1 -- 172.21.15.22:0/3798451030 >> v1:172.21.15.22:6789/0 conn(0x7f41180d0fa0 legacy=0x7f41180b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411d22b640 1 -- 172.21.15.22:0/3798451030 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41180c6e40 con 0x7f41180d1d90 2023-11-24T06:13:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.497+0000 7f411ca2a640 1 -- 172.21.15.22:0/3798451030 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875891574 0 0) 0x7f41180c6bf0 con 0x7f41180d0fa0 2023-11-24T06:13:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.499+0000 7f411d22b640 1 --2- 172.21.15.22:0/3798451030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41180d1d90 0x7f41180ce6c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4108009870 tx=0x7f410802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfd70efbc0f90eb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.499+0000 7f411ca2a640 1 -- 172.21.15.22:0/3798451030 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108030860 con 0x7f41180d1d90 2023-11-24T06:13:54.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.499+0000 7f411ca2a640 1 -- 172.21.15.22:0/3798451030 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41080309c0 con 0x7f41180d1d90 2023-11-24T06:13:54.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.499+0000 7f411ca2a640 1 -- 172.21.15.22:0/3798451030 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108030d50 con 0x7f41180d1d90 2023-11-24T06:13:54.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.499+0000 7f411ea2e640 1 -- 172.21.15.22:0/3798451030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41180d1d90 msgr2=0x7f41180ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.499+0000 7f411ea2e640 1 --2- 172.21.15.22:0/3798451030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41180d1d90 0x7f41180ce6c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4108009870 tx=0x7f410802b9a0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.499+0000 7f411ea2e640 1 -- 172.21.15.22:0/3798451030 shutdown_connections 2023-11-24T06:13:54.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.500+0000 7f411ea2e640 1 --2- 172.21.15.22:0/3798451030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41180d1d90 0x7f41180ce6c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.500+0000 7f411ea2e640 1 -- 172.21.15.22:0/3798451030 >> 172.21.15.22:0/3798451030 conn(0x7f41180d30a0 msgr2=0x7f41180d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.500+0000 7f411ea2e640 1 -- 172.21.15.22:0/3798451030 shutdown_connections 2023-11-24T06:13:54.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.500+0000 7f411ea2e640 1 -- 172.21.15.22:0/3798451030 wait complete. 2023-11-24T06:13:54.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.501+0000 7f411ea2e640 1 Processor -- start 2023-11-24T06:13:54.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.501+0000 7f411ea2e640 1 -- start start 2023-11-24T06:13:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.502+0000 7f411ea2e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41180d0fa0 0x7f411809f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.502+0000 7f411ea2e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41180d1d90 0x7f41181f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.502+0000 7f411ea2e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411815d3b0 0x7f41180d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.502+0000 7f411ea2e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41181f3bc0 con 0x7f411815d3b0 2023-11-24T06:13:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.502+0000 7f411ea2e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411809f9f0 con 0x7f41180d0fa0 2023-11-24T06:13:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.502+0000 7f411ea2e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411809fcd0 con 0x7f41180d1d90 2023-11-24T06:13:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411e22d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411815d3b0 0x7f41180d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411e22d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411815d3b0 0x7f41180d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43488/0 (socket says 172.21.15.22:43488) 2023-11-24T06:13:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411e22d640 1 -- 172.21.15.22:0/3366051269 learned_addr learned my addr 172.21.15.22:0/3366051269 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411e22d640 1 -- 172.21.15.22:0/3366051269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41180d1d90 msgr2=0x7f41181f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411e22d640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41180d1d90 0x7f41181f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411e22d640 1 -- 172.21.15.22:0/3366051269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41180d0fa0 msgr2=0x7f411809f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411da2c640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41180d0fa0 0x7f411809f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411e22d640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41180d0fa0 0x7f411809f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411e22d640 1 -- 172.21.15.22:0/3366051269 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080094d0 con 0x7f411815d3b0 2023-11-24T06:13:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.503+0000 7f411e22d640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411815d3b0 0x7f41180d36f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f411000c7e0 tx=0x7f411000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.504+0000 7f410e7fc640 1 -- 172.21.15.22:0/3366051269 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000a640 con 0x7f411815d3b0 2023-11-24T06:13:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.504+0000 7f410e7fc640 1 -- 172.21.15.22:0/3366051269 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000a7c0 con 0x7f411815d3b0 2023-11-24T06:13:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.504+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411809ffb0 con 0x7f411815d3b0 2023-11-24T06:13:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.504+0000 7f410e7fc640 1 -- 172.21.15.22:0/3366051269 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000ab70 con 0x7f411815d3b0 2023-11-24T06:13:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.504+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41180a0570 con 0x7f411815d3b0 2023-11-24T06:13:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.505+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411804e840 con 0x7f411815d3b0 2023-11-24T06:13:54.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.506+0000 7f410e7fc640 1 -- 172.21.15.22:0/3366051269 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f411000acd0 con 0x7f411815d3b0 2023-11-24T06:13:54.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.507+0000 7f410e7fc640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40fc06aff0 0x7f40fc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.507+0000 7f410e7fc640 1 -- 172.21.15.22:0/3366051269 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41100891f0 con 0x7f411815d3b0 2023-11-24T06:13:54.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.507+0000 7f411da2c640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40fc06aff0 0x7f40fc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.508+0000 7f411da2c640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40fc06aff0 0x7f40fc06d4b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4114000f60 tx=0x7f4114009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.511+0000 7f410e7fc640 1 -- 172.21.15.22:0/3366051269 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4110054020 con 0x7f411815d3b0 2023-11-24T06:13:54.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.704+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41180cea40 con 0x7f411815d3b0 2023-11-24T06:13:54.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.705+0000 7f410e7fc640 1 -- 172.21.15.22:0/3366051269 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4110057640 con 0x7f411815d3b0 2023-11-24T06:13:54.708 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:13:54.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.707+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40fc06aff0 msgr2=0x7f40fc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.707+0000 7f411ea2e640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40fc06aff0 0x7f40fc06d4b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4114000f60 tx=0x7f4114009040 comp rx=0 tx=0).stop 2023-11-24T06:13:54.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.707+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411815d3b0 msgr2=0x7f41180d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.707+0000 7f411ea2e640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411815d3b0 0x7f41180d36f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f411000c7e0 tx=0x7f411000cca0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.708+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 shutdown_connections 2023-11-24T06:13:54.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.708+0000 7f411ea2e640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f40fc06aff0 0x7f40fc06d4b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.708+0000 7f411ea2e640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411815d3b0 0x7f41180d36f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.708+0000 7f411ea2e640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41180d1d90 0x7f41181f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.708+0000 7f411ea2e640 1 --2- 172.21.15.22:0/3366051269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41180d0fa0 0x7f411809f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.708+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 >> 172.21.15.22:0/3366051269 conn(0x7f41180d30a0 msgr2=0x7f41180d1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.708+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 shutdown_connections 2023-11-24T06:13:54.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.708+0000 7f411ea2e640 1 -- 172.21.15.22:0/3366051269 wait complete. 2023-11-24T06:13:54.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:54.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.952+0000 7f68fe973640 1 Processor -- start 2023-11-24T06:13:54.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.952+0000 7f68fe973640 1 -- start start 2023-11-24T06:13:54.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.954+0000 7f68fe973640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68f81439e0 0x7f68f80b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.954+0000 7f68fe973640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68f806a440 0x7f68f806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.954+0000 7f68fe973640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f80b4dc0 con 0x7f68f806d570 2023-11-24T06:13:54.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.954+0000 7f68fe973640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f806ae00 con 0x7f68f81439e0 2023-11-24T06:13:54.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.954+0000 7f68fe973640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8143dc0 con 0x7f68f806a440 2023-11-24T06:13:54.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.954+0000 7f68fe172640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f68f806d570 0x7f68f806d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36516/0 (socket says 172.21.15.22:36516) 2023-11-24T06:13:54.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.954+0000 7f68fe172640 1 -- 172.21.15.22:0/3341493906 learned_addr learned my addr 172.21.15.22:0/3341493906 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.954+0000 7f68fd971640 1 --2- 172.21.15.22:0/3341493906 >> v2:172.21.15.31:3300/0 conn(0x7f68f81439e0 0x7f68f80b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fd170640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68f806a440 0x7f68f806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254005195 0 0) 0x7f68f0001490 con 0x7f68f806d570 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e4003520 con 0x7f68f806d570 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3858328242 0 0) 0x7f68e4003520 con 0x7f68f806d570 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68f806a440 msgr2=0x7f68f806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68f806a440 0x7f68f806a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 >> v2:172.21.15.31:3300/0 conn(0x7f68f81439e0 msgr2=0x7f68f80b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 --2- 172.21.15.22:0/3341493906 >> v2:172.21.15.31:3300/0 conn(0x7f68f81439e0 0x7f68f80b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8161350 con 0x7f68f806d570 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f68f0001b80 con 0x7f68f806d570 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 >> v1:172.21.15.22:6789/0 conn(0x7f68f806d570 legacy=0x7f68f806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68f806a440 0x7f68e40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68e4003f60 0x7f68e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e4004d00 0x7f68e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f806ae00 con 0x7f68e4003f60 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8143dc0 con 0x7f68e4004d00 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e400b9b0 con 0x7f68f806a440 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.955+0000 7f68fd170640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68e4003f60 0x7f68e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.956+0000 7f68fd971640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68f806a440 0x7f68e40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.956+0000 7f68fd170640 1 -- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68f806a440 msgr2=0x7f68e40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.956+0000 7f68fd170640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68f806a440 0x7f68e40039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.956+0000 7f68fd170640 1 -- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e4004d00 msgr2=0x7f68e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.956+0000 7f68fd170640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68e4004d00 0x7f68e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.956+0000 7f68fd170640 1 -- 172.21.15.22:0/3341493906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4003520 con 0x7f68e4003f60 2023-11-24T06:13:54.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.957+0000 7f68fd170640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68e4003f60 0x7f68e40047c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009ac0 tx=0x7f68e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2309667e702ac1a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.957+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e802c6b0 con 0x7f68e4003f60 2023-11-24T06:13:54.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.957+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e802c810 con 0x7f68e4003f60 2023-11-24T06:13:54.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.957+0000 7f68fc96f640 1 -- 172.21.15.22:0/3341493906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e802cba0 con 0x7f68e4003f60 2023-11-24T06:13:54.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.958+0000 7f68fe973640 1 -- 172.21.15.22:0/3341493906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68e4003f60 msgr2=0x7f68e40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.958+0000 7f68fe973640 1 --2- 172.21.15.22:0/3341493906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68e4003f60 0x7f68e40047c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009ac0 tx=0x7f68e40057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.958+0000 7f68fe172640 1 -- 172.21.15.22:0/3341493906 reap_dead start 2023-11-24T06:13:54.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.958+0000 7f68fe973640 1 -- 172.21.15.22:0/3341493906 shutdown_connections 2023-11-24T06:13:54.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.958+0000 7f68fe973640 1 -- 172.21.15.22:0/3341493906 >> 172.21.15.22:0/3341493906 conn(0x7f68f806bbb0 msgr2=0x7f68f80b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.958+0000 7f68fe973640 1 -- 172.21.15.22:0/3341493906 shutdown_connections 2023-11-24T06:13:54.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.958+0000 7f68fe973640 1 -- 172.21.15.22:0/3341493906 wait complete. 2023-11-24T06:13:54.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.960+0000 7f68fe973640 1 Processor -- start 2023-11-24T06:13:54.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.960+0000 7f68fe973640 1 -- start start 2023-11-24T06:13:54.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.961+0000 7f68fe973640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68e4003f60 0x7f68f8160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.961+0000 7f68fe973640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68f8140aa0 0x7f68f815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.961+0000 7f68fe973640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f80ae4b0 0x7f68f80ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.961+0000 7f68fe973640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80aee70 con 0x7f68f8140aa0 2023-11-24T06:13:54.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.961+0000 7f68fe973640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f81e6d70 con 0x7f68f80ae4b0 2023-11-24T06:13:54.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.961+0000 7f68fe973640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8141040 con 0x7f68e4003f60 2023-11-24T06:13:54.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.961+0000 7f68fd170640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68f8140aa0 0x7f68f815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.961+0000 7f68fd170640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68f8140aa0 0x7f68f815c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43506/0 (socket says 172.21.15.22:43506) 2023-11-24T06:13:54.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.961+0000 7f68fd170640 1 -- 172.21.15.22:0/357841256 learned_addr learned my addr 172.21.15.22:0/357841256 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:54.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.962+0000 7f68fd971640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68e4003f60 0x7f68f8160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.962+0000 7f68fe172640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f80ae4b0 0x7f68f80ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.962+0000 7f68fd170640 1 -- 172.21.15.22:0/357841256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68e4003f60 msgr2=0x7f68f8160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.962+0000 7f68fd170640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68e4003f60 0x7f68f8160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.962+0000 7f68fd170640 1 -- 172.21.15.22:0/357841256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f80ae4b0 msgr2=0x7f68f80ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.962+0000 7f68fd170640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f80ae4b0 0x7f68f80ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.962+0000 7f68fd170640 1 -- 172.21.15.22:0/357841256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8160850 con 0x7f68f8140aa0 2023-11-24T06:13:54.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.962+0000 7f68fd170640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68f8140aa0 0x7f68f815c170 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f68e802c250 tx=0x7f68e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.963+0000 7f68ee7fc640 1 -- 172.21.15.22:0/357841256 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8003810 con 0x7f68f8140aa0 2023-11-24T06:13:54.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.963+0000 7f68ee7fc640 1 -- 172.21.15.22:0/357841256 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e8003970 con 0x7f68f8140aa0 2023-11-24T06:13:54.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.963+0000 7f68ee7fc640 1 -- 172.21.15.22:0/357841256 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8003ce0 con 0x7f68f8140aa0 2023-11-24T06:13:54.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.963+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f815f770 con 0x7f68f8140aa0 2023-11-24T06:13:54.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.963+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f815fd30 con 0x7f68f8140aa0 2023-11-24T06:13:54.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.964+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f815ff20 con 0x7f68f8140aa0 2023-11-24T06:13:54.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.965+0000 7f68ee7fc640 1 -- 172.21.15.22:0/357841256 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f68e8047450 con 0x7f68f8140aa0 2023-11-24T06:13:54.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.966+0000 7f68ee7fc640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f68dc06aff0 0x7f68dc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.967+0000 7f68ee7fc640 1 -- 172.21.15.22:0/357841256 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68e80abb50 con 0x7f68f8140aa0 2023-11-24T06:13:54.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.967+0000 7f68fd971640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f68dc06aff0 0x7f68dc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.967+0000 7f68fd971640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f68dc06aff0 0x7f68dc06d4b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009a90 tx=0x7f68f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:54.971+0000 7f68ee7fc640 1 -- 172.21.15.22:0/357841256 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68e8076a20 con 0x7f68f8140aa0 2023-11-24T06:13:55.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.167+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68f804e840 con 0x7f68f8140aa0 2023-11-24T06:13:55.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.168+0000 7f68ee7fc640 1 -- 172.21.15.22:0/357841256 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68e80044e0 con 0x7f68f8140aa0 2023-11-24T06:13:55.171 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:13:55.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.170+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f68dc06aff0 msgr2=0x7f68dc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.170+0000 7f68fe973640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f68dc06aff0 0x7f68dc06d4b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009a90 tx=0x7f68f4008040 comp rx=0 tx=0).stop 2023-11-24T06:13:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.170+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68f8140aa0 msgr2=0x7f68f815c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.170+0000 7f68fe973640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68f8140aa0 0x7f68f815c170 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f68e802c250 tx=0x7f68e8004730 comp rx=0 tx=0).stop 2023-11-24T06:13:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.170+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 shutdown_connections 2023-11-24T06:13:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.171+0000 7f68fe973640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f68dc06aff0 0x7f68dc06d4b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.171+0000 7f68fe973640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f80ae4b0 0x7f68f80ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.171+0000 7f68fe973640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68f8140aa0 0x7f68f815c170 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.171+0000 7f68fe973640 1 --2- 172.21.15.22:0/357841256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68e4003f60 0x7f68f8160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.171+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 >> 172.21.15.22:0/357841256 conn(0x7f68f806bbb0 msgr2=0x7f68f81417a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.171+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 shutdown_connections 2023-11-24T06:13:55.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.171+0000 7f68fe973640 1 -- 172.21.15.22:0/357841256 wait complete. 2023-11-24T06:13:55.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.414+0000 7fbb4453e640 1 Processor -- start 2023-11-24T06:13:55.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.414+0000 7fbb4453e640 1 -- start start 2023-11-24T06:13:55.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb4453e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb3c071300 0x7fbb3c1619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb4453e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbb3c06cf30 0x7fbb3c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb4453e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c161ef0 con 0x7fbb3c15d440 2023-11-24T06:13:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb4453e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c0cf500 con 0x7fbb3c06cf30 2023-11-24T06:13:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb4453e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0ce8f0 con 0x7fbb3c071300 2023-11-24T06:13:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb42adb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbb3c06cf30 0x7fbb3c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb42adb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbb3c06cf30 0x7fbb3c06d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43522/0 (socket says 172.21.15.22:43522) 2023-11-24T06:13:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb42adb640 1 -- 172.21.15.22:0/3483340321 learned_addr learned my addr 172.21.15.22:0/3483340321 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:55.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb42adb640 1 -- 172.21.15.22:0/3483340321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb3c071300 msgr2=0x7fbb3c1619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:55.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb42adb640 1 --2- 172.21.15.22:0/3483340321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb3c071300 0x7fbb3c1619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.416+0000 7fbb42adb640 1 -- 172.21.15.22:0/3483340321 >> v1:172.21.15.31:6789/0 conn(0x7fbb3c15d440 legacy=0x7fbb3c070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:55.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.417+0000 7fbb42adb640 1 -- 172.21.15.22:0/3483340321 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c0cebd0 con 0x7fbb3c06cf30 2023-11-24T06:13:55.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.418+0000 7fbb42adb640 1 --2- 172.21.15.22:0/3483340321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c06cf30 0x7fbb3c06d3e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009870 tx=0x7fbb3402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69046a559de88eb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.418+0000 7fbb412d8640 1 -- 172.21.15.22:0/3483340321 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34031640 con 0x7fbb3c06cf30 2023-11-24T06:13:55.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.418+0000 7fbb412d8640 1 -- 172.21.15.22:0/3483340321 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb340317a0 con 0x7fbb3c06cf30 2023-11-24T06:13:55.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.418+0000 7fbb412d8640 1 -- 172.21.15.22:0/3483340321 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34031b30 con 0x7fbb3c06cf30 2023-11-24T06:13:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.419+0000 7fbb4453e640 1 -- 172.21.15.22:0/3483340321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c06cf30 msgr2=0x7fbb3c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.419+0000 7fbb4453e640 1 --2- 172.21.15.22:0/3483340321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c06cf30 0x7fbb3c06d3e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009870 tx=0x7fbb3402b8f0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.419+0000 7fbb4453e640 1 -- 172.21.15.22:0/3483340321 shutdown_connections 2023-11-24T06:13:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.419+0000 7fbb4453e640 1 --2- 172.21.15.22:0/3483340321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c06cf30 0x7fbb3c06d3e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.419+0000 7fbb4453e640 1 --2- 172.21.15.22:0/3483340321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb3c071300 0x7fbb3c1619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.419+0000 7fbb4453e640 1 -- 172.21.15.22:0/3483340321 >> 172.21.15.22:0/3483340321 conn(0x7fbb3c0cf740 msgr2=0x7fbb3c0cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.419+0000 7fbb4453e640 1 -- 172.21.15.22:0/3483340321 shutdown_connections 2023-11-24T06:13:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.419+0000 7fbb4453e640 1 -- 172.21.15.22:0/3483340321 wait complete. 2023-11-24T06:13:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.421+0000 7fbb4453e640 1 Processor -- start 2023-11-24T06:13:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.421+0000 7fbb4453e640 1 -- start start 2023-11-24T06:13:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.422+0000 7fbb4453e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb3c06cf30 0x7fbb3c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.422+0000 7fbb4453e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c071300 0x7fbb3c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.422+0000 7fbb4453e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb3c15d440 0x7fbb3c15e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.422+0000 7fbb4453e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c157780 con 0x7fbb3c071300 2023-11-24T06:13:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.422+0000 7fbb4453e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c1e6f40 con 0x7fbb3c15d440 2023-11-24T06:13:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.422+0000 7fbb4453e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c1e7220 con 0x7fbb3c06cf30 2023-11-24T06:13:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.422+0000 7fbb41ad9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c071300 0x7fbb3c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.422+0000 7fbb41ad9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c071300 0x7fbb3c15bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43526/0 (socket says 172.21.15.22:43526) 2023-11-24T06:13:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.422+0000 7fbb41ad9640 1 -- 172.21.15.22:0/2689716664 learned_addr learned my addr 172.21.15.22:0/2689716664 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.423+0000 7fbb422da640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb3c06cf30 0x7fbb3c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.423+0000 7fbb42adb640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb3c15d440 0x7fbb3c15e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.423+0000 7fbb41ad9640 1 -- 172.21.15.22:0/2689716664 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb3c06cf30 msgr2=0x7fbb3c157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.423+0000 7fbb41ad9640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb3c06cf30 0x7fbb3c157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.423+0000 7fbb41ad9640 1 -- 172.21.15.22:0/2689716664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb3c15d440 msgr2=0x7fbb3c15e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.423+0000 7fbb41ad9640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb3c15d440 0x7fbb3c15e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.423+0000 7fbb41ad9640 1 -- 172.21.15.22:0/2689716664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb340094d0 con 0x7fbb3c071300 2023-11-24T06:13:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.423+0000 7fbb41ad9640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c071300 0x7fbb3c15bce0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00b4a0 tx=0x7fbb2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.423+0000 7fbb32ffd640 1 -- 172.21.15.22:0/2689716664 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c010610 con 0x7fbb3c071300 2023-11-24T06:13:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.424+0000 7fbb32ffd640 1 -- 172.21.15.22:0/2689716664 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c010770 con 0x7fbb3c071300 2023-11-24T06:13:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.424+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c1e7500 con 0x7fbb3c071300 2023-11-24T06:13:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.424+0000 7fbb32ffd640 1 -- 172.21.15.22:0/2689716664 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c010b20 con 0x7fbb3c071300 2023-11-24T06:13:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.424+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c1e7ac0 con 0x7fbb3c071300 2023-11-24T06:13:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.425+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c1e7cb0 con 0x7fbb3c071300 2023-11-24T06:13:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.426+0000 7fbb32ffd640 1 -- 172.21.15.22:0/2689716664 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbb2c010c80 con 0x7fbb3c071300 2023-11-24T06:13:55.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.427+0000 7fbb32ffd640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb2006aff0 0x7fbb2006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.427+0000 7fbb32ffd640 1 -- 172.21.15.22:0/2689716664 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb2c089640 con 0x7fbb3c071300 2023-11-24T06:13:55.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.427+0000 7fbb422da640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb2006aff0 0x7fbb2006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.428+0000 7fbb422da640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb2006aff0 0x7fbb2006d4b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c071d20 tx=0x7fbb380094d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.432+0000 7fbb32ffd640 1 -- 172.21.15.22:0/2689716664 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb2c0543d0 con 0x7fbb3c071300 2023-11-24T06:13:55.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.626+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb3c072510 con 0x7fbb3c071300 2023-11-24T06:13:55.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.627+0000 7fbb32ffd640 1 -- 172.21.15.22:0/2689716664 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb2c0579f0 con 0x7fbb3c071300 2023-11-24T06:13:55.630 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:13:55.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.629+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb2006aff0 msgr2=0x7fbb2006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.629+0000 7fbb4453e640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb2006aff0 0x7fbb2006d4b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c071d20 tx=0x7fbb380094d0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c071300 msgr2=0x7fbb3c15bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c071300 0x7fbb3c15bce0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00b4a0 tx=0x7fbb2c00b960 comp rx=0 tx=0).stop 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 shutdown_connections 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb2006aff0 0x7fbb2006d4b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb3c15d440 0x7fbb3c15e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb3c071300 0x7fbb3c15bce0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 --2- 172.21.15.22:0/2689716664 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb3c06cf30 0x7fbb3c157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 >> 172.21.15.22:0/2689716664 conn(0x7fbb3c0cf740 msgr2=0x7fbb3c0cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 shutdown_connections 2023-11-24T06:13:55.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.630+0000 7fbb4453e640 1 -- 172.21.15.22:0/2689716664 wait complete. 2023-11-24T06:13:55.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:13:55.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.873+0000 7f3b4934e640 1 Processor -- start 2023-11-24T06:13:55.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.873+0000 7f3b4934e640 1 -- start start 2023-11-24T06:13:55.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.875+0000 7f3b4934e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3b440b2c50 0x7f3b44164520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.875+0000 7f3b4934e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4406cf20 con 0x7f3b44070a40 2023-11-24T06:13:55.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.875+0000 7f3b4934e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4406d200 con 0x7f3b4406c9a0 2023-11-24T06:13:55.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.875+0000 7f3b4934e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4406d4e0 con 0x7f3b440b2c50 2023-11-24T06:13:55.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.875+0000 7f3b48b4d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3b440b2c50 0x7f3b44164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.875+0000 7f3b48b4d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3b440b2c50 0x7f3b44164520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43538/0 (socket says 172.21.15.22:43538) 2023-11-24T06:13:55.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.875+0000 7f3b48b4d640 1 -- 172.21.15.22:0/383177217 learned_addr learned my addr 172.21.15.22:0/383177217 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.876+0000 7f3b48b4d640 1 -- 172.21.15.22:0/383177217 >> v1:172.21.15.31:6789/0 conn(0x7f3b4406c9a0 legacy=0x7f3b44070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.876+0000 7f3b48b4d640 1 -- 172.21.15.22:0/383177217 >> v1:172.21.15.22:6789/0 conn(0x7f3b44070a40 legacy=0x7f3b4415a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.876+0000 7f3b437fe640 1 -- 172.21.15.22:0/383177217 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399327012 0 0) 0x7f3b4406cf20 con 0x7f3b44070a40 2023-11-24T06:13:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.876+0000 7f3b48b4d640 1 -- 172.21.15.22:0/383177217 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4406d7c0 con 0x7f3b440b2c50 2023-11-24T06:13:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.877+0000 7f3b48b4d640 1 --2- 172.21.15.22:0/383177217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 0x7f3b44164520 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d150 tx=0x7f3b3c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a86e4ca123780 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.877+0000 7f3b437fe640 1 -- 172.21.15.22:0/383177217 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c038400 con 0x7f3b440b2c50 2023-11-24T06:13:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.877+0000 7f3b437fe640 1 -- 172.21.15.22:0/383177217 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c032070 con 0x7f3b440b2c50 2023-11-24T06:13:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.877+0000 7f3b437fe640 1 -- 172.21.15.22:0/383177217 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c038780 con 0x7f3b440b2c50 2023-11-24T06:13:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.878+0000 7f3b4934e640 1 -- 172.21.15.22:0/383177217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 msgr2=0x7f3b44164520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.878+0000 7f3b4934e640 1 --2- 172.21.15.22:0/383177217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 0x7f3b44164520 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d150 tx=0x7f3b3c02e170 comp rx=0 tx=0).stop 2023-11-24T06:13:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.878+0000 7f3b4934e640 1 -- 172.21.15.22:0/383177217 shutdown_connections 2023-11-24T06:13:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.878+0000 7f3b4934e640 1 --2- 172.21.15.22:0/383177217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 0x7f3b44164520 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.878+0000 7f3b4934e640 1 -- 172.21.15.22:0/383177217 >> 172.21.15.22:0/383177217 conn(0x7f3b440b0840 msgr2=0x7f3b440b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.878+0000 7f3b4934e640 1 -- 172.21.15.22:0/383177217 shutdown_connections 2023-11-24T06:13:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.878+0000 7f3b4934e640 1 -- 172.21.15.22:0/383177217 wait complete. 2023-11-24T06:13:55.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.880+0000 7f3b4934e640 1 Processor -- start 2023-11-24T06:13:55.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.881+0000 7f3b4934e640 1 -- start start 2023-11-24T06:13:55.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.882+0000 7f3b4934e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b4406c9a0 0x7f3b4415cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.882+0000 7f3b4934e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b44070a40 0x7f3b44142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.882+0000 7f3b4934e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 0x7f3b440c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.882+0000 7f3b4934e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4415c710 con 0x7f3b440b2c50 2023-11-24T06:13:55.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.882+0000 7f3b4934e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4415b850 con 0x7f3b4406c9a0 2023-11-24T06:13:55.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.882+0000 7f3b4934e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4415ba90 con 0x7f3b44070a40 2023-11-24T06:13:55.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.882+0000 7f3b48b4d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 0x7f3b440c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.882+0000 7f3b48b4d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 0x7f3b440c3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43540/0 (socket says 172.21.15.22:43540) 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.882+0000 7f3b48b4d640 1 -- 172.21.15.22:0/4290394275 learned_addr learned my addr 172.21.15.22:0/4290394275 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.883+0000 7f3b3bfff640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b44070a40 0x7f3b44142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.883+0000 7f3b43fff640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b4406c9a0 0x7f3b4415cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.883+0000 7f3b48b4d640 1 -- 172.21.15.22:0/4290394275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b44070a40 msgr2=0x7f3b44142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.883+0000 7f3b48b4d640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b44070a40 0x7f3b44142600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.883+0000 7f3b48b4d640 1 -- 172.21.15.22:0/4290394275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b4406c9a0 msgr2=0x7f3b4415cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.883+0000 7f3b48b4d640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b4406c9a0 0x7f3b4415cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.883+0000 7f3b48b4d640 1 -- 172.21.15.22:0/4290394275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c00bd40 con 0x7f3b440b2c50 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.883+0000 7f3b48b4d640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 0x7f3b440c3ab0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d150 tx=0x7f3b3c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.883+0000 7f3b417fa640 1 -- 172.21.15.22:0/4290394275 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c003990 con 0x7f3b440b2c50 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.884+0000 7f3b417fa640 1 -- 172.21.15.22:0/4290394275 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c003b10 con 0x7f3b440b2c50 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.884+0000 7f3b417fa640 1 -- 172.21.15.22:0/4290394275 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c004030 con 0x7f3b440b2c50 2023-11-24T06:13:55.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.884+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4415bd70 con 0x7f3b440b2c50 2023-11-24T06:13:55.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.884+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4415c330 con 0x7f3b440b2c50 2023-11-24T06:13:55.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.885+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4415c850 con 0x7f3b440b2c50 2023-11-24T06:13:55.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.886+0000 7f3b417fa640 1 -- 172.21.15.22:0/4290394275 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3b3c004190 con 0x7f3b440b2c50 2023-11-24T06:13:55.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.887+0000 7f3b417fa640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b2406aff0 0x7f3b2406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.887+0000 7f3b417fa640 1 -- 172.21.15.22:0/4290394275 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b3c0abc70 con 0x7f3b440b2c50 2023-11-24T06:13:55.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.887+0000 7f3b43fff640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b2406aff0 0x7f3b2406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.888+0000 7f3b43fff640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b2406aff0 0x7f3b2406d4b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3b34000f60 tx=0x7f3b34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:55.891+0000 7f3b417fa640 1 -- 172.21.15.22:0/4290394275 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b4415c850 con 0x7f3b440b2c50 2023-11-24T06:13:56.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.090+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3b4415c850 con 0x7f3b440b2c50 2023-11-24T06:13:56.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.091+0000 7f3b417fa640 1 -- 172.21.15.22:0/4290394275 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3b4415c850 con 0x7f3b440b2c50 2023-11-24T06:13:56.094 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:13:56.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.093+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b2406aff0 msgr2=0x7f3b2406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.093+0000 7f3b4934e640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b2406aff0 0x7f3b2406d4b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3b34000f60 tx=0x7f3b34009040 comp rx=0 tx=0).stop 2023-11-24T06:13:56.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.093+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 msgr2=0x7f3b440c3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.093+0000 7f3b4934e640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 0x7f3b440c3ab0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d150 tx=0x7f3b3c004ab0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.094+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 shutdown_connections 2023-11-24T06:13:56.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.094+0000 7f3b4934e640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b2406aff0 0x7f3b2406d4b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.094+0000 7f3b4934e640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b440b2c50 0x7f3b440c3ab0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.094+0000 7f3b4934e640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b44070a40 0x7f3b44142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.094+0000 7f3b4934e640 1 --2- 172.21.15.22:0/4290394275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b4406c9a0 0x7f3b4415cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.094+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 >> 172.21.15.22:0/4290394275 conn(0x7f3b440b0840 msgr2=0x7f3b440ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:56.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.094+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 shutdown_connections 2023-11-24T06:13:56.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.094+0000 7f3b4934e640 1 -- 172.21.15.22:0/4290394275 wait complete. 2023-11-24T06:13:56.116 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2023-11-24T06:13:56.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.116 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T06:13:56.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[95278]: fuse finished with error 0 and tester_r 0 2023-11-24T06:13:56.226 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:13:56.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.228 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:13:56.327 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:13:56.328 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:56.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:13:56.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:13:56.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.390 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T06:13:56.448 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-24T06:13:56.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:13:56.449 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:13:56.449 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:56.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:13:56.515 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:13:56.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.516 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T06:13:56.573 INFO:teuthology.orchestra.run.smithi031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-24T06:13:56.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:13:56.574 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:56.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.807+0000 7fb7da74e640 1 Processor -- start 2023-11-24T06:13:56.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.807+0000 7fb7da74e640 1 -- start start 2023-11-24T06:13:56.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.808+0000 7fb7da74e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d4143950 0x7fb7d4164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.808+0000 7fb7da74e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d4071700 con 0x7fb7d40cf760 2023-11-24T06:13:56.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.808+0000 7fb7da74e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d415b410 con 0x7fb7d4143570 2023-11-24T06:13:56.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.808+0000 7fb7da74e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d415b130 con 0x7fb7d4143950 2023-11-24T06:13:56.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7d8f4b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb7d40cf760 0x7fb7d415a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36544/0 (socket says 172.21.15.22:36544) 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7d8f4b640 1 -- 172.21.15.22:0/2019024498 learned_addr learned my addr 172.21.15.22:0/2019024498 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7d9f4d640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d4143950 0x7fb7d4164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538905097 0 0) 0x7fb7c8001490 con 0x7fb7d40cf760 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c0005730 con 0x7fb7d40cf760 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2692782434 0 0) 0x7fb7c0005730 con 0x7fb7d40cf760 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d4143950 msgr2=0x7fb7d4164e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7c7fff640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d4143950 0x7fb7d4164e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 >> v1:172.21.15.31:6789/0 conn(0x7fb7d4143570 legacy=0x7fb7d40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d415dbd0 con 0x7fb7d40cf760 2023-11-24T06:13:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.809+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fb7c8001b80 con 0x7fb7d40cf760 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 >> v1:172.21.15.22:6789/0 conn(0x7fb7d40cf760 legacy=0x7fb7d415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7c7fff640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d4143950 0x7fb7c0005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7c7fff640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00061a0 0x7fb7c00069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7c7fff640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7c0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d415b130 con 0x7fb7c0006f10 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c000dd80 con 0x7fb7c00061a0 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c000df40 con 0x7fb7d4143950 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7d9f4d640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7c0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7d9f4d640 1 -- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d4143950 msgr2=0x7fb7c0005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7d974c640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d4143950 0x7fb7c0005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7d8f4b640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00061a0 0x7fb7c00069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7d9f4d640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d4143950 0x7fb7c0005c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7d9f4d640 1 -- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00061a0 msgr2=0x7fb7c00069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7d9f4d640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00061a0 0x7fb7c00069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7d9f4d640 1 -- 172.21.15.22:0/2019024498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c0005730 con 0x7fb7c0006f10 2023-11-24T06:13:56.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.810+0000 7fb7d8f4b640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00061a0 0x7fb7c00069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:56.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7d9f4d640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7c0007390 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009ac0 tx=0x7fb7c0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58441388d9ae21bd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc02c6b0 con 0x7fb7c0006f10 2023-11-24T06:13:56.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc02c810 con 0x7fb7c0006f10 2023-11-24T06:13:56.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7c7fff640 1 -- 172.21.15.22:0/2019024498 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc02cba0 con 0x7fb7c0006f10 2023-11-24T06:13:56.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7da74e640 1 -- 172.21.15.22:0/2019024498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 msgr2=0x7fb7c0007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7da74e640 1 --2- 172.21.15.22:0/2019024498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7c0007390 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009ac0 tx=0x7fb7c0007a00 comp rx=0 tx=0).stop 2023-11-24T06:13:56.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7d9f4d640 1 -- 172.21.15.22:0/2019024498 reap_dead start 2023-11-24T06:13:56.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7da74e640 1 -- 172.21.15.22:0/2019024498 shutdown_connections 2023-11-24T06:13:56.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7da74e640 1 -- 172.21.15.22:0/2019024498 >> 172.21.15.22:0/2019024498 conn(0x7fb7d406a860 msgr2=0x7fb7d406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:56.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.812+0000 7fb7da74e640 1 -- 172.21.15.22:0/2019024498 shutdown_connections 2023-11-24T06:13:56.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.813+0000 7fb7da74e640 1 -- 172.21.15.22:0/2019024498 wait complete. 2023-11-24T06:13:56.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.814+0000 7fb7da74e640 1 Processor -- start 2023-11-24T06:13:56.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.814+0000 7fb7da74e640 1 -- start start 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.815+0000 7fb7da74e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7d414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.815+0000 7fb7da74e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d41ef460 0x7fb7d406c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.815+0000 7fb7da74e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d41374d0 0x7fb7d406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.815+0000 7fb7da74e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4137140 con 0x7fb7c0006f10 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.815+0000 7fb7da74e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d414e520 con 0x7fb7d41ef460 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.815+0000 7fb7da74e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4137a70 con 0x7fb7d41374d0 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d974c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7d414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d974c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7d414dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43560/0 (socket says 172.21.15.22:43560) 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d974c640 1 -- 172.21.15.22:0/41439301 learned_addr learned my addr 172.21.15.22:0/41439301 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:56.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d9f4d640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d41374d0 0x7fb7d406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d8f4b640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d41ef460 0x7fb7d406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d974c640 1 -- 172.21.15.22:0/41439301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d41374d0 msgr2=0x7fb7d406c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d974c640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d41374d0 0x7fb7d406c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d974c640 1 -- 172.21.15.22:0/41439301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d41ef460 msgr2=0x7fb7d406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d974c640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d41ef460 0x7fb7d406c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d974c640 1 -- 172.21.15.22:0/41439301 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4137d50 con 0x7fb7c0006f10 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.816+0000 7fb7d8f4b640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d41ef460 0x7fb7d406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.817+0000 7fb7d974c640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7d414dfe0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000d5a0 tx=0x7fb7d000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.817+0000 7fb7c5ffb640 1 -- 172.21.15.22:0/41439301 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0005480 con 0x7fb7c0006f10 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.817+0000 7fb7c5ffb640 1 -- 172.21.15.22:0/41439301 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0003610 con 0x7fb7c0006f10 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.817+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d4138030 con 0x7fb7c0006f10 2023-11-24T06:13:56.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.817+0000 7fb7c5ffb640 1 -- 172.21.15.22:0/41439301 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0003980 con 0x7fb7c0006f10 2023-11-24T06:13:56.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.817+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d413aa50 con 0x7fb7c0006f10 2023-11-24T06:13:56.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.818+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d404e840 con 0x7fb7c0006f10 2023-11-24T06:13:56.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.819+0000 7fb7c5ffb640 1 -- 172.21.15.22:0/41439301 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb7d0003ae0 con 0x7fb7c0006f10 2023-11-24T06:13:56.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.821+0000 7fb7c5ffb640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7b806aff0 0x7fb7b806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.821+0000 7fb7c5ffb640 1 -- 172.21.15.22:0/41439301 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7d0089890 con 0x7fb7c0006f10 2023-11-24T06:13:56.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.821+0000 7fb7d8f4b640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7b806aff0 0x7fb7b806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.822+0000 7fb7d8f4b640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7b806aff0 0x7fb7b806d4b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8001cb0 tx=0x7fb7c80014b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:56.825+0000 7fb7c5ffb640 1 -- 172.21.15.22:0/41439301 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb7d00545a0 con 0x7fb7c0006f10 2023-11-24T06:13:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.061+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7d40b3910 con 0x7fb7c0006f10 2023-11-24T06:13:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.063+0000 7fb7c5ffb640 1 -- 172.21.15.22:0/41439301 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fb7d0001230 con 0x7fb7c0006f10 2023-11-24T06:13:57.066 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:57.066 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3821411702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3821411702},{"type":"v1","addr":"172.21.15.31:6835","nonce":3821411702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3025908035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3025908035},{"type":"v1","addr":"172.21.15.31:6833","nonce":3025908035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/475244267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":475244267},{"type":"v1","addr":"172.21.15.22:6835","nonce":475244267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:29.209497+0000","modified":"2023-11-24T06:13:34.306159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6837/1515634482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1515634482},{"type":"v1","addr":"172.21.15.22:6837","nonce":1515634482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:13:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 16 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7b806aff0 msgr2=0x7fb7b806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7b806aff0 0x7fb7b806d4b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8001cb0 tx=0x7fb7c80014b0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 msgr2=0x7fb7d414dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7d414dfe0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000d5a0 tx=0x7fb7d000da60 comp rx=0 tx=0).stop 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 shutdown_connections 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7b806aff0 0x7fb7b806d4b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7d41374d0 0x7fb7d406c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d41ef460 0x7fb7d406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 --2- 172.21.15.22:0/41439301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7c0006f10 0x7fb7d414dfe0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 >> 172.21.15.22:0/41439301 conn(0x7fb7d406a860 msgr2=0x7fb7d40cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 shutdown_connections 2023-11-24T06:13:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.066+0000 7fb7da74e640 1 -- 172.21.15.22:0/41439301 wait complete. 2023-11-24T06:13:57.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:57.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.313+0000 7f5dd5d7a640 1 Processor -- start 2023-11-24T06:13:57.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.313+0000 7f5dd5d7a640 1 -- start start 2023-11-24T06:13:57.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.314+0000 7f5dd5d7a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5dd00d1490 0x7f5dd00d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.314+0000 7f5dd5d7a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd00cf0b0 con 0x7f5dd015d5a0 2023-11-24T06:13:57.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.314+0000 7f5dd5d7a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd00d1e30 con 0x7f5dd00b0630 2023-11-24T06:13:57.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.314+0000 7f5dd5d7a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd00b01a0 con 0x7f5dd00d1490 2023-11-24T06:13:57.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.315+0000 7f5dd4d78640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5dd015d5a0 0x7f5dd00d3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36554/0 (socket says 172.21.15.22:36554) 2023-11-24T06:13:57.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.315+0000 7f5dd4d78640 1 -- 172.21.15.22:0/3570370936 learned_addr learned my addr 172.21.15.22:0/3570370936 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:57.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.315+0000 7f5dcffff640 1 --2- 172.21.15.22:0/3570370936 >> v2:172.21.15.22:3300/0 conn(0x7f5dd00d1490 0x7f5dd00d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.315+0000 7f5dcffff640 1 -- 172.21.15.22:0/3570370936 >> v1:172.21.15.31:6789/0 conn(0x7f5dd00b0630 legacy=0x7f5dd00b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:57.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.315+0000 7f5dcf7fe640 1 -- 172.21.15.22:0/3570370936 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751138626 0 0) 0x7f5dd00cf0b0 con 0x7f5dd015d5a0 2023-11-24T06:13:57.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.315+0000 7f5dcffff640 1 -- 172.21.15.22:0/3570370936 >> v1:172.21.15.22:6789/0 conn(0x7f5dd015d5a0 legacy=0x7f5dd00d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.315+0000 7f5dcffff640 1 -- 172.21.15.22:0/3570370936 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd015d980 con 0x7f5dd00d1490 2023-11-24T06:13:57.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.316+0000 7f5dcffff640 1 --2- 172.21.15.22:0/3570370936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd00d1490 0x7f5dd00d18f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40097a0 tx=0x7f5dc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf1deae58e01572 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:57.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.317+0000 7f5dcf7fe640 1 -- 172.21.15.22:0/3570370936 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4031830 con 0x7f5dd00d1490 2023-11-24T06:13:57.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.317+0000 7f5dcf7fe640 1 -- 172.21.15.22:0/3570370936 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc4031990 con 0x7f5dd00d1490 2023-11-24T06:13:57.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.317+0000 7f5dcf7fe640 1 -- 172.21.15.22:0/3570370936 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4031d20 con 0x7f5dd00d1490 2023-11-24T06:13:57.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.317+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/3570370936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd00d1490 msgr2=0x7f5dd00d18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.317+0000 7f5dd5d7a640 1 --2- 172.21.15.22:0/3570370936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd00d1490 0x7f5dd00d18f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40097a0 tx=0x7f5dc402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.317+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/3570370936 shutdown_connections 2023-11-24T06:13:57.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.317+0000 7f5dd5d7a640 1 --2- 172.21.15.22:0/3570370936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd00d1490 0x7f5dd00d18f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.317+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/3570370936 >> 172.21.15.22:0/3570370936 conn(0x7f5dd009c3a0 msgr2=0x7f5dd00d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:57.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.318+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/3570370936 shutdown_connections 2023-11-24T06:13:57.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.318+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/3570370936 wait complete. 2023-11-24T06:13:57.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.319+0000 7f5dd5d7a640 1 Processor -- start 2023-11-24T06:13:57.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.319+0000 7f5dd5d7a640 1 -- start start 2023-11-24T06:13:57.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.320+0000 7f5dd5d7a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd00b0630 0x7f5dd01601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.320+0000 7f5dd5d7a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5dd00d1490 0x7f5dd01f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.320+0000 7f5dd5d7a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd015d5a0 0x7f5dd0157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.320+0000 7f5dd5d7a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd01f3c40 con 0x7f5dd015d5a0 2023-11-24T06:13:57.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.320+0000 7f5dd5d7a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd015e700 con 0x7f5dd00b0630 2023-11-24T06:13:57.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.320+0000 7f5dd5d7a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd015e9e0 con 0x7f5dd00d1490 2023-11-24T06:13:57.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd5579640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd015d5a0 0x7f5dd0157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd5579640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd015d5a0 0x7f5dd0157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43584/0 (socket says 172.21.15.22:43584) 2023-11-24T06:13:57.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd5579640 1 -- 172.21.15.22:0/349664258 learned_addr learned my addr 172.21.15.22:0/349664258 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd4d78640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd00b0630 0x7f5dd01601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd5579640 1 -- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5dd00d1490 msgr2=0x7f5dd01f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dcffff640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5dd00d1490 0x7f5dd01f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd5579640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5dd00d1490 0x7f5dd01f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd5579640 1 -- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd00b0630 msgr2=0x7f5dd01601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd5579640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd00b0630 0x7f5dd01601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd5579640 1 -- 172.21.15.22:0/349664258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4009400 con 0x7f5dd015d5a0 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd4d78640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd00b0630 0x7f5dd01601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dcffff640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5dd00d1490 0x7f5dd01f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:57.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.321+0000 7f5dd5579640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd015d5a0 0x7f5dd0157860 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800b410 tx=0x7f5dc800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:57.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.322+0000 7f5dcd7fa640 1 -- 172.21.15.22:0/349664258 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8004020 con 0x7f5dd015d5a0 2023-11-24T06:13:57.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.322+0000 7f5dcd7fa640 1 -- 172.21.15.22:0/349664258 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc8004180 con 0x7f5dd015d5a0 2023-11-24T06:13:57.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.322+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd01f3fb0 con 0x7f5dd015d5a0 2023-11-24T06:13:57.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.322+0000 7f5dcd7fa640 1 -- 172.21.15.22:0/349664258 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8011630 con 0x7f5dd015d5a0 2023-11-24T06:13:57.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.322+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd0157da0 con 0x7f5dd015d5a0 2023-11-24T06:13:57.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.323+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd01f44d0 con 0x7f5dd015d5a0 2023-11-24T06:13:57.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.324+0000 7f5dcd7fa640 1 -- 172.21.15.22:0/349664258 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5dc8011790 con 0x7f5dd015d5a0 2023-11-24T06:13:57.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.325+0000 7f5dcd7fa640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5dbc06aff0 0x7f5dbc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.325+0000 7f5dcd7fa640 1 -- 172.21.15.22:0/349664258 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dc8089610 con 0x7f5dd015d5a0 2023-11-24T06:13:57.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.325+0000 7f5dd4d78640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5dbc06aff0 0x7f5dbc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.326+0000 7f5dd4d78640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5dbc06aff0 0x7f5dbc06d4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0007fd0 tx=0x7f5dc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:57.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.329+0000 7f5dcd7fa640 1 -- 172.21.15.22:0/349664258 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5dd01f44d0 con 0x7f5dd015d5a0 2023-11-24T06:13:57.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.526+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dd01f44d0 con 0x7f5dd015d5a0 2023-11-24T06:13:57.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.529+0000 7f5dcd7fa640 1 -- 172.21.15.22:0/349664258 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f5dd01f44d0 con 0x7f5dd015d5a0 2023-11-24T06:13:57.533 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:57.533 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:13:30.762606+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:27.041850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:28.235409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5dbc06aff0 msgr2=0x7f5dbc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5dbc06aff0 0x7f5dbc06d4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0007fd0 tx=0x7f5dc0009040 comp rx=0 tx=0).stop 2023-11-24T06:13:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd015d5a0 msgr2=0x7f5dd0157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd015d5a0 0x7f5dd0157860 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800b410 tx=0x7f5dc800b8d0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 shutdown_connections 2023-11-24T06:13:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5dbc06aff0 0x7f5dbc06d4b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd015d5a0 0x7f5dd0157860 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5dd00d1490 0x7f5dd01f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 --2- 172.21.15.22:0/349664258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd00b0630 0x7f5dd01601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.532+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 >> 172.21.15.22:0/349664258 conn(0x7f5dd009c3a0 msgr2=0x7f5dd00cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.533+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 shutdown_connections 2023-11-24T06:13:57.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.533+0000 7f5dd5d7a640 1 -- 172.21.15.22:0/349664258 wait complete. 2023-11-24T06:13:57.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:27.041850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:28.235409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:57.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:57.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.772+0000 7f5bcc1c9640 1 Processor -- start 2023-11-24T06:13:57.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.772+0000 7f5bcc1c9640 1 -- start start 2023-11-24T06:13:57.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.774+0000 7f5bcc1c9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc415b350 0x7f5bc40abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.774+0000 7f5bcc1c9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5bc409cb30 0x7f5bc40b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.774+0000 7f5bcc1c9640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc415b730 con 0x7f5bc40adb60 2023-11-24T06:13:57.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.774+0000 7f5bcc1c9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc40ac740 con 0x7f5bc409cb30 2023-11-24T06:13:57.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.774+0000 7f5bcc1c9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc40ac460 con 0x7f5bc415b350 2023-11-24T06:13:57.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.774+0000 7f5bca766640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5bc40adb60 0x7f5bc40adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36564/0 (socket says 172.21.15.22:36564) 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.774+0000 7f5bca766640 1 -- 172.21.15.22:0/3852814181 learned_addr learned my addr 172.21.15.22:0/3852814181 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc9f65640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc415b350 0x7f5bc40abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc9764640 1 --2- 172.21.15.22:0/3852814181 >> v2:172.21.15.31:3300/0 conn(0x7f5bc409cb30 0x7f5bc40b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079036629 0 0) 0x7f5bbc001490 con 0x7f5bc40adb60 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb0003520 con 0x7f5bc40adb60 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1833362144 0 0) 0x7f5bb0003520 con 0x7f5bc40adb60 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc415b350 msgr2=0x7f5bc40abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc8f63640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc415b350 0x7f5bc40abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 >> v2:172.21.15.31:3300/0 conn(0x7f5bc409cb30 msgr2=0x7f5bc40b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc8f63640 1 --2- 172.21.15.22:0/3852814181 >> v2:172.21.15.31:3300/0 conn(0x7f5bc409cb30 0x7f5bc40b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc40b2a50 con 0x7f5bc40adb60 2023-11-24T06:13:57.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.775+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f5bbc001b80 con 0x7f5bc40adb60 2023-11-24T06:13:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 >> v1:172.21.15.22:6789/0 conn(0x7f5bc40adb60 legacy=0x7f5bc40adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bc8f63640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc415b350 0x7f5bb0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bc8f63640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bb0003ef0 0x7f5bb00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bc8f63640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bb0004d00 0x7f5bb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc40ac740 con 0x7f5bb0004d00 2023-11-24T06:13:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc40ac460 con 0x7f5bb0003ef0 2023-11-24T06:13:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb000b980 con 0x7f5bc415b350 2023-11-24T06:13:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bca766640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bb0004d00 0x7f5bb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bc9f65640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc415b350 0x7f5bb0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bca766640 1 -- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc415b350 msgr2=0x7f5bb0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bca766640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc415b350 0x7f5bb0003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.776+0000 7f5bca766640 1 -- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bb0003ef0 msgr2=0x7f5bb00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.777+0000 7f5bca766640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bb0003ef0 0x7f5bb00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.777+0000 7f5bca766640 1 -- 172.21.15.22:0/3852814181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0003520 con 0x7f5bb0004d00 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.778+0000 7f5bca766640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bb0004d00 0x7f5bb0005180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00a830 tx=0x7f5bb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c4fcb5624559c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.778+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc034630 con 0x7f5bb0004d00 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.778+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc02f070 con 0x7f5bb0004d00 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.778+0000 7f5bc8f63640 1 -- 172.21.15.22:0/3852814181 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc034a30 con 0x7f5bb0004d00 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.779+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/3852814181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bb0004d00 msgr2=0x7f5bb0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.779+0000 7f5bcc1c9640 1 --2- 172.21.15.22:0/3852814181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bb0004d00 0x7f5bb0005180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00a830 tx=0x7f5bb00057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.779+0000 7f5bca766640 1 -- 172.21.15.22:0/3852814181 reap_dead start 2023-11-24T06:13:57.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.779+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/3852814181 shutdown_connections 2023-11-24T06:13:57.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.779+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/3852814181 >> 172.21.15.22:0/3852814181 conn(0x7f5bc40b0ba0 msgr2=0x7f5bc40b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:57.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.779+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/3852814181 shutdown_connections 2023-11-24T06:13:57.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.779+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/3852814181 wait complete. 2023-11-24T06:13:57.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.781+0000 7f5bcc1c9640 1 Processor -- start 2023-11-24T06:13:57.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.781+0000 7f5bcc1c9640 1 -- start start 2023-11-24T06:13:57.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.782+0000 7f5bcc1c9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bb0004d00 0x7f5bc4148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.782+0000 7f5bcc1c9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc414e7d0 0x7f5bc4151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.782+0000 7f5bcc1c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bc414ca80 0x7f5bc4151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.782+0000 7f5bcc1c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc414d040 con 0x7f5bc414ca80 2023-11-24T06:13:57.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.782+0000 7f5bcc1c9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc414d320 con 0x7f5bb0004d00 2023-11-24T06:13:57.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.782+0000 7f5bcc1c9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc414d600 con 0x7f5bc414e7d0 2023-11-24T06:13:57.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.782+0000 7f5bca766640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bc414ca80 0x7f5bc4151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.782+0000 7f5bca766640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bc414ca80 0x7f5bc4151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43606/0 (socket says 172.21.15.22:43606) 2023-11-24T06:13:57.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.782+0000 7f5bca766640 1 -- 172.21.15.22:0/1127072874 learned_addr learned my addr 172.21.15.22:0/1127072874 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bc9f65640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bb0004d00 0x7f5bc4148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bc9764640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc414e7d0 0x7f5bc4151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bca766640 1 -- 172.21.15.22:0/1127072874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc414e7d0 msgr2=0x7f5bc4151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bca766640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc414e7d0 0x7f5bc4151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bca766640 1 -- 172.21.15.22:0/1127072874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bb0004d00 msgr2=0x7f5bc4148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bca766640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bb0004d00 0x7f5bc4148d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bca766640 1 -- 172.21.15.22:0/1127072874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc414d8e0 con 0x7f5bc414ca80 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bc9f65640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bb0004d00 0x7f5bc4148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bca766640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bc414ca80 0x7f5bc4151aa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc001e40 tx=0x7f5bbc001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bba7fc640 1 -- 172.21.15.22:0/1127072874 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc034840 con 0x7f5bc414ca80 2023-11-24T06:13:57.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bba7fc640 1 -- 172.21.15.22:0/1127072874 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0349a0 con 0x7f5bc414ca80 2023-11-24T06:13:57.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.783+0000 7f5bba7fc640 1 -- 172.21.15.22:0/1127072874 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc034d10 con 0x7f5bc414ca80 2023-11-24T06:13:57.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.784+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc414dbc0 con 0x7f5bc414ca80 2023-11-24T06:13:57.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.784+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc4149240 con 0x7f5bc414ca80 2023-11-24T06:13:57.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.785+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc409d200 con 0x7f5bc414ca80 2023-11-24T06:13:57.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.786+0000 7f5bba7fc640 1 -- 172.21.15.22:0/1127072874 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5bbc031030 con 0x7f5bc414ca80 2023-11-24T06:13:57.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.787+0000 7f5bba7fc640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5ba806aff0 0x7f5ba806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:57.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.787+0000 7f5bba7fc640 1 -- 172.21.15.22:0/1127072874 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bbc0abe40 con 0x7f5bc414ca80 2023-11-24T06:13:57.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.787+0000 7f5bc9f65640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5ba806aff0 0x7f5ba806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:57.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.788+0000 7f5bc9f65640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5ba806aff0 0x7f5ba806d4b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00099e0 tx=0x7f5bc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:57.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.791+0000 7f5bba7fc640 1 -- 172.21.15.22:0/1127072874 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5bbc076be0 con 0x7f5bc414ca80 2023-11-24T06:13:57.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.986+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bc415b730 con 0x7f5bc414ca80 2023-11-24T06:13:57.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.987+0000 7f5bba7fc640 1 -- 172.21.15.22:0/1127072874 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bc415b730 con 0x7f5bc414ca80 2023-11-24T06:13:57.990 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:13:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.989+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5ba806aff0 msgr2=0x7f5ba806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.989+0000 7f5bcc1c9640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5ba806aff0 0x7f5ba806d4b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00099e0 tx=0x7f5bc0008040 comp rx=0 tx=0).stop 2023-11-24T06:13:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.989+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bc414ca80 msgr2=0x7f5bc4151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.989+0000 7f5bcc1c9640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bc414ca80 0x7f5bc4151aa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc001e40 tx=0x7f5bbc001f10 comp rx=0 tx=0).stop 2023-11-24T06:13:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.990+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 shutdown_connections 2023-11-24T06:13:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.990+0000 7f5bcc1c9640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5ba806aff0 0x7f5ba806d4b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.990+0000 7f5bcc1c9640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bc414ca80 0x7f5bc4151aa0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.990+0000 7f5bcc1c9640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bc414e7d0 0x7f5bc4151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.990+0000 7f5bcc1c9640 1 --2- 172.21.15.22:0/1127072874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bb0004d00 0x7f5bc4148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.990+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 >> 172.21.15.22:0/1127072874 conn(0x7f5bc40b0ba0 msgr2=0x7f5bc40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:57.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.990+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 shutdown_connections 2023-11-24T06:13:57.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:57.990+0000 7f5bcc1c9640 1 -- 172.21.15.22:0/1127072874 wait complete. 2023-11-24T06:13:58.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.235+0000 7f5fd5321640 1 Processor -- start 2023-11-24T06:13:58.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.235+0000 7f5fd5321640 1 -- start start 2023-11-24T06:13:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.237+0000 7f5fd5321640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fd01439b0 0x7f5fd0070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.237+0000 7f5fd5321640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd0070d40 con 0x7f5fd01435d0 2023-11-24T06:13:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.237+0000 7f5fd5321640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd0071020 con 0x7f5fd00b4140 2023-11-24T06:13:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.237+0000 7f5fd5321640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd0071300 con 0x7f5fd01439b0 2023-11-24T06:13:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.237+0000 7f5fcffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5fd01435d0 0x7f5fd00b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36566/0 (socket says 172.21.15.22:36566) 2023-11-24T06:13:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.237+0000 7f5fcffff640 1 -- 172.21.15.22:0/387281295 learned_addr learned my addr 172.21.15.22:0/387281295 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.237+0000 7f5fd4b20640 1 --2- 172.21.15.22:0/387281295 >> v2:172.21.15.22:3300/0 conn(0x7f5fd01439b0 0x7f5fd0070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.238+0000 7f5fd4b20640 1 -- 172.21.15.22:0/387281295 >> v1:172.21.15.31:6789/0 conn(0x7f5fd00b4140 legacy=0x7f5fd0070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.238+0000 7f5fcf7fe640 1 -- 172.21.15.22:0/387281295 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754397760 0 0) 0x7f5fd0070d40 con 0x7f5fd01435d0 2023-11-24T06:13:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.238+0000 7f5fd4b20640 1 -- 172.21.15.22:0/387281295 >> v1:172.21.15.22:6789/0 conn(0x7f5fd01435d0 legacy=0x7f5fd00b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.238+0000 7f5fd4b20640 1 -- 172.21.15.22:0/387281295 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00715e0 con 0x7f5fd01439b0 2023-11-24T06:13:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.239+0000 7f5fd4b20640 1 --2- 172.21.15.22:0/387281295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 0x7f5fd0070760 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009d90 tx=0x7f5fc802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de18e2f0ef5660f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.239+0000 7f5fcf7fe640 1 -- 172.21.15.22:0/387281295 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc802cbd0 con 0x7f5fd01439b0 2023-11-24T06:13:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.239+0000 7f5fcf7fe640 1 -- 172.21.15.22:0/387281295 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc802cd30 con 0x7f5fd01439b0 2023-11-24T06:13:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.239+0000 7f5fcf7fe640 1 -- 172.21.15.22:0/387281295 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc802cea0 con 0x7f5fd01439b0 2023-11-24T06:13:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.240+0000 7f5fd5321640 1 -- 172.21.15.22:0/387281295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 msgr2=0x7f5fd0070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.240+0000 7f5fd5321640 1 --2- 172.21.15.22:0/387281295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 0x7f5fd0070760 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009d90 tx=0x7f5fc802be20 comp rx=0 tx=0).stop 2023-11-24T06:13:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.240+0000 7f5fd5321640 1 -- 172.21.15.22:0/387281295 shutdown_connections 2023-11-24T06:13:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.240+0000 7f5fd5321640 1 --2- 172.21.15.22:0/387281295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 0x7f5fd0070760 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.240+0000 7f5fd5321640 1 -- 172.21.15.22:0/387281295 >> 172.21.15.22:0/387281295 conn(0x7f5fd00cec10 msgr2=0x7f5fd00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.240+0000 7f5fd5321640 1 -- 172.21.15.22:0/387281295 shutdown_connections 2023-11-24T06:13:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.240+0000 7f5fd5321640 1 -- 172.21.15.22:0/387281295 wait complete. 2023-11-24T06:13:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.242+0000 7f5fd5321640 1 Processor -- start 2023-11-24T06:13:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.242+0000 7f5fd5321640 1 -- start start 2023-11-24T06:13:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.243+0000 7f5fd5321640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b4140 0x7f5fd00cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.243+0000 7f5fd5321640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd01435d0 0x7f5fd013a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.243+0000 7f5fd5321640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 0x7f5fd013a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.243+0000 7f5fd5321640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0139e90 con 0x7f5fd01439b0 2023-11-24T06:13:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.243+0000 7f5fd5321640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd00cc300 con 0x7f5fd01435d0 2023-11-24T06:13:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.243+0000 7f5fd5321640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd01f2930 con 0x7f5fd00b4140 2023-11-24T06:13:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.243+0000 7f5fd4b20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 0x7f5fd013a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.243+0000 7f5fd4b20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 0x7f5fd013a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43636/0 (socket says 172.21.15.22:43636) 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.243+0000 7f5fd4b20640 1 -- 172.21.15.22:0/380907917 learned_addr learned my addr 172.21.15.22:0/380907917 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.244+0000 7f5fcffff640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b4140 0x7f5fd00cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.244+0000 7f5fd4b20640 1 -- 172.21.15.22:0/380907917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b4140 msgr2=0x7f5fd00cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.244+0000 7f5fd4b20640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b4140 0x7f5fd00cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.244+0000 7f5fd4b20640 1 -- 172.21.15.22:0/380907917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd01435d0 msgr2=0x7f5fd013a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.244+0000 7f5fc7fff640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd01435d0 0x7f5fd013a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.244+0000 7f5fd4b20640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd01435d0 0x7f5fd013a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.244+0000 7f5fd4b20640 1 -- 172.21.15.22:0/380907917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8009a70 con 0x7f5fd01439b0 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.244+0000 7f5fc7fff640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd01435d0 0x7f5fd013a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.244+0000 7f5fd4b20640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 0x7f5fd013a600 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009d90 tx=0x7f5fc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.245+0000 7f5fcd7fa640 1 -- 172.21.15.22:0/380907917 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc802cea0 con 0x7f5fd01439b0 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.245+0000 7f5fcd7fa640 1 -- 172.21.15.22:0/380907917 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc803e630 con 0x7f5fd01439b0 2023-11-24T06:13:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.245+0000 7f5fcd7fa640 1 -- 172.21.15.22:0/380907917 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc803e9e0 con 0x7f5fd01439b0 2023-11-24T06:13:58.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.245+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd01546a0 con 0x7f5fd01439b0 2023-11-24T06:13:58.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.245+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd00cc830 con 0x7f5fd01439b0 2023-11-24T06:13:58.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.246+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd004e840 con 0x7f5fd01439b0 2023-11-24T06:13:58.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.247+0000 7f5fcd7fa640 1 -- 172.21.15.22:0/380907917 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5fc803b050 con 0x7f5fd01439b0 2023-11-24T06:13:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.248+0000 7f5fcd7fa640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5fb006aff0 0x7f5fb006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.248+0000 7f5fcd7fa640 1 -- 172.21.15.22:0/380907917 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fc80ac290 con 0x7f5fd01439b0 2023-11-24T06:13:58.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.248+0000 7f5fcffff640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5fb006aff0 0x7f5fb006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.249+0000 7f5fcffff640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5fb006aff0 0x7f5fb006d4b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0007fd0 tx=0x7f5fc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:58.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.253+0000 7f5fcd7fa640 1 -- 172.21.15.22:0/380907917 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5fc80771d0 con 0x7f5fd01439b0 2023-11-24T06:13:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.447+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fd00ac870 con 0x7f5fd01439b0 2023-11-24T06:13:58.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.448+0000 7f5fcd7fa640 1 -- 172.21.15.22:0/380907917 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fc807a7f0 con 0x7f5fd01439b0 2023-11-24T06:13:58.451 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:13:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5fb006aff0 msgr2=0x7f5fb006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5fb006aff0 0x7f5fb006d4b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0007fd0 tx=0x7f5fc0009040 comp rx=0 tx=0).stop 2023-11-24T06:13:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 msgr2=0x7f5fd013a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 0x7f5fd013a600 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009d90 tx=0x7f5fc8004a40 comp rx=0 tx=0).stop 2023-11-24T06:13:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 shutdown_connections 2023-11-24T06:13:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5fb006aff0 0x7f5fb006d4b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd01439b0 0x7f5fd013a600 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd01435d0 0x7f5fd013a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 --2- 172.21.15.22:0/380907917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b4140 0x7f5fd00cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 >> 172.21.15.22:0/380907917 conn(0x7f5fd00cec10 msgr2=0x7f5fd00acd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 shutdown_connections 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.451+0000 7f5fd5321640 1 -- 172.21.15.22:0/380907917 wait complete. 2023-11-24T06:13:58.475 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:58.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.707+0000 7ff1e9a9b640 1 Processor -- start 2023-11-24T06:13:58.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.707+0000 7ff1e9a9b640 1 -- start start 2023-11-24T06:13:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.708+0000 7ff1e9a9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1e4146bd0 0x7ff1e40ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.708+0000 7ff1e9a9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 0x7ff1e415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.708+0000 7ff1e9a9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1e406e700 0x7ff1e406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.708+0000 7ff1e9a9b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e406f0b0 con 0x7ff1e406e700 2023-11-24T06:13:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.709+0000 7ff1e9a9b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e415de10 con 0x7ff1e4146bd0 2023-11-24T06:13:58.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.709+0000 7ff1e9a9b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40c5f90 con 0x7ff1e4161b80 2023-11-24T06:13:58.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.709+0000 7ff1e3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1e406e700 0x7ff1e406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.709+0000 7ff1e3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1e406e700 0x7ff1e406eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43646/0 (socket says 172.21.15.22:43646) 2023-11-24T06:13:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.709+0000 7ff1e3fff640 1 -- 172.21.15.22:0/1781276074 learned_addr learned my addr 172.21.15.22:0/1781276074 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.709+0000 7ff1e2ffd640 1 --2- 172.21.15.22:0/1781276074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 0x7ff1e415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.709+0000 7ff1e37fe640 1 --2- 172.21.15.22:0/1781276074 >> v2:172.21.15.31:3300/0 conn(0x7ff1e4146bd0 0x7ff1e40ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.710+0000 7ff1e3fff640 1 -- 172.21.15.22:0/1781276074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 msgr2=0x7ff1e415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.710+0000 7ff1e3fff640 1 --2- 172.21.15.22:0/1781276074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 0x7ff1e415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.710+0000 7ff1e3fff640 1 -- 172.21.15.22:0/1781276074 >> v2:172.21.15.31:3300/0 conn(0x7ff1e4146bd0 msgr2=0x7ff1e40ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.710+0000 7ff1e3fff640 1 --2- 172.21.15.22:0/1781276074 >> v2:172.21.15.31:3300/0 conn(0x7ff1e4146bd0 0x7ff1e40ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.710+0000 7ff1e3fff640 1 -- 172.21.15.22:0/1781276074 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40c6270 con 0x7ff1e406e700 2023-11-24T06:13:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.711+0000 7ff1e3fff640 1 --2- 172.21.15.22:0/1781276074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 0x7ff1e406eb70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4066da0 tx=0x7ff1dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d28b3c081c13fc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.711+0000 7ff1e27fc640 1 -- 172.21.15.22:0/1781276074 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc031870 con 0x7ff1e406e700 2023-11-24T06:13:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.711+0000 7ff1e27fc640 1 -- 172.21.15.22:0/1781276074 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0319d0 con 0x7ff1e406e700 2023-11-24T06:13:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.711+0000 7ff1e27fc640 1 -- 172.21.15.22:0/1781276074 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc031d60 con 0x7ff1e406e700 2023-11-24T06:13:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.712+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1781276074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 msgr2=0x7ff1e406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.712+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1781276074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 0x7ff1e406eb70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4066da0 tx=0x7ff1dc02b910 comp rx=0 tx=0).stop 2023-11-24T06:13:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.712+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1781276074 shutdown_connections 2023-11-24T06:13:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.712+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1781276074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 0x7ff1e406eb70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.712+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1781276074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 0x7ff1e415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.712+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1781276074 >> v2:172.21.15.31:3300/0 conn(0x7ff1e4146bd0 0x7ff1e40ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.712+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1781276074 >> 172.21.15.22:0/1781276074 conn(0x7ff1e40661f0 msgr2=0x7ff1e40665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.712+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1781276074 shutdown_connections 2023-11-24T06:13:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.712+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1781276074 wait complete. 2023-11-24T06:13:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.714+0000 7ff1e9a9b640 1 Processor -- start 2023-11-24T06:13:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.714+0000 7ff1e9a9b640 1 -- start start 2023-11-24T06:13:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.715+0000 7ff1e9a9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 0x7ff1e40d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.715+0000 7ff1e9a9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e4146bd0 0x7ff1e41e7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.715+0000 7ff1e9a9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 0x7ff1e40ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.715+0000 7ff1e9a9b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e41f3e60 con 0x7ff1e406e700 2023-11-24T06:13:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.715+0000 7ff1e9a9b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e41f3250 con 0x7ff1e4146bd0 2023-11-24T06:13:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.715+0000 7ff1e9a9b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e41f3530 con 0x7ff1e4161b80 2023-11-24T06:13:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 0x7ff1e40d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 0x7ff1e40d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43662/0 (socket says 172.21.15.22:43662) 2023-11-24T06:13:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e37fe640 1 -- 172.21.15.22:0/1754002980 learned_addr learned my addr 172.21.15.22:0/1754002980 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e2ffd640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e4146bd0 0x7ff1e41e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e3fff640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 0x7ff1e40ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e37fe640 1 -- 172.21.15.22:0/1754002980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 msgr2=0x7ff1e40ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e37fe640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 0x7ff1e40ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e37fe640 1 -- 172.21.15.22:0/1754002980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e4146bd0 msgr2=0x7ff1e41e7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e37fe640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e4146bd0 0x7ff1e41e7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e37fe640 1 -- 172.21.15.22:0/1754002980 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0094d0 con 0x7ff1e406e700 2023-11-24T06:13:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.716+0000 7ff1e37fe640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 0x7ff1e40d01a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4007e60 tx=0x7ff1d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.717+0000 7ff1dbfff640 1 -- 172.21.15.22:0/1754002980 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4014620 con 0x7ff1e406e700 2023-11-24T06:13:58.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.717+0000 7ff1dbfff640 1 -- 172.21.15.22:0/1754002980 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d400ee90 con 0x7ff1e406e700 2023-11-24T06:13:58.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.717+0000 7ff1dbfff640 1 -- 172.21.15.22:0/1754002980 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40149c0 con 0x7ff1e406e700 2023-11-24T06:13:58.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.717+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e41f3810 con 0x7ff1e406e700 2023-11-24T06:13:58.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.717+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40d06e0 con 0x7ff1e406e700 2023-11-24T06:13:58.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.718+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e406fb50 con 0x7ff1e406e700 2023-11-24T06:13:58.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.719+0000 7ff1dbfff640 1 -- 172.21.15.22:0/1754002980 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff1d4014b20 con 0x7ff1e406e700 2023-11-24T06:13:58.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.720+0000 7ff1dbfff640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1c406aff0 0x7ff1c406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.720+0000 7ff1dbfff640 1 -- 172.21.15.22:0/1754002980 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1d408a2a0 con 0x7ff1e406e700 2023-11-24T06:13:58.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.720+0000 7ff1e2ffd640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1c406aff0 0x7ff1c406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.721+0000 7ff1e2ffd640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1c406aff0 0x7ff1c406d4b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1e415e5f0 tx=0x7ff1cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.725+0000 7ff1dbfff640 1 -- 172.21.15.22:0/1754002980 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1d40550d0 con 0x7ff1e406e700 2023-11-24T06:13:58.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.918+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1e415d490 con 0x7ff1e406e700 2023-11-24T06:13:58.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.919+0000 7ff1dbfff640 1 -- 172.21.15.22:0/1754002980 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff1d4009a20 con 0x7ff1e406e700 2023-11-24T06:13:58.922 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:13:58.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.921+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1c406aff0 msgr2=0x7ff1c406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.921+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1c406aff0 0x7ff1c406d4b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1e415e5f0 tx=0x7ff1cc008040 comp rx=0 tx=0).stop 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.921+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 msgr2=0x7ff1e40d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.921+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 0x7ff1e40d01a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4007e60 tx=0x7ff1d400e4b0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.922+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 shutdown_connections 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.922+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1c406aff0 0x7ff1c406d4b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.922+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e4161b80 0x7ff1e40ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.922+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e4146bd0 0x7ff1e41e7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.922+0000 7ff1e9a9b640 1 --2- 172.21.15.22:0/1754002980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e406e700 0x7ff1e40d01a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.922+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 >> 172.21.15.22:0/1754002980 conn(0x7ff1e40661f0 msgr2=0x7ff1e40665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.922+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 shutdown_connections 2023-11-24T06:13:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:58.922+0000 7ff1e9a9b640 1 -- 172.21.15.22:0/1754002980 wait complete. 2023-11-24T06:13:58.943 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:59.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.158+0000 7feca91cf640 1 Processor -- start 2023-11-24T06:13:59.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.158+0000 7feca91cf640 1 -- start start 2023-11-24T06:13:59.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.159+0000 7feca91cf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca40cf500 0x7feca40cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.159+0000 7feca91cf640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca4140900 con 0x7feca413dfd0 2023-11-24T06:13:59.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.159+0000 7feca91cf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca415fa70 con 0x7feca40cf050 2023-11-24T06:13:59.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.159+0000 7feca91cf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca415c580 con 0x7feca40cf500 2023-11-24T06:13:59.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.160+0000 7feca3fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7feca413dfd0 0x7feca415be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36570/0 (socket says 172.21.15.22:36570) 2023-11-24T06:13:59.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.160+0000 7feca3fff640 1 -- 172.21.15.22:0/4223193424 learned_addr learned my addr 172.21.15.22:0/4223193424 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:13:59.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.160+0000 7feca89ce640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca40cf500 0x7feca40cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.160+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695365988 0 0) 0x7feca4140900 con 0x7feca413dfd0 2023-11-24T06:13:59.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.160+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec90003520 con 0x7feca413dfd0 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1070820512 0 0) 0x7fec90003520 con 0x7feca413dfd0 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca40cf500 msgr2=0x7feca40cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca40cf500 0x7feca40cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 >> v1:172.21.15.31:6789/0 conn(0x7feca40cf050 legacy=0x7feca40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40cf950 con 0x7feca413dfd0 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fec94001690 con 0x7feca413dfd0 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 >> v1:172.21.15.22:6789/0 conn(0x7feca413dfd0 legacy=0x7feca415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca40cf500 0x7fec90003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec90003fe0 0x7fec900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7fec90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca415c580 con 0x7fec90004d00 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9000bb40 con 0x7fec90003fe0 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9000bd00 con 0x7feca40cf500 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca89ce640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7fec90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca3fff640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca40cf500 0x7fec90003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.161+0000 7feca89ce640 1 -- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca40cf500 msgr2=0x7fec90003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.162+0000 7feca89ce640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca40cf500 0x7fec90003a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.162+0000 7feca89ce640 1 -- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec90003fe0 msgr2=0x7fec900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.162+0000 7fec9bfff640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec90003fe0 0x7fec900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.162+0000 7feca89ce640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec90003fe0 0x7fec900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.162+0000 7feca89ce640 1 -- 172.21.15.22:0/4223193424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec90003520 con 0x7fec90004d00 2023-11-24T06:13:59.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.162+0000 7fec9bfff640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec90003fe0 0x7fec900047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:59.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.163+0000 7feca89ce640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7fec90005180 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009fc0 tx=0x7fec900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab94c970bc3d2e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.163+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c02cc20 con 0x7fec90004d00 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.163+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c00f040 con 0x7fec90004d00 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.163+0000 7feca37fe640 1 -- 172.21.15.22:0/4223193424 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c034440 con 0x7fec90004d00 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.163+0000 7feca91cf640 1 -- 172.21.15.22:0/4223193424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 msgr2=0x7fec90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.163+0000 7feca91cf640 1 --2- 172.21.15.22:0/4223193424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7fec90005180 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009fc0 tx=0x7fec900057f0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.163+0000 7feca89ce640 1 -- 172.21.15.22:0/4223193424 reap_dead start 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.164+0000 7feca91cf640 1 -- 172.21.15.22:0/4223193424 shutdown_connections 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.164+0000 7feca91cf640 1 -- 172.21.15.22:0/4223193424 >> 172.21.15.22:0/4223193424 conn(0x7feca406a860 msgr2=0x7feca406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.164+0000 7feca91cf640 1 -- 172.21.15.22:0/4223193424 shutdown_connections 2023-11-24T06:13:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.164+0000 7feca91cf640 1 -- 172.21.15.22:0/4223193424 wait complete. 2023-11-24T06:13:59.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.165+0000 7feca91cf640 1 Processor -- start 2023-11-24T06:13:59.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.166+0000 7feca91cf640 1 -- start start 2023-11-24T06:13:59.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.166+0000 7feca91cf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7feca40b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.166+0000 7feca91cf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feca40b0820 0x7feca413f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca91cf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca41e7370 0x7feca413fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca91cf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca40b0d00 con 0x7fec90004d00 2023-11-24T06:13:59.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca91cf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca40b0fe0 con 0x7feca40b0820 2023-11-24T06:13:59.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca91cf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca40b12c0 con 0x7feca41e7370 2023-11-24T06:13:59.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7feca40b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7feca40b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43686/0 (socket says 172.21.15.22:43686) 2023-11-24T06:13:59.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca3fff640 1 -- 172.21.15.22:0/3889187995 learned_addr learned my addr 172.21.15.22:0/3889187995 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:59.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca3fff640 1 -- 172.21.15.22:0/3889187995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca41e7370 msgr2=0x7feca413fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca3fff640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca41e7370 0x7feca413fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca3fff640 1 -- 172.21.15.22:0/3889187995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feca40b0820 msgr2=0x7feca413f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca3fff640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feca40b0820 0x7feca413f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.167+0000 7feca3fff640 1 -- 172.21.15.22:0/3889187995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40b15a0 con 0x7fec90004d00 2023-11-24T06:13:59.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.168+0000 7feca3fff640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7feca40b3040 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fec9400d780 tx=0x7fec9400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:59.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.168+0000 7feca17fa640 1 -- 172.21.15.22:0/3889187995 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec940074e0 con 0x7fec90004d00 2023-11-24T06:13:59.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.168+0000 7feca17fa640 1 -- 172.21.15.22:0/3889187995 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9400de90 con 0x7fec90004d00 2023-11-24T06:13:59.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.168+0000 7feca17fa640 1 -- 172.21.15.22:0/3889187995 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94004a00 con 0x7fec90004d00 2023-11-24T06:13:59.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.168+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca41e52b0 con 0x7fec90004d00 2023-11-24T06:13:59.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.168+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca4155c00 con 0x7fec90004d00 2023-11-24T06:13:59.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.169+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca41e5110 con 0x7fec90004d00 2023-11-24T06:13:59.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.170+0000 7feca17fa640 1 -- 172.21.15.22:0/3889187995 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fec94004b60 con 0x7fec90004d00 2023-11-24T06:13:59.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.171+0000 7feca17fa640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec8406b020 0x7fec8406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.171+0000 7feca17fa640 1 -- 172.21.15.22:0/3889187995 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec940895c0 con 0x7fec90004d00 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.171+0000 7fec9bfff640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec8406b020 0x7fec8406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.172+0000 7fec9bfff640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec8406b020 0x7fec8406d4e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feca415ed10 tx=0x7fec8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:59.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.175+0000 7feca17fa640 1 -- 172.21.15.22:0/3889187995 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feca41e5110 con 0x7fec90004d00 2023-11-24T06:13:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.399+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feca41e5110 con 0x7fec90004d00 2023-11-24T06:13:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.401+0000 7feca17fa640 1 -- 172.21.15.22:0/3889187995 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7feca41e5110 con 0x7fec90004d00 2023-11-24T06:13:59.404 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:59.404 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3821411702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3821411702},{"type":"v1","addr":"172.21.15.31:6835","nonce":3821411702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3025908035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3025908035},{"type":"v1","addr":"172.21.15.31:6833","nonce":3025908035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/475244267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":475244267},{"type":"v1","addr":"172.21.15.22:6835","nonce":475244267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:29.209497+0000","modified":"2023-11-24T06:13:34.306159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6837/1515634482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1515634482},{"type":"v1","addr":"172.21.15.22:6837","nonce":1515634482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:13:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 16 2023-11-24T06:13:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.403+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec8406b020 msgr2=0x7fec8406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.403+0000 7feca91cf640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec8406b020 0x7fec8406d4e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feca415ed10 tx=0x7fec8c009040 comp rx=0 tx=0).stop 2023-11-24T06:13:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.403+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 msgr2=0x7feca40b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.403+0000 7feca91cf640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7feca40b3040 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fec9400d780 tx=0x7fec9400dc40 comp rx=0 tx=0).stop 2023-11-24T06:13:59.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.404+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 shutdown_connections 2023-11-24T06:13:59.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.404+0000 7feca91cf640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec8406b020 0x7fec8406d4e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.404+0000 7feca91cf640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feca41e7370 0x7feca413fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.404+0000 7feca91cf640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feca40b0820 0x7feca413f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.404+0000 7feca91cf640 1 --2- 172.21.15.22:0/3889187995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec90004d00 0x7feca40b3040 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.404+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 >> 172.21.15.22:0/3889187995 conn(0x7feca406a860 msgr2=0x7feca4158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:59.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.404+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 shutdown_connections 2023-11-24T06:13:59.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.404+0000 7feca91cf640 1 -- 172.21.15.22:0/3889187995 wait complete. 2023-11-24T06:13:59.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:59.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.645+0000 7fbc24b9e640 1 Processor -- start 2023-11-24T06:13:59.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.646+0000 7fbc24b9e640 1 -- start start 2023-11-24T06:13:59.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.647+0000 7fbc24b9e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200ce040 0x7fbc200ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.647+0000 7fbc24b9e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc200b6410 0x7fbc200b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.647+0000 7fbc24b9e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200ce9c0 con 0x7fbc2015d580 2023-11-24T06:13:59.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.647+0000 7fbc24b9e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200d1dd0 con 0x7fbc200b6410 2023-11-24T06:13:59.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.647+0000 7fbc24b9e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200d20b0 con 0x7fbc200ce040 2023-11-24T06:13:59.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.647+0000 7fbc1ed9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc200b6410 0x7fbc200b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.647+0000 7fbc1ed9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc200b6410 0x7fbc200b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43698/0 (socket says 172.21.15.22:43698) 2023-11-24T06:13:59.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.647+0000 7fbc1ed9d640 1 -- 172.21.15.22:0/1784824410 learned_addr learned my addr 172.21.15.22:0/1784824410 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:59.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.648+0000 7fbc1dd9b640 1 --2- 172.21.15.22:0/1784824410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200ce040 0x7fbc200ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.648+0000 7fbc1ed9d640 1 -- 172.21.15.22:0/1784824410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200ce040 msgr2=0x7fbc200ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:59.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.648+0000 7fbc1ed9d640 1 --2- 172.21.15.22:0/1784824410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200ce040 0x7fbc200ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.648+0000 7fbc1ed9d640 1 -- 172.21.15.22:0/1784824410 >> v1:172.21.15.31:6789/0 conn(0x7fbc2015d580 legacy=0x7fbc200d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:59.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.648+0000 7fbc1ed9d640 1 -- 172.21.15.22:0/1784824410 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200d2390 con 0x7fbc200b6410 2023-11-24T06:13:59.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.648+0000 7fbc1dd9b640 1 --2- 172.21.15.22:0/1784824410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200ce040 0x7fbc200ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:59.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.649+0000 7fbc1ed9d640 1 --2- 172.21.15.22:0/1784824410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc200b6410 0x7fbc200b68a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009870 tx=0x7fbc1802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827687bc5dbac1b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.649+0000 7fbc1d59a640 1 -- 172.21.15.22:0/1784824410 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18030840 con 0x7fbc200b6410 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.649+0000 7fbc1d59a640 1 -- 172.21.15.22:0/1784824410 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc180309a0 con 0x7fbc200b6410 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.649+0000 7fbc1d59a640 1 -- 172.21.15.22:0/1784824410 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18030d30 con 0x7fbc200b6410 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.650+0000 7fbc24b9e640 1 -- 172.21.15.22:0/1784824410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc200b6410 msgr2=0x7fbc200b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.650+0000 7fbc24b9e640 1 --2- 172.21.15.22:0/1784824410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc200b6410 0x7fbc200b68a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009870 tx=0x7fbc1802b980 comp rx=0 tx=0).stop 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.650+0000 7fbc24b9e640 1 -- 172.21.15.22:0/1784824410 shutdown_connections 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.650+0000 7fbc24b9e640 1 --2- 172.21.15.22:0/1784824410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc200b6410 0x7fbc200b68a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.650+0000 7fbc24b9e640 1 --2- 172.21.15.22:0/1784824410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200ce040 0x7fbc200ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.650+0000 7fbc24b9e640 1 -- 172.21.15.22:0/1784824410 >> 172.21.15.22:0/1784824410 conn(0x7fbc20071f90 msgr2=0x7fbc200723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.650+0000 7fbc24b9e640 1 -- 172.21.15.22:0/1784824410 shutdown_connections 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.650+0000 7fbc24b9e640 1 -- 172.21.15.22:0/1784824410 wait complete. 2023-11-24T06:13:59.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.652+0000 7fbc24b9e640 1 Processor -- start 2023-11-24T06:13:59.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.652+0000 7fbc24b9e640 1 -- start start 2023-11-24T06:13:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.653+0000 7fbc24b9e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200b6410 0x7fbc200b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.653+0000 7fbc24b9e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200ce040 0x7fbc201f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.653+0000 7fbc24b9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc2015d580 0x7fbc201e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.653+0000 7fbc24b9e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201f40b0 con 0x7fbc2015d580 2023-11-24T06:13:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.653+0000 7fbc24b9e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201e6e00 con 0x7fbc200ce040 2023-11-24T06:13:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.653+0000 7fbc24b9e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201e70a0 con 0x7fbc200b6410 2023-11-24T06:13:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.653+0000 7fbc1ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc2015d580 0x7fbc201e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.653+0000 7fbc1ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc2015d580 0x7fbc201e68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43704/0 (socket says 172.21.15.22:43704) 2023-11-24T06:13:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.653+0000 7fbc1ed9d640 1 -- 172.21.15.22:0/3867909207 learned_addr learned my addr 172.21.15.22:0/3867909207 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1e59c640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200b6410 0x7fbc200b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1dd9b640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200ce040 0x7fbc201f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1ed9d640 1 -- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200b6410 msgr2=0x7fbc200b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1ed9d640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200b6410 0x7fbc200b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1ed9d640 1 -- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200ce040 msgr2=0x7fbc201f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1ed9d640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200ce040 0x7fbc201f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1ed9d640 1 -- 172.21.15.22:0/3867909207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180094d0 con 0x7fbc2015d580 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1e59c640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200b6410 0x7fbc200b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1dd9b640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200ce040 0x7fbc201f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc1ed9d640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc2015d580 0x7fbc201e68c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009870 tx=0x7fbc18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc16ffd640 1 -- 172.21.15.22:0/3867909207 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc180307d0 con 0x7fbc2015d580 2023-11-24T06:13:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc16ffd640 1 -- 172.21.15.22:0/3867909207 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc18043400 con 0x7fbc2015d580 2023-11-24T06:13:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc16ffd640 1 -- 172.21.15.22:0/3867909207 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc180437b0 con 0x7fbc2015d580 2023-11-24T06:13:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.654+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc201f3090 con 0x7fbc2015d580 2023-11-24T06:13:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.655+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc201f3650 con 0x7fbc2015d580 2023-11-24T06:13:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.656+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc20074770 con 0x7fbc2015d580 2023-11-24T06:13:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.657+0000 7fbc16ffd640 1 -- 172.21.15.22:0/3867909207 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbc18043910 con 0x7fbc2015d580 2023-11-24T06:13:59.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.658+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc0006aff0 0x7fbc0006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:59.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.658+0000 7fbc16ffd640 1 -- 172.21.15.22:0/3867909207 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc1803e070 con 0x7fbc2015d580 2023-11-24T06:13:59.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.658+0000 7fbc1e59c640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc0006aff0 0x7fbc0006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:59.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.659+0000 7fbc1e59c640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc0006aff0 0x7fbc0006d4b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000a810 tx=0x7fbc10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:59.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.662+0000 7fbc16ffd640 1 -- 172.21.15.22:0/3867909207 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc18077990 con 0x7fbc2015d580 2023-11-24T06:13:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.857+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc201f2e80 con 0x7fbc2015d580 2023-11-24T06:13:59.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.860+0000 7fbc16ffd640 1 -- 172.21.15.22:0/3867909207 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fbc18034090 con 0x7fbc2015d580 2023-11-24T06:13:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:13:59.863 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:13:30.762606+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:27.041850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:28.235409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc0006aff0 msgr2=0x7fbc0006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc0006aff0 0x7fbc0006d4b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000a810 tx=0x7fbc10008040 comp rx=0 tx=0).stop 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc2015d580 msgr2=0x7fbc201e68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc2015d580 0x7fbc201e68c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009870 tx=0x7fbc18004730 comp rx=0 tx=0).stop 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 shutdown_connections 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbc0006aff0 0x7fbc0006d4b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc2015d580 0x7fbc201e68c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc200ce040 0x7fbc201f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 --2- 172.21.15.22:0/3867909207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc200b6410 0x7fbc200b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 >> 172.21.15.22:0/3867909207 conn(0x7fbc20071f90 msgr2=0x7fbc20072370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 shutdown_connections 2023-11-24T06:13:59.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:13:59.863+0000 7fbc24b9e640 1 -- 172.21.15.22:0/3867909207 wait complete. 2023-11-24T06:13:59.886 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:13:59.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:00.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.115+0000 7fe9da92e640 1 Processor -- start 2023-11-24T06:14:00.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.116+0000 7fe9da92e640 1 -- start start 2023-11-24T06:14:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.117+0000 7fe9da92e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9d40cf050 0x7fe9d40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.117+0000 7fe9da92e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d4140900 con 0x7fe9d413dfd0 2023-11-24T06:14:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.117+0000 7fe9da92e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d415fa70 con 0x7fe9d40cd7b0 2023-11-24T06:14:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.117+0000 7fe9da92e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d40cfa40 con 0x7fe9d40cf050 2023-11-24T06:14:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d992c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe9d413dfd0 0x7fe9d415be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36576/0 (socket says 172.21.15.22:36576) 2023-11-24T06:14:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d992c640 1 -- 172.21.15.22:0/1625178725 learned_addr learned my addr 172.21.15.22:0/1625178725 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115509165 0 0) 0x7fe9d4140900 con 0x7fe9d413dfd0 2023-11-24T06:14:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c0003520 con 0x7fe9d413dfd0 2023-11-24T06:14:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d912b640 1 --2- 172.21.15.22:0/1625178725 >> v2:172.21.15.31:3300/0 conn(0x7fe9d40cf050 0x7fe9d40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1851562190 0 0) 0x7fe9c0003520 con 0x7fe9d413dfd0 2023-11-24T06:14:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 >> v2:172.21.15.31:3300/0 conn(0x7fe9d40cf050 msgr2=0x7fe9d40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d892a640 1 --2- 172.21.15.22:0/1625178725 >> v2:172.21.15.31:3300/0 conn(0x7fe9d40cf050 0x7fe9d40cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 >> v1:172.21.15.31:6789/0 conn(0x7fe9d40cd7b0 legacy=0x7fe9d40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d415ee60 con 0x7fe9d413dfd0 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fe9d0001670 con 0x7fe9d413dfd0 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.118+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 >> v1:172.21.15.22:6789/0 conn(0x7fe9d413dfd0 legacy=0x7fe9d415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d892a640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c0003a30 0x7fe9c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d892a640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9c00047c0 0x7fe9c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d892a640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0005380 0x7fe9c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40cfa40 con 0x7fe9c00047c0 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c000c240 con 0x7fe9c0005380 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c000c400 con 0x7fe9c0003a30 2023-11-24T06:14:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d912b640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9c00047c0 0x7fe9c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d992c640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c0003a30 0x7fe9c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d912b640 1 -- 172.21.15.22:0/1625178725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c0003a30 msgr2=0x7fe9c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d912b640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c0003a30 0x7fe9c0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d912b640 1 -- 172.21.15.22:0/1625178725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0005380 msgr2=0x7fe9c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d912b640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0005380 0x7fe9c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9d912b640 1 -- 172.21.15.22:0/1625178725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0003520 con 0x7fe9c00047c0 2023-11-24T06:14:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.119+0000 7fe9da12d640 1 -- 172.21.15.22:0/1625178725 reap_dead start 2023-11-24T06:14:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.121+0000 7fe9d912b640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9c00047c0 0x7fe9c0004c40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400a9a0 tx=0x7fe9c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d8e739b909020c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.121+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4030660 con 0x7fe9c00047c0 2023-11-24T06:14:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.121+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c40307c0 con 0x7fe9c00047c0 2023-11-24T06:14:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.121+0000 7fe9d892a640 1 -- 172.21.15.22:0/1625178725 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4030bb0 con 0x7fe9c00047c0 2023-11-24T06:14:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.121+0000 7fe9da92e640 1 -- 172.21.15.22:0/1625178725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9c00047c0 msgr2=0x7fe9c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.121+0000 7fe9da92e640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9c00047c0 0x7fe9c0004c40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400a9a0 tx=0x7fe9c00057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.122+0000 7fe9da92e640 1 -- 172.21.15.22:0/1625178725 shutdown_connections 2023-11-24T06:14:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.122+0000 7fe9da92e640 1 --2- 172.21.15.22:0/1625178725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9c00047c0 0x7fe9c0004c40 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.122+0000 7fe9da92e640 1 -- 172.21.15.22:0/1625178725 >> 172.21.15.22:0/1625178725 conn(0x7fe9d406a860 msgr2=0x7fe9d406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.122+0000 7fe9da92e640 1 -- 172.21.15.22:0/1625178725 shutdown_connections 2023-11-24T06:14:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.122+0000 7fe9da92e640 1 -- 172.21.15.22:0/1625178725 wait complete. 2023-11-24T06:14:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.124+0000 7fe9da92e640 1 Processor -- start 2023-11-24T06:14:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.124+0000 7fe9da92e640 1 -- start start 2023-11-24T06:14:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.125+0000 7fe9da92e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c00047c0 0x7fe9d4158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.125+0000 7fe9da92e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d4154d10 0x7fe9d4154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.125+0000 7fe9da92e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9d40b2980 0x7fe9d40b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.125+0000 7fe9da92e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d415b4c0 con 0x7fe9d4154d10 2023-11-24T06:14:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.125+0000 7fe9da92e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40b3340 con 0x7fe9d40b2980 2023-11-24T06:14:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.125+0000 7fe9da92e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d4154b60 con 0x7fe9c00047c0 2023-11-24T06:14:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.125+0000 7fe9d912b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d4154d10 0x7fe9d4154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.125+0000 7fe9d912b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d4154d10 0x7fe9d4154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43718/0 (socket says 172.21.15.22:43718) 2023-11-24T06:14:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.125+0000 7fe9d912b640 1 -- 172.21.15.22:0/655560429 learned_addr learned my addr 172.21.15.22:0/655560429 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9d992c640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c00047c0 0x7fe9d4158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9da12d640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9d40b2980 0x7fe9d40b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9d912b640 1 -- 172.21.15.22:0/655560429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c00047c0 msgr2=0x7fe9d4158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9d912b640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c00047c0 0x7fe9d4158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9d912b640 1 -- 172.21.15.22:0/655560429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9d40b2980 msgr2=0x7fe9d40b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9d912b640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9d40b2980 0x7fe9d40b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9d912b640 1 -- 172.21.15.22:0/655560429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d415ab60 con 0x7fe9d4154d10 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9da12d640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9d40b2980 0x7fe9d40b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9d912b640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d4154d10 0x7fe9d4154620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe9c402bef0 tx=0x7fe9c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9ca7fc640 1 -- 172.21.15.22:0/655560429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c403e040 con 0x7fe9d4154d10 2023-11-24T06:14:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9ca7fc640 1 -- 172.21.15.22:0/655560429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c4039aa0 con 0x7fe9d4154d10 2023-11-24T06:14:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d415ae00 con 0x7fe9d4154d10 2023-11-24T06:14:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.126+0000 7fe9ca7fc640 1 -- 172.21.15.22:0/655560429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4039e10 con 0x7fe9d4154d10 2023-11-24T06:14:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.127+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d4155bc0 con 0x7fe9d4154d10 2023-11-24T06:14:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.128+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d406dc50 con 0x7fe9d4154d10 2023-11-24T06:14:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.129+0000 7fe9ca7fc640 1 -- 172.21.15.22:0/655560429 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe9c40443f0 con 0x7fe9d4154d10 2023-11-24T06:14:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.130+0000 7fe9ca7fc640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9b806b020 0x7fe9b806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.130+0000 7fe9ca7fc640 1 -- 172.21.15.22:0/655560429 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9c40abfb0 con 0x7fe9d4154d10 2023-11-24T06:14:00.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.130+0000 7fe9d992c640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9b806b020 0x7fe9b806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.131+0000 7fe9d992c640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9b806b020 0x7fe9b806d4e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0001770 tx=0x7fe9d0000f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:00.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.134+0000 7fe9ca7fc640 1 -- 172.21.15.22:0/655560429 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9c4076cc0 con 0x7fe9d4154d10 2023-11-24T06:14:00.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.365+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9d404e840 con 0x7fe9d4154d10 2023-11-24T06:14:00.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.366+0000 7fe9ca7fc640 1 -- 172.21.15.22:0/655560429 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fe9c4034090 con 0x7fe9d4154d10 2023-11-24T06:14:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:00.423 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3821411702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3821411702},{"type":"v1","addr":"172.21.15.31:6835","nonce":3821411702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3025908035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3025908035},{"type":"v1","addr":"172.21.15.31:6833","nonce":3025908035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/475244267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":475244267},{"type":"v1","addr":"172.21.15.22:6835","nonce":475244267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:29.209497+0000","modified":"2023-11-24T06:13:34.306159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6837/1515634482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1515634482},{"type":"v1","addr":"172.21.15.22:6837","nonce":1515634482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:14:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 16 2023-11-24T06:14:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9b806b020 msgr2=0x7fe9b806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9b806b020 0x7fe9b806d4e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0001770 tx=0x7fe9d0000f50 comp rx=0 tx=0).stop 2023-11-24T06:14:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d4154d10 msgr2=0x7fe9d4154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d4154d10 0x7fe9d4154620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe9c402bef0 tx=0x7fe9c40046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 shutdown_connections 2023-11-24T06:14:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe9b806b020 0x7fe9b806d4e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9d40b2980 0x7fe9d40b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d4154d10 0x7fe9d4154620 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 --2- 172.21.15.22:0/655560429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9c00047c0 0x7fe9d4158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 >> 172.21.15.22:0/655560429 conn(0x7fe9d406a860 msgr2=0x7fe9d413f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 shutdown_connections 2023-11-24T06:14:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.369+0000 7fe9da92e640 1 -- 172.21.15.22:0/655560429 wait complete. 2023-11-24T06:14:00.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:00.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.658+0000 7f69b9d6c640 1 Processor -- start 2023-11-24T06:14:00.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.659+0000 7f69b9d6c640 1 -- start start 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.660+0000 7f69b9d6c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69b40d14a0 0x7f69b40d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.660+0000 7f69b9d6c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f69b40b0640 0x7f69b40b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.660+0000 7f69b9d6c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b40cf0c0 con 0x7f69b415d5b0 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.660+0000 7f69b9d6c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b40b01b0 con 0x7f69b40b0640 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.660+0000 7f69b9d6c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b415d990 con 0x7f69b40d14a0 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.661+0000 7f69b956b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f69b40b0640 0x7f69b40b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.661+0000 7f69b956b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f69b40b0640 0x7f69b40b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43726/0 (socket says 172.21.15.22:43726) 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.661+0000 7f69b956b640 1 -- 172.21.15.22:0/284858900 learned_addr learned my addr 172.21.15.22:0/284858900 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.661+0000 7f69b956b640 1 -- 172.21.15.22:0/284858900 >> v2:172.21.15.31:3300/0 conn(0x7f69b40d14a0 msgr2=0x7f69b40d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:00.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.661+0000 7f69b956b640 1 --2- 172.21.15.22:0/284858900 >> v2:172.21.15.31:3300/0 conn(0x7f69b40d14a0 0x7f69b40d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.661+0000 7f69b956b640 1 -- 172.21.15.22:0/284858900 >> v1:172.21.15.31:6789/0 conn(0x7f69b415d5b0 legacy=0x7f69b40d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:00.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.661+0000 7f69b956b640 1 -- 172.21.15.22:0/284858900 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40d1e40 con 0x7f69b40b0640 2023-11-24T06:14:00.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.662+0000 7f69b956b640 1 --2- 172.21.15.22:0/284858900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 0x7f69b40b0ad0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f69b4161000 tx=0x7f69ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ba91dff4978a95 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:00.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.663+0000 7f69b37fe640 1 -- 172.21.15.22:0/284858900 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac031870 con 0x7f69b40b0640 2023-11-24T06:14:00.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.663+0000 7f69b37fe640 1 -- 172.21.15.22:0/284858900 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac0319d0 con 0x7f69b40b0640 2023-11-24T06:14:00.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.663+0000 7f69b37fe640 1 -- 172.21.15.22:0/284858900 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac031d60 con 0x7f69b40b0640 2023-11-24T06:14:00.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.663+0000 7f69b9d6c640 1 -- 172.21.15.22:0/284858900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 msgr2=0x7f69b40b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.663+0000 7f69b9d6c640 1 --2- 172.21.15.22:0/284858900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 0x7f69b40b0ad0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f69b4161000 tx=0x7f69ac02b910 comp rx=0 tx=0).stop 2023-11-24T06:14:00.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.663+0000 7f69b9d6c640 1 -- 172.21.15.22:0/284858900 shutdown_connections 2023-11-24T06:14:00.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.663+0000 7f69b9d6c640 1 --2- 172.21.15.22:0/284858900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 0x7f69b40b0ad0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.663+0000 7f69b9d6c640 1 --2- 172.21.15.22:0/284858900 >> v2:172.21.15.31:3300/0 conn(0x7f69b40d14a0 0x7f69b40d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.663+0000 7f69b9d6c640 1 -- 172.21.15.22:0/284858900 >> 172.21.15.22:0/284858900 conn(0x7f69b409c3b0 msgr2=0x7f69b40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:00.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.664+0000 7f69b9d6c640 1 -- 172.21.15.22:0/284858900 shutdown_connections 2023-11-24T06:14:00.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.664+0000 7f69b9d6c640 1 -- 172.21.15.22:0/284858900 wait complete. 2023-11-24T06:14:00.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.665+0000 7f69b9d6c640 1 Processor -- start 2023-11-24T06:14:00.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.665+0000 7f69b9d6c640 1 -- start start 2023-11-24T06:14:00.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.666+0000 7f69b9d6c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 0x7f69b4151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.666+0000 7f69b9d6c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b40d14a0 0x7f69b40c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.666+0000 7f69b9d6c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b415d5b0 0x7f69b40c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.666+0000 7f69b9d6c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b415db60 con 0x7f69b40b0640 2023-11-24T06:14:00.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.666+0000 7f69b9d6c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b415e400 con 0x7f69b415d5b0 2023-11-24T06:14:00.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.666+0000 7f69b9d6c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40c86f0 con 0x7f69b40d14a0 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b8d6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 0x7f69b4151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b8d6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 0x7f69b4151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43738/0 (socket says 172.21.15.22:43738) 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b8d6a640 1 -- 172.21.15.22:0/3538638133 learned_addr learned my addr 172.21.15.22:0/3538638133 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b956b640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b415d5b0 0x7f69b40c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b8d6a640 1 -- 172.21.15.22:0/3538638133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b40d14a0 msgr2=0x7f69b40c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b3fff640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b40d14a0 0x7f69b40c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b8d6a640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b40d14a0 0x7f69b40c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b8d6a640 1 -- 172.21.15.22:0/3538638133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b415d5b0 msgr2=0x7f69b40c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b8d6a640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b415d5b0 0x7f69b40c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b8d6a640 1 -- 172.21.15.22:0/3538638133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac0094d0 con 0x7f69b40b0640 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.667+0000 7f69b956b640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b415d5b0 0x7f69b40c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.668+0000 7f69b8d6a640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 0x7f69b4151df0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f69a400ba80 tx=0x7f69a400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:00.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.668+0000 7f69b17fa640 1 -- 172.21.15.22:0/3538638133 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a400cc00 con 0x7f69b40b0640 2023-11-24T06:14:00.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.668+0000 7f69b17fa640 1 -- 172.21.15.22:0/3538638133 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a400cd60 con 0x7f69b40b0640 2023-11-24T06:14:00.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.668+0000 7f69b17fa640 1 -- 172.21.15.22:0/3538638133 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4003bb0 con 0x7f69b40b0640 2023-11-24T06:14:00.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.668+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b40b7680 con 0x7f69b40b0640 2023-11-24T06:14:00.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.668+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b415e090 con 0x7f69b40b0640 2023-11-24T06:14:00.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.669+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b415d0f0 con 0x7f69b40b0640 2023-11-24T06:14:00.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.670+0000 7f69b17fa640 1 -- 172.21.15.22:0/3538638133 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f69a4014440 con 0x7f69b40b0640 2023-11-24T06:14:00.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.671+0000 7f69b17fa640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f69a006aff0 0x7f69a006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:00.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.671+0000 7f69b17fa640 1 -- 172.21.15.22:0/3538638133 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69a40897b0 con 0x7f69b40b0640 2023-11-24T06:14:00.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.672+0000 7f69b3fff640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f69a006aff0 0x7f69a006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:00.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.673+0000 7f69b3fff640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f69a006aff0 0x7f69a006d4b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f69b40b7c80 tx=0x7f69a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:00.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.676+0000 7f69b17fa640 1 -- 172.21.15.22:0/3538638133 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f69a4054540 con 0x7f69b40b0640 2023-11-24T06:14:00.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.913+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69b404e840 con 0x7f69b40b0640 2023-11-24T06:14:00.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.914+0000 7f69b17fa640 1 -- 172.21.15.22:0/3538638133 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f69a4057b60 con 0x7f69b40b0640 2023-11-24T06:14:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:00.917 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3821411702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3821411702},{"type":"v1","addr":"172.21.15.31:6835","nonce":3821411702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3025908035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3025908035},{"type":"v1","addr":"172.21.15.31:6833","nonce":3025908035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/475244267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":475244267},{"type":"v1","addr":"172.21.15.22:6835","nonce":475244267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:29.209497+0000","modified":"2023-11-24T06:13:34.306159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6837/1515634482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1515634482},{"type":"v1","addr":"172.21.15.22:6837","nonce":1515634482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:14:00.917 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 16 2023-11-24T06:14:00.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.916+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f69a006aff0 msgr2=0x7f69a006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.916+0000 7f69b9d6c640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f69a006aff0 0x7f69a006d4b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f69b40b7c80 tx=0x7f69a8008040 comp rx=0 tx=0).stop 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.916+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 msgr2=0x7f69b4151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.916+0000 7f69b9d6c640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 0x7f69b4151df0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f69a400ba80 tx=0x7f69a400bf40 comp rx=0 tx=0).stop 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.916+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 shutdown_connections 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.917+0000 7f69b9d6c640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f69a006aff0 0x7f69a006d4b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.917+0000 7f69b9d6c640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b415d5b0 0x7f69b40c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.917+0000 7f69b9d6c640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b40d14a0 0x7f69b40c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.917+0000 7f69b9d6c640 1 --2- 172.21.15.22:0/3538638133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69b40b0640 0x7f69b4151df0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.917+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 >> 172.21.15.22:0/3538638133 conn(0x7f69b409c3b0 msgr2=0x7f69b40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.917+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 shutdown_connections 2023-11-24T06:14:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:00.917+0000 7f69b9d6c640 1 -- 172.21.15.22:0/3538638133 wait complete. 2023-11-24T06:14:00.938 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.161+0000 7f788e9fa640 1 Processor -- start 2023-11-24T06:14:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.161+0000 7f788e9fa640 1 -- start start 2023-11-24T06:14:01.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.163+0000 7f788e9fa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788815df80 0x7f78881680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.163+0000 7f788e9fa640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7888161670 con 0x7f788806d250 2023-11-24T06:14:01.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.163+0000 7f788e9fa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7888071730 con 0x7f7888157770 2023-11-24T06:14:01.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.163+0000 7f788e9fa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788815e430 con 0x7f788815df80 2023-11-24T06:14:01.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.164+0000 7f788d1f7640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f788806d250 0x7f788815d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59640/0 (socket says 172.21.15.22:59640) 2023-11-24T06:14:01.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.164+0000 7f788d1f7640 1 -- 172.21.15.22:0/1931759033 learned_addr learned my addr 172.21.15.22:0/1931759033 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:01.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.164+0000 7f788e1f9640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788815df80 0x7f78881680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.164+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924176973 0 0) 0x7f7888161670 con 0x7f788806d250 2023-11-24T06:14:01.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.164+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7874003520 con 0x7f788806d250 2023-11-24T06:14:01.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990968417 0 0) 0x7f7888071730 con 0x7f7888157770 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7888161670 con 0x7f7888157770 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 192682730 0 0) 0x7f7874003520 con 0x7f788806d250 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788815df80 msgr2=0x7f78881680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788815df80 0x7f78881680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 >> v1:172.21.15.31:6789/0 conn(0x7f7888157770 legacy=0x7f788806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788815e610 con 0x7f788806d250 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f7878001670 con 0x7f788806d250 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 >> v1:172.21.15.22:6789/0 conn(0x7f788806d250 legacy=0x7f788815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7874003ba0 0x7f7874003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788815df80 0x7f78740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7874004d00 0x7f7874005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788815e430 con 0x7f7874003ba0 2023-11-24T06:14:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787400bab0 con 0x7f7874004d00 2023-11-24T06:14:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787400bc70 con 0x7f788815df80 2023-11-24T06:14:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.165+0000 7f788d9f8640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7874003ba0 0x7f7874003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.166+0000 7f788d1f7640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788815df80 0x7f78740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.166+0000 7f788e1f9640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7874004d00 0x7f7874005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.166+0000 7f788d9f8640 1 -- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788815df80 msgr2=0x7f78740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:01.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.166+0000 7f788d9f8640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788815df80 0x7f78740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.166+0000 7f788d9f8640 1 -- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7874004d00 msgr2=0x7f7874005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:01.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.166+0000 7f788d9f8640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7874004d00 0x7f7874005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.166+0000 7f788d9f8640 1 -- 172.21.15.22:0/1931759033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874003520 con 0x7f7874003ba0 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.167+0000 7f788d9f8640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7874003ba0 0x7f7874003fa0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7884001fd0 tx=0x7f78740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969ce545d2b2d3c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.167+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884003b70 con 0x7f7874003ba0 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.167+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884003cd0 con 0x7f7874003ba0 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.167+0000 7f788c9f6640 1 -- 172.21.15.22:0/1931759033 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840052f0 con 0x7f7874003ba0 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.168+0000 7f788e9fa640 1 -- 172.21.15.22:0/1931759033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7874003ba0 msgr2=0x7f7874003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.168+0000 7f788e9fa640 1 --2- 172.21.15.22:0/1931759033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7874003ba0 0x7f7874003fa0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7884001fd0 tx=0x7f78740057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.168+0000 7f788e1f9640 1 -- 172.21.15.22:0/1931759033 reap_dead start 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.168+0000 7f788e9fa640 1 -- 172.21.15.22:0/1931759033 shutdown_connections 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.168+0000 7f788e9fa640 1 -- 172.21.15.22:0/1931759033 >> 172.21.15.22:0/1931759033 conn(0x7f788806a860 msgr2=0x7f788806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.168+0000 7f788e9fa640 1 -- 172.21.15.22:0/1931759033 shutdown_connections 2023-11-24T06:14:01.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.168+0000 7f788e9fa640 1 -- 172.21.15.22:0/1931759033 wait complete. 2023-11-24T06:14:01.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.170+0000 7f788e9fa640 1 Processor -- start 2023-11-24T06:14:01.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.170+0000 7f788e9fa640 1 -- start start 2023-11-24T06:14:01.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.171+0000 7f788e9fa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7874003ba0 0x7f788814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.171+0000 7f788e9fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78880cce50 0x7f78880cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.171+0000 7f788e9fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7888153aa0 0x7f7888153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.171+0000 7f788e9fa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78880cd810 con 0x7f7888153aa0 2023-11-24T06:14:01.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.171+0000 7f788e9fa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788814d4a0 con 0x7f78880cce50 2023-11-24T06:14:01.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.171+0000 7f788e9fa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78881547d0 con 0x7f7874003ba0 2023-11-24T06:14:01.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788e1f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7888153aa0 0x7f7888153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788e1f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7888153aa0 0x7f7888153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36790/0 (socket says 172.21.15.22:36790) 2023-11-24T06:14:01.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788e1f9640 1 -- 172.21.15.22:0/2146407535 learned_addr learned my addr 172.21.15.22:0/2146407535 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:01.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788d9f8640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7874003ba0 0x7f788814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788d1f7640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78880cce50 0x7f78880cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788e1f9640 1 -- 172.21.15.22:0/2146407535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7874003ba0 msgr2=0x7f788814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788e1f9640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7874003ba0 0x7f788814bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788e1f9640 1 -- 172.21.15.22:0/2146407535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78880cce50 msgr2=0x7f78880cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788e1f9640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78880cce50 0x7f78880cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788e1f9640 1 -- 172.21.15.22:0/2146407535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7888154ab0 con 0x7f7888153aa0 2023-11-24T06:14:01.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.172+0000 7f788d9f8640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7874003ba0 0x7f788814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:01.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.173+0000 7f788e1f9640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7888153aa0 0x7f7888153f20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f78880b1da0 tx=0x7f7880011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:01.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.173+0000 7f787e7fc640 1 -- 172.21.15.22:0/2146407535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880004500 con 0x7f7888153aa0 2023-11-24T06:14:01.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.173+0000 7f787e7fc640 1 -- 172.21.15.22:0/2146407535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7880003610 con 0x7f7888153aa0 2023-11-24T06:14:01.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.173+0000 7f787e7fc640 1 -- 172.21.15.22:0/2146407535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78800039e0 con 0x7f7888153aa0 2023-11-24T06:14:01.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.173+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7888154d90 con 0x7f7888153aa0 2023-11-24T06:14:01.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.173+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7888154460 con 0x7f7888153aa0 2023-11-24T06:14:01.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.174+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78881552b0 con 0x7f7888153aa0 2023-11-24T06:14:01.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.175+0000 7f787e7fc640 1 -- 172.21.15.22:0/2146407535 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7880003b40 con 0x7f7888153aa0 2023-11-24T06:14:01.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.176+0000 7f787e7fc640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f786c06aff0 0x7f786c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.176+0000 7f787e7fc640 1 -- 172.21.15.22:0/2146407535 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7880089a50 con 0x7f7888153aa0 2023-11-24T06:14:01.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.177+0000 7f788d9f8640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f786c06aff0 0x7f786c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.177+0000 7f788d9f8640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f786c06aff0 0x7f786c06d4b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7884034000 tx=0x7f7884031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:01.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.181+0000 7f787e7fc640 1 -- 172.21.15.22:0/2146407535 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78881552b0 con 0x7f7888153aa0 2023-11-24T06:14:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.372+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78881552b0 con 0x7f7888153aa0 2023-11-24T06:14:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.374+0000 7f787e7fc640 1 -- 172.21.15.22:0/2146407535 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f78881552b0 con 0x7f7888153aa0 2023-11-24T06:14:01.377 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:01.377 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:13:30.762606+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:27.041850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:28.235409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:01.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f786c06aff0 msgr2=0x7f786c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f786c06aff0 0x7f786c06d4b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7884034000 tx=0x7f7884031000 comp rx=0 tx=0).stop 2023-11-24T06:14:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7888153aa0 msgr2=0x7f7888153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7888153aa0 0x7f7888153f20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f78880b1da0 tx=0x7f7880011920 comp rx=0 tx=0).stop 2023-11-24T06:14:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 shutdown_connections 2023-11-24T06:14:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f786c06aff0 0x7f786c06d4b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7888153aa0 0x7f7888153f20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78880cce50 0x7f78880cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 --2- 172.21.15.22:0/2146407535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7874003ba0 0x7f788814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 >> 172.21.15.22:0/2146407535 conn(0x7f788806a860 msgr2=0x7f78880cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 shutdown_connections 2023-11-24T06:14:01.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.377+0000 7f788e9fa640 1 -- 172.21.15.22:0/2146407535 wait complete. 2023-11-24T06:14:01.399 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:14:01.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.616+0000 7f281ad53640 1 Processor -- start 2023-11-24T06:14:01.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.617+0000 7f281ad53640 1 -- start start 2023-11-24T06:14:01.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.618+0000 7f281ad53640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f281415d770 0x7f28140d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.618+0000 7f281ad53640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28140d2740 0x7f28140d3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.618+0000 7f281ad53640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28140d0b40 con 0x7f28140d37b0 2023-11-24T06:14:01.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.618+0000 7f281ad53640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28140d3c60 con 0x7f281415d770 2023-11-24T06:14:01.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.618+0000 7f281ad53640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281415db50 con 0x7f28140d2740 2023-11-24T06:14:01.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.618+0000 7f2818aef640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f281415d770 0x7f28140d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.619+0000 7f2818aef640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f281415d770 0x7f28140d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36806/0 (socket says 172.21.15.22:36806) 2023-11-24T06:14:01.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.619+0000 7f2818aef640 1 -- 172.21.15.22:0/1412168551 learned_addr learned my addr 172.21.15.22:0/1412168551 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:01.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.619+0000 7f2818aef640 1 -- 172.21.15.22:0/1412168551 >> v2:172.21.15.31:3300/0 conn(0x7f28140d2740 msgr2=0x7f28140d3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:01.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.619+0000 7f2818aef640 1 --2- 172.21.15.22:0/1412168551 >> v2:172.21.15.31:3300/0 conn(0x7f28140d2740 0x7f28140d3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.619+0000 7f2818aef640 1 -- 172.21.15.22:0/1412168551 >> v1:172.21.15.31:6789/0 conn(0x7f28140d37b0 legacy=0x7f28140b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:01.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.619+0000 7f2818aef640 1 -- 172.21.15.22:0/1412168551 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28140d0860 con 0x7f281415d770 2023-11-24T06:14:01.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.620+0000 7f2818aef640 1 --2- 172.21.15.22:0/1412168551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 0x7f28140d2200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f28140b93f0 tx=0x7f281002bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cde2f3aca6599ca server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:01.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.620+0000 7f280b7fe640 1 -- 172.21.15.22:0/1412168551 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281002caa0 con 0x7f281415d770 2023-11-24T06:14:01.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f280b7fe640 1 -- 172.21.15.22:0/1412168551 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281002cc00 con 0x7f281415d770 2023-11-24T06:14:01.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f280b7fe640 1 -- 172.21.15.22:0/1412168551 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100343f0 con 0x7f281415d770 2023-11-24T06:14:01.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f281ad53640 1 -- 172.21.15.22:0/1412168551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 msgr2=0x7f28140d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f281ad53640 1 --2- 172.21.15.22:0/1412168551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 0x7f28140d2200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f28140b93f0 tx=0x7f281002bf00 comp rx=0 tx=0).stop 2023-11-24T06:14:01.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f281ad53640 1 -- 172.21.15.22:0/1412168551 shutdown_connections 2023-11-24T06:14:01.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f281ad53640 1 --2- 172.21.15.22:0/1412168551 >> v2:172.21.15.31:3300/0 conn(0x7f28140d2740 0x7f28140d3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f281ad53640 1 --2- 172.21.15.22:0/1412168551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 0x7f28140d2200 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f281ad53640 1 -- 172.21.15.22:0/1412168551 >> 172.21.15.22:0/1412168551 conn(0x7f28140721a0 msgr2=0x7f281406b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:01.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f281ad53640 1 -- 172.21.15.22:0/1412168551 shutdown_connections 2023-11-24T06:14:01.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.621+0000 7f281ad53640 1 -- 172.21.15.22:0/1412168551 wait complete. 2023-11-24T06:14:01.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.623+0000 7f281ad53640 1 Processor -- start 2023-11-24T06:14:01.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.623+0000 7f281ad53640 1 -- start start 2023-11-24T06:14:01.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.624+0000 7f281ad53640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140d37b0 0x7f281414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.624+0000 7f281ad53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 0x7f281415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.624+0000 7f281ad53640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28141601a0 0x7f281414dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.624+0000 7f281ad53640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281415ebc0 con 0x7f281415d770 2023-11-24T06:14:01.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.624+0000 7f281ad53640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281415eea0 con 0x7f28140d37b0 2023-11-24T06:14:01.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.624+0000 7f281ad53640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281415f180 con 0x7f28141601a0 2023-11-24T06:14:01.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.625+0000 7f280bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 0x7f281415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.625+0000 7f280bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 0x7f281415fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36814/0 (socket says 172.21.15.22:36814) 2023-11-24T06:14:01.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.625+0000 7f280bfff640 1 -- 172.21.15.22:0/1514474717 learned_addr learned my addr 172.21.15.22:0/1514474717 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:01.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.625+0000 7f280bfff640 1 -- 172.21.15.22:0/1514474717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28141601a0 msgr2=0x7f281414dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.625+0000 7f280bfff640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28141601a0 0x7f281414dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.625+0000 7f280bfff640 1 -- 172.21.15.22:0/1514474717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140d37b0 msgr2=0x7f281414caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.625+0000 7f280bfff640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140d37b0 0x7f281414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.625+0000 7f280bfff640 1 -- 172.21.15.22:0/1514474717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2810009b30 con 0x7f281415d770 2023-11-24T06:14:01.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.626+0000 7f280bfff640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 0x7f281415fc60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2804006fd0 tx=0x7f280400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:01.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.626+0000 7f28097fa640 1 -- 172.21.15.22:0/1514474717 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804011830 con 0x7f281415d770 2023-11-24T06:14:01.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.626+0000 7f28097fa640 1 -- 172.21.15.22:0/1514474717 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2804011990 con 0x7f281415d770 2023-11-24T06:14:01.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.626+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281415f460 con 0x7f281415d770 2023-11-24T06:14:01.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.626+0000 7f28097fa640 1 -- 172.21.15.22:0/1514474717 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804011d60 con 0x7f281415d770 2023-11-24T06:14:01.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.626+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281415e800 con 0x7f281415d770 2023-11-24T06:14:01.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.627+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281415f980 con 0x7f281415d770 2023-11-24T06:14:01.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.628+0000 7f28097fa640 1 -- 172.21.15.22:0/1514474717 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f280401b460 con 0x7f281415d770 2023-11-24T06:14:01.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.629+0000 7f28097fa640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f280006b020 0x7f280006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.629+0000 7f28097fa640 1 -- 172.21.15.22:0/1514474717 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2804089730 con 0x7f281415d770 2023-11-24T06:14:01.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.629+0000 7f2818aef640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f280006b020 0x7f280006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.630+0000 7f2818aef640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f280006b020 0x7f280006d4e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2810035000 tx=0x7f281002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:01.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.634+0000 7f28097fa640 1 -- 172.21.15.22:0/1514474717 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f281415f980 con 0x7f281415d770 2023-11-24T06:14:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.872+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f281415f980 con 0x7f281415d770 2023-11-24T06:14:01.876 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-11-24T06:14:01.874+0000 7f6dde801640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:14:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.878+0000 7f28097fa640 1 -- 172.21.15.22:0/1514474717 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f281415f980 con 0x7f281415d770 2023-11-24T06:14:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:14:01.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f280006b020 msgr2=0x7f280006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f280006b020 0x7f280006d4e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2810035000 tx=0x7f281002e000 comp rx=0 tx=0).stop 2023-11-24T06:14:01.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 msgr2=0x7f281415fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 0x7f281415fc60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2804006fd0 tx=0x7f280400b8e0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 shutdown_connections 2023-11-24T06:14:01.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f280006b020 0x7f280006d4e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28141601a0 0x7f281414dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281415d770 0x7f281415fc60 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 --2- 172.21.15.22:0/1514474717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28140d37b0 0x7f281414caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 >> 172.21.15.22:0/1514474717 conn(0x7f28140721a0 msgr2=0x7f28140b73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:01.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.882+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 shutdown_connections 2023-11-24T06:14:01.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:01.883+0000 7f281ad53640 1 -- 172.21.15.22:0/1514474717 wait complete. 2023-11-24T06:14:01.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:14:01.983 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-11-24T06:14:02.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.102+0000 7f619ca31640 1 Processor -- start 2023-11-24T06:14:02.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.103+0000 7f619ca31640 1 -- start start 2023-11-24T06:14:02.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.104+0000 7f619ca31640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61980cd440 0x7f6198071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:02.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.104+0000 7f619ca31640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cc920 0x7f61980af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:02.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.104+0000 7f619ca31640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61980cfe50 con 0x7f619806a440 2023-11-24T06:14:02.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.104+0000 7f619ca31640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61980723c0 con 0x7f61980cd440 2023-11-24T06:14:02.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.104+0000 7f619ca31640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980ccd60 con 0x7f61980cc920 2023-11-24T06:14:02.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.104+0000 7f619659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61980cd440 0x7f6198071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:02.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.104+0000 7f6196d9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f619806a440 0x7f619815cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59658/0 (socket says 172.21.15.22:59658) 2023-11-24T06:14:02.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.104+0000 7f6196d9d640 1 -- 172.21.15.22:0/2590510858 learned_addr learned my addr 172.21.15.22:0/2590510858 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:02.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.105+0000 7f6195d9b640 1 --2- 172.21.15.22:0/2590510858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cc920 0x7f61980af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:02.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.105+0000 7f619659c640 1 -- 172.21.15.22:0/2590510858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cc920 msgr2=0x7f61980af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:02.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.105+0000 7f619659c640 1 --2- 172.21.15.22:0/2590510858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cc920 0x7f61980af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.105+0000 7f619659c640 1 -- 172.21.15.22:0/2590510858 >> v1:172.21.15.22:6789/0 conn(0x7f619806a440 legacy=0x7f619815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:02.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.105+0000 7f619559a640 1 -- 172.21.15.22:0/2590510858 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843825631 0 0) 0x7f61980cfe50 con 0x7f619806a440 2023-11-24T06:14:02.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.105+0000 7f619659c640 1 -- 172.21.15.22:0/2590510858 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980cf260 con 0x7f61980cd440 2023-11-24T06:14:02.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.106+0000 7f619659c640 1 --2- 172.21.15.22:0/2590510858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61980cd440 0x7f6198071ae0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6188009d90 tx=0x7f618802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433edd291b59346d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:02.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.106+0000 7f619559a640 1 -- 172.21.15.22:0/2590510858 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618802cc50 con 0x7f61980cd440 2023-11-24T06:14:02.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619559a640 1 -- 172.21.15.22:0/2590510858 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618802cdb0 con 0x7f61980cd440 2023-11-24T06:14:02.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619559a640 1 -- 172.21.15.22:0/2590510858 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188034660 con 0x7f61980cd440 2023-11-24T06:14:02.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619ca31640 1 -- 172.21.15.22:0/2590510858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61980cd440 msgr2=0x7f6198071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:02.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619ca31640 1 --2- 172.21.15.22:0/2590510858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61980cd440 0x7f6198071ae0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6188009d90 tx=0x7f618802bea0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619ca31640 1 -- 172.21.15.22:0/2590510858 shutdown_connections 2023-11-24T06:14:02.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619ca31640 1 --2- 172.21.15.22:0/2590510858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cc920 0x7f61980af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619ca31640 1 --2- 172.21.15.22:0/2590510858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61980cd440 0x7f6198071ae0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619ca31640 1 -- 172.21.15.22:0/2590510858 >> 172.21.15.22:0/2590510858 conn(0x7f61980b1c90 msgr2=0x7f61980b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:02.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619ca31640 1 -- 172.21.15.22:0/2590510858 shutdown_connections 2023-11-24T06:14:02.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.107+0000 7f619ca31640 1 -- 172.21.15.22:0/2590510858 wait complete. 2023-11-24T06:14:02.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.109+0000 7f619ca31640 1 Processor -- start 2023-11-24T06:14:02.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.109+0000 7f619ca31640 1 -- start start 2023-11-24T06:14:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.110+0000 7f619ca31640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f619806a440 0x7f61980c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.110+0000 7f619ca31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61980cc920 0x7f61980b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.110+0000 7f619ca31640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cd440 0x7f6198159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.110+0000 7f619ca31640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6198158b80 con 0x7f619806a440 2023-11-24T06:14:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.110+0000 7f619ca31640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6198158e60 con 0x7f61980cc920 2023-11-24T06:14:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.110+0000 7f619ca31640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6198159140 con 0x7f61980cd440 2023-11-24T06:14:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f619659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f619806a440 0x7f61980c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f619659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f619806a440 0x7f61980c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36866/0 (socket says 172.21.15.22:36866) 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f619659c640 1 -- 172.21.15.22:0/4193538966 learned_addr learned my addr 172.21.15.22:0/4193538966 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f6195d9b640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61980cc920 0x7f61980b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f6196d9d640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cd440 0x7f6198159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f619659c640 1 -- 172.21.15.22:0/4193538966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cd440 msgr2=0x7f6198159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f619659c640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cd440 0x7f6198159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f619659c640 1 -- 172.21.15.22:0/4193538966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61980cc920 msgr2=0x7f61980b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f619659c640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61980cc920 0x7f61980b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f619659c640 1 -- 172.21.15.22:0/4193538966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188009a70 con 0x7f619806a440 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f6195d9b640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61980cc920 0x7f61980b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:02.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.111+0000 7f619659c640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f619806a440 0x7f61980c6580 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6188009d90 tx=0x7f6188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.112+0000 7f618effd640 1 -- 172.21.15.22:0/4193538966 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188040650 con 0x7f619806a440 2023-11-24T06:14:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.112+0000 7f618effd640 1 -- 172.21.15.22:0/4193538966 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61880407b0 con 0x7f619806a440 2023-11-24T06:14:02.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.112+0000 7f618effd640 1 -- 172.21.15.22:0/4193538966 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188040b60 con 0x7f619806a440 2023-11-24T06:14:02.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.112+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6198159420 con 0x7f619806a440 2023-11-24T06:14:02.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.112+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61980c6ac0 con 0x7f619806a440 2023-11-24T06:14:02.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.113+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6198159940 con 0x7f619806a440 2023-11-24T06:14:02.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.114+0000 7f618effd640 1 -- 172.21.15.22:0/4193538966 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6188040cc0 con 0x7f619806a440 2023-11-24T06:14:02.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.115+0000 7f618effd640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f617806b020 0x7f617806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:02.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.115+0000 7f618effd640 1 -- 172.21.15.22:0/4193538966 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f61880ac820 con 0x7f619806a440 2023-11-24T06:14:02.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.115+0000 7f6195d9b640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f617806b020 0x7f617806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:02.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.116+0000 7f6195d9b640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f617806b020 0x7f617806d4e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6180006fd0 tx=0x7f6180008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:02.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.119+0000 7f618effd640 1 -- 172.21.15.22:0/4193538966 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6198159940 con 0x7f619806a440 2023-11-24T06:14:02.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.351+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6198159940 con 0x7f619806a440 2023-11-24T06:14:02.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.881+0000 7f618effd640 1 -- 172.21.15.22:0/4193538966 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6198159940 con 0x7f619806a440 2023-11-24T06:14:02.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.885+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f617806b020 msgr2=0x7f617806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:02.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.885+0000 7f619ca31640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f617806b020 0x7f617806d4e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6180006fd0 tx=0x7f6180008040 comp rx=0 tx=0).stop 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.885+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f619806a440 msgr2=0x7f61980c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.885+0000 7f619ca31640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f619806a440 0x7f61980c6580 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6188009d90 tx=0x7f6188004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.886+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 shutdown_connections 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.886+0000 7f619ca31640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f617806b020 0x7f617806d4e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.886+0000 7f619ca31640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61980cd440 0x7f6198159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.886+0000 7f619ca31640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61980cc920 0x7f61980b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.886+0000 7f619ca31640 1 --2- 172.21.15.22:0/4193538966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f619806a440 0x7f61980c6580 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.886+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 >> 172.21.15.22:0/4193538966 conn(0x7f61980b1c90 msgr2=0x7f61980d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.886+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 shutdown_connections 2023-11-24T06:14:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:02.886+0000 7f619ca31640 1 -- 172.21.15.22:0/4193538966 wait complete. 2023-11-24T06:14:02.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:14:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.144+0000 7ff20c3e5640 1 Processor -- start 2023-11-24T06:14:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.144+0000 7ff20c3e5640 1 -- start start 2023-11-24T06:14:03.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.146+0000 7ff20c3e5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.146+0000 7ff20c3e5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff204072280 0x7ff2040b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.146+0000 7ff20c3e5640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff204071780 con 0x7ff204160b10 2023-11-24T06:14:03.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.146+0000 7ff20c3e5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040b2320 con 0x7ff204072280 2023-11-24T06:14:03.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.146+0000 7ff20c3e5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20406df30 con 0x7ff20406cad0 2023-11-24T06:14:03.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.147+0000 7ff20a181640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff204160b10 0x7ff20406c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59664/0 (socket says 172.21.15.22:59664) 2023-11-24T06:14:03.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.147+0000 7ff20a181640 1 -- 172.21.15.22:0/204575374 learned_addr learned my addr 172.21.15.22:0/204575374 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:03.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.147+0000 7ff209980640 1 --2- 172.21.15.22:0/204575374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.147+0000 7ff20a982640 1 --2- 172.21.15.22:0/204575374 >> v2:172.21.15.31:3300/0 conn(0x7ff204072280 0x7ff2040b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.147+0000 7ff20917f640 1 -- 172.21.15.22:0/204575374 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218344061 0 0) 0x7ff204071780 con 0x7ff204160b10 2023-11-24T06:14:03.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.147+0000 7ff20917f640 1 -- 172.21.15.22:0/204575374 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f0003520 con 0x7ff204160b10 2023-11-24T06:14:03.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.148+0000 7ff209980640 1 -- 172.21.15.22:0/204575374 >> v2:172.21.15.31:3300/0 conn(0x7ff204072280 msgr2=0x7ff2040b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:03.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.148+0000 7ff209980640 1 --2- 172.21.15.22:0/204575374 >> v2:172.21.15.31:3300/0 conn(0x7ff204072280 0x7ff2040b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.148+0000 7ff209980640 1 -- 172.21.15.22:0/204575374 >> v1:172.21.15.22:6789/0 conn(0x7ff204160b10 legacy=0x7ff20406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.148+0000 7ff209980640 1 -- 172.21.15.22:0/204575374 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040711c0 con 0x7ff20406cad0 2023-11-24T06:14:03.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.149+0000 7ff209980640 1 --2- 172.21.15.22:0/204575374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20406e420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097a0 tx=0x7ff1f402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e501b363914d824d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:03.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.150+0000 7ff20917f640 1 -- 172.21.15.22:0/204575374 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4031780 con 0x7ff20406cad0 2023-11-24T06:14:03.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.150+0000 7ff20917f640 1 -- 172.21.15.22:0/204575374 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f40318e0 con 0x7ff20406cad0 2023-11-24T06:14:03.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.150+0000 7ff20917f640 1 -- 172.21.15.22:0/204575374 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4031c70 con 0x7ff20406cad0 2023-11-24T06:14:03.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.150+0000 7ff20c3e5640 1 -- 172.21.15.22:0/204575374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 msgr2=0x7ff20406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.150+0000 7ff20c3e5640 1 --2- 172.21.15.22:0/204575374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20406e420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097a0 tx=0x7ff1f402b820 comp rx=0 tx=0).stop 2023-11-24T06:14:03.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.151+0000 7ff20c3e5640 1 -- 172.21.15.22:0/204575374 shutdown_connections 2023-11-24T06:14:03.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.151+0000 7ff20c3e5640 1 --2- 172.21.15.22:0/204575374 >> v2:172.21.15.31:3300/0 conn(0x7ff204072280 0x7ff2040b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.151+0000 7ff20c3e5640 1 --2- 172.21.15.22:0/204575374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20406e420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.151+0000 7ff20c3e5640 1 -- 172.21.15.22:0/204575374 >> 172.21.15.22:0/204575374 conn(0x7ff2040b0ba0 msgr2=0x7ff2040b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:03.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.151+0000 7ff20c3e5640 1 -- 172.21.15.22:0/204575374 shutdown_connections 2023-11-24T06:14:03.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.151+0000 7ff20c3e5640 1 -- 172.21.15.22:0/204575374 wait complete. 2023-11-24T06:14:03.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.152+0000 7ff20c3e5640 1 Processor -- start 2023-11-24T06:14:03.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.153+0000 7ff20c3e5640 1 -- start start 2023-11-24T06:14:03.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.153+0000 7ff20c3e5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20409c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.153+0000 7ff20c3e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff204072280 0x7ff204155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.153+0000 7ff20c3e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff204160b10 0x7ff204099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20c3e5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040cd380 con 0x7ff204160b10 2023-11-24T06:14:03.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20c3e5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20409c700 con 0x7ff204072280 2023-11-24T06:14:03.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20c3e5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20409c940 con 0x7ff20406cad0 2023-11-24T06:14:03.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a982640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff204160b10 0x7ff204099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a982640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff204160b10 0x7ff204099a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36870/0 (socket says 172.21.15.22:36870) 2023-11-24T06:14:03.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a982640 1 -- 172.21.15.22:0/3449745256 learned_addr learned my addr 172.21.15.22:0/3449745256 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:03.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff209980640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff204072280 0x7ff204155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a181640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20409c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a982640 1 -- 172.21.15.22:0/3449745256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 msgr2=0x7ff20409c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a982640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20409c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a982640 1 -- 172.21.15.22:0/3449745256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff204072280 msgr2=0x7ff204155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a982640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff204072280 0x7ff204155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a982640 1 -- 172.21.15.22:0/3449745256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f4009400 con 0x7ff204160b10 2023-11-24T06:14:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.154+0000 7ff20a181640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20409c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.155+0000 7ff20a982640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff204160b10 0x7ff204099a00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00e930 tx=0x7ff1fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.155+0000 7ff1faffd640 1 -- 172.21.15.22:0/3449745256 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc009690 con 0x7ff204160b10 2023-11-24T06:14:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.155+0000 7ff1faffd640 1 -- 172.21.15.22:0/3449745256 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00c920 con 0x7ff204160b10 2023-11-24T06:14:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.155+0000 7ff1faffd640 1 -- 172.21.15.22:0/3449745256 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00ccd0 con 0x7ff204160b10 2023-11-24T06:14:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.155+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff204157fe0 con 0x7ff204160b10 2023-11-24T06:14:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.155+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2041585a0 con 0x7ff204160b10 2023-11-24T06:14:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.156+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2040b51b0 con 0x7ff204160b10 2023-11-24T06:14:03.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.157+0000 7ff1faffd640 1 -- 172.21.15.22:0/3449745256 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff1fc013470 con 0x7ff204160b10 2023-11-24T06:14:03.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.158+0000 7ff1faffd640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1e806aff0 0x7ff1e806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.159+0000 7ff1faffd640 1 -- 172.21.15.22:0/3449745256 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff1fc089c30 con 0x7ff204160b10 2023-11-24T06:14:03.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.159+0000 7ff20a181640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1e806aff0 0x7ff1e806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.159+0000 7ff20a181640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1e806aff0 0x7ff1e806d4b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff200001560 tx=0x7ff200009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:03.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.163+0000 7ff1faffd640 1 -- 172.21.15.22:0/3449745256 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1fc054a20 con 0x7ff204160b10 2023-11-24T06:14:03.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.359+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff20409d200 con 0x7ff204160b10 2023-11-24T06:14:03.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.885+0000 7ff1faffd640 1 -- 172.21.15.22:0/3449745256 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff1fc0210d0 con 0x7ff204160b10 2023-11-24T06:14:03.888 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:14:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1e806aff0 msgr2=0x7ff1e806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1e806aff0 0x7ff1e806d4b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff200001560 tx=0x7ff200009040 comp rx=0 tx=0).stop 2023-11-24T06:14:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff204160b10 msgr2=0x7ff204099a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff204160b10 0x7ff204099a00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00e930 tx=0x7ff1fc00edf0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 shutdown_connections 2023-11-24T06:14:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1e806aff0 0x7ff1e806d4b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff204160b10 0x7ff204099a00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff204072280 0x7ff204155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 --2- 172.21.15.22:0/3449745256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20406cad0 0x7ff20409c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 >> 172.21.15.22:0/3449745256 conn(0x7ff2040b0ba0 msgr2=0x7ff2040aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:03.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 shutdown_connections 2023-11-24T06:14:03.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:03.890+0000 7ff20c3e5640 1 -- 172.21.15.22:0/3449745256 wait complete. 2023-11-24T06:14:03.916 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:14:04.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.145+0000 7f1900d21640 1 Processor -- start 2023-11-24T06:14:04.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.145+0000 7f1900d21640 1 -- start start 2023-11-24T06:14:04.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.146+0000 7f1900d21640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f18fc0ad450 0x7f18fc154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:04.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.146+0000 7f1900d21640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc070850 0x7f18fc071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:04.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f1900d21640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc0ce650 con 0x7f18fc153ea0 2023-11-24T06:14:04.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f1900d21640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc0ad8e0 con 0x7f18fc0ad450 2023-11-24T06:14:04.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f1900d21640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc1547c0 con 0x7f18fc070850 2023-11-24T06:14:04.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f18f2ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f18fc0ad450 0x7f18fc154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:04.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f18f2ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f18fc0ad450 0x7f18fc154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36878/0 (socket says 172.21.15.22:36878) 2023-11-24T06:14:04.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f18f2ffd640 1 -- 172.21.15.22:0/811313167 learned_addr learned my addr 172.21.15.22:0/811313167 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:04.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f18f2ffd640 1 -- 172.21.15.22:0/811313167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc070850 msgr2=0x7f18fc071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:04.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f18f2ffd640 1 --2- 172.21.15.22:0/811313167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc070850 0x7f18fc071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f18f2ffd640 1 -- 172.21.15.22:0/811313167 >> v1:172.21.15.31:6789/0 conn(0x7f18fc153ea0 legacy=0x7f18fc15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:04.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.147+0000 7f18f2ffd640 1 -- 172.21.15.22:0/811313167 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc15e0a0 con 0x7f18fc0ad450 2023-11-24T06:14:04.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.149+0000 7f18f2ffd640 1 --2- 172.21.15.22:0/811313167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc0ad450 0x7f18fc154280 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009e80 tx=0x7f18e402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e496b5cb352b65 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:04.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.149+0000 7f18faffd640 1 -- 172.21.15.22:0/811313167 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e402ca50 con 0x7f18fc0ad450 2023-11-24T06:14:04.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.149+0000 7f18faffd640 1 -- 172.21.15.22:0/811313167 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e402cbb0 con 0x7f18fc0ad450 2023-11-24T06:14:04.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.149+0000 7f18faffd640 1 -- 172.21.15.22:0/811313167 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e40343f0 con 0x7f18fc0ad450 2023-11-24T06:14:04.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.150+0000 7f1900d21640 1 -- 172.21.15.22:0/811313167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc0ad450 msgr2=0x7f18fc154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:04.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.150+0000 7f1900d21640 1 --2- 172.21.15.22:0/811313167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc0ad450 0x7f18fc154280 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009e80 tx=0x7f18e402beb0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.150+0000 7f1900d21640 1 -- 172.21.15.22:0/811313167 shutdown_connections 2023-11-24T06:14:04.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.150+0000 7f1900d21640 1 --2- 172.21.15.22:0/811313167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc070850 0x7f18fc071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.150+0000 7f1900d21640 1 --2- 172.21.15.22:0/811313167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc0ad450 0x7f18fc154280 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.150+0000 7f1900d21640 1 -- 172.21.15.22:0/811313167 >> 172.21.15.22:0/811313167 conn(0x7f18fc0cec10 msgr2=0x7f18fc0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:04.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.150+0000 7f1900d21640 1 -- 172.21.15.22:0/811313167 shutdown_connections 2023-11-24T06:14:04.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.150+0000 7f1900d21640 1 -- 172.21.15.22:0/811313167 wait complete. 2023-11-24T06:14:04.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.152+0000 7f1900d21640 1 Processor -- start 2023-11-24T06:14:04.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.153+0000 7f1900d21640 1 -- start start 2023-11-24T06:14:04.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.154+0000 7f1900d21640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18fc070850 0x7f18fc1437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.154+0000 7f1900d21640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc0ad450 0x7f18fc1e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.154+0000 7f1900d21640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc153ea0 0x7f18fc156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.154+0000 7f1900d21640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc154cf0 con 0x7f18fc153ea0 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.154+0000 7f1900d21640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc1549c0 con 0x7f18fc070850 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.154+0000 7f1900d21640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc1e62c0 con 0x7f18fc0ad450 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc153ea0 0x7f18fc156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18fc070850 0x7f18fc1437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18fc070850 0x7f18fc1437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:42698/0 (socket says 172.21.15.22:42698) 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc153ea0 0x7f18fc156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36890/0 (socket says 172.21.15.22:36890) 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fb7fe640 1 -- 172.21.15.22:0/2425021453 learned_addr learned my addr 172.21.15.22:0/2425021453 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:04.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18f2ffd640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc0ad450 0x7f18fc1e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:04.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fbfff640 1 -- 172.21.15.22:0/2425021453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc0ad450 msgr2=0x7f18fc1e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:04.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fbfff640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc0ad450 0x7f18fc1e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fbfff640 1 -- 172.21.15.22:0/2425021453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18fc070850 msgr2=0x7f18fc1437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:04.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fbfff640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18fc070850 0x7f18fc1437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fbfff640 1 -- 172.21.15.22:0/2425021453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4009b30 con 0x7f18fc153ea0 2023-11-24T06:14:04.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18f2ffd640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc0ad450 0x7f18fc1e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:04.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.155+0000 7f18fbfff640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc153ea0 0x7f18fc156850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f18f400b410 tx=0x7f18f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:04.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.156+0000 7f18f8ff9640 1 -- 172.21.15.22:0/2425021453 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4011830 con 0x7f18fc153ea0 2023-11-24T06:14:04.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.156+0000 7f18f8ff9640 1 -- 172.21.15.22:0/2425021453 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f4011990 con 0x7f18fc153ea0 2023-11-24T06:14:04.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.156+0000 7f18f8ff9640 1 -- 172.21.15.22:0/2425021453 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4011d40 con 0x7f18fc153ea0 2023-11-24T06:14:04.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.156+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc1e65a0 con 0x7f18fc153ea0 2023-11-24T06:14:04.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.156+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc1e5e40 con 0x7f18fc153ea0 2023-11-24T06:14:04.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.157+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18fc1e6090 con 0x7f18fc153ea0 2023-11-24T06:14:04.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.158+0000 7f18f8ff9640 1 -- 172.21.15.22:0/2425021453 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f18f401a400 con 0x7f18fc153ea0 2023-11-24T06:14:04.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.159+0000 7f18f8ff9640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f18dc06aff0 0x7f18dc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:04.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.159+0000 7f18f8ff9640 1 -- 172.21.15.22:0/2425021453 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f18f40898d0 con 0x7f18fc153ea0 2023-11-24T06:14:04.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.159+0000 7f18fb7fe640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f18dc06aff0 0x7f18dc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:04.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.160+0000 7f18fb7fe640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f18dc06aff0 0x7f18dc06d4b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f18fc150550 tx=0x7f18ec009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:04.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.166+0000 7f18f8ff9640 1 -- 172.21.15.22:0/2425021453 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18f40547c0 con 0x7f18fc153ea0 2023-11-24T06:14:04.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.363+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f18fc04e840 con 0x7f18fc153ea0 2023-11-24T06:14:04.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.889+0000 7f18f8ff9640 1 -- 172.21.15.22:0/2425021453 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f18f4015020 con 0x7f18fc153ea0 2023-11-24T06:14:04.892 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-11-24T06:14:04.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f18dc06aff0 msgr2=0x7f18dc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:04.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f18dc06aff0 0x7f18dc06d4b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f18fc150550 tx=0x7f18ec009110 comp rx=0 tx=0).stop 2023-11-24T06:14:04.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc153ea0 msgr2=0x7f18fc156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:04.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc153ea0 0x7f18fc156850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f18f400b410 tx=0x7f18f400b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 shutdown_connections 2023-11-24T06:14:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f18dc06aff0 0x7f18dc06d4b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18fc153ea0 0x7f18fc156850 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18fc0ad450 0x7f18fc1e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 --2- 172.21.15.22:0/2425021453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18fc070850 0x7f18fc1437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.892+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 >> 172.21.15.22:0/2425021453 conn(0x7f18fc0cec10 msgr2=0x7f18fc0ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.893+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 shutdown_connections 2023-11-24T06:14:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:04.893+0000 7f1900d21640 1 -- 172.21.15.22:0/2425021453 wait complete. 2023-11-24T06:14:04.916 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:14:05.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.138+0000 7fd8f5fbc640 1 Processor -- start 2023-11-24T06:14:05.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.139+0000 7fd8f5fbc640 1 -- start start 2023-11-24T06:14:05.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.140+0000 7fd8f5fbc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00d1fd0 0x7fd8f00ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.140+0000 7fd8f5fbc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd8f00b33d0 0x7fd8f00b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.140+0000 7fd8f5fbc640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f00b2980 con 0x7fd8f00cfa30 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.140+0000 7fd8f5fbc640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f00cf220 con 0x7fd8f00b33d0 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.140+0000 7fd8f5fbc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00cf500 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.141+0000 7fd8f4fba640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd8f00cfa30 0x7fd8f00cfe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59674/0 (socket says 172.21.15.22:59674) 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.141+0000 7fd8f4fba640 1 -- 172.21.15.22:0/4289908922 learned_addr learned my addr 172.21.15.22:0/4289908922 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.141+0000 7fd8f57bb640 1 --2- 172.21.15.22:0/4289908922 >> v2:172.21.15.22:3300/0 conn(0x7fd8f00b33d0 0x7fd8f00b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.141+0000 7fd8effff640 1 --2- 172.21.15.22:0/4289908922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00d1fd0 0x7fd8f00ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.141+0000 7fd8f57bb640 1 -- 172.21.15.22:0/4289908922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00d1fd0 msgr2=0x7fd8f00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.141+0000 7fd8f57bb640 1 --2- 172.21.15.22:0/4289908922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00d1fd0 0x7fd8f00ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.141+0000 7fd8f57bb640 1 -- 172.21.15.22:0/4289908922 >> v1:172.21.15.22:6789/0 conn(0x7fd8f00cfa30 legacy=0x7fd8f00cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.141+0000 7fd8f57bb640 1 -- 172.21.15.22:0/4289908922 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00b2bd0 con 0x7fd8f00b33d0 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.142+0000 7fd8f57bb640 1 --2- 172.21.15.22:0/4289908922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00b33d0 0x7fd8f00b3860 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80097a0 tx=0x7fd8e802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa87458fa3ef4b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.142+0000 7fd8ef7fe640 1 -- 172.21.15.22:0/4289908922 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e802d040 con 0x7fd8f00b33d0 2023-11-24T06:14:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8ef7fe640 1 -- 172.21.15.22:0/4289908922 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8031810 con 0x7fd8f00b33d0 2023-11-24T06:14:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8ef7fe640 1 -- 172.21.15.22:0/4289908922 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8031ba0 con 0x7fd8f00b33d0 2023-11-24T06:14:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/4289908922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00b33d0 msgr2=0x7fd8f00b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8f5fbc640 1 --2- 172.21.15.22:0/4289908922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00b33d0 0x7fd8f00b3860 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80097a0 tx=0x7fd8e802b8b0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/4289908922 shutdown_connections 2023-11-24T06:14:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8f5fbc640 1 --2- 172.21.15.22:0/4289908922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00b33d0 0x7fd8f00b3860 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8f5fbc640 1 --2- 172.21.15.22:0/4289908922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00d1fd0 0x7fd8f00ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/4289908922 >> 172.21.15.22:0/4289908922 conn(0x7fd8f00d3020 msgr2=0x7fd8f00d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/4289908922 shutdown_connections 2023-11-24T06:14:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.143+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/4289908922 wait complete. 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.145+0000 7fd8f5fbc640 1 Processor -- start 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.145+0000 7fd8f5fbc640 1 -- start start 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.146+0000 7fd8f5fbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f00b33d0 0x7fd8f00b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.146+0000 7fd8f5fbc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00cfa30 0x7fd8f00cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.146+0000 7fd8f5fbc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00d1fd0 0x7fd8f00cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.146+0000 7fd8f5fbc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f015e720 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.146+0000 7fd8f5fbc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f0155a50 con 0x7fd8f00b33d0 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.146+0000 7fd8f5fbc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00cc440 con 0x7fd8f00cfa30 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.146+0000 7fd8f57bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00d1fd0 0x7fd8f00cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.146+0000 7fd8f57bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00d1fd0 0x7fd8f00cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36902/0 (socket says 172.21.15.22:36902) 2023-11-24T06:14:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.146+0000 7fd8f57bb640 1 -- 172.21.15.22:0/2470282842 learned_addr learned my addr 172.21.15.22:0/2470282842 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.147+0000 7fd8f4fba640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f00b33d0 0x7fd8f00b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.147+0000 7fd8effff640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00cfa30 0x7fd8f00cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.147+0000 7fd8f57bb640 1 -- 172.21.15.22:0/2470282842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00cfa30 msgr2=0x7fd8f00cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.147+0000 7fd8f57bb640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00cfa30 0x7fd8f00cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.147+0000 7fd8f57bb640 1 -- 172.21.15.22:0/2470282842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f00b33d0 msgr2=0x7fd8f00b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.147+0000 7fd8f57bb640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f00b33d0 0x7fd8f00b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.147+0000 7fd8f57bb640 1 -- 172.21.15.22:0/2470282842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e8009400 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.147+0000 7fd8f4fba640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f00b33d0 0x7fd8f00b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.147+0000 7fd8f57bb640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00d1fd0 0x7fd8f00cbda0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80096f0 tx=0x7fd8e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.148+0000 7fd8ed7fa640 1 -- 172.21.15.22:0/2470282842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e803ace0 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.148+0000 7fd8ed7fa640 1 -- 172.21.15.22:0/2470282842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e803ae60 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.148+0000 7fd8ed7fa640 1 -- 172.21.15.22:0/2470282842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8042630 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.148+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f00cc720 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.148+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f00b6030 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.149+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f00d0a40 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.150+0000 7fd8ed7fa640 1 -- 172.21.15.22:0/2470282842 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd8e804b450 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.151+0000 7fd8ed7fa640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8dc06aff0 0x7fd8dc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.151+0000 7fd8ed7fa640 1 -- 172.21.15.22:0/2470282842 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8e80ab570 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.151+0000 7fd8f4fba640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8dc06aff0 0x7fd8dc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.152+0000 7fd8f4fba640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8dc06aff0 0x7fd8dc06d4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0005c00 tx=0x7fd8e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.155+0000 7fd8ed7fa640 1 -- 172.21.15.22:0/2470282842 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8e8076580 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.368+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd8f004e840 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.376+0000 7fd8ed7fa640 1 -- 172.21.15.22:0/2470282842 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd8e8079ba0 con 0x7fd8f00d1fd0 2023-11-24T06:14:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8dc06aff0 msgr2=0x7fd8dc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8dc06aff0 0x7fd8dc06d4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0005c00 tx=0x7fd8e0009040 comp rx=0 tx=0).stop 2023-11-24T06:14:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00d1fd0 msgr2=0x7fd8f00cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00d1fd0 0x7fd8f00cbda0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80096f0 tx=0x7fd8e80046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 shutdown_connections 2023-11-24T06:14:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8dc06aff0 0x7fd8dc06d4b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f00d1fd0 0x7fd8f00cbda0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8f00cfa30 0x7fd8f00cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 --2- 172.21.15.22:0/2470282842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f00b33d0 0x7fd8f00b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 >> 172.21.15.22:0/2470282842 conn(0x7fd8f00d3020 msgr2=0x7fd8f00cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 shutdown_connections 2023-11-24T06:14:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.379+0000 7fd8f5fbc640 1 -- 172.21.15.22:0/2470282842 wait complete. 2023-11-24T06:14:05.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-11-24T06:14:05.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.609+0000 7f0d6ffff640 1 Processor -- start 2023-11-24T06:14:05.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.610+0000 7f0d6ffff640 1 -- start start 2023-11-24T06:14:05.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.612+0000 7f0d6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d7013dfd0 0x7f0d7015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.612+0000 7f0d6ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d700cf4d0 0x7f0d7006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.612+0000 7f0d6ffff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d700ce7c0 con 0x7f0d700cf050 2023-11-24T06:14:05.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.612+0000 7f0d6ffff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d70140900 con 0x7f0d700cf4d0 2023-11-24T06:14:05.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.612+0000 7f0d6ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7015fa70 con 0x7f0d7013dfd0 2023-11-24T06:14:05.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.612+0000 7f0d6f7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d700cf4d0 0x7f0d7006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.612+0000 7f0d6f7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d700cf4d0 0x7f0d7006c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36904/0 (socket says 172.21.15.22:36904) 2023-11-24T06:14:05.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.612+0000 7f0d6f7fe640 1 -- 172.21.15.22:0/3365268020 learned_addr learned my addr 172.21.15.22:0/3365268020 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:05.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.612+0000 7f0d6effd640 1 --2- 172.21.15.22:0/3365268020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d7013dfd0 0x7f0d7015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.613+0000 7f0d6f7fe640 1 -- 172.21.15.22:0/3365268020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d7013dfd0 msgr2=0x7f0d7015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:05.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.613+0000 7f0d6f7fe640 1 --2- 172.21.15.22:0/3365268020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d7013dfd0 0x7f0d7015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.613+0000 7f0d6f7fe640 1 -- 172.21.15.22:0/3365268020 >> v1:172.21.15.31:6789/0 conn(0x7f0d700cf050 legacy=0x7f0d7006c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:05.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.613+0000 7f0d6f7fe640 1 -- 172.21.15.22:0/3365268020 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7015ee60 con 0x7f0d700cf4d0 2023-11-24T06:14:05.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.614+0000 7f0d6f7fe640 1 --2- 172.21.15.22:0/3365268020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf4d0 0x7f0d7006c840 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009e50 tx=0x7f0d6802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851218fb3a05fd98 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.614+0000 7f0d6e7fc640 1 -- 172.21.15.22:0/3365268020 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6802ca70 con 0x7f0d700cf4d0 2023-11-24T06:14:05.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.614+0000 7f0d6e7fc640 1 -- 172.21.15.22:0/3365268020 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6802cbd0 con 0x7f0d700cf4d0 2023-11-24T06:14:05.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.614+0000 7f0d6e7fc640 1 -- 172.21.15.22:0/3365268020 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680343f0 con 0x7f0d700cf4d0 2023-11-24T06:14:05.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.615+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3365268020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf4d0 msgr2=0x7f0d7006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.615+0000 7f0d6ffff640 1 --2- 172.21.15.22:0/3365268020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf4d0 0x7f0d7006c840 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009e50 tx=0x7f0d6802bed0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.615+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3365268020 shutdown_connections 2023-11-24T06:14:05.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.615+0000 7f0d6ffff640 1 --2- 172.21.15.22:0/3365268020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf4d0 0x7f0d7006c840 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.615+0000 7f0d6ffff640 1 --2- 172.21.15.22:0/3365268020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d7013dfd0 0x7f0d7015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.615+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3365268020 >> 172.21.15.22:0/3365268020 conn(0x7f0d7006a860 msgr2=0x7f0d7006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:05.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.615+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3365268020 shutdown_connections 2023-11-24T06:14:05.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.615+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3365268020 wait complete. 2023-11-24T06:14:05.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.618+0000 7f0d6ffff640 1 Processor -- start 2023-11-24T06:14:05.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.618+0000 7f0d6ffff640 1 -- start start 2023-11-24T06:14:05.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.619+0000 7f0d6ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf050 0x7f0d70154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.619+0000 7f0d6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d700cf4d0 0x7f0d700b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.619+0000 7f0d6ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d7013dfd0 0x7f0d700b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.619+0000 7f0d6ffff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70155030 con 0x7f0d700cf050 2023-11-24T06:14:05.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.619+0000 7f0d6ffff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70155be0 con 0x7f0d7013dfd0 2023-11-24T06:14:05.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.619+0000 7f0d6ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70155ec0 con 0x7f0d700cf4d0 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf050 0x7f0d70154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf050 0x7f0d70154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36918/0 (socket says 172.21.15.22:36918) 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6effd640 1 -- 172.21.15.22:0/3129909440 learned_addr learned my addr 172.21.15.22:0/3129909440 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d67fff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d700cf4d0 0x7f0d700b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6f7fe640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d7013dfd0 0x7f0d700b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6effd640 1 -- 172.21.15.22:0/3129909440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d700cf4d0 msgr2=0x7f0d700b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6effd640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d700cf4d0 0x7f0d700b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6effd640 1 -- 172.21.15.22:0/3129909440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d7013dfd0 msgr2=0x7f0d700b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6effd640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d7013dfd0 0x7f0d700b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6effd640 1 -- 172.21.15.22:0/3129909440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68009b30 con 0x7f0d700cf050 2023-11-24T06:14:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d67fff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d700cf4d0 0x7f0d700b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.620+0000 7f0d6effd640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf050 0x7f0d70154af0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000d800 tx=0x7f0d6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.621+0000 7f0d677fe640 1 -- 172.21.15.22:0/3129909440 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000b6c0 con 0x7f0d700cf050 2023-11-24T06:14:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.621+0000 7f0d677fe640 1 -- 172.21.15.22:0/3129909440 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6000b820 con 0x7f0d700cf050 2023-11-24T06:14:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.621+0000 7f0d677fe640 1 -- 172.21.15.22:0/3129909440 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000bbb0 con 0x7f0d700cf050 2023-11-24T06:14:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.621+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d701561a0 con 0x7f0d700cf050 2023-11-24T06:14:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.621+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d70156760 con 0x7f0d700cf050 2023-11-24T06:14:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.622+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7004e840 con 0x7f0d700cf050 2023-11-24T06:14:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.623+0000 7f0d677fe640 1 -- 172.21.15.22:0/3129909440 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0d6000bd10 con 0x7f0d700cf050 2023-11-24T06:14:05.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.624+0000 7f0d677fe640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d5006aff0 0x7f0d5006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.624+0000 7f0d677fe640 1 -- 172.21.15.22:0/3129909440 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0d60089c70 con 0x7f0d700cf050 2023-11-24T06:14:05.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.624+0000 7f0d67fff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d5006aff0 0x7f0d5006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.625+0000 7f0d67fff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d5006aff0 0x7f0d5006d4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d58006fd0 tx=0x7f0d58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.629+0000 7f0d677fe640 1 -- 172.21.15.22:0/3129909440 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d60054d00 con 0x7f0d700cf050 2023-11-24T06:14:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.898+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f0d700ce9a0 con 0x7f0d700cf050 2023-11-24T06:14:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.907+0000 7f0d677fe640 1 -- 172.21.15.22:0/3129909440 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v141) v1 ==== 158+0+0 (secure 0 0 0) 0x7f0d60058320 con 0x7f0d700cf050 2023-11-24T06:14:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.909+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d5006aff0 msgr2=0x7f0d5006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.909+0000 7f0d6ffff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d5006aff0 0x7f0d5006d4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d58006fd0 tx=0x7f0d58008040 comp rx=0 tx=0).stop 2023-11-24T06:14:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf050 msgr2=0x7f0d70154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf050 0x7f0d70154af0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000d800 tx=0x7f0d6000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 shutdown_connections 2023-11-24T06:14:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0d5006aff0 0x7f0d5006d4b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d7013dfd0 0x7f0d700b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0d700cf4d0 0x7f0d700b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 --2- 172.21.15.22:0/3129909440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d700cf050 0x7f0d70154af0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 >> 172.21.15.22:0/3129909440 conn(0x7f0d7006a860 msgr2=0x7f0d7013fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:05.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 shutdown_connections 2023-11-24T06:14:05.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:05.910+0000 7f0d6ffff640 1 -- 172.21.15.22:0/3129909440 wait complete. 2023-11-24T06:14:05.932 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2023-11-24T06:14:05.933 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T06:14:05.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:06.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.145+0000 7fd7e8a61640 1 Processor -- start 2023-11-24T06:14:06.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.145+0000 7fd7e8a61640 1 -- start start 2023-11-24T06:14:06.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.146+0000 7fd7e8a61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e406d520 0x7fd7e406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.146+0000 7fd7e8a61640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7e40ad720 0x7fd7e415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.146+0000 7fd7e8a61640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e415c360 con 0x7fd7e40abff0 2023-11-24T06:14:06.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.146+0000 7fd7e8a61640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e40b41a0 con 0x7fd7e40ad720 2023-11-24T06:14:06.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.146+0000 7fd7e8a61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e406de40 con 0x7fd7e406d520 2023-11-24T06:14:06.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.146+0000 7fd7e1d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7e40ad720 0x7fd7e415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.146+0000 7fd7e1d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7e40ad720 0x7fd7e415ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36926/0 (socket says 172.21.15.22:36926) 2023-11-24T06:14:06.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.146+0000 7fd7e1d9b640 1 -- 172.21.15.22:0/2574273709 learned_addr learned my addr 172.21.15.22:0/2574273709 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:06.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.147+0000 7fd7e259c640 1 --2- 172.21.15.22:0/2574273709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e406d520 0x7fd7e406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.147+0000 7fd7e1d9b640 1 -- 172.21.15.22:0/2574273709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e406d520 msgr2=0x7fd7e406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:06.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.147+0000 7fd7e1d9b640 1 --2- 172.21.15.22:0/2574273709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e406d520 0x7fd7e406d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.147+0000 7fd7e1d9b640 1 -- 172.21.15.22:0/2574273709 >> v1:172.21.15.22:6789/0 conn(0x7fd7e40abff0 legacy=0x7fd7e415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.147+0000 7fd7e1d9b640 1 -- 172.21.15.22:0/2574273709 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e415ba30 con 0x7fd7e40ad720 2023-11-24T06:14:06.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.147+0000 7fd7e159a640 1 -- 172.21.15.22:0/2574273709 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235912792 0 0) 0x7fd7e415c360 con 0x7fd7e40abff0 2023-11-24T06:14:06.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.148+0000 7fd7e1d9b640 1 --2- 172.21.15.22:0/2574273709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40ad720 0x7fd7e415ecd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009870 tx=0x7fd7cc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f3e8aa4890e95e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.148+0000 7fd7e159a640 1 -- 172.21.15.22:0/2574273709 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc030840 con 0x7fd7e40ad720 2023-11-24T06:14:06.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.148+0000 7fd7e159a640 1 -- 172.21.15.22:0/2574273709 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc0309a0 con 0x7fd7e40ad720 2023-11-24T06:14:06.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.148+0000 7fd7e159a640 1 -- 172.21.15.22:0/2574273709 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc030d30 con 0x7fd7e40ad720 2023-11-24T06:14:06.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.149+0000 7fd7e8a61640 1 -- 172.21.15.22:0/2574273709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40ad720 msgr2=0x7fd7e415ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.149+0000 7fd7e8a61640 1 --2- 172.21.15.22:0/2574273709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40ad720 0x7fd7e415ecd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009870 tx=0x7fd7cc02b980 comp rx=0 tx=0).stop 2023-11-24T06:14:06.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.149+0000 7fd7e8a61640 1 -- 172.21.15.22:0/2574273709 shutdown_connections 2023-11-24T06:14:06.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.149+0000 7fd7e8a61640 1 --2- 172.21.15.22:0/2574273709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40ad720 0x7fd7e415ecd0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.149+0000 7fd7e8a61640 1 --2- 172.21.15.22:0/2574273709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e406d520 0x7fd7e406d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.149+0000 7fd7e8a61640 1 -- 172.21.15.22:0/2574273709 >> 172.21.15.22:0/2574273709 conn(0x7fd7e40b0d80 msgr2=0x7fd7e40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.149+0000 7fd7e8a61640 1 -- 172.21.15.22:0/2574273709 shutdown_connections 2023-11-24T06:14:06.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.149+0000 7fd7e8a61640 1 -- 172.21.15.22:0/2574273709 wait complete. 2023-11-24T06:14:06.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.151+0000 7fd7e8a61640 1 Processor -- start 2023-11-24T06:14:06.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.151+0000 7fd7e8a61640 1 -- start start 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.152+0000 7fd7e8a61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e406d520 0x7fd7e41558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.152+0000 7fd7e8a61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40abff0 0x7fd7e415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.152+0000 7fd7e8a61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e40ad720 0x7fd7e415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.152+0000 7fd7e8a61640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41521d0 con 0x7fd7e40abff0 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.152+0000 7fd7e8a61640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41524b0 con 0x7fd7e406d520 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.152+0000 7fd7e8a61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4152790 con 0x7fd7e40ad720 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.152+0000 7fd7e1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40abff0 0x7fd7e415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.152+0000 7fd7e1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40abff0 0x7fd7e415ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36938/0 (socket says 172.21.15.22:36938) 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.152+0000 7fd7e1d9b640 1 -- 172.21.15.22:0/1612964208 learned_addr learned my addr 172.21.15.22:0/1612964208 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:06.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.153+0000 7fd7e2d9d640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e40ad720 0x7fd7e415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.153+0000 7fd7e259c640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e406d520 0x7fd7e41558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.153+0000 7fd7e1d9b640 1 -- 172.21.15.22:0/1612964208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e40ad720 msgr2=0x7fd7e415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.153+0000 7fd7e1d9b640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e40ad720 0x7fd7e415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.153+0000 7fd7e1d9b640 1 -- 172.21.15.22:0/1612964208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e406d520 msgr2=0x7fd7e41558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.153+0000 7fd7e1d9b640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e406d520 0x7fd7e41558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.153+0000 7fd7e1d9b640 1 -- 172.21.15.22:0/1612964208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0094d0 con 0x7fd7e40abff0 2023-11-24T06:14:06.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.153+0000 7fd7e2d9d640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e40ad720 0x7fd7e415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:06.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.153+0000 7fd7e1d9b640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40abff0 0x7fd7e415ed10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0090b0 tx=0x7fd7cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.154+0000 7fd7daffd640 1 -- 172.21.15.22:0/1612964208 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc039b50 con 0x7fd7e40abff0 2023-11-24T06:14:06.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.154+0000 7fd7daffd640 1 -- 172.21.15.22:0/1612964208 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc039cb0 con 0x7fd7e40abff0 2023-11-24T06:14:06.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.154+0000 7fd7daffd640 1 -- 172.21.15.22:0/1612964208 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc043630 con 0x7fd7e40abff0 2023-11-24T06:14:06.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.154+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e4152a70 con 0x7fd7e40abff0 2023-11-24T06:14:06.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.154+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e415a060 con 0x7fd7e40abff0 2023-11-24T06:14:06.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.155+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e4152f90 con 0x7fd7e40abff0 2023-11-24T06:14:06.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.156+0000 7fd7daffd640 1 -- 172.21.15.22:0/1612964208 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd7cc02f390 con 0x7fd7e40abff0 2023-11-24T06:14:06.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.157+0000 7fd7daffd640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd7c406aff0 0x7fd7c406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.157+0000 7fd7daffd640 1 -- 172.21.15.22:0/1612964208 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd7cc0ab8a0 con 0x7fd7e40abff0 2023-11-24T06:14:06.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.157+0000 7fd7e259c640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd7c406aff0 0x7fd7c406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.158+0000 7fd7e259c640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd7c406aff0 0x7fd7c406d4b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009f30 tx=0x7fd7d400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.162+0000 7fd7daffd640 1 -- 172.21.15.22:0/1612964208 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7e4152f90 con 0x7fd7e40abff0 2023-11-24T06:14:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.354+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7e4152f90 con 0x7fd7e40abff0 2023-11-24T06:14:06.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.356+0000 7fd7daffd640 1 -- 172.21.15.22:0/1612964208 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12938 (secure 0 0 0) 0x7fd7e4152f90 con 0x7fd7e40abff0 2023-11-24T06:14:06.359 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:06.359 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":39,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:04.886003+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6837/1515634482":"2023-11-25T06:14:01.874792+0000","172.21.15.22:6836/1515634482":"2023-11-25T06:14:01.874792+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd7c406aff0 msgr2=0x7fd7c406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd7c406aff0 0x7fd7c406d4b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009f30 tx=0x7fd7d400b040 comp rx=0 tx=0).stop 2023-11-24T06:14:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40abff0 msgr2=0x7fd7e415ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40abff0 0x7fd7e415ed10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0090b0 tx=0x7fd7cc004730 comp rx=0 tx=0).stop 2023-11-24T06:14:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 shutdown_connections 2023-11-24T06:14:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd7c406aff0 0x7fd7c406d4b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7e40ad720 0x7fd7e415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7e40abff0 0x7fd7e415ed10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 --2- 172.21.15.22:0/1612964208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e406d520 0x7fd7e41558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 >> 172.21.15.22:0/1612964208 conn(0x7fd7e40b0d80 msgr2=0x7fd7e4158500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.358+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 shutdown_connections 2023-11-24T06:14:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.359+0000 7fd7e8a61640 1 -- 172.21.15.22:0/1612964208 wait complete. 2023-11-24T06:14:06.381 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:06.382 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.601+0000 7fb1fbfff640 1 Processor -- start 2023-11-24T06:14:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.601+0000 7fb1fbfff640 1 -- start start 2023-11-24T06:14:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.603+0000 7fb1fbfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1fc144770 0x7fb1fc15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.603+0000 7fb1fbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1fc15f0a0 0x7fb1fc0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.603+0000 7fb1fbfff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc15f930 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.603+0000 7fb1fbfff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b43b0 con 0x7fb1fc144770 2023-11-24T06:14:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.603+0000 7fb1fbfff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc15f510 con 0x7fb1fc15f0a0 2023-11-24T06:14:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1faffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1fc144770 0x7fb1fc15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1faffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1fc144770 0x7fb1fc15eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36954/0 (socket says 172.21.15.22:36954) 2023-11-24T06:14:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1fa7fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb1fc0b35a0 0x7fb1fc06c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59694/0 (socket says 172.21.15.22:59694) 2023-11-24T06:14:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1faffd640 1 -- 172.21.15.22:0/880494418 learned_addr learned my addr 172.21.15.22:0/880494418 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1fb7fe640 1 --2- 172.21.15.22:0/880494418 >> v2:172.21.15.31:3300/0 conn(0x7fb1fc15f0a0 0x7fb1fc0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1faffd640 1 -- 172.21.15.22:0/880494418 >> v2:172.21.15.31:3300/0 conn(0x7fb1fc15f0a0 msgr2=0x7fb1fc0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1faffd640 1 --2- 172.21.15.22:0/880494418 >> v2:172.21.15.31:3300/0 conn(0x7fb1fc15f0a0 0x7fb1fc0ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1faffd640 1 -- 172.21.15.22:0/880494418 >> v1:172.21.15.22:6789/0 conn(0x7fb1fc0b35a0 legacy=0x7fb1fc06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1faffd640 1 -- 172.21.15.22:0/880494418 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0ce9f0 con 0x7fb1fc144770 2023-11-24T06:14:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.604+0000 7fb1fb7fe640 1 --2- 172.21.15.22:0/880494418 >> v2:172.21.15.31:3300/0 conn(0x7fb1fc15f0a0 0x7fb1fc0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:06.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.605+0000 7fb1faffd640 1 --2- 172.21.15.22:0/880494418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc144770 0x7fb1fc15eb60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0700e0 tx=0x7fb1ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50688d9abeb098e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.606+0000 7fb1f9ffb640 1 -- 172.21.15.22:0/880494418 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec030860 con 0x7fb1fc144770 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.606+0000 7fb1f9ffb640 1 -- 172.21.15.22:0/880494418 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0309c0 con 0x7fb1fc144770 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.606+0000 7fb1f9ffb640 1 -- 172.21.15.22:0/880494418 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec030d50 con 0x7fb1fc144770 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.606+0000 7fb1fbfff640 1 -- 172.21.15.22:0/880494418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc144770 msgr2=0x7fb1fc15eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.606+0000 7fb1fbfff640 1 --2- 172.21.15.22:0/880494418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc144770 0x7fb1fc15eb60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0700e0 tx=0x7fb1ec02b9a0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.606+0000 7fb1fbfff640 1 -- 172.21.15.22:0/880494418 shutdown_connections 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.606+0000 7fb1fbfff640 1 --2- 172.21.15.22:0/880494418 >> v2:172.21.15.31:3300/0 conn(0x7fb1fc15f0a0 0x7fb1fc0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.606+0000 7fb1fbfff640 1 --2- 172.21.15.22:0/880494418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc144770 0x7fb1fc15eb60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.606+0000 7fb1fbfff640 1 -- 172.21.15.22:0/880494418 >> 172.21.15.22:0/880494418 conn(0x7fb1fc0cec10 msgr2=0x7fb1fc0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.607+0000 7fb1fbfff640 1 -- 172.21.15.22:0/880494418 shutdown_connections 2023-11-24T06:14:06.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.607+0000 7fb1fbfff640 1 -- 172.21.15.22:0/880494418 wait complete. 2023-11-24T06:14:06.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.608+0000 7fb1fbfff640 1 Processor -- start 2023-11-24T06:14:06.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.609+0000 7fb1fbfff640 1 -- start start 2023-11-24T06:14:06.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc0b35a0 0x7fb1fc0a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1fbfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1fc144770 0x7fb1fc13f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1fbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1fc15f0a0 0x7fb1fc13fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1fbfff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0a9930 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1fbfff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0a9c10 con 0x7fb1fc15f0a0 2023-11-24T06:14:06.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1fbfff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0a9ef0 con 0x7fb1fc144770 2023-11-24T06:14:06.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc0b35a0 0x7fb1fc0a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc0b35a0 0x7fb1fc0a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36966/0 (socket says 172.21.15.22:36966) 2023-11-24T06:14:06.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1faffd640 1 -- 172.21.15.22:0/3539510346 learned_addr learned my addr 172.21.15.22:0/3539510346 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1faffd640 1 -- 172.21.15.22:0/3539510346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1fc144770 msgr2=0x7fb1fc13f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1faffd640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1fc144770 0x7fb1fc13f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1faffd640 1 -- 172.21.15.22:0/3539510346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1fc15f0a0 msgr2=0x7fb1fc13fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1faffd640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1fc15f0a0 0x7fb1fc13fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.610+0000 7fb1faffd640 1 -- 172.21.15.22:0/3539510346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec0094d0 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.611+0000 7fb1faffd640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc0b35a0 0x7fb1fc0a8e70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec000c00 tx=0x7fb1ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.611+0000 7fb1e3fff640 1 -- 172.21.15.22:0/3539510346 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec039e20 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.611+0000 7fb1e3fff640 1 -- 172.21.15.22:0/3539510346 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec043400 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.611+0000 7fb1e3fff640 1 -- 172.21.15.22:0/3539510346 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0437b0 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.611+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc0aa1d0 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.611+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc0712f0 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.612+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc04e840 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.613+0000 7fb1e3fff640 1 -- 172.21.15.22:0/3539510346 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb1ec043910 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.614+0000 7fb1e3fff640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1e806aff0 0x7fb1e806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.614+0000 7fb1e3fff640 1 -- 172.21.15.22:0/3539510346 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb1ec03e070 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.614+0000 7fb1fa7fc640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1e806aff0 0x7fb1e806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.615+0000 7fb1fa7fc640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1e806aff0 0x7fb1e806d4b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000f60 tx=0x7fb1f0007a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.619+0000 7fb1e3fff640 1 -- 172.21.15.22:0/3539510346 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1ec077c90 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.816+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1fc0a9a70 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.817+0000 7fb1e3fff640 1 -- 172.21.15.22:0/3539510346 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1fc0a9a70 con 0x7fb1fc0b35a0 2023-11-24T06:14:06.820 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:14:06.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1e806aff0 msgr2=0x7fb1e806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1e806aff0 0x7fb1e806d4b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000f60 tx=0x7fb1f0007a00 comp rx=0 tx=0).stop 2023-11-24T06:14:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc0b35a0 msgr2=0x7fb1fc0a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc0b35a0 0x7fb1fc0a8e70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec000c00 tx=0x7fb1ec004730 comp rx=0 tx=0).stop 2023-11-24T06:14:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 shutdown_connections 2023-11-24T06:14:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1e806aff0 0x7fb1e806d4b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1fc15f0a0 0x7fb1fc13fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1fc144770 0x7fb1fc13f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 --2- 172.21.15.22:0/3539510346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1fc0b35a0 0x7fb1fc0a8e70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.820+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 >> 172.21.15.22:0/3539510346 conn(0x7fb1fc0cec10 msgr2=0x7fb1fc06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.821+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 shutdown_connections 2023-11-24T06:14:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:06.821+0000 7fb1fbfff640 1 -- 172.21.15.22:0/3539510346 wait complete. 2023-11-24T06:14:06.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-11-24T06:14:07.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.066+0000 7f6311e39640 1 Processor -- start 2023-11-24T06:14:07.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.067+0000 7f6311e39640 1 -- start start 2023-11-24T06:14:07.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.068+0000 7f6311e39640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f630c13dfd0 0x7f630c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.068+0000 7f6311e39640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f630c0cf4d0 0x7f630c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.068+0000 7f6311e39640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c0ce7c0 con 0x7f630c0cf050 2023-11-24T06:14:07.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.068+0000 7f6311e39640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c140900 con 0x7f630c0cf4d0 2023-11-24T06:14:07.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.068+0000 7f6311e39640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c15fa70 con 0x7f630c13dfd0 2023-11-24T06:14:07.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.069+0000 7f6311638640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f630c0cf4d0 0x7f630c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.069+0000 7f630bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f630c0cf050 0x7f630c06c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59710/0 (socket says 172.21.15.22:59710) 2023-11-24T06:14:07.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.069+0000 7f630bfff640 1 -- 172.21.15.22:0/4019148594 learned_addr learned my addr 172.21.15.22:0/4019148594 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:07.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.069+0000 7f6310e37640 1 --2- 172.21.15.22:0/4019148594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f630c13dfd0 0x7f630c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.069+0000 7f6311638640 1 -- 172.21.15.22:0/4019148594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f630c13dfd0 msgr2=0x7f630c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:07.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.069+0000 7f6311638640 1 --2- 172.21.15.22:0/4019148594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f630c13dfd0 0x7f630c15be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.070+0000 7f6311638640 1 -- 172.21.15.22:0/4019148594 >> v1:172.21.15.22:6789/0 conn(0x7f630c0cf050 legacy=0x7f630c06c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.070+0000 7f6311638640 1 -- 172.21.15.22:0/4019148594 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c15ee60 con 0x7f630c0cf4d0 2023-11-24T06:14:07.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.070+0000 7f630b7fe640 1 -- 172.21.15.22:0/4019148594 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325097074 0 0) 0x7f630c0ce7c0 con 0x7f630c0cf050 2023-11-24T06:14:07.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.071+0000 7f6311638640 1 --2- 172.21.15.22:0/4019148594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf4d0 0x7f630c06c840 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6304009d90 tx=0x7f630402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138b4a0fed29ee53 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.071+0000 7f630b7fe640 1 -- 172.21.15.22:0/4019148594 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630402cc50 con 0x7f630c0cf4d0 2023-11-24T06:14:07.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.071+0000 7f630b7fe640 1 -- 172.21.15.22:0/4019148594 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630402cdb0 con 0x7f630c0cf4d0 2023-11-24T06:14:07.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.071+0000 7f630b7fe640 1 -- 172.21.15.22:0/4019148594 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304034660 con 0x7f630c0cf4d0 2023-11-24T06:14:07.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.071+0000 7f6311e39640 1 -- 172.21.15.22:0/4019148594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf4d0 msgr2=0x7f630c06c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.071+0000 7f6311e39640 1 --2- 172.21.15.22:0/4019148594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf4d0 0x7f630c06c840 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6304009d90 tx=0x7f630402bea0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.072+0000 7f6311e39640 1 -- 172.21.15.22:0/4019148594 shutdown_connections 2023-11-24T06:14:07.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.072+0000 7f6311e39640 1 --2- 172.21.15.22:0/4019148594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf4d0 0x7f630c06c840 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.072+0000 7f6311e39640 1 --2- 172.21.15.22:0/4019148594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f630c13dfd0 0x7f630c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.072+0000 7f6311e39640 1 -- 172.21.15.22:0/4019148594 >> 172.21.15.22:0/4019148594 conn(0x7f630c06a860 msgr2=0x7f630c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:07.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.072+0000 7f6311e39640 1 -- 172.21.15.22:0/4019148594 shutdown_connections 2023-11-24T06:14:07.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.072+0000 7f6311e39640 1 -- 172.21.15.22:0/4019148594 wait complete. 2023-11-24T06:14:07.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.073+0000 7f6311e39640 1 Processor -- start 2023-11-24T06:14:07.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.074+0000 7f6311e39640 1 -- start start 2023-11-24T06:14:07.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6311e39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf050 0x7f630c158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6311e39640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f630c0cf4d0 0x7f630c12a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6311e39640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f630c13dfd0 0x7f630c0cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6311e39640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c158ac0 con 0x7f630c0cf050 2023-11-24T06:14:07.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6311e39640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0ca690 con 0x7f630c0cf4d0 2023-11-24T06:14:07.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6311e39640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0c9a80 con 0x7f630c13dfd0 2023-11-24T06:14:07.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6310e37640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf050 0x7f630c158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6310e37640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf050 0x7f630c158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36980/0 (socket says 172.21.15.22:36980) 2023-11-24T06:14:07.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6310e37640 1 -- 172.21.15.22:0/2736414321 learned_addr learned my addr 172.21.15.22:0/2736414321 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6310e37640 1 -- 172.21.15.22:0/2736414321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f630c13dfd0 msgr2=0x7f630c0cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6310e37640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f630c13dfd0 0x7f630c0cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6310e37640 1 -- 172.21.15.22:0/2736414321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f630c0cf4d0 msgr2=0x7f630c12a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f630bfff640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f630c0cf4d0 0x7f630c12a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6310e37640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f630c0cf4d0 0x7f630c12a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f6310e37640 1 -- 172.21.15.22:0/2736414321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304009a70 con 0x7f630c0cf050 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.075+0000 7f630bfff640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f630c0cf4d0 0x7f630c12a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.076+0000 7f6310e37640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf050 0x7f630c158580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f630000d5f0 tx=0x7f630000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.076+0000 7f63097fa640 1 -- 172.21.15.22:0/2736414321 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000125f0 con 0x7f630c0cf050 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.076+0000 7f63097fa640 1 -- 172.21.15.22:0/2736414321 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300012750 con 0x7f630c0cf050 2023-11-24T06:14:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.076+0000 7f63097fa640 1 -- 172.21.15.22:0/2736414321 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300012b00 con 0x7f630c0cf050 2023-11-24T06:14:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.076+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c0c9d60 con 0x7f630c0cf050 2023-11-24T06:14:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.076+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c0ca320 con 0x7f630c0cf050 2023-11-24T06:14:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.078+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c04e840 con 0x7f630c0cf050 2023-11-24T06:14:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.078+0000 7f63097fa640 1 -- 172.21.15.22:0/2736414321 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6300012c60 con 0x7f630c0cf050 2023-11-24T06:14:07.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.079+0000 7f63097fa640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f62f006aff0 0x7f62f006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.079+0000 7f63097fa640 1 -- 172.21.15.22:0/2736414321 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6300089b00 con 0x7f630c0cf050 2023-11-24T06:14:07.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.080+0000 7f630bfff640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f62f006aff0 0x7f62f006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.080+0000 7f630bfff640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f62f006aff0 0x7f62f006d4b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f630c0cc250 tx=0x7f62f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.084+0000 7f63097fa640 1 -- 172.21.15.22:0/2736414321 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6300054c30 con 0x7f630c0cf050 2023-11-24T06:14:07.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.348+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f630c071a60 con 0x7f630c0cf050 2023-11-24T06:14:07.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.919+0000 7f63097fa640 1 -- 172.21.15.22:0/2736414321 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v143) v1 ==== 143+0+0 (secure 0 0 0) 0x7f6300058250 con 0x7f630c0cf050 2023-11-24T06:14:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f62f006aff0 msgr2=0x7f62f006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f62f006aff0 0x7f62f006d4b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f630c0cc250 tx=0x7f62f8009040 comp rx=0 tx=0).stop 2023-11-24T06:14:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf050 msgr2=0x7f630c158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf050 0x7f630c158580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f630000d5f0 tx=0x7f630000dab0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 shutdown_connections 2023-11-24T06:14:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f62f006aff0 0x7f62f006d4b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f630c13dfd0 0x7f630c0cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f630c0cf4d0 0x7f630c12a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 --2- 172.21.15.22:0/2736414321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f630c0cf050 0x7f630c158580 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.922+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 >> 172.21.15.22:0/2736414321 conn(0x7f630c06a860 msgr2=0x7f630c13e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.923+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 shutdown_connections 2023-11-24T06:14:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:07.923+0000 7f6311e39640 1 -- 172.21.15.22:0/2736414321 wait complete. 2023-11-24T06:14:07.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:14:08.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.165+0000 7f84b359e640 1 Processor -- start 2023-11-24T06:14:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.166+0000 7f84b359e640 1 -- start start 2023-11-24T06:14:08.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.167+0000 7f84b359e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f84b40d1d90 0x7f84b40d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.167+0000 7f84b359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f84b40cdbb0 0x7f84b40b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.167+0000 7f84b359e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b40cef30 con 0x7f84b415d340 2023-11-24T06:14:08.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.167+0000 7f84b359e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b40d11a0 con 0x7f84b40d1d90 2023-11-24T06:14:08.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.167+0000 7f84b359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b40ce320 con 0x7f84b40cdbb0 2023-11-24T06:14:08.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84b259c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f84b415d340 0x7f84b40d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59718/0 (socket says 172.21.15.22:59718) 2023-11-24T06:14:08.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84b259c640 1 -- 172.21.15.22:0/4114878962 learned_addr learned my addr 172.21.15.22:0/4114878962 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:08.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84abfff640 1 --2- 172.21.15.22:0/4114878962 >> v2:172.21.15.22:3300/0 conn(0x7f84b40d1d90 0x7f84b40d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84b1d9b640 1 -- 172.21.15.22:0/4114878962 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255218 0 0) 0x7f84b40cef30 con 0x7f84b415d340 2023-11-24T06:14:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84b1d9b640 1 -- 172.21.15.22:0/4114878962 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a0003520 con 0x7f84b415d340 2023-11-24T06:14:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84b2d9d640 1 --2- 172.21.15.22:0/4114878962 >> v2:172.21.15.31:3300/0 conn(0x7f84b40cdbb0 0x7f84b40b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84abfff640 1 -- 172.21.15.22:0/4114878962 >> v2:172.21.15.31:3300/0 conn(0x7f84b40cdbb0 msgr2=0x7f84b40b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:08.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84abfff640 1 --2- 172.21.15.22:0/4114878962 >> v2:172.21.15.31:3300/0 conn(0x7f84b40cdbb0 0x7f84b40b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84abfff640 1 -- 172.21.15.22:0/4114878962 >> v1:172.21.15.22:6789/0 conn(0x7f84b415d340 legacy=0x7f84b40d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84abfff640 1 -- 172.21.15.22:0/4114878962 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b40ce600 con 0x7f84b40d1d90 2023-11-24T06:14:08.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.168+0000 7f84b2d9d640 1 --2- 172.21.15.22:0/4114878962 >> v2:172.21.15.31:3300/0 conn(0x7f84b40cdbb0 0x7f84b40b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:08.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.170+0000 7f84abfff640 1 --2- 172.21.15.22:0/4114878962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 0x7f84b40d00b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f84b40b9120 tx=0x7f849c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5542e75b61bc1101 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.170+0000 7f84b1d9b640 1 -- 172.21.15.22:0/4114878962 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c031830 con 0x7f84b40d1d90 2023-11-24T06:14:08.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.170+0000 7f84b1d9b640 1 -- 172.21.15.22:0/4114878962 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c031990 con 0x7f84b40d1d90 2023-11-24T06:14:08.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.170+0000 7f84b1d9b640 1 -- 172.21.15.22:0/4114878962 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c031d00 con 0x7f84b40d1d90 2023-11-24T06:14:08.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.171+0000 7f84b359e640 1 -- 172.21.15.22:0/4114878962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 msgr2=0x7f84b40d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.171+0000 7f84b359e640 1 --2- 172.21.15.22:0/4114878962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 0x7f84b40d00b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f84b40b9120 tx=0x7f849c02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.171+0000 7f84b359e640 1 -- 172.21.15.22:0/4114878962 shutdown_connections 2023-11-24T06:14:08.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.171+0000 7f84b359e640 1 --2- 172.21.15.22:0/4114878962 >> v2:172.21.15.31:3300/0 conn(0x7f84b40cdbb0 0x7f84b40b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.171+0000 7f84b359e640 1 --2- 172.21.15.22:0/4114878962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 0x7f84b40d00b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.171+0000 7f84b359e640 1 -- 172.21.15.22:0/4114878962 >> 172.21.15.22:0/4114878962 conn(0x7f84b409c370 msgr2=0x7f84b40d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:08.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.171+0000 7f84b359e640 1 -- 172.21.15.22:0/4114878962 shutdown_connections 2023-11-24T06:14:08.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.171+0000 7f84b359e640 1 -- 172.21.15.22:0/4114878962 wait complete. 2023-11-24T06:14:08.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.173+0000 7f84b359e640 1 Processor -- start 2023-11-24T06:14:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.173+0000 7f84b359e640 1 -- start start 2023-11-24T06:14:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84b359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84b40cdbb0 0x7f84b4159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84b359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 0x7f84b40c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84b359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84b415d340 0x7f84b40c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84b359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b3e30 con 0x7f84b40d1d90 2023-11-24T06:14:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84b359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4159b50 con 0x7f84b415d340 2023-11-24T06:14:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84b359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b3ab0 con 0x7f84b40cdbb0 2023-11-24T06:14:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84abfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 0x7f84b40c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84abfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 0x7f84b40c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37000/0 (socket says 172.21.15.22:37000) 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84abfff640 1 -- 172.21.15.22:0/3734743573 learned_addr learned my addr 172.21.15.22:0/3734743573 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84b259c640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84b40cdbb0 0x7f84b4159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84abfff640 1 -- 172.21.15.22:0/3734743573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84b40cdbb0 msgr2=0x7f84b4159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84abfff640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84b40cdbb0 0x7f84b4159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.174+0000 7f84abfff640 1 -- 172.21.15.22:0/3734743573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84b415d340 msgr2=0x7f84b40c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.175+0000 7f84abfff640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84b415d340 0x7f84b40c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.175+0000 7f84abfff640 1 -- 172.21.15.22:0/3734743573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c009400 con 0x7f84b40d1d90 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.175+0000 7f84abfff640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 0x7f84b40c72c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f849c009890 tx=0x7f849c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.175+0000 7f84aaffd640 1 -- 172.21.15.22:0/3734743573 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c03a630 con 0x7f84b40d1d90 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.175+0000 7f84aaffd640 1 -- 172.21.15.22:0/3734743573 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c03a7b0 con 0x7f84b40d1d90 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.175+0000 7f84aaffd640 1 -- 172.21.15.22:0/3734743573 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c03ab60 con 0x7f84b40d1d90 2023-11-24T06:14:08.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.175+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b40b3480 con 0x7f84b40d1d90 2023-11-24T06:14:08.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.175+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b415ffb0 con 0x7f84b40d1d90 2023-11-24T06:14:08.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.176+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b40b3f70 con 0x7f84b40d1d90 2023-11-24T06:14:08.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.178+0000 7f84aaffd640 1 -- 172.21.15.22:0/3734743573 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f849c03acc0 con 0x7f84b40d1d90 2023-11-24T06:14:08.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.178+0000 7f84aaffd640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f849406b020 0x7f849406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.179+0000 7f84aaffd640 1 -- 172.21.15.22:0/3734743573 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f849c0ab480 con 0x7f84b40d1d90 2023-11-24T06:14:08.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.179+0000 7f84b259c640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f849406b020 0x7f849406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.179+0000 7f84b259c640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f849406b020 0x7f849406d4e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000f60 tx=0x7f84a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.183+0000 7f84aaffd640 1 -- 172.21.15.22:0/3734743573 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f84b40b3f70 con 0x7f84b40d1d90 2023-11-24T06:14:08.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.378+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f84b40b3f70 con 0x7f84b40d1d90 2023-11-24T06:14:08.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.383+0000 7f84aaffd640 1 -- 172.21.15.22:0/3734743573 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84b40b3f70 con 0x7f84b40d1d90 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f849406b020 msgr2=0x7f849406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f849406b020 0x7f849406d4e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000f60 tx=0x7f84a4009040 comp rx=0 tx=0).stop 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 msgr2=0x7f84b40c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 0x7f84b40c72c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f849c009890 tx=0x7f849c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 shutdown_connections 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f849406b020 0x7f849406d4e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84b415d340 0x7f84b40c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84b40d1d90 0x7f84b40c72c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 --2- 172.21.15.22:0/3734743573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84b40cdbb0 0x7f84b4159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 >> 172.21.15.22:0/3734743573 conn(0x7f84b409c370 msgr2=0x7f84b406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:08.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 shutdown_connections 2023-11-24T06:14:08.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:08.386+0000 7f84b359e640 1 -- 172.21.15.22:0/3734743573 wait complete. 2023-11-24T06:14:08.409 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:14:08.410 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:14:08.531 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:14:08.661 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:14:08.661 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:14:08.661 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:08.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:14:08.724 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:14:08.724 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:08.787 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:14:08.788 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:14:08.788 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:08.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:14:08.852 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:14:08.852 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:08.915 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:14:08.915 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:14:08.915 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:09.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.143+0000 7f1e69f48640 1 Processor -- start 2023-11-24T06:14:09.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.143+0000 7f1e69f48640 1 -- start start 2023-11-24T06:14:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.145+0000 7f1e69f48640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1e6406d520 0x7f1e6406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.145+0000 7f1e69f48640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640ad720 0x7f1e6415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.145+0000 7f1e69f48640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6415c360 con 0x7f1e640abff0 2023-11-24T06:14:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.145+0000 7f1e69f48640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e640b41a0 con 0x7f1e6406d520 2023-11-24T06:14:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.145+0000 7f1e69f48640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6406de40 con 0x7f1e640ad720 2023-11-24T06:14:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.145+0000 7f1e637fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1e6406d520 0x7f1e6406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.145+0000 7f1e63fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1e640abff0 0x7f1e6415f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59720/0 (socket says 172.21.15.22:59720) 2023-11-24T06:14:09.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.145+0000 7f1e63fff640 1 -- 172.21.15.22:0/934967009 learned_addr learned my addr 172.21.15.22:0/934967009 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:09.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.146+0000 7f1e62ffd640 1 --2- 172.21.15.22:0/934967009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640ad720 0x7f1e6415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.146+0000 7f1e637fe640 1 -- 172.21.15.22:0/934967009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640ad720 msgr2=0x7f1e6415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:09.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.146+0000 7f1e637fe640 1 --2- 172.21.15.22:0/934967009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640ad720 0x7f1e6415ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.146+0000 7f1e637fe640 1 -- 172.21.15.22:0/934967009 >> v1:172.21.15.22:6789/0 conn(0x7f1e640abff0 legacy=0x7f1e6415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.146+0000 7f1e637fe640 1 -- 172.21.15.22:0/934967009 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6415ba30 con 0x7f1e6406d520 2023-11-24T06:14:09.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.147+0000 7f1e637fe640 1 --2- 172.21.15.22:0/934967009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6406d520 0x7f1e6406d900 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1e540097a0 tx=0x7f1e5402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8e130272ce877d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.148+0000 7f1e627fc640 1 -- 172.21.15.22:0/934967009 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5402d040 con 0x7f1e6406d520 2023-11-24T06:14:09.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.148+0000 7f1e627fc640 1 -- 172.21.15.22:0/934967009 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e54031810 con 0x7f1e6406d520 2023-11-24T06:14:09.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.148+0000 7f1e627fc640 1 -- 172.21.15.22:0/934967009 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54031ba0 con 0x7f1e6406d520 2023-11-24T06:14:09.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.148+0000 7f1e69f48640 1 -- 172.21.15.22:0/934967009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6406d520 msgr2=0x7f1e6406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.148+0000 7f1e69f48640 1 --2- 172.21.15.22:0/934967009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6406d520 0x7f1e6406d900 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1e540097a0 tx=0x7f1e5402b8b0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.149+0000 7f1e69f48640 1 -- 172.21.15.22:0/934967009 shutdown_connections 2023-11-24T06:14:09.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.149+0000 7f1e69f48640 1 --2- 172.21.15.22:0/934967009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640ad720 0x7f1e6415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.149+0000 7f1e69f48640 1 --2- 172.21.15.22:0/934967009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6406d520 0x7f1e6406d900 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.149+0000 7f1e69f48640 1 -- 172.21.15.22:0/934967009 >> 172.21.15.22:0/934967009 conn(0x7f1e640b0d80 msgr2=0x7f1e640b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:09.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.149+0000 7f1e69f48640 1 -- 172.21.15.22:0/934967009 shutdown_connections 2023-11-24T06:14:09.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.149+0000 7f1e69f48640 1 -- 172.21.15.22:0/934967009 wait complete. 2023-11-24T06:14:09.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.150+0000 7f1e69f48640 1 Processor -- start 2023-11-24T06:14:09.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.151+0000 7f1e69f48640 1 -- start start 2023-11-24T06:14:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e69f48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e6406d520 0x7f1e640cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e69f48640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640abff0 0x7f1e640c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e69f48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e640ad720 0x7f1e6414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e69f48640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6414c8d0 con 0x7f1e640ad720 2023-11-24T06:14:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e69f48640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640c9480 con 0x7f1e6406d520 2023-11-24T06:14:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e69f48640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640c8870 con 0x7f1e640abff0 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e640ad720 0x7f1e6414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e640ad720 0x7f1e6414c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37018/0 (socket says 172.21.15.22:37018) 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e63fff640 1 -- 172.21.15.22:0/2741743130 learned_addr learned my addr 172.21.15.22:0/2741743130 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e62ffd640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640abff0 0x7f1e640c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e637fe640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e6406d520 0x7f1e640cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.152+0000 7f1e63fff640 1 -- 172.21.15.22:0/2741743130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640abff0 msgr2=0x7f1e640c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e63fff640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640abff0 0x7f1e640c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e63fff640 1 -- 172.21.15.22:0/2741743130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e6406d520 msgr2=0x7f1e640cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e63fff640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e6406d520 0x7f1e640cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e63fff640 1 -- 172.21.15.22:0/2741743130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e54009400 con 0x7f1e640ad720 2023-11-24T06:14:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e637fe640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e6406d520 0x7f1e640cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e63fff640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e640ad720 0x7f1e6414c390 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00caf0 tx=0x7f1e5c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e4bfff640 1 -- 172.21.15.22:0/2741743130 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00aca0 con 0x7f1e640ad720 2023-11-24T06:14:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e4bfff640 1 -- 172.21.15.22:0/2741743130 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c00ae00 con 0x7f1e640ad720 2023-11-24T06:14:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e4bfff640 1 -- 172.21.15.22:0/2741743130 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c012600 con 0x7f1e640ad720 2023-11-24T06:14:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e640c8b50 con 0x7f1e640ad720 2023-11-24T06:14:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.153+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e640c9110 con 0x7f1e640ad720 2023-11-24T06:14:09.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.155+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e64074770 con 0x7f1e640ad720 2023-11-24T06:14:09.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.156+0000 7f1e4bfff640 1 -- 172.21.15.22:0/2741743130 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1e5c007070 con 0x7f1e640ad720 2023-11-24T06:14:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.156+0000 7f1e4bfff640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e5006aff0 0x7f1e5006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.157+0000 7f1e4bfff640 1 -- 172.21.15.22:0/2741743130 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1e5c089470 con 0x7f1e640ad720 2023-11-24T06:14:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.157+0000 7f1e637fe640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e5006aff0 0x7f1e5006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.157+0000 7f1e637fe640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e5006aff0 0x7f1e5006d4b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1e54036000 tx=0x7f1e5403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.161+0000 7f1e4bfff640 1 -- 172.21.15.22:0/2741743130 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e5c054650 con 0x7f1e640ad720 2023-11-24T06:14:09.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.394+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e640c95c0 con 0x7f1e640ad720 2023-11-24T06:14:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.395+0000 7f1e4bfff640 1 -- 172.21.15.22:0/2741743130 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f1e5c017090 con 0x7f1e640ad720 2023-11-24T06:14:09.398 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:09.398 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3821411702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3821411702},{"type":"v1","addr":"172.21.15.31:6835","nonce":3821411702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3025908035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3025908035},{"type":"v1","addr":"172.21.15.31:6833","nonce":3025908035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/475244267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":475244267},{"type":"v1","addr":"172.21.15.22:6835","nonce":475244267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2346144260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2346144260},{"type":"v1","addr":"172.21.15.22:6837","nonce":2346144260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-11-24T06:14:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 18 2023-11-24T06:14:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e5006aff0 msgr2=0x7f1e5006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e5006aff0 0x7f1e5006d4b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1e54036000 tx=0x7f1e5403c040 comp rx=0 tx=0).stop 2023-11-24T06:14:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e640ad720 msgr2=0x7f1e6414c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e640ad720 0x7f1e6414c390 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00caf0 tx=0x7f1e5c00a060 comp rx=0 tx=0).stop 2023-11-24T06:14:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 shutdown_connections 2023-11-24T06:14:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e5006aff0 0x7f1e5006d4b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e640ad720 0x7f1e6414c390 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e640abff0 0x7f1e640c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 --2- 172.21.15.22:0/2741743130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e6406d520 0x7f1e640cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 >> 172.21.15.22:0/2741743130 conn(0x7f1e640b0d80 msgr2=0x7f1e640afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:09.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 shutdown_connections 2023-11-24T06:14:09.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.398+0000 7f1e69f48640 1 -- 172.21.15.22:0/2741743130 wait complete. 2023-11-24T06:14:09.420 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:14:09.420 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:14:09.420 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:14:09.420 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:09.421 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:14:09.421 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:14:09.421 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:14:09.421 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:09.421 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:14:09.421 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:14:09.422 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:14:09.422 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:09.422 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:14:09.422 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:14:09.422 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:14:09.422 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:09.439 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:14:09.439 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:14:09.440 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:14:09.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:14:09.445 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:14:09.445 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:14:09.449 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:14:09.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:14:09.487 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:14:09.488 DEBUG:teuthology.parallel:result is None 2023-11-24T06:14:09.494 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:14:09.494 DEBUG:teuthology.parallel:result is None 2023-11-24T06:14:09.498 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:14:09.498 DEBUG:teuthology.parallel:result is None 2023-11-24T06:14:09.506 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:14:09.506 DEBUG:teuthology.parallel:result is None 2023-11-24T06:14:09.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:14:09.656 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-11-24T06:14:09.656 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-11-24T06:14:09.671 INFO:tasks.ceph.mds.d.smithi031.stdout:starting mds.d at 2023-11-24T06:14:09.672 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2023-11-24T06:14:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.696+0000 7fec1e63d640 1 Processor -- start 2023-11-24T06:14:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.696+0000 7fec1e63d640 1 -- start start 2023-11-24T06:14:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec1e63d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec1806d520 0x7fec1806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec1e63d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec180acb50 0x7fec180719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec1e63d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec18070dc0 con 0x7fec18165430 2023-11-24T06:14:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec1e63d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec18161d00 con 0x7fec1806d520 2023-11-24T06:14:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec1e63d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1806de40 con 0x7fec180acb50 2023-11-24T06:14:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec17fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec1806d520 0x7fec1806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec17fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec1806d520 0x7fec1806d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37050/0 (socket says 172.21.15.22:37050) 2023-11-24T06:14:09.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec17fff640 1 -- 172.21.15.22:0/3496350568 learned_addr learned my addr 172.21.15.22:0/3496350568 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:09.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec1cbda640 1 --1- 172.21.15.22:0/3496350568 >> v1:172.21.15.22:6789/0 conn(0x7fec18165430 0x7fec181658e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59740/0 (socket says 172.21.15.22:59740) 2023-11-24T06:14:09.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec0ffff640 1 --2- 172.21.15.22:0/3496350568 >> v2:172.21.15.31:3300/0 conn(0x7fec180acb50 0x7fec180719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec17fff640 1 -- 172.21.15.22:0/3496350568 >> v2:172.21.15.31:3300/0 conn(0x7fec180acb50 msgr2=0x7fec180719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:09.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec17fff640 1 --2- 172.21.15.22:0/3496350568 >> v2:172.21.15.31:3300/0 conn(0x7fec180acb50 0x7fec180719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec17fff640 1 -- 172.21.15.22:0/3496350568 >> v1:172.21.15.22:6789/0 conn(0x7fec18165430 legacy=0x7fec181658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.698+0000 7fec17fff640 1 -- 172.21.15.22:0/3496350568 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180cedb0 con 0x7fec1806d520 2023-11-24T06:14:09.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.700+0000 7fec17fff640 1 --2- 172.21.15.22:0/3496350568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1806d520 0x7fec1806d900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fec1806bdb0 tx=0x7fec0802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a37f40616390a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.700+0000 7fec177fe640 1 -- 172.21.15.22:0/3496350568 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08030870 con 0x7fec1806d520 2023-11-24T06:14:09.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.700+0000 7fec177fe640 1 -- 172.21.15.22:0/3496350568 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec080309d0 con 0x7fec1806d520 2023-11-24T06:14:09.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.700+0000 7fec177fe640 1 -- 172.21.15.22:0/3496350568 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08030d60 con 0x7fec1806d520 2023-11-24T06:14:09.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.700+0000 7fec1e63d640 1 -- 172.21.15.22:0/3496350568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1806d520 msgr2=0x7fec1806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.700+0000 7fec1e63d640 1 --2- 172.21.15.22:0/3496350568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1806d520 0x7fec1806d900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fec1806bdb0 tx=0x7fec0802b9b0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.701+0000 7fec1e63d640 1 -- 172.21.15.22:0/3496350568 shutdown_connections 2023-11-24T06:14:09.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.701+0000 7fec1e63d640 1 --2- 172.21.15.22:0/3496350568 >> v2:172.21.15.31:3300/0 conn(0x7fec180acb50 0x7fec180719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.701+0000 7fec1e63d640 1 --2- 172.21.15.22:0/3496350568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1806d520 0x7fec1806d900 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.701+0000 7fec1e63d640 1 -- 172.21.15.22:0/3496350568 >> 172.21.15.22:0/3496350568 conn(0x7fec180b0d80 msgr2=0x7fec180b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:09.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.701+0000 7fec1e63d640 1 -- 172.21.15.22:0/3496350568 shutdown_connections 2023-11-24T06:14:09.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.701+0000 7fec1e63d640 1 -- 172.21.15.22:0/3496350568 wait complete. 2023-11-24T06:14:09.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.702+0000 7fec1e63d640 1 Processor -- start 2023-11-24T06:14:09.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.703+0000 7fec1e63d640 1 -- start start 2023-11-24T06:14:09.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.703+0000 7fec1e63d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec1806d520 0x7fec181462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.703+0000 7fec1e63d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec180acb50 0x7fec180afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.703+0000 7fec1e63d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec18165430 0x7fec180b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.703+0000 7fec1e63d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18152f10 con 0x7fec180acb50 2023-11-24T06:14:09.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.703+0000 7fec1e63d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec181467e0 con 0x7fec18165430 2023-11-24T06:14:09.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec1e63d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec18153140 con 0x7fec1806d520 2023-11-24T06:14:09.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec0ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec180acb50 0x7fec180afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec0ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec180acb50 0x7fec180afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37056/0 (socket says 172.21.15.22:37056) 2023-11-24T06:14:09.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec0ffff640 1 -- 172.21.15.22:0/1851029802 learned_addr learned my addr 172.21.15.22:0/1851029802 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:09.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec1cbda640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec18165430 0x7fec180b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec17fff640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec1806d520 0x7fec181462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec0ffff640 1 -- 172.21.15.22:0/1851029802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec1806d520 msgr2=0x7fec181462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec0ffff640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec1806d520 0x7fec181462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec0ffff640 1 -- 172.21.15.22:0/1851029802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec18165430 msgr2=0x7fec180b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec0ffff640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec18165430 0x7fec180b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.704+0000 7fec0ffff640 1 -- 172.21.15.22:0/1851029802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec080094d0 con 0x7fec180acb50 2023-11-24T06:14:09.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.705+0000 7fec0ffff640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec180acb50 0x7fec180afd40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fec0000d800 tx=0x7fec0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.705+0000 7fec157fa640 1 -- 172.21.15.22:0/1851029802 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000b6c0 con 0x7fec180acb50 2023-11-24T06:14:09.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.705+0000 7fec157fa640 1 -- 172.21.15.22:0/1851029802 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000b820 con 0x7fec180acb50 2023-11-24T06:14:09.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.705+0000 7fec157fa640 1 -- 172.21.15.22:0/1851029802 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000bbb0 con 0x7fec180acb50 2023-11-24T06:14:09.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.705+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec18153420 con 0x7fec180acb50 2023-11-24T06:14:09.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.705+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec181539e0 con 0x7fec180acb50 2023-11-24T06:14:09.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.706+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec18074770 con 0x7fec180acb50 2023-11-24T06:14:09.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.708+0000 7fec157fa640 1 -- 172.21.15.22:0/1851029802 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fec0000bd10 con 0x7fec180acb50 2023-11-24T06:14:09.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.708+0000 7fec157fa640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7febf806b040 0x7febf806d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.709+0000 7fec157fa640 1 -- 172.21.15.22:0/1851029802 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fec0008a5a0 con 0x7fec180acb50 2023-11-24T06:14:09.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.709+0000 7fec17fff640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7febf806b040 0x7febf806d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.710+0000 7fec17fff640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7febf806b040 0x7febf806d500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec08036000 tx=0x7fec08008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.712+0000 7fec157fa640 1 -- 172.21.15.22:0/1851029802 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec00055760 con 0x7fec180acb50 2023-11-24T06:14:09.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:09.921+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fec1806e320 con 0x7fec180acb50 2023-11-24T06:14:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.410+0000 7fec157fa640 1 -- 172.21.15.22:0/1851029802 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7fec00058d80 con 0x7fec180acb50 2023-11-24T06:14:10.413 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-11-24T06:14:10.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.414+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7febf806b040 msgr2=0x7febf806d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.414+0000 7fec1e63d640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7febf806b040 0x7febf806d500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec08036000 tx=0x7fec08008030 comp rx=0 tx=0).stop 2023-11-24T06:14:10.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.414+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec180acb50 msgr2=0x7fec180afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.414+0000 7fec1e63d640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec180acb50 0x7fec180afd40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fec0000d800 tx=0x7fec0000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.414+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 shutdown_connections 2023-11-24T06:14:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.415+0000 7fec1e63d640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7febf806b040 0x7febf806d500 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.415+0000 7fec1e63d640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec18165430 0x7fec180b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.415+0000 7fec1e63d640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec180acb50 0x7fec180afd40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.415+0000 7fec1e63d640 1 --2- 172.21.15.22:0/1851029802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec1806d520 0x7fec181462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.415+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 >> 172.21.15.22:0/1851029802 conn(0x7fec180b0d80 msgr2=0x7fec18160660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.415+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 shutdown_connections 2023-11-24T06:14:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.415+0000 7fec1e63d640 1 -- 172.21.15.22:0/1851029802 wait complete. 2023-11-24T06:14:10.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:14:10.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.655+0000 7fedec8bb640 1 Processor -- start 2023-11-24T06:14:10.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.656+0000 7fedec8bb640 1 -- start start 2023-11-24T06:14:10.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.657+0000 7fedec8bb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fede80d3810 0x7fede80cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.657+0000 7fedec8bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede80d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.657+0000 7fedec8bb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede80d2020 con 0x7fede815d430 2023-11-24T06:14:10.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.657+0000 7fedec8bb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede80d09d0 con 0x7fede80d3810 2023-11-24T06:14:10.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.657+0000 7fedec8bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede80d3ca0 con 0x7fede80d1690 2023-11-24T06:14:10.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.658+0000 7fede7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede80d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.658+0000 7fede7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede80d1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:53920/0 (socket says 172.21.15.22:53920) 2023-11-24T06:14:10.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.658+0000 7fede7fff640 1 -- 172.21.15.22:0/234389177 learned_addr learned my addr 172.21.15.22:0/234389177 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:10.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.658+0000 7feddffff640 1 --2- 172.21.15.22:0/234389177 >> v2:172.21.15.31:3300/0 conn(0x7fede80d3810 0x7fede80cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.659+0000 7fede7fff640 1 -- 172.21.15.22:0/234389177 >> v2:172.21.15.31:3300/0 conn(0x7fede80d3810 msgr2=0x7fede80cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:10.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.659+0000 7fede7fff640 1 --2- 172.21.15.22:0/234389177 >> v2:172.21.15.31:3300/0 conn(0x7fede80d3810 0x7fede80cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.659+0000 7fede7fff640 1 -- 172.21.15.22:0/234389177 >> v1:172.21.15.31:6789/0 conn(0x7fede815d430 legacy=0x7fede81615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.659+0000 7fede7fff640 1 -- 172.21.15.22:0/234389177 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede815d810 con 0x7fede80d1690 2023-11-24T06:14:10.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.660+0000 7fede7fff640 1 --2- 172.21.15.22:0/234389177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede80d1ae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fede0009e50 tx=0x7fede002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=117503beecbe25c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:10.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.661+0000 7fede6ffd640 1 -- 172.21.15.22:0/234389177 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede002cb00 con 0x7fede80d1690 2023-11-24T06:14:10.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.661+0000 7fede6ffd640 1 -- 172.21.15.22:0/234389177 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede002cc60 con 0x7fede80d1690 2023-11-24T06:14:10.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.661+0000 7fede6ffd640 1 -- 172.21.15.22:0/234389177 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede00343f0 con 0x7fede80d1690 2023-11-24T06:14:10.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.662+0000 7fedec8bb640 1 -- 172.21.15.22:0/234389177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 msgr2=0x7fede80d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.662+0000 7fedec8bb640 1 --2- 172.21.15.22:0/234389177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede80d1ae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fede0009e50 tx=0x7fede002bf60 comp rx=0 tx=0).stop 2023-11-24T06:14:10.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.662+0000 7fedec8bb640 1 -- 172.21.15.22:0/234389177 shutdown_connections 2023-11-24T06:14:10.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.662+0000 7fedec8bb640 1 --2- 172.21.15.22:0/234389177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede80d1ae0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.662+0000 7fedec8bb640 1 --2- 172.21.15.22:0/234389177 >> v2:172.21.15.31:3300/0 conn(0x7fede80d3810 0x7fede80cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.662+0000 7fedec8bb640 1 -- 172.21.15.22:0/234389177 >> 172.21.15.22:0/234389177 conn(0x7fede808cb00 msgr2=0x7fede809c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:10.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.662+0000 7fedec8bb640 1 -- 172.21.15.22:0/234389177 shutdown_connections 2023-11-24T06:14:10.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.662+0000 7fedec8bb640 1 -- 172.21.15.22:0/234389177 wait complete. 2023-11-24T06:14:10.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.664+0000 7fedec8bb640 1 Processor -- start 2023-11-24T06:14:10.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.664+0000 7fedec8bb640 1 -- start start 2023-11-24T06:14:10.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fedec8bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fedec8bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fede80d3810 0x7fede81e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fedec8bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fede815d430 0x7fede80c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fedec8bb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede81483c0 con 0x7fede815d430 2023-11-24T06:14:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fedec8bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede81e6ea0 con 0x7fede80d3810 2023-11-24T06:14:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fedec8bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede81e6300 con 0x7fede80d1690 2023-11-24T06:14:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fede7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fede815d430 0x7fede80c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fede7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fede815d430 0x7fede80c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37072/0 (socket says 172.21.15.22:37072) 2023-11-24T06:14:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fede7fff640 1 -- 172.21.15.22:0/1778303431 learned_addr learned my addr 172.21.15.22:0/1778303431 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:10.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7fede77fe640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.666+0000 7feddffff640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fede80d3810 0x7fede81e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fede7fff640 1 -- 172.21.15.22:0/1778303431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 msgr2=0x7fede815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fede7fff640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fede7fff640 1 -- 172.21.15.22:0/1778303431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fede80d3810 msgr2=0x7fede81e7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fede7fff640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fede80d3810 0x7fede81e7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fede7fff640 1 -- 172.21.15.22:0/1778303431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0009b30 con 0x7fede815d430 2023-11-24T06:14:10.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fede7fff640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fede815d430 0x7fede80c6be0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fede0036040 tx=0x7fede0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:10.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fede4ff9640 1 -- 172.21.15.22:0/1778303431 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0040470 con 0x7fede815d430 2023-11-24T06:14:10.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fede4ff9640 1 -- 172.21.15.22:0/1778303431 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede00405d0 con 0x7fede815d430 2023-11-24T06:14:10.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fede4ff9640 1 -- 172.21.15.22:0/1778303431 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0040980 con 0x7fede815d430 2023-11-24T06:14:10.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.667+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede81e6570 con 0x7fede815d430 2023-11-24T06:14:10.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.668+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede81e6b30 con 0x7fede815d430 2023-11-24T06:14:10.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.669+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede8067960 con 0x7fede815d430 2023-11-24T06:14:10.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.670+0000 7fede4ff9640 1 -- 172.21.15.22:0/1778303431 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fede0040ae0 con 0x7fede815d430 2023-11-24T06:14:10.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.671+0000 7fede4ff9640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fedc806aff0 0x7fedc806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.671+0000 7fede4ff9640 1 -- 172.21.15.22:0/1778303431 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fede00ac410 con 0x7fede815d430 2023-11-24T06:14:10.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.671+0000 7fede77fe640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fedc806aff0 0x7fedc806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.672+0000 7fede77fe640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fedc806aff0 0x7fedc806d4b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fedd8000f60 tx=0x7fedd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:10.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.675+0000 7fede4ff9640 1 -- 172.21.15.22:0/1778303431 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fede0077610 con 0x7fede815d430 2023-11-24T06:14:10.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.936+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fede8155540 con 0x7fede815d430 2023-11-24T06:14:10.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.937+0000 7fede4ff9640 1 -- 172.21.15.22:0/1778303431 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fede007ac30 con 0x7fede815d430 2023-11-24T06:14:10.939 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBlC0/KHRAAP3OMqK3lsC21mJ3yyEa2uQ==", 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBl1X/aBhAAY61uwiv5vBaTPkDByOLPmw==", 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBlfblGMBAAjEBBQvn4tcLAx4BB3IjQrw==", 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:14:10.941 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBlxcDDGBAAMX5i2Zfh+M5ZvjS1gKUVwA==", 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.942 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQByPmBl1c3MDBAAG4T9x4tKBMvnezzPu4t21g==", 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-11-24T06:14:10.943 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB1PmBlnqt2JxAASc03pLw8zZ4XPH46+FtW3Q==", 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB5PmBld+YeBhAA8jBhyD2sGPOXouNHKK4mUQ==", 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB8PmBlx3blDxAAuB/aw9Wmh3rIxKpm7HK73A==", 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCDPmBlows5IRAAcEuvr47gyOcmFYg2HRRakw==", 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCHPmBlYK2jABAAJ093DHd2vAmF07tYS/qHzA==", 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCKPmBlYV2SGxAAArDvmB2DRwHwVy+cOu3JNw==", 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCNPmBlyZsANhAAKCXDIC1kjqyk42AJqK93/g==", 2023-11-24T06:14:10.947 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBlp6jYJxAA527jQJV49tBf9Am4wak0NA==", 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBwPmBlGvWoBBAAvbXYydB5FV2WWwhJpeoP/A==", 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBld3CuMxAAwvncg0GHEOgekURnLX45ow==", 2023-11-24T06:14:10.949 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBwPmBlWinREBAALUxc6wrq/vbCi/RkUtnoLw==", 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:14:10.950 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBtPmBlU/GnCxAAg5trW7FqqDD3pTR9iBuH6A==", 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBlLBh/EBAA1PD6yyS4WDatwZsP2fu8Nw==", 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBl35NuAxAAr2yZZ37B4v9xkzTh/HGQhg==", 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-11-24T06:14:10.952 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-11-24T06:14:10.953 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:14:10.953 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.953 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:10.953 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-11-24T06:14:10.953 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:14:10.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fedc806aff0 msgr2=0x7fedc806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fedc806aff0 0x7fedc806d4b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fedd8000f60 tx=0x7fedd8009040 comp rx=0 tx=0).stop 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fede815d430 msgr2=0x7fede80c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fede815d430 0x7fede80c6be0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fede0036040 tx=0x7fede0004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 shutdown_connections 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fedc806aff0 0x7fedc806d4b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fede815d430 0x7fede80c6be0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fede80d3810 0x7fede81e7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 --2- 172.21.15.22:0/1778303431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fede80d1690 0x7fede815ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 >> 172.21.15.22:0/1778303431 conn(0x7fede808cb00 msgr2=0x7fede8155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.939+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 shutdown_connections 2023-11-24T06:14:10.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:10.940+0000 7fedec8bb640 1 -- 172.21.15.22:0/1778303431 wait complete. 2023-11-24T06:14:10.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:11.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.178+0000 7f23d971d640 1 Processor -- start 2023-11-24T06:14:11.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.178+0000 7f23d971d640 1 -- start start 2023-11-24T06:14:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.180+0000 7f23d971d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f23d4070780 0x7f23d406d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.180+0000 7f23d971d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d4071cd0 con 0x7f23d4160970 2023-11-24T06:14:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.180+0000 7f23d971d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d40b2120 con 0x7f23d4070cd0 2023-11-24T06:14:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.180+0000 7f23d971d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d40b2400 con 0x7f23d4070780 2023-11-24T06:14:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.180+0000 7f23d27fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f23d4070780 0x7f23d406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.180+0000 7f23d27fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f23d4070780 0x7f23d406d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38628/0 (socket says 172.21.15.22:38628) 2023-11-24T06:14:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.180+0000 7f23d2ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f23d4160970 0x7f23d40b2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44816/0 (socket says 172.21.15.22:44816) 2023-11-24T06:14:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.180+0000 7f23d27fc640 1 -- 172.21.15.22:0/492534574 learned_addr learned my addr 172.21.15.22:0/492534574 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.181+0000 7f23d27fc640 1 -- 172.21.15.22:0/492534574 >> v1:172.21.15.31:6789/0 conn(0x7f23d4070cd0 legacy=0x7f23d40acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.181+0000 7f23d27fc640 1 -- 172.21.15.22:0/492534574 >> v1:172.21.15.22:6789/0 conn(0x7f23d4160970 legacy=0x7f23d40b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.181+0000 7f23d1ffb640 1 -- 172.21.15.22:0/492534574 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810854598 0 0) 0x7f23d4071cd0 con 0x7f23d4160970 2023-11-24T06:14:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.181+0000 7f23d27fc640 1 -- 172.21.15.22:0/492534574 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d40b26e0 con 0x7f23d4070780 2023-11-24T06:14:11.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.182+0000 7f23d27fc640 1 --2- 172.21.15.22:0/492534574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070780 0x7f23d406d520 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009870 tx=0x7f23bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450465bd3356f06 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.182+0000 7f23d1ffb640 1 -- 172.21.15.22:0/492534574 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc031870 con 0x7f23d4070780 2023-11-24T06:14:11.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.182+0000 7f23d1ffb640 1 -- 172.21.15.22:0/492534574 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc0319d0 con 0x7f23d4070780 2023-11-24T06:14:11.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.182+0000 7f23d1ffb640 1 -- 172.21.15.22:0/492534574 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc031d60 con 0x7f23d4070780 2023-11-24T06:14:11.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.183+0000 7f23d971d640 1 -- 172.21.15.22:0/492534574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070780 msgr2=0x7f23d406d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.183+0000 7f23d971d640 1 --2- 172.21.15.22:0/492534574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070780 0x7f23d406d520 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009870 tx=0x7f23bc02b910 comp rx=0 tx=0).stop 2023-11-24T06:14:11.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.183+0000 7f23d971d640 1 -- 172.21.15.22:0/492534574 shutdown_connections 2023-11-24T06:14:11.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.183+0000 7f23d971d640 1 --2- 172.21.15.22:0/492534574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070780 0x7f23d406d520 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.183+0000 7f23d971d640 1 -- 172.21.15.22:0/492534574 >> 172.21.15.22:0/492534574 conn(0x7f23d40b0d80 msgr2=0x7f23d40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.183+0000 7f23d971d640 1 -- 172.21.15.22:0/492534574 shutdown_connections 2023-11-24T06:14:11.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.183+0000 7f23d971d640 1 -- 172.21.15.22:0/492534574 wait complete. 2023-11-24T06:14:11.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.185+0000 7f23d971d640 1 Processor -- start 2023-11-24T06:14:11.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.185+0000 7f23d971d640 1 -- start start 2023-11-24T06:14:11.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.186+0000 7f23d971d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23d4070780 0x7f23d41502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.186+0000 7f23d971d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070cd0 0x7f23d4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.186+0000 7f23d971d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d4160970 0x7f23d4158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.186+0000 7f23d971d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41f3980 con 0x7f23d4070cd0 2023-11-24T06:14:11.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.186+0000 7f23d971d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41f29a0 con 0x7f23d4160970 2023-11-24T06:14:11.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.186+0000 7f23d971d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41507f0 con 0x7f23d4070780 2023-11-24T06:14:11.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.186+0000 7f23d27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070cd0 0x7f23d4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.186+0000 7f23d27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070cd0 0x7f23d4158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38634/0 (socket says 172.21.15.22:38634) 2023-11-24T06:14:11.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.186+0000 7f23d27fc640 1 -- 172.21.15.22:0/1983008343 learned_addr learned my addr 172.21.15.22:0/1983008343 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.187+0000 7f23d2ffd640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23d4070780 0x7f23d41502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.187+0000 7f23d37fe640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d4160970 0x7f23d4158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.187+0000 7f23d27fc640 1 -- 172.21.15.22:0/1983008343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23d4070780 msgr2=0x7f23d41502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.187+0000 7f23d27fc640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23d4070780 0x7f23d41502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.187+0000 7f23d27fc640 1 -- 172.21.15.22:0/1983008343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d4160970 msgr2=0x7f23d4158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.187+0000 7f23d27fc640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d4160970 0x7f23d4158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.187+0000 7f23d27fc640 1 -- 172.21.15.22:0/1983008343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0094d0 con 0x7f23d4070cd0 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.187+0000 7f23d27fc640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070cd0 0x7f23d4158200 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f23bc000c00 tx=0x7f23bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.188+0000 7f23cb7fe640 1 -- 172.21.15.22:0/1983008343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc03ad30 con 0x7f23d4070cd0 2023-11-24T06:14:11.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.188+0000 7f23cb7fe640 1 -- 172.21.15.22:0/1983008343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc03ae90 con 0x7f23d4070cd0 2023-11-24T06:14:11.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.188+0000 7f23cb7fe640 1 -- 172.21.15.22:0/1983008343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc044630 con 0x7f23d4070cd0 2023-11-24T06:14:11.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.188+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d41f34f0 con 0x7f23d4070cd0 2023-11-24T06:14:11.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.188+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d4158d20 con 0x7f23d4070cd0 2023-11-24T06:14:11.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.189+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d4074770 con 0x7f23d4070cd0 2023-11-24T06:14:11.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.190+0000 7f23cb7fe640 1 -- 172.21.15.22:0/1983008343 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f23bc044790 con 0x7f23d4070cd0 2023-11-24T06:14:11.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.191+0000 7f23cb7fe640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23b406aff0 0x7f23b406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.191+0000 7f23cb7fe640 1 -- 172.21.15.22:0/1983008343 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23bc02d040 con 0x7f23d4070cd0 2023-11-24T06:14:11.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.191+0000 7f23d2ffd640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23b406aff0 0x7f23b406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.192+0000 7f23d2ffd640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23b406aff0 0x7f23b406d4b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f23c4007ed0 tx=0x7f23c4007e60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.195+0000 7f23cb7fe640 1 -- 172.21.15.22:0/1983008343 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23bc077150 con 0x7f23d4070cd0 2023-11-24T06:14:11.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.380+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23d406e290 con 0x7f23d4070cd0 2023-11-24T06:14:11.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.382+0000 7f23cb7fe640 1 -- 172.21.15.22:0/1983008343 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12809 (secure 0 0 0) 0x7f23bc07a770 con 0x7f23d4070cd0 2023-11-24T06:14:11.385 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:11.385 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":43,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:10.424952+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:11.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23b406aff0 msgr2=0x7f23b406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23b406aff0 0x7f23b406d4b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f23c4007ed0 tx=0x7f23c4007e60 comp rx=0 tx=0).stop 2023-11-24T06:14:11.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070cd0 msgr2=0x7f23d4158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070cd0 0x7f23d4158200 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f23bc000c00 tx=0x7f23bc0046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 shutdown_connections 2023-11-24T06:14:11.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23b406aff0 0x7f23b406d4b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d4160970 0x7f23d4158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23d4070cd0 0x7f23d4158200 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 --2- 172.21.15.22:0/1983008343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23d4070780 0x7f23d41502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 >> 172.21.15.22:0/1983008343 conn(0x7f23d40b0d80 msgr2=0x7f23d40b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.384+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 shutdown_connections 2023-11-24T06:14:11.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.385+0000 7f23d971d640 1 -- 172.21.15.22:0/1983008343 wait complete. 2023-11-24T06:14:11.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:11.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.609+0000 7f4ea16df640 1 Processor -- start 2023-11-24T06:14:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.610+0000 7f4ea16df640 1 -- start start 2023-11-24T06:14:11.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.611+0000 7f4ea16df640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c0ad450 0x7f4e9c154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.611+0000 7f4ea16df640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e9c070850 0x7f4e9c071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.611+0000 7f4ea16df640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c0ce650 con 0x7f4e9c153ea0 2023-11-24T06:14:11.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.611+0000 7f4ea16df640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9c1547c0 con 0x7f4e9c070850 2023-11-24T06:14:11.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.611+0000 7f4ea16df640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0ad8b0 con 0x7f4e9c0ad450 2023-11-24T06:14:11.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.612+0000 7f4e9bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4e9c153ea0 0x7f4e9c15d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44818/0 (socket says 172.21.15.22:44818) 2023-11-24T06:14:11.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.612+0000 7f4e9bfff640 1 -- 172.21.15.22:0/3468100987 learned_addr learned my addr 172.21.15.22:0/3468100987 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:11.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.612+0000 7f4e9b7fe640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c0ad450 0x7f4e9c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.612+0000 7f4ea0ede640 1 --2- 172.21.15.22:0/3468100987 >> v2:172.21.15.31:3300/0 conn(0x7f4e9c070850 0x7f4e9c071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272797165 0 0) 0x7f4e9c0ce650 con 0x7f4e9c153ea0 2023-11-24T06:14:11.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e84003520 con 0x7f4e9c153ea0 2023-11-24T06:14:11.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1930374692 0 0) 0x7f4e84003520 con 0x7f4e9c153ea0 2023-11-24T06:14:11.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c0ad450 msgr2=0x7f4e9c154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c0ad450 0x7f4e9c154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 >> v2:172.21.15.31:3300/0 conn(0x7f4e9c070850 msgr2=0x7f4e9c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 --2- 172.21.15.22:0/3468100987 >> v2:172.21.15.31:3300/0 conn(0x7f4e9c070850 0x7f4e9c071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c15e0a0 con 0x7f4e9c153ea0 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f4e8c001670 con 0x7f4e9c153ea0 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 >> v1:172.21.15.22:6789/0 conn(0x7f4e9c153ea0 legacy=0x7f4e9c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e84003a10 0x7f4e84003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c0ad450 0x7f4e840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1547c0 con 0x7f4e84004d00 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0ad8b0 con 0x7f4e84003a10 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.613+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8400b9b0 con 0x7f4e9c0ad450 2023-11-24T06:14:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.614+0000 7f4ea0ede640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.614+0000 7f4e9b7fe640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c0ad450 0x7f4e840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.614+0000 7f4e9bfff640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e84003a10 0x7f4e84003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.614+0000 7f4ea0ede640 1 -- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c0ad450 msgr2=0x7f4e840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.614+0000 7f4ea0ede640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c0ad450 0x7f4e840047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.614+0000 7f4ea0ede640 1 -- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e84003a10 msgr2=0x7f4e84003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.614+0000 7f4ea0ede640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e84003a10 0x7f4e84003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.614+0000 7f4ea0ede640 1 -- 172.21.15.22:0/3468100987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84003520 con 0x7f4e84004d00 2023-11-24T06:14:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.615+0000 7f4ea0ede640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e84005180 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009fc0 tx=0x7f4e840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef8fe903e40aa6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.615+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9402cc30 con 0x7f4e84004d00 2023-11-24T06:14:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.615+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9400f040 con 0x7f4e84004d00 2023-11-24T06:14:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.615+0000 7f4e9affd640 1 -- 172.21.15.22:0/3468100987 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94034440 con 0x7f4e84004d00 2023-11-24T06:14:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.616+0000 7f4ea16df640 1 -- 172.21.15.22:0/3468100987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 msgr2=0x7f4e84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.616+0000 7f4ea16df640 1 --2- 172.21.15.22:0/3468100987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e84005180 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009fc0 tx=0x7f4e840057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.616+0000 7f4ea0ede640 1 -- 172.21.15.22:0/3468100987 reap_dead start 2023-11-24T06:14:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.616+0000 7f4ea16df640 1 -- 172.21.15.22:0/3468100987 shutdown_connections 2023-11-24T06:14:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.616+0000 7f4ea16df640 1 -- 172.21.15.22:0/3468100987 >> 172.21.15.22:0/3468100987 conn(0x7f4e9c0cec10 msgr2=0x7f4e9c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.616+0000 7f4ea16df640 1 -- 172.21.15.22:0/3468100987 shutdown_connections 2023-11-24T06:14:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.616+0000 7f4ea16df640 1 -- 172.21.15.22:0/3468100987 wait complete. 2023-11-24T06:14:11.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.618+0000 7f4ea16df640 1 Processor -- start 2023-11-24T06:14:11.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.618+0000 7f4ea16df640 1 -- start start 2023-11-24T06:14:11.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.619+0000 7f4ea16df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e9c1e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.619+0000 7f4ea16df640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c152110 0x7f4e9c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.619+0000 7f4ea16df640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e9c152640 0x7f4e9c070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.619+0000 7f4ea16df640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c151fa0 con 0x7f4e84004d00 2023-11-24T06:14:11.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.619+0000 7f4ea16df640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1f4f00 con 0x7f4e9c152640 2023-11-24T06:14:11.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.619+0000 7f4ea16df640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1f48f0 con 0x7f4e9c152110 2023-11-24T06:14:11.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.619+0000 7f4e9bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e9c1e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.619+0000 7f4e9bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e9c1e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38644/0 (socket says 172.21.15.22:38644) 2023-11-24T06:14:11.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.619+0000 7f4e9bfff640 1 -- 172.21.15.22:0/3430310048 learned_addr learned my addr 172.21.15.22:0/3430310048 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4ea0ede640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e9c152640 0x7f4e9c070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4e9bfff640 1 -- 172.21.15.22:0/3430310048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c152110 msgr2=0x7f4e9c151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4e9bfff640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c152110 0x7f4e9c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4e9bfff640 1 -- 172.21.15.22:0/3430310048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e9c152640 msgr2=0x7f4e9c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4e9bfff640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e9c152640 0x7f4e9c070ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4e9bfff640 1 -- 172.21.15.22:0/3430310048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c157150 con 0x7f4e84004d00 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4e9bfff640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e9c1e5900 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00d840 tx=0x7f4e8c00dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4e98ff9640 1 -- 172.21.15.22:0/3430310048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c0074e0 con 0x7f4e84004d00 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4e98ff9640 1 -- 172.21.15.22:0/3430310048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c007640 con 0x7f4e84004d00 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4e98ff9640 1 -- 172.21.15.22:0/3430310048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c004a20 con 0x7f4e84004d00 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c157430 con 0x7f4e84004d00 2023-11-24T06:14:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.620+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c1f4b90 con 0x7f4e84004d00 2023-11-24T06:14:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.622+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c1f4d50 con 0x7f4e84004d00 2023-11-24T06:14:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.622+0000 7f4e98ff9640 1 -- 172.21.15.22:0/3430310048 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4e8c004b80 con 0x7f4e84004d00 2023-11-24T06:14:11.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.623+0000 7f4e98ff9640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e8806b020 0x7f4e8806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.623+0000 7f4e98ff9640 1 -- 172.21.15.22:0/3430310048 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4e8c0890a0 con 0x7f4e84004d00 2023-11-24T06:14:11.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.624+0000 7f4e9b7fe640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e8806b020 0x7f4e8806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.624+0000 7f4e9b7fe640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e8806b020 0x7f4e8806d4e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c072130 tx=0x7f4e90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.628+0000 7f4e98ff9640 1 -- 172.21.15.22:0/3430310048 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e8c054070 con 0x7f4e84004d00 2023-11-24T06:14:11.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.820+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e9c04e840 con 0x7f4e84004d00 2023-11-24T06:14:11.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.821+0000 7f4e98ff9640 1 -- 172.21.15.22:0/3430310048 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e8c057690 con 0x7f4e84004d00 2023-11-24T06:14:11.824 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:14:11.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e8806b020 msgr2=0x7f4e8806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e8806b020 0x7f4e8806d4e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c072130 tx=0x7f4e90008040 comp rx=0 tx=0).stop 2023-11-24T06:14:11.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 msgr2=0x7f4e9c1e5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e9c1e5900 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00d840 tx=0x7f4e8c00dd00 comp rx=0 tx=0).stop 2023-11-24T06:14:11.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 shutdown_connections 2023-11-24T06:14:11.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e8806b020 0x7f4e8806d4e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e9c152640 0x7f4e9c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9c152110 0x7f4e9c151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 --2- 172.21.15.22:0/3430310048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e84004d00 0x7f4e9c1e5900 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 >> 172.21.15.22:0/3430310048 conn(0x7f4e9c0cec10 msgr2=0x7f4e9c15d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 shutdown_connections 2023-11-24T06:14:11.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:11.824+0000 7f4ea16df640 1 -- 172.21.15.22:0/3430310048 wait complete. 2023-11-24T06:14:11.845 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:14:12.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.058+0000 7f1e8a4ff640 1 Processor -- start 2023-11-24T06:14:12.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.059+0000 7f1e8a4ff640 1 -- start start 2023-11-24T06:14:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.060+0000 7f1e8a4ff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1e8413dfd0 0x7f1e8415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.060+0000 7f1e8a4ff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e840ce7c0 con 0x7f1e840cf500 2023-11-24T06:14:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.060+0000 7f1e8a4ff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e84140900 con 0x7f1e840cf050 2023-11-24T06:14:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.060+0000 7f1e8a4ff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8406cf50 con 0x7f1e8413dfd0 2023-11-24T06:14:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.061+0000 7f1e894fd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1e8413dfd0 0x7f1e8415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.061+0000 7f1e894fd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1e8413dfd0 0x7f1e8415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38650/0 (socket says 172.21.15.22:38650) 2023-11-24T06:14:12.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.061+0000 7f1e894fd640 1 -- 172.21.15.22:0/277040727 learned_addr learned my addr 172.21.15.22:0/277040727 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:12.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.061+0000 7f1e89cfe640 1 --1- 172.21.15.22:0/277040727 >> v1:172.21.15.22:6789/0 conn(0x7f1e840cf500 0x7f1e8406c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44828/0 (socket says 172.21.15.22:44828) 2023-11-24T06:14:12.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.061+0000 7f1e894fd640 1 -- 172.21.15.22:0/277040727 >> v1:172.21.15.31:6789/0 conn(0x7f1e840cf050 legacy=0x7f1e8406c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:12.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.061+0000 7f1e894fd640 1 -- 172.21.15.22:0/277040727 >> v1:172.21.15.22:6789/0 conn(0x7f1e840cf500 legacy=0x7f1e8406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.061+0000 7f1e894fd640 1 -- 172.21.15.22:0/277040727 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8415fa70 con 0x7f1e8413dfd0 2023-11-24T06:14:12.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.062+0000 7f1e894fd640 1 --2- 172.21.15.22:0/277040727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e8413dfd0 0x7f1e8415be70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009e50 tx=0x7f1e7402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c0f14f4744e890 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:12.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.063+0000 7f1e83fff640 1 -- 172.21.15.22:0/277040727 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7402cb10 con 0x7f1e8413dfd0 2023-11-24T06:14:12.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.063+0000 7f1e83fff640 1 -- 172.21.15.22:0/277040727 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7402cc70 con 0x7f1e8413dfd0 2023-11-24T06:14:12.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.063+0000 7f1e83fff640 1 -- 172.21.15.22:0/277040727 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740343f0 con 0x7f1e8413dfd0 2023-11-24T06:14:12.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.063+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/277040727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e8413dfd0 msgr2=0x7f1e8415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.063+0000 7f1e8a4ff640 1 --2- 172.21.15.22:0/277040727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e8413dfd0 0x7f1e8415be70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009e50 tx=0x7f1e7402bf70 comp rx=0 tx=0).stop 2023-11-24T06:14:12.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.063+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/277040727 shutdown_connections 2023-11-24T06:14:12.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.063+0000 7f1e8a4ff640 1 --2- 172.21.15.22:0/277040727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e8413dfd0 0x7f1e8415be70 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.063+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/277040727 >> 172.21.15.22:0/277040727 conn(0x7f1e8406a860 msgr2=0x7f1e8406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:12.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.063+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/277040727 shutdown_connections 2023-11-24T06:14:12.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.064+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/277040727 wait complete. 2023-11-24T06:14:12.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.065+0000 7f1e8a4ff640 1 Processor -- start 2023-11-24T06:14:12.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.065+0000 7f1e8a4ff640 1 -- start start 2023-11-24T06:14:12.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.066+0000 7f1e8a4ff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e840cf050 0x7f1e8413cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.066+0000 7f1e8a4ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e840cf500 0x7f1e8414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.066+0000 7f1e8a4ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e8413dfd0 0x7f1e840b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.066+0000 7f1e8a4ff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8413d500 con 0x7f1e840cf500 2023-11-24T06:14:12.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.066+0000 7f1e8a4ff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8414f6e0 con 0x7f1e8413dfd0 2023-11-24T06:14:12.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.066+0000 7f1e8a4ff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8415c110 con 0x7f1e840cf050 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e88cfc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e840cf500 0x7f1e8414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e88cfc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e840cf500 0x7f1e8414f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38664/0 (socket says 172.21.15.22:38664) 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e88cfc640 1 -- 172.21.15.22:0/541916017 learned_addr learned my addr 172.21.15.22:0/541916017 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e894fd640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e840cf050 0x7f1e8413cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e88cfc640 1 -- 172.21.15.22:0/541916017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e840cf050 msgr2=0x7f1e8413cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e88cfc640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e840cf050 0x7f1e8413cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e88cfc640 1 -- 172.21.15.22:0/541916017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e8413dfd0 msgr2=0x7f1e840b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e89cfe640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e8413dfd0 0x7f1e840b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e88cfc640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e8413dfd0 0x7f1e840b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e88cfc640 1 -- 172.21.15.22:0/541916017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74009b30 con 0x7f1e840cf500 2023-11-24T06:14:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.067+0000 7f1e894fd640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e840cf050 0x7f1e8413cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:12.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.068+0000 7f1e88cfc640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e840cf500 0x7f1e8414f1a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800c430 tx=0x7f1e7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.068+0000 7f1e81ffb640 1 -- 172.21.15.22:0/541916017 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78011790 con 0x7f1e840cf500 2023-11-24T06:14:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.068+0000 7f1e81ffb640 1 -- 172.21.15.22:0/541916017 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e780118f0 con 0x7f1e840cf500 2023-11-24T06:14:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.068+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e840b1d70 con 0x7f1e840cf500 2023-11-24T06:14:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.068+0000 7f1e81ffb640 1 -- 172.21.15.22:0/541916017 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78011ce0 con 0x7f1e840cf500 2023-11-24T06:14:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.068+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e840b2330 con 0x7f1e840cf500 2023-11-24T06:14:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.069+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8415c330 con 0x7f1e840cf500 2023-11-24T06:14:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.070+0000 7f1e81ffb640 1 -- 172.21.15.22:0/541916017 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1e7801c460 con 0x7f1e840cf500 2023-11-24T06:14:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.071+0000 7f1e81ffb640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e7006aff0 0x7f1e7006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.071+0000 7f1e81ffb640 1 -- 172.21.15.22:0/541916017 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1e780895c0 con 0x7f1e840cf500 2023-11-24T06:14:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.072+0000 7f1e894fd640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e7006aff0 0x7f1e7006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.072+0000 7f1e894fd640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e7006aff0 0x7f1e7006d4b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1e74035000 tx=0x7f1e74030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:12.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.075+0000 7f1e81ffb640 1 -- 172.21.15.22:0/541916017 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e8415c330 con 0x7f1e840cf500 2023-11-24T06:14:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.274+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1e8415c2d0 con 0x7f1e840cf500 2023-11-24T06:14:12.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.275+0000 7f1e81ffb640 1 -- 172.21.15.22:0/541916017 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1e780546a0 con 0x7f1e840cf500 2023-11-24T06:14:12.278 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:12.278 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-11-24T06:14:12.278 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:12.278 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-11-24T06:14:12.278 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-11-24T06:14:12.278 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:12.279 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-11-24T06:14:12.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.277+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e7006aff0 msgr2=0x7f1e7006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.277+0000 7f1e8a4ff640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e7006aff0 0x7f1e7006d4b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1e74035000 tx=0x7f1e74030000 comp rx=0 tx=0).stop 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e840cf500 msgr2=0x7f1e8414f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e840cf500 0x7f1e8414f1a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800c430 tx=0x7f1e7800c8f0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 shutdown_connections 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e7006aff0 0x7f1e7006d4b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e8413dfd0 0x7f1e840b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e840cf500 0x7f1e8414f1a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 --2- 172.21.15.22:0/541916017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e840cf050 0x7f1e8413cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 >> 172.21.15.22:0/541916017 conn(0x7f1e8406a860 msgr2=0x7f1e8406c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 shutdown_connections 2023-11-24T06:14:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.278+0000 7f1e8a4ff640 1 -- 172.21.15.22:0/541916017 wait complete. 2023-11-24T06:14:12.301 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:14:12.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:14:12.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.532+0000 7f0268bb0640 1 Processor -- start 2023-11-24T06:14:12.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.532+0000 7f0268bb0640 1 -- start start 2023-11-24T06:14:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.534+0000 7f0268bb0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0264162220 0x7f02640b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.534+0000 7f0268bb0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f026406cad0 0x7f0264162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.534+0000 7f0268bb0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0264162fa0 con 0x7f0264162600 2023-11-24T06:14:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.534+0000 7f0268bb0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02640706a0 con 0x7f026406cad0 2023-11-24T06:14:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.534+0000 7f0268bb0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0264070c60 con 0x7f0264162220 2023-11-24T06:14:12.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.535+0000 7f0262d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f026406cad0 0x7f0264162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.535+0000 7f025bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0264162600 0x7f026406c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44840/0 (socket says 172.21.15.22:44840) 2023-11-24T06:14:12.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.535+0000 7f025bfff640 1 -- 172.21.15.22:0/804456933 learned_addr learned my addr 172.21.15.22:0/804456933 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:12.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.535+0000 7f026259c640 1 --2- 172.21.15.22:0/804456933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0264162220 0x7f02640b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.535+0000 7f0262d9d640 1 -- 172.21.15.22:0/804456933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0264162220 msgr2=0x7f02640b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:12.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.535+0000 7f0262d9d640 1 --2- 172.21.15.22:0/804456933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0264162220 0x7f02640b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.535+0000 7f0262d9d640 1 -- 172.21.15.22:0/804456933 >> v1:172.21.15.22:6789/0 conn(0x7f0264162600 legacy=0x7f026406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.535+0000 7f0262d9d640 1 -- 172.21.15.22:0/804456933 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02640722b0 con 0x7f026406cad0 2023-11-24T06:14:12.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.535+0000 7f0261d9b640 1 -- 172.21.15.22:0/804456933 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450234641 0 0) 0x7f0264162fa0 con 0x7f0264162600 2023-11-24T06:14:12.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.537+0000 7f0262d9d640 1 --2- 172.21.15.22:0/804456933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026406cad0 0x7f0264162a60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f025c009d90 tx=0x7f025c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0846c6569c6749 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:12.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.537+0000 7f0261d9b640 1 -- 172.21.15.22:0/804456933 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c02cc50 con 0x7f026406cad0 2023-11-24T06:14:12.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.537+0000 7f0261d9b640 1 -- 172.21.15.22:0/804456933 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c02cdb0 con 0x7f026406cad0 2023-11-24T06:14:12.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.537+0000 7f0261d9b640 1 -- 172.21.15.22:0/804456933 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c034660 con 0x7f026406cad0 2023-11-24T06:14:12.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.538+0000 7f0268bb0640 1 -- 172.21.15.22:0/804456933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026406cad0 msgr2=0x7f0264162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.538+0000 7f0268bb0640 1 --2- 172.21.15.22:0/804456933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026406cad0 0x7f0264162a60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f025c009d90 tx=0x7f025c02bea0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.538+0000 7f0268bb0640 1 -- 172.21.15.22:0/804456933 shutdown_connections 2023-11-24T06:14:12.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.538+0000 7f0268bb0640 1 --2- 172.21.15.22:0/804456933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026406cad0 0x7f0264162a60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.538+0000 7f0268bb0640 1 --2- 172.21.15.22:0/804456933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0264162220 0x7f02640b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.538+0000 7f0268bb0640 1 -- 172.21.15.22:0/804456933 >> 172.21.15.22:0/804456933 conn(0x7f02640b0ba0 msgr2=0x7f02640b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:12.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.538+0000 7f0268bb0640 1 -- 172.21.15.22:0/804456933 shutdown_connections 2023-11-24T06:14:12.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.538+0000 7f0268bb0640 1 -- 172.21.15.22:0/804456933 wait complete. 2023-11-24T06:14:12.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.540+0000 7f0268bb0640 1 Processor -- start 2023-11-24T06:14:12.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.540+0000 7f0268bb0640 1 -- start start 2023-11-24T06:14:12.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.541+0000 7f0268bb0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f026406cad0 0x7f0264159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.541+0000 7f0268bb0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0264162220 0x7f0264099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.541+0000 7f0268bb0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0264162600 0x7f02640ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.541+0000 7f0268bb0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02641595d0 con 0x7f0264162600 2023-11-24T06:14:12.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.541+0000 7f0268bb0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0264164290 con 0x7f0264162220 2023-11-24T06:14:12.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.541+0000 7f0268bb0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0264159a60 con 0x7f026406cad0 2023-11-24T06:14:12.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.541+0000 7f0262d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0264162600 0x7f02640ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.541+0000 7f0262d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0264162600 0x7f02640ada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38678/0 (socket says 172.21.15.22:38678) 2023-11-24T06:14:12.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.541+0000 7f0262d9d640 1 -- 172.21.15.22:0/1588782951 learned_addr learned my addr 172.21.15.22:0/1588782951 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:12.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f026259c640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f026406cad0 0x7f0264159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f0262d9d640 1 -- 172.21.15.22:0/1588782951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f026406cad0 msgr2=0x7f0264159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f0262d9d640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f026406cad0 0x7f0264159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f0262d9d640 1 -- 172.21.15.22:0/1588782951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0264162220 msgr2=0x7f0264099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f0262d9d640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0264162220 0x7f0264099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f0262d9d640 1 -- 172.21.15.22:0/1588782951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c009a70 con 0x7f0264162600 2023-11-24T06:14:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f026259c640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f026406cad0 0x7f0264159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f0262d9d640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0264162600 0x7f02640ada40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f025c009d90 tx=0x7f025c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f025affd640 1 -- 172.21.15.22:0/1588782951 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c040650 con 0x7f0264162600 2023-11-24T06:14:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f025affd640 1 -- 172.21.15.22:0/1588782951 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c0407d0 con 0x7f0264162600 2023-11-24T06:14:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f025affd640 1 -- 172.21.15.22:0/1588782951 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c040b80 con 0x7f0264162600 2023-11-24T06:14:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.542+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026409ba30 con 0x7f0264162600 2023-11-24T06:14:12.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.543+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026409bff0 con 0x7f0264162600 2023-11-24T06:14:12.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.544+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0264070dd0 con 0x7f0264162600 2023-11-24T06:14:12.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.545+0000 7f025affd640 1 -- 172.21.15.22:0/1588782951 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f025c040ce0 con 0x7f0264162600 2023-11-24T06:14:12.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.545+0000 7f025affd640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f024406b020 0x7f024406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.546+0000 7f025affd640 1 -- 172.21.15.22:0/1588782951 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f025c0ac370 con 0x7f0264162600 2023-11-24T06:14:12.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.546+0000 7f026259c640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f024406b020 0x7f024406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.547+0000 7f026259c640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f024406b020 0x7f024406d4e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0254006fd0 tx=0x7f0254008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:12.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.550+0000 7f025affd640 1 -- 172.21.15.22:0/1588782951 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f025c0776a0 con 0x7f0264162600 2023-11-24T06:14:12.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:12.743+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0264164400 con 0x7f0264162600 2023-11-24T06:14:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.426+0000 7f025affd640 1 -- 172.21.15.22:0/1588782951 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7f025c07acc0 con 0x7f0264162600 2023-11-24T06:14:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-11-24T06:14:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.432+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f024406b020 msgr2=0x7f024406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.432+0000 7f0268bb0640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f024406b020 0x7f024406d4e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0254006fd0 tx=0x7f0254008040 comp rx=0 tx=0).stop 2023-11-24T06:14:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.432+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0264162600 msgr2=0x7f02640ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.432+0000 7f0268bb0640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0264162600 0x7f02640ada40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f025c009d90 tx=0x7f025c004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:13.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.433+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 shutdown_connections 2023-11-24T06:14:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.433+0000 7f0268bb0640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f024406b020 0x7f024406d4e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.433+0000 7f0268bb0640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0264162600 0x7f02640ada40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.433+0000 7f0268bb0640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0264162220 0x7f0264099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.433+0000 7f0268bb0640 1 --2- 172.21.15.22:0/1588782951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f026406cad0 0x7f0264159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.433+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 >> 172.21.15.22:0/1588782951 conn(0x7f02640b0ba0 msgr2=0x7f0264160ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:13.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.434+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 shutdown_connections 2023-11-24T06:14:13.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.434+0000 7f0268bb0640 1 -- 172.21.15.22:0/1588782951 wait complete. 2023-11-24T06:14:13.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:14:13.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.694+0000 7fb56bf3c640 1 Processor -- start 2023-11-24T06:14:13.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.695+0000 7fb56bf3c640 1 -- start start 2023-11-24T06:14:13.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.696+0000 7fb56bf3c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb56415b350 0x7fb5640abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.696+0000 7fb56bf3c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb56409cb30 0x7fb5640b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.697+0000 7fb56bf3c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56415b730 con 0x7fb5640adb60 2023-11-24T06:14:13.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.697+0000 7fb56bf3c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640ac740 con 0x7fb56415b350 2023-11-24T06:14:13.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.697+0000 7fb56bf3c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640ac460 con 0x7fb56409cb30 2023-11-24T06:14:13.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.697+0000 7fb56a4d9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb5640adb60 0x7fb5640adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44846/0 (socket says 172.21.15.22:44846) 2023-11-24T06:14:13.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.697+0000 7fb56a4d9640 1 -- 172.21.15.22:0/317138495 learned_addr learned my addr 172.21.15.22:0/317138495 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:13.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.697+0000 7fb569cd8640 1 --2- 172.21.15.22:0/317138495 >> v2:172.21.15.31:3300/0 conn(0x7fb56415b350 0x7fb5640abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.697+0000 7fb5694d7640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb56409cb30 0x7fb5640b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252777473 0 0) 0x7fb55c001490 con 0x7fb5640adb60 2023-11-24T06:14:13.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb550003520 con 0x7fb5640adb60 2023-11-24T06:14:13.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 623943954 0 0) 0x7fb550003520 con 0x7fb5640adb60 2023-11-24T06:14:13.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb56409cb30 msgr2=0x7fb5640b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:13.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb56409cb30 0x7fb5640b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 >> v2:172.21.15.31:3300/0 conn(0x7fb56415b350 msgr2=0x7fb5640abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:13.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 --2- 172.21.15.22:0/317138495 >> v2:172.21.15.31:3300/0 conn(0x7fb56415b350 0x7fb5640abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640b2a50 con 0x7fb5640adb60 2023-11-24T06:14:13.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fb55c001b80 con 0x7fb5640adb60 2023-11-24T06:14:13.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 >> v1:172.21.15.22:6789/0 conn(0x7fb5640adb60 legacy=0x7fb5640adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb56409cb30 0x7fb550003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb5500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550004d00 0x7fb550005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640ac740 con 0x7fb550003ef0 2023-11-24T06:14:13.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640ac460 con 0x7fb550004d00 2023-11-24T06:14:13.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55000b980 con 0x7fb56409cb30 2023-11-24T06:14:13.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.698+0000 7fb5694d7640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb5500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.699+0000 7fb569cd8640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb56409cb30 0x7fb550003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.699+0000 7fb56a4d9640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550004d00 0x7fb550005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.699+0000 7fb5694d7640 1 -- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb56409cb30 msgr2=0x7fb550003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:13.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.699+0000 7fb5694d7640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb56409cb30 0x7fb550003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.699+0000 7fb5694d7640 1 -- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550004d00 msgr2=0x7fb550005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:13.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.699+0000 7fb5694d7640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550004d00 0x7fb550005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.699+0000 7fb5694d7640 1 -- 172.21.15.22:0/317138495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550003520 con 0x7fb550003ef0 2023-11-24T06:14:13.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.700+0000 7fb5694d7640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb5500047c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb554009ac0 tx=0x7fb5500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a30ceb04c0c67c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:13.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.700+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55402c6b0 con 0x7fb550003ef0 2023-11-24T06:14:13.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.700+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55402c810 con 0x7fb550003ef0 2023-11-24T06:14:13.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.700+0000 7fb568cd6640 1 -- 172.21.15.22:0/317138495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55402cba0 con 0x7fb550003ef0 2023-11-24T06:14:13.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.701+0000 7fb56bf3c640 1 -- 172.21.15.22:0/317138495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 msgr2=0x7fb5500047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.701+0000 7fb56bf3c640 1 --2- 172.21.15.22:0/317138495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb5500047c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb554009ac0 tx=0x7fb5500057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.701+0000 7fb56a4d9640 1 -- 172.21.15.22:0/317138495 reap_dead start 2023-11-24T06:14:13.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.701+0000 7fb56bf3c640 1 -- 172.21.15.22:0/317138495 shutdown_connections 2023-11-24T06:14:13.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.701+0000 7fb56bf3c640 1 -- 172.21.15.22:0/317138495 >> 172.21.15.22:0/317138495 conn(0x7fb5640b0ba0 msgr2=0x7fb5640b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:13.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.701+0000 7fb56bf3c640 1 -- 172.21.15.22:0/317138495 shutdown_connections 2023-11-24T06:14:13.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.701+0000 7fb56bf3c640 1 -- 172.21.15.22:0/317138495 wait complete. 2023-11-24T06:14:13.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.703+0000 7fb56bf3c640 1 Processor -- start 2023-11-24T06:14:13.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.703+0000 7fb56bf3c640 1 -- start start 2023-11-24T06:14:13.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.704+0000 7fb56bf3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb56414ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.704+0000 7fb56bf3c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5641f3eb0 0x7fb5641f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.704+0000 7fb56bf3c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb564150ce0 0x7fb564151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.704+0000 7fb56bf3c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5641f4870 con 0x7fb550003ef0 2023-11-24T06:14:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.704+0000 7fb56bf3c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564070930 con 0x7fb5641f3eb0 2023-11-24T06:14:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.704+0000 7fb56bf3c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb564152090 con 0x7fb564150ce0 2023-11-24T06:14:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb569cd8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb56414ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb569cd8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb56414ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38708/0 (socket says 172.21.15.22:38708) 2023-11-24T06:14:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb569cd8640 1 -- 172.21.15.22:0/2445704089 learned_addr learned my addr 172.21.15.22:0/2445704089 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb5694d7640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5641f3eb0 0x7fb5641f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb569cd8640 1 -- 172.21.15.22:0/2445704089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb564150ce0 msgr2=0x7fb564151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb569cd8640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb564150ce0 0x7fb564151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb569cd8640 1 -- 172.21.15.22:0/2445704089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5641f3eb0 msgr2=0x7fb5641f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb569cd8640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5641f3eb0 0x7fb5641f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb569cd8640 1 -- 172.21.15.22:0/2445704089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5641f4ae0 con 0x7fb550003ef0 2023-11-24T06:14:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.705+0000 7fb569cd8640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb56414ef60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb5600116d0 tx=0x7fb560011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.706+0000 7fb55a7fc640 1 -- 172.21.15.22:0/2445704089 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000f960 con 0x7fb550003ef0 2023-11-24T06:14:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.706+0000 7fb55a7fc640 1 -- 172.21.15.22:0/2445704089 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000fac0 con 0x7fb550003ef0 2023-11-24T06:14:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.706+0000 7fb55a7fc640 1 -- 172.21.15.22:0/2445704089 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000fe30 con 0x7fb550003ef0 2023-11-24T06:14:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.706+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb564151ad0 con 0x7fb550003ef0 2023-11-24T06:14:13.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.706+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5640705c0 con 0x7fb550003ef0 2023-11-24T06:14:13.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.707+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56404e920 con 0x7fb550003ef0 2023-11-24T06:14:13.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.708+0000 7fb55a7fc640 1 -- 172.21.15.22:0/2445704089 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb560015460 con 0x7fb550003ef0 2023-11-24T06:14:13.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.709+0000 7fb55a7fc640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb54806aff0 0x7fb54806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.709+0000 7fb55a7fc640 1 -- 172.21.15.22:0/2445704089 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb560089cc0 con 0x7fb550003ef0 2023-11-24T06:14:13.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.710+0000 7fb5694d7640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb54806aff0 0x7fb54806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.711+0000 7fb5694d7640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb54806aff0 0x7fb54806d4b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb554036000 tx=0x7fb554030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:13.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.715+0000 7fb55a7fc640 1 -- 172.21.15.22:0/2445704089 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb560090080 con 0x7fb550003ef0 2023-11-24T06:14:13.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:13.911+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb56409d1e0 con 0x7fb550003ef0 2023-11-24T06:14:14.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.434+0000 7fb55a7fc640 1 -- 172.21.15.22:0/2445704089 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb5600220d0 con 0x7fb550003ef0 2023-11-24T06:14:14.437 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-11-24T06:14:14.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb54806aff0 msgr2=0x7fb54806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb54806aff0 0x7fb54806d4b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb554036000 tx=0x7fb554030000 comp rx=0 tx=0).stop 2023-11-24T06:14:14.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 msgr2=0x7fb56414ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb56414ef60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb5600116d0 tx=0x7fb560011b90 comp rx=0 tx=0).stop 2023-11-24T06:14:14.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 shutdown_connections 2023-11-24T06:14:14.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb54806aff0 0x7fb54806d4b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb564150ce0 0x7fb564151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5641f3eb0 0x7fb5641f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 --2- 172.21.15.22:0/2445704089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550003ef0 0x7fb56414ef60 secure :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb5600116d0 tx=0x7fb560011b90 comp rx=0 tx=0).stop 2023-11-24T06:14:14.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.439+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 >> 172.21.15.22:0/2445704089 conn(0x7fb5640b0ba0 msgr2=0x7fb564159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:14.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.442+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 shutdown_connections 2023-11-24T06:14:14.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.442+0000 7fb56bf3c640 1 -- 172.21.15.22:0/2445704089 wait complete. 2023-11-24T06:14:14.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:14:14.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.666+0000 7f86e02b4640 1 Processor -- start 2023-11-24T06:14:14.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.666+0000 7f86e02b4640 1 -- start start 2023-11-24T06:14:14.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.668+0000 7f86e02b4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86d8160b10 0x7f86d806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.668+0000 7f86e02b4640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d8071780 con 0x7f86d8072280 2023-11-24T06:14:14.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.668+0000 7f86e02b4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d80711c0 con 0x7f86d806cad0 2023-11-24T06:14:14.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.668+0000 7f86e02b4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d80b2320 con 0x7f86d8160b10 2023-11-24T06:14:14.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.668+0000 7f86dd84f640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f86d8072280 0x7f86d806c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44860/0 (socket says 172.21.15.22:44860) 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.668+0000 7f86dd84f640 1 -- 172.21.15.22:0/593381031 learned_addr learned my addr 172.21.15.22:0/593381031 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86de050640 1 --2- 172.21.15.22:0/593381031 >> v2:172.21.15.31:3300/0 conn(0x7f86d8160b10 0x7f86d806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565999559 0 0) 0x7f86d8071780 con 0x7f86d8072280 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c4003520 con 0x7f86d8072280 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585010817 0 0) 0x7f86c4003520 con 0x7f86d8072280 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 >> v2:172.21.15.31:3300/0 conn(0x7f86d8160b10 msgr2=0x7f86d806e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 --2- 172.21.15.22:0/593381031 >> v2:172.21.15.31:3300/0 conn(0x7f86d8160b10 0x7f86d806e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 >> v1:172.21.15.31:6789/0 conn(0x7f86d806cad0 legacy=0x7f86d80b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80714a0 con 0x7f86d8072280 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f86c8001670 con 0x7f86d8072280 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 >> v1:172.21.15.22:6789/0 conn(0x7f86d8072280 legacy=0x7f86d806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86c4003970 0x7f86c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40047c0 0x7f86c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.669+0000 7f86dd04e640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80b2320 con 0x7f86c40052a0 2023-11-24T06:14:14.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c400c170 con 0x7f86c40047c0 2023-11-24T06:14:14.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c400c330 con 0x7f86c4003970 2023-11-24T06:14:14.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86de851640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86de050640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86c4003970 0x7f86c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86dd84f640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40047c0 0x7f86c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86de851640 1 -- 172.21.15.22:0/593381031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86c4003970 msgr2=0x7f86c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86de851640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86c4003970 0x7f86c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86de851640 1 -- 172.21.15.22:0/593381031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40047c0 msgr2=0x7f86c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86de851640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40047c0 0x7f86c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.670+0000 7f86de851640 1 -- 172.21.15.22:0/593381031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4003520 con 0x7f86c40052a0 2023-11-24T06:14:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.671+0000 7f86de851640 1 -- 172.21.15.22:0/593381031 reap_dead start 2023-11-24T06:14:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.672+0000 7f86de851640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86c400b980 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f86d80b4000 tx=0x7f86c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c990c5e35925e37 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.672+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0003b70 con 0x7f86c40052a0 2023-11-24T06:14:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.672+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0003cd0 con 0x7f86c40052a0 2023-11-24T06:14:14.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.672+0000 7f86dd04e640 1 -- 172.21.15.22:0/593381031 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0005310 con 0x7f86c40052a0 2023-11-24T06:14:14.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.672+0000 7f86e02b4640 1 -- 172.21.15.22:0/593381031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 msgr2=0x7f86c400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.672+0000 7f86e02b4640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86c400b980 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f86d80b4000 tx=0x7f86c40057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.673+0000 7f86e02b4640 1 -- 172.21.15.22:0/593381031 shutdown_connections 2023-11-24T06:14:14.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.673+0000 7f86e02b4640 1 --2- 172.21.15.22:0/593381031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86c400b980 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.673+0000 7f86e02b4640 1 -- 172.21.15.22:0/593381031 >> 172.21.15.22:0/593381031 conn(0x7f86d80b0ba0 msgr2=0x7f86d80b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:14.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.673+0000 7f86e02b4640 1 -- 172.21.15.22:0/593381031 shutdown_connections 2023-11-24T06:14:14.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.673+0000 7f86e02b4640 1 -- 172.21.15.22:0/593381031 wait complete. 2023-11-24T06:14:14.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.675+0000 7f86e02b4640 1 Processor -- start 2023-11-24T06:14:14.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.675+0000 7f86e02b4640 1 -- start start 2023-11-24T06:14:14.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86e02b4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86d80ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86e02b4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86d8150150 0x7f86d81505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86e02b4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86d809ba00 0x7f86d809beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86e02b4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d8150b10 con 0x7f86c40052a0 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86e02b4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d81f6550 con 0x7f86d8150150 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86e02b4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d809c710 con 0x7f86d809ba00 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86de050640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86d80ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86de050640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86d80ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38736/0 (socket says 172.21.15.22:38736) 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86de050640 1 -- 172.21.15.22:0/2867211484 learned_addr learned my addr 172.21.15.22:0/2867211484 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86de050640 1 -- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86d809ba00 msgr2=0x7f86d809beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86de851640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86d809ba00 0x7f86d809beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86dd84f640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86d8150150 0x7f86d81505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86de050640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86d809ba00 0x7f86d809beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86de050640 1 -- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86d8150150 msgr2=0x7f86d81505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86de050640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86d8150150 0x7f86d81505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.676+0000 7f86de050640 1 -- 172.21.15.22:0/2867211484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d81f67f0 con 0x7f86c40052a0 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.677+0000 7f86de851640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86d809ba00 0x7f86d809beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.677+0000 7f86dd84f640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86d8150150 0x7f86d81505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.677+0000 7f86de050640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86d80ad140 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f86d400f500 tx=0x7f86d400f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.677+0000 7f86ceffd640 1 -- 172.21.15.22:0/2867211484 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4013810 con 0x7f86c40052a0 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.677+0000 7f86ceffd640 1 -- 172.21.15.22:0/2867211484 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d4013970 con 0x7f86c40052a0 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.677+0000 7f86ceffd640 1 -- 172.21.15.22:0/2867211484 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4013d00 con 0x7f86c40052a0 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.677+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d81f6ad0 con 0x7f86c40052a0 2023-11-24T06:14:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.677+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d809c3f0 con 0x7f86c40052a0 2023-11-24T06:14:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.678+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d81f6ff0 con 0x7f86c40052a0 2023-11-24T06:14:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.680+0000 7f86ceffd640 1 -- 172.21.15.22:0/2867211484 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f86d401f460 con 0x7f86c40052a0 2023-11-24T06:14:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.681+0000 7f86ceffd640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f86bc06aff0 0x7f86bc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.681+0000 7f86ceffd640 1 -- 172.21.15.22:0/2867211484 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f86d408a630 con 0x7f86c40052a0 2023-11-24T06:14:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.681+0000 7f86dd84f640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f86bc06aff0 0x7f86bc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.682+0000 7f86dd84f640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f86bc06aff0 0x7f86bc06d4b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f86c8001200 tx=0x7f86c8001190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.684+0000 7f86ceffd640 1 -- 172.21.15.22:0/2867211484 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f86d4055550 con 0x7f86c40052a0 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:14.913+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f86d81f6ff0 con 0x7f86c40052a0 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.467+0000 7f86ceffd640 1 -- 172.21.15.22:0/2867211484 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f86d81f6ff0 con 0x7f86c40052a0 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 6 and data pool 7 2023-11-24T06:14:15.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.473+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f86bc06aff0 msgr2=0x7f86bc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.473+0000 7f86e02b4640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f86bc06aff0 0x7f86bc06d4b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f86c8001200 tx=0x7f86c8001190 comp rx=0 tx=0).stop 2023-11-24T06:14:15.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.473+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 msgr2=0x7f86d80ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.473+0000 7f86e02b4640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86d80ad140 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f86d400f500 tx=0x7f86d400f9c0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.474+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 shutdown_connections 2023-11-24T06:14:15.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.474+0000 7f86e02b4640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f86bc06aff0 0x7f86bc06d4b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.474+0000 7f86e02b4640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86d809ba00 0x7f86d809beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.474+0000 7f86e02b4640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86d8150150 0x7f86d81505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.474+0000 7f86e02b4640 1 --2- 172.21.15.22:0/2867211484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c40052a0 0x7f86d80ad140 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.474+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 >> 172.21.15.22:0/2867211484 conn(0x7f86d80b0ba0 msgr2=0x7f86d80706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:15.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.474+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 shutdown_connections 2023-11-24T06:14:15.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.474+0000 7f86e02b4640 1 -- 172.21.15.22:0/2867211484 wait complete. 2023-11-24T06:14:15.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:15.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.677+0000 7f56a470f640 1 Processor -- start 2023-11-24T06:14:15.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.677+0000 7f56a470f640 1 -- start start 2023-11-24T06:14:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a470f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f569c06d520 0x7f569c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a470f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f569c0ad720 0x7f569c15ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a470f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c0abff0 0x7f569c15f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a470f640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c0b41a0 con 0x7f569c06d520 2023-11-24T06:14:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a470f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c15c360 con 0x7f569c0ad720 2023-11-24T06:14:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a470f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c06de40 con 0x7f569c0abff0 2023-11-24T06:14:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a24ab640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f569c06d520 0x7f569c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a24ab640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f569c06d520 0x7f569c06d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38738/0 (socket says 172.21.15.22:38738) 2023-11-24T06:14:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a24ab640 1 -- 172.21.15.22:0/428909642 learned_addr learned my addr 172.21.15.22:0/428909642 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:15.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.679+0000 7f56a1caa640 1 --2- 172.21.15.22:0/428909642 >> v2:172.21.15.31:3300/0 conn(0x7f569c0ad720 0x7f569c15ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.680+0000 7f56a2cac640 1 --2- 172.21.15.22:0/428909642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c0abff0 0x7f569c15f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.680+0000 7f56a24ab640 1 -- 172.21.15.22:0/428909642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c0abff0 msgr2=0x7f569c15f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:15.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.680+0000 7f56a24ab640 1 --2- 172.21.15.22:0/428909642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c0abff0 0x7f569c15f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.680+0000 7f56a24ab640 1 -- 172.21.15.22:0/428909642 >> v2:172.21.15.31:3300/0 conn(0x7f569c0ad720 msgr2=0x7f569c15ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.680+0000 7f56a24ab640 1 --2- 172.21.15.22:0/428909642 >> v2:172.21.15.31:3300/0 conn(0x7f569c0ad720 0x7f569c15ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.680+0000 7f56a24ab640 1 -- 172.21.15.22:0/428909642 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c15ba30 con 0x7f569c06d520 2023-11-24T06:14:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.680+0000 7f56a2cac640 1 --2- 172.21.15.22:0/428909642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c0abff0 0x7f569c15f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.681+0000 7f56a24ab640 1 --2- 172.21.15.22:0/428909642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c06d520 0x7f569c06d900 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f569c0adb00 tx=0x7f569802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a710848bc1ecfb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.681+0000 7f56a14a9640 1 -- 172.21.15.22:0/428909642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698031870 con 0x7f569c06d520 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.681+0000 7f56a14a9640 1 -- 172.21.15.22:0/428909642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56980319d0 con 0x7f569c06d520 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.681+0000 7f56a14a9640 1 -- 172.21.15.22:0/428909642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698031d60 con 0x7f569c06d520 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.682+0000 7f56a470f640 1 -- 172.21.15.22:0/428909642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c06d520 msgr2=0x7f569c06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.682+0000 7f56a470f640 1 --2- 172.21.15.22:0/428909642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c06d520 0x7f569c06d900 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f569c0adb00 tx=0x7f569802b910 comp rx=0 tx=0).stop 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.682+0000 7f56a470f640 1 -- 172.21.15.22:0/428909642 shutdown_connections 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.682+0000 7f56a470f640 1 --2- 172.21.15.22:0/428909642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c0abff0 0x7f569c15f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.682+0000 7f56a470f640 1 --2- 172.21.15.22:0/428909642 >> v2:172.21.15.31:3300/0 conn(0x7f569c0ad720 0x7f569c15ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.682+0000 7f56a470f640 1 --2- 172.21.15.22:0/428909642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c06d520 0x7f569c06d900 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.682+0000 7f56a470f640 1 -- 172.21.15.22:0/428909642 >> 172.21.15.22:0/428909642 conn(0x7f569c0b0d80 msgr2=0x7f569c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.682+0000 7f56a470f640 1 -- 172.21.15.22:0/428909642 shutdown_connections 2023-11-24T06:14:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.682+0000 7f56a470f640 1 -- 172.21.15.22:0/428909642 wait complete. 2023-11-24T06:14:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.684+0000 7f56a470f640 1 Processor -- start 2023-11-24T06:14:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.684+0000 7f56a470f640 1 -- start start 2023-11-24T06:14:15.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.685+0000 7f56a470f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c06d520 0x7f569c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.685+0000 7f56a470f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f569c0abff0 0x7f569c14d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.685+0000 7f56a470f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c0ad720 0x7f569c0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.685+0000 7f56a470f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c157070 con 0x7f569c0ad720 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.685+0000 7f56a470f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0cbd10 con 0x7f569c0abff0 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.685+0000 7f56a470f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0cbff0 con 0x7f569c06d520 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.685+0000 7f56a2cac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c0ad720 0x7f569c0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.685+0000 7f56a2cac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c0ad720 0x7f569c0c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38750/0 (socket says 172.21.15.22:38750) 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.685+0000 7f56a2cac640 1 -- 172.21.15.22:0/3703884691 learned_addr learned my addr 172.21.15.22:0/3703884691 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f56a24ab640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c06d520 0x7f569c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f56a1caa640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f569c0abff0 0x7f569c14d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f56a2cac640 1 -- 172.21.15.22:0/3703884691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c06d520 msgr2=0x7f569c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f56a2cac640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c06d520 0x7f569c0ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f56a2cac640 1 -- 172.21.15.22:0/3703884691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f569c0abff0 msgr2=0x7f569c14d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f56a2cac640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f569c0abff0 0x7f569c14d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f56a2cac640 1 -- 172.21.15.22:0/3703884691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56980094d0 con 0x7f569c0ad720 2023-11-24T06:14:15.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f56a2cac640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c0ad720 0x7f569c0c9d70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f569400ce20 tx=0x7f569400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:15.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f5692ffd640 1 -- 172.21.15.22:0/3703884691 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694003b90 con 0x7f569c0ad720 2023-11-24T06:14:15.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f5692ffd640 1 -- 172.21.15.22:0/3703884691 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694003d10 con 0x7f569c0ad720 2023-11-24T06:14:15.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f5692ffd640 1 -- 172.21.15.22:0/3703884691 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694004260 con 0x7f569c0ad720 2023-11-24T06:14:15.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.686+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c0cc2d0 con 0x7f569c0ad720 2023-11-24T06:14:15.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.687+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c0cc890 con 0x7f569c0ad720 2023-11-24T06:14:15.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.688+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c074770 con 0x7f569c0ad720 2023-11-24T06:14:15.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.689+0000 7f5692ffd640 1 -- 172.21.15.22:0/3703884691 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f56940043c0 con 0x7f569c0ad720 2023-11-24T06:14:15.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.690+0000 7f5692ffd640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f568006aff0 0x7f568006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.690+0000 7f5692ffd640 1 -- 172.21.15.22:0/3703884691 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f569408a270 con 0x7f569c0ad720 2023-11-24T06:14:15.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.690+0000 7f56a24ab640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f568006aff0 0x7f568006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.691+0000 7f56a24ab640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f568006aff0 0x7f568006d4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5698036000 tx=0x7f569803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:15.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.695+0000 7f5692ffd640 1 -- 172.21.15.22:0/3703884691 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5694055000 con 0x7f569c0ad720 2023-11-24T06:14:15.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.890+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f569c0cb370 con 0x7f569c0ad720 2023-11-24T06:14:15.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.893+0000 7f5692ffd640 1 -- 172.21.15.22:0/3703884691 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16478 (secure 0 0 0) 0x7f5694003e80 con 0x7f569c0ad720 2023-11-24T06:14:15.896 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:15.896 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":46,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:14.914948+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:15.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f568006aff0 msgr2=0x7f568006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f568006aff0 0x7f568006d4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5698036000 tx=0x7f569803c040 comp rx=0 tx=0).stop 2023-11-24T06:14:15.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c0ad720 msgr2=0x7f569c0c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c0ad720 0x7f569c0c9d70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f569400ce20 tx=0x7f569400a710 comp rx=0 tx=0).stop 2023-11-24T06:14:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 shutdown_connections 2023-11-24T06:14:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f568006aff0 0x7f568006d4b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f569c0ad720 0x7f569c0c9d70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f569c0abff0 0x7f569c14d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 --2- 172.21.15.22:0/3703884691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f569c06d520 0x7f569c0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 >> 172.21.15.22:0/3703884691 conn(0x7f569c0b0d80 msgr2=0x7f569c0aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:15.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 shutdown_connections 2023-11-24T06:14:15.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:15.896+0000 7f56a470f640 1 -- 172.21.15.22:0/3703884691 wait complete. 2023-11-24T06:14:15.917 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.123+0000 7f98e2c9f640 1 Processor -- start 2023-11-24T06:14:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.123+0000 7f98e2c9f640 1 -- start start 2023-11-24T06:14:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.125+0000 7f98e2c9f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f98dc15d460 0x7f98dc0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.125+0000 7f98e2c9f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f98dc06be70 0x7f98dc0cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.125+0000 7f98e2c9f640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc0cbf60 con 0x7f98dc15d840 2023-11-24T06:14:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.125+0000 7f98e2c9f640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0cc520 con 0x7f98dc15d460 2023-11-24T06:14:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.125+0000 7f98e2c9f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0d03b0 con 0x7f98dc06be70 2023-11-24T06:14:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.125+0000 7f98e1c9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f98dc15d460 0x7f98dc0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.125+0000 7f98e1c9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f98dc15d460 0x7f98dc0b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38754/0 (socket says 172.21.15.22:38754) 2023-11-24T06:14:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.125+0000 7f98e149c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f98dc15d840 0x7f98dc06b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44874/0 (socket says 172.21.15.22:44874) 2023-11-24T06:14:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.125+0000 7f98e1c9d640 1 -- 172.21.15.22:0/152895648 learned_addr learned my addr 172.21.15.22:0/152895648 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.126+0000 7f98e249e640 1 --2- 172.21.15.22:0/152895648 >> v2:172.21.15.31:3300/0 conn(0x7f98dc06be70 0x7f98dc0cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.126+0000 7f98e1c9d640 1 -- 172.21.15.22:0/152895648 >> v2:172.21.15.31:3300/0 conn(0x7f98dc06be70 msgr2=0x7f98dc0cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.126+0000 7f98e1c9d640 1 --2- 172.21.15.22:0/152895648 >> v2:172.21.15.31:3300/0 conn(0x7f98dc06be70 0x7f98dc0cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.126+0000 7f98e1c9d640 1 -- 172.21.15.22:0/152895648 >> v1:172.21.15.22:6789/0 conn(0x7f98dc15d840 legacy=0x7f98dc06b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.126+0000 7f98e1c9d640 1 -- 172.21.15.22:0/152895648 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc06c3c0 con 0x7f98dc15d460 2023-11-24T06:14:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.126+0000 7f98e0c9b640 1 -- 172.21.15.22:0/152895648 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283346726 0 0) 0x7f98dc0cbf60 con 0x7f98dc15d840 2023-11-24T06:14:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.127+0000 7f98e1c9d640 1 --2- 172.21.15.22:0/152895648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 0x7f98dc0b2100 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f98dc071ca0 tx=0x7f98d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ef27d6708656ae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.127+0000 7f98e0c9b640 1 -- 172.21.15.22:0/152895648 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8030860 con 0x7f98dc15d460 2023-11-24T06:14:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.127+0000 7f98e0c9b640 1 -- 172.21.15.22:0/152895648 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d80309c0 con 0x7f98dc15d460 2023-11-24T06:14:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.128+0000 7f98e0c9b640 1 -- 172.21.15.22:0/152895648 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8030d50 con 0x7f98dc15d460 2023-11-24T06:14:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.128+0000 7f98e2c9f640 1 -- 172.21.15.22:0/152895648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 msgr2=0x7f98dc0b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.128+0000 7f98e2c9f640 1 --2- 172.21.15.22:0/152895648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 0x7f98dc0b2100 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f98dc071ca0 tx=0x7f98d802b9a0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.128+0000 7f98e2c9f640 1 -- 172.21.15.22:0/152895648 shutdown_connections 2023-11-24T06:14:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.128+0000 7f98e2c9f640 1 --2- 172.21.15.22:0/152895648 >> v2:172.21.15.31:3300/0 conn(0x7f98dc06be70 0x7f98dc0cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.128+0000 7f98e2c9f640 1 --2- 172.21.15.22:0/152895648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 0x7f98dc0b2100 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.128+0000 7f98e2c9f640 1 -- 172.21.15.22:0/152895648 >> 172.21.15.22:0/152895648 conn(0x7f98dc0d0f00 msgr2=0x7f98dc0d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:16.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.128+0000 7f98e2c9f640 1 -- 172.21.15.22:0/152895648 shutdown_connections 2023-11-24T06:14:16.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.128+0000 7f98e2c9f640 1 -- 172.21.15.22:0/152895648 wait complete. 2023-11-24T06:14:16.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.130+0000 7f98e2c9f640 1 Processor -- start 2023-11-24T06:14:16.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.130+0000 7f98e2c9f640 1 -- start start 2023-11-24T06:14:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.131+0000 7f98e2c9f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98dc06be70 0x7f98dc09ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.131+0000 7f98e2c9f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 0x7f98dc14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.131+0000 7f98e2c9f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98dc15d840 0x7f98dc15f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.131+0000 7f98e2c9f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0b2990 con 0x7f98dc15d460 2023-11-24T06:14:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.131+0000 7f98e2c9f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0b2c70 con 0x7f98dc06be70 2023-11-24T06:14:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.131+0000 7f98e2c9f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0b2f50 con 0x7f98dc15d840 2023-11-24T06:14:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.131+0000 7f98e149c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 0x7f98dc14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.131+0000 7f98e149c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 0x7f98dc14aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38770/0 (socket says 172.21.15.22:38770) 2023-11-24T06:14:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.131+0000 7f98e149c640 1 -- 172.21.15.22:0/716115521 learned_addr learned my addr 172.21.15.22:0/716115521 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e149c640 1 -- 172.21.15.22:0/716115521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98dc15d840 msgr2=0x7f98dc15f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e149c640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98dc15d840 0x7f98dc15f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e1c9d640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98dc06be70 0x7f98dc09ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e149c640 1 -- 172.21.15.22:0/716115521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98dc06be70 msgr2=0x7f98dc09ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e149c640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98dc06be70 0x7f98dc09ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e149c640 1 -- 172.21.15.22:0/716115521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d80094d0 con 0x7f98dc15d460 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e1c9d640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98dc06be70 0x7f98dc09ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e149c640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 0x7f98dc14aa50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00c4b0 tx=0x7f98cc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98d27fc640 1 -- 172.21.15.22:0/716115521 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc0074e0 con 0x7f98dc15d460 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98d27fc640 1 -- 172.21.15.22:0/716115521 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc007660 con 0x7f98dc15d460 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98d27fc640 1 -- 172.21.15.22:0/716115521 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc004a20 con 0x7f98dc15d460 2023-11-24T06:14:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc0b3230 con 0x7f98dc15d460 2023-11-24T06:14:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.132+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc09b4a0 con 0x7f98dc15d460 2023-11-24T06:14:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.134+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc04e840 con 0x7f98dc15d460 2023-11-24T06:14:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.135+0000 7f98d27fc640 1 -- 172.21.15.22:0/716115521 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f98cc004b80 con 0x7f98dc15d460 2023-11-24T06:14:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.136+0000 7f98d27fc640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f98c006aff0 0x7f98c006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.136+0000 7f98d27fc640 1 -- 172.21.15.22:0/716115521 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98cc088a50 con 0x7f98dc15d460 2023-11-24T06:14:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.136+0000 7f98e1c9d640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f98c006aff0 0x7f98c006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.136+0000 7f98e1c9d640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f98c006aff0 0x7f98c006d4b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f98d8036000 tx=0x7f98d803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.140+0000 7f98d27fc640 1 -- 172.21.15.22:0/716115521 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98cc053940 con 0x7f98dc15d460 2023-11-24T06:14:16.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.333+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98dc06e170 con 0x7f98dc15d460 2023-11-24T06:14:16.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.335+0000 7f98d27fc640 1 -- 172.21.15.22:0/716115521 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16478 (secure 0 0 0) 0x7f98cc018020 con 0x7f98dc15d460 2023-11-24T06:14:16.339 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:16.339 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":46,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:14.914948+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:16.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f98c006aff0 msgr2=0x7f98c006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f98c006aff0 0x7f98c006d4b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f98d8036000 tx=0x7f98d803b040 comp rx=0 tx=0).stop 2023-11-24T06:14:16.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 msgr2=0x7f98dc14aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 0x7f98dc14aa50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00c4b0 tx=0x7f98cc00c970 comp rx=0 tx=0).stop 2023-11-24T06:14:16.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 shutdown_connections 2023-11-24T06:14:16.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f98c006aff0 0x7f98c006d4b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98dc15d840 0x7f98dc15f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98dc15d460 0x7f98dc14aa50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 --2- 172.21.15.22:0/716115521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98dc06be70 0x7f98dc09ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.338+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 >> 172.21.15.22:0/716115521 conn(0x7f98dc0d0f00 msgr2=0x7f98dc15c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:16.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.339+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 shutdown_connections 2023-11-24T06:14:16.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.339+0000 7f98e2c9f640 1 -- 172.21.15.22:0/716115521 wait complete. 2023-11-24T06:14:16.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:14:16.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.591+0000 7fac63dd5640 1 Processor -- start 2023-11-24T06:14:16.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.592+0000 7fac63dd5640 1 -- start start 2023-11-24T06:14:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.593+0000 7fac63dd5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c159850 0x7fac5c070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.593+0000 7fac63dd5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac5c071e00 0x7fac5c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.593+0000 7fac63dd5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fac5c0cbef0 0x7fac5c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.593+0000 7fac63dd5640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c0cc380 con 0x7fac5c0cbef0 2023-11-24T06:14:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.593+0000 7fac63dd5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c0709b0 con 0x7fac5c071e00 2023-11-24T06:14:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.593+0000 7fac63dd5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c159c30 con 0x7fac5c159850 2023-11-24T06:14:16.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac62372640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fac5c0cbef0 0x7fac5c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac62372640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fac5c0cbef0 0x7fac5c15d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38786/0 (socket says 172.21.15.22:38786) 2023-11-24T06:14:16.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac62372640 1 -- 172.21.15.22:0/2626974541 learned_addr learned my addr 172.21.15.22:0/2626974541 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:16.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac61b71640 1 --2- 172.21.15.22:0/2626974541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c159850 0x7fac5c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac62372640 1 -- 172.21.15.22:0/2626974541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c159850 msgr2=0x7fac5c070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:16.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac62372640 1 --2- 172.21.15.22:0/2626974541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c159850 0x7fac5c070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac62372640 1 -- 172.21.15.22:0/2626974541 >> v2:172.21.15.31:3300/0 conn(0x7fac5c071e00 msgr2=0x7fac5c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:16.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac62372640 1 --2- 172.21.15.22:0/2626974541 >> v2:172.21.15.31:3300/0 conn(0x7fac5c071e00 0x7fac5c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac62372640 1 -- 172.21.15.22:0/2626974541 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c072330 con 0x7fac5c0cbef0 2023-11-24T06:14:16.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.594+0000 7fac61b71640 1 --2- 172.21.15.22:0/2626974541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c159850 0x7fac5c070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:16.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.595+0000 7fac62372640 1 --2- 172.21.15.22:0/2626974541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c0cbef0 0x7fac5c15d390 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0ccd90 tx=0x7fac5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd255f22cc95462 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.596+0000 7fac60b6f640 1 -- 172.21.15.22:0/2626974541 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54031870 con 0x7fac5c0cbef0 2023-11-24T06:14:16.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.596+0000 7fac60b6f640 1 -- 172.21.15.22:0/2626974541 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac540319d0 con 0x7fac5c0cbef0 2023-11-24T06:14:16.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.596+0000 7fac60b6f640 1 -- 172.21.15.22:0/2626974541 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54031d60 con 0x7fac5c0cbef0 2023-11-24T06:14:16.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.596+0000 7fac63dd5640 1 -- 172.21.15.22:0/2626974541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c0cbef0 msgr2=0x7fac5c15d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.596+0000 7fac63dd5640 1 --2- 172.21.15.22:0/2626974541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c0cbef0 0x7fac5c15d390 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0ccd90 tx=0x7fac5402b910 comp rx=0 tx=0).stop 2023-11-24T06:14:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.597+0000 7fac63dd5640 1 -- 172.21.15.22:0/2626974541 shutdown_connections 2023-11-24T06:14:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.597+0000 7fac63dd5640 1 --2- 172.21.15.22:0/2626974541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c0cbef0 0x7fac5c15d390 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.597+0000 7fac63dd5640 1 --2- 172.21.15.22:0/2626974541 >> v2:172.21.15.31:3300/0 conn(0x7fac5c071e00 0x7fac5c0cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.597+0000 7fac63dd5640 1 --2- 172.21.15.22:0/2626974541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c159850 0x7fac5c070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.597+0000 7fac63dd5640 1 -- 172.21.15.22:0/2626974541 >> 172.21.15.22:0/2626974541 conn(0x7fac5c06a860 msgr2=0x7fac5c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.597+0000 7fac63dd5640 1 -- 172.21.15.22:0/2626974541 shutdown_connections 2023-11-24T06:14:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.597+0000 7fac63dd5640 1 -- 172.21.15.22:0/2626974541 wait complete. 2023-11-24T06:14:16.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.599+0000 7fac63dd5640 1 Processor -- start 2023-11-24T06:14:16.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.599+0000 7fac63dd5640 1 -- start start 2023-11-24T06:14:16.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac63dd5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c071e00 0x7fac5c158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac63dd5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c0cbef0 0x7fac5c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac63dd5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c159850 0x7fac5c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac63dd5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0c87d0 con 0x7fac5c071e00 2023-11-24T06:14:16.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac63dd5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0c8a70 con 0x7fac5c159850 2023-11-24T06:14:16.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac63dd5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0c8d50 con 0x7fac5c0cbef0 2023-11-24T06:14:16.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac61b71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c071e00 0x7fac5c158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac61b71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c071e00 0x7fac5c158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38800/0 (socket says 172.21.15.22:38800) 2023-11-24T06:14:16.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac61b71640 1 -- 172.21.15.22:0/4164494536 learned_addr learned my addr 172.21.15.22:0/4164494536 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:16.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac61b71640 1 -- 172.21.15.22:0/4164494536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c0cbef0 msgr2=0x7fac5c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac61b71640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c0cbef0 0x7fac5c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac61b71640 1 -- 172.21.15.22:0/4164494536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c159850 msgr2=0x7fac5c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac61b71640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c159850 0x7fac5c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.600+0000 7fac61b71640 1 -- 172.21.15.22:0/4164494536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac540094d0 con 0x7fac5c071e00 2023-11-24T06:14:16.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.601+0000 7fac61b71640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c071e00 0x7fac5c158c70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00cf60 tx=0x7fac4c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.601+0000 7fac5a7fc640 1 -- 172.21.15.22:0/4164494536 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00d840 con 0x7fac5c071e00 2023-11-24T06:14:16.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.601+0000 7fac5a7fc640 1 -- 172.21.15.22:0/4164494536 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c00d9a0 con 0x7fac5c071e00 2023-11-24T06:14:16.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.601+0000 7fac5a7fc640 1 -- 172.21.15.22:0/4164494536 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00dd30 con 0x7fac5c071e00 2023-11-24T06:14:16.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.601+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c0c9030 con 0x7fac5c071e00 2023-11-24T06:14:16.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.601+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c0c95f0 con 0x7fac5c071e00 2023-11-24T06:14:16.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.603+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c067d60 con 0x7fac5c071e00 2023-11-24T06:14:16.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.604+0000 7fac5a7fc640 1 -- 172.21.15.22:0/4164494536 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fac4c015440 con 0x7fac5c071e00 2023-11-24T06:14:16.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.604+0000 7fac5a7fc640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac4806aff0 0x7fac4806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.605+0000 7fac5a7fc640 1 -- 172.21.15.22:0/4164494536 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac4c08a2f0 con 0x7fac5c071e00 2023-11-24T06:14:16.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.605+0000 7fac61370640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac4806aff0 0x7fac4806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.606+0000 7fac61370640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac4806aff0 0x7fac4806d4b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fac5c09cda0 tx=0x7fac50006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.609+0000 7fac5a7fc640 1 -- 172.21.15.22:0/4164494536 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac4c0551d0 con 0x7fac5c071e00 2023-11-24T06:14:16.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:16.834+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fac5c04e8b0 con 0x7fac5c071e00 2023-11-24T06:14:17.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.488+0000 7fac5a7fc640 1 -- 172.21.15.22:0/4164494536 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7fac4c0587f0 con 0x7fac5c071e00 2023-11-24T06:14:17.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac4806aff0 msgr2=0x7fac4806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac4806aff0 0x7fac4806d4b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fac5c09cda0 tx=0x7fac50006bf0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c071e00 msgr2=0x7fac5c158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c071e00 0x7fac5c158c70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00cf60 tx=0x7fac4c00cf90 comp rx=0 tx=0).stop 2023-11-24T06:14:17.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 shutdown_connections 2023-11-24T06:14:17.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fac4806aff0 0x7fac4806d4b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac5c159850 0x7fac5c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac5c0cbef0 0x7fac5c0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 --2- 172.21.15.22:0/4164494536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac5c071e00 0x7fac5c158c70 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.492+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 >> 172.21.15.22:0/4164494536 conn(0x7fac5c06a860 msgr2=0x7fac5c0b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:17.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.493+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 shutdown_connections 2023-11-24T06:14:17.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.493+0000 7fac63dd5640 1 -- 172.21.15.22:0/4164494536 wait complete. 2023-11-24T06:14:17.517 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:14:17.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:14:17.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.748+0000 7f6156cf1640 1 Processor -- start 2023-11-24T06:14:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.748+0000 7f6156cf1640 1 -- start start 2023-11-24T06:14:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.749+0000 7f6156cf1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61500c8930 0x7f61500ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.749+0000 7f6156cf1640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61500c6bf0 con 0x7f61500d1d90 2023-11-24T06:14:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.750+0000 7f6156cf1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61500cedc0 con 0x7f615015d3b0 2023-11-24T06:14:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.750+0000 7f6156cf1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61500c6e40 con 0x7f61500c8930 2023-11-24T06:14:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.750+0000 7f61554ee640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f61500d1d90 0x7f61500b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44888/0 (socket says 172.21.15.22:44888) 2023-11-24T06:14:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.750+0000 7f61554ee640 1 -- 172.21.15.22:0/2314388803 learned_addr learned my addr 172.21.15.22:0/2314388803 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:17.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.750+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370263159 0 0) 0x7f61500c6bf0 con 0x7f61500d1d90 2023-11-24T06:14:17.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.750+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f613c003520 con 0x7f61500d1d90 2023-11-24T06:14:17.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.750+0000 7f61564f0640 1 --2- 172.21.15.22:0/2314388803 >> v2:172.21.15.31:3300/0 conn(0x7f61500c8930 0x7f61500ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2401431171 0 0) 0x7f613c003520 con 0x7f61500d1d90 2023-11-24T06:14:17.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 >> v2:172.21.15.31:3300/0 conn(0x7f61500c8930 msgr2=0x7f61500ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:17.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 --2- 172.21.15.22:0/2314388803 >> v2:172.21.15.31:3300/0 conn(0x7f61500c8930 0x7f61500ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 >> v1:172.21.15.31:6789/0 conn(0x7f615015d3b0 legacy=0x7f61500d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500c7120 con 0x7f61500d1d90 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f6140001670 con 0x7f61500d1d90 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 >> v1:172.21.15.22:6789/0 conn(0x7f61500d1d90 legacy=0x7f61500b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f613c003a30 0x7f613c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c0047c0 0x7f613c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f613c005380 0x7f613c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61500c6e40 con 0x7f613c003a30 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c00c220 con 0x7f613c0047c0 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c00c3e0 con 0x7f613c005380 2023-11-24T06:14:17.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f6155cef640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f613c003a30 0x7f613c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.751+0000 7f61554ee640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c0047c0 0x7f613c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.752+0000 7f61564f0640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f613c005380 0x7f613c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.752+0000 7f6155cef640 1 -- 172.21.15.22:0/2314388803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f613c005380 msgr2=0x7f613c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.752+0000 7f6155cef640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f613c005380 0x7f613c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.752+0000 7f6155cef640 1 -- 172.21.15.22:0/2314388803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c0047c0 msgr2=0x7f613c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.752+0000 7f6155cef640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c0047c0 0x7f613c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.752+0000 7f6155cef640 1 -- 172.21.15.22:0/2314388803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c003520 con 0x7f613c003a30 2023-11-24T06:14:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.752+0000 7f61564f0640 1 -- 172.21.15.22:0/2314388803 reap_dead start 2023-11-24T06:14:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.753+0000 7f6155cef640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f613c003a30 0x7f613c003e50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f614c001e50 tx=0x7f613c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b2a9967270d72a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.753+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c003b70 con 0x7f613c003a30 2023-11-24T06:14:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.753+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c003cd0 con 0x7f613c003a30 2023-11-24T06:14:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.753+0000 7f6154ced640 1 -- 172.21.15.22:0/2314388803 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c005310 con 0x7f613c003a30 2023-11-24T06:14:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.754+0000 7f6156cf1640 1 -- 172.21.15.22:0/2314388803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f613c003a30 msgr2=0x7f613c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.754+0000 7f6156cf1640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f613c003a30 0x7f613c003e50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f614c001e50 tx=0x7f613c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.754+0000 7f6156cf1640 1 -- 172.21.15.22:0/2314388803 shutdown_connections 2023-11-24T06:14:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.754+0000 7f6156cf1640 1 --2- 172.21.15.22:0/2314388803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f613c003a30 0x7f613c003e50 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.754+0000 7f6156cf1640 1 -- 172.21.15.22:0/2314388803 >> 172.21.15.22:0/2314388803 conn(0x7f61500d30a0 msgr2=0x7f61500d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:17.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.754+0000 7f6156cf1640 1 -- 172.21.15.22:0/2314388803 shutdown_connections 2023-11-24T06:14:17.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.754+0000 7f6156cf1640 1 -- 172.21.15.22:0/2314388803 wait complete. 2023-11-24T06:14:17.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.756+0000 7f6156cf1640 1 Processor -- start 2023-11-24T06:14:17.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.756+0000 7f6156cf1640 1 -- start start 2023-11-24T06:14:17.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f6156cf1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c003a30 0x7f6150157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f6156cf1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6150156f00 0x7f615015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f6156cf1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615015a900 0x7f615015e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f6156cf1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61500cb710 con 0x7f615015a900 2023-11-24T06:14:17.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f6156cf1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6150157a40 con 0x7f613c003a30 2023-11-24T06:14:17.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f6156cf1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6150158ba0 con 0x7f6150156f00 2023-11-24T06:14:17.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f61564f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615015a900 0x7f615015e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f61564f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615015a900 0x7f615015e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38816/0 (socket says 172.21.15.22:38816) 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f61564f0640 1 -- 172.21.15.22:0/1903003445 learned_addr learned my addr 172.21.15.22:0/1903003445 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f61554ee640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6150156f00 0x7f615015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f6155cef640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c003a30 0x7f6150157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f61564f0640 1 -- 172.21.15.22:0/1903003445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6150156f00 msgr2=0x7f615015a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.757+0000 7f61564f0640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6150156f00 0x7f615015a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f61564f0640 1 -- 172.21.15.22:0/1903003445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c003a30 msgr2=0x7f6150157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f61564f0640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c003a30 0x7f6150157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f61564f0640 1 -- 172.21.15.22:0/1903003445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500cb050 con 0x7f615015a900 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f6155cef640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c003a30 0x7f6150157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:17.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f61564f0640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615015a900 0x7f615015e360 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f615008c4a0 tx=0x7f614800e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:17.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f61467fc640 1 -- 172.21.15.22:0/1903003445 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614800c070 con 0x7f615015a900 2023-11-24T06:14:17.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f61467fc640 1 -- 172.21.15.22:0/1903003445 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6148004020 con 0x7f615015a900 2023-11-24T06:14:17.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f61467fc640 1 -- 172.21.15.22:0/1903003445 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61480043d0 con 0x7f615015a900 2023-11-24T06:14:17.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61500cb330 con 0x7f615015a900 2023-11-24T06:14:17.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.758+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6150158850 con 0x7f615015a900 2023-11-24T06:14:17.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.759+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61500cb850 con 0x7f615015a900 2023-11-24T06:14:17.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.760+0000 7f61467fc640 1 -- 172.21.15.22:0/1903003445 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6148003610 con 0x7f615015a900 2023-11-24T06:14:17.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.761+0000 7f61467fc640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406b020 0x7f613406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.761+0000 7f61467fc640 1 -- 172.21.15.22:0/1903003445 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6148088be0 con 0x7f615015a900 2023-11-24T06:14:17.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.762+0000 7f6155cef640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406b020 0x7f613406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.762+0000 7f6155cef640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406b020 0x7f613406d4e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f614c034000 tx=0x7f614c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:17.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.766+0000 7f61467fc640 1 -- 172.21.15.22:0/1903003445 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61500cb850 con 0x7f615015a900 2023-11-24T06:14:18.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:17.999+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f61500cb850 con 0x7f615015a900 2023-11-24T06:14:18.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.492+0000 7f61467fc640 1 -- 172.21.15.22:0/1903003445 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f61500cb850 con 0x7f615015a900 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406b020 msgr2=0x7f613406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406b020 0x7f613406d4e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f614c034000 tx=0x7f614c009030 comp rx=0 tx=0).stop 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615015a900 msgr2=0x7f615015e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615015a900 0x7f615015e360 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f615008c4a0 tx=0x7f614800e8b0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 shutdown_connections 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406b020 0x7f613406d4e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615015a900 0x7f615015e360 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6150156f00 0x7f615015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 --2- 172.21.15.22:0/1903003445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613c003a30 0x7f6150157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 >> 172.21.15.22:0/1903003445 conn(0x7f61500d30a0 msgr2=0x7f615006c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:18.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 shutdown_connections 2023-11-24T06:14:18.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.496+0000 7f6156cf1640 1 -- 172.21.15.22:0/1903003445 wait complete. 2023-11-24T06:14:18.520 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:14:18.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.749+0000 7f90a26bb640 1 Processor -- start 2023-11-24T06:14:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.749+0000 7f90a26bb640 1 -- start start 2023-11-24T06:14:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.751+0000 7f90a26bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c06d520 0x7f909c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.751+0000 7f90a26bb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f909c0abff0 0x7f909c15f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.751+0000 7f90a26bb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c15c360 con 0x7f909c0ad720 2023-11-24T06:14:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.751+0000 7f90a26bb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c0b41a0 con 0x7f909c0abff0 2023-11-24T06:14:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.751+0000 7f90a26bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c06de40 con 0x7f909c06d520 2023-11-24T06:14:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.751+0000 7f90a0c58640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f909c0abff0 0x7f909c15f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.751+0000 7f90937fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f909c0ad720 0x7f909c15ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44902/0 (socket says 172.21.15.22:44902) 2023-11-24T06:14:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.751+0000 7f90937fe640 1 -- 172.21.15.22:0/178895356 learned_addr learned my addr 172.21.15.22:0/178895356 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.752+0000 7f909bfff640 1 --2- 172.21.15.22:0/178895356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c06d520 0x7f909c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.752+0000 7f90a0c58640 1 -- 172.21.15.22:0/178895356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c06d520 msgr2=0x7f909c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.752+0000 7f90a0c58640 1 --2- 172.21.15.22:0/178895356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c06d520 0x7f909c06d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.752+0000 7f90a0c58640 1 -- 172.21.15.22:0/178895356 >> v1:172.21.15.22:6789/0 conn(0x7f909c0ad720 legacy=0x7f909c15ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.752+0000 7f90a0c58640 1 -- 172.21.15.22:0/178895356 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c15ba30 con 0x7f909c0abff0 2023-11-24T06:14:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.752+0000 7f909b7fe640 1 -- 172.21.15.22:0/178895356 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765858156 0 0) 0x7f909c15c360 con 0x7f909c0ad720 2023-11-24T06:14:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.753+0000 7f90a0c58640 1 --2- 172.21.15.22:0/178895356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 0x7f909c15f3e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9094009d90 tx=0x7f909402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487e284e0318e181 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.753+0000 7f909b7fe640 1 -- 172.21.15.22:0/178895356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909402cc50 con 0x7f909c0abff0 2023-11-24T06:14:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.753+0000 7f909b7fe640 1 -- 172.21.15.22:0/178895356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909402cdb0 con 0x7f909c0abff0 2023-11-24T06:14:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.753+0000 7f909b7fe640 1 -- 172.21.15.22:0/178895356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094034660 con 0x7f909c0abff0 2023-11-24T06:14:18.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.754+0000 7f90a26bb640 1 -- 172.21.15.22:0/178895356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 msgr2=0x7f909c15f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.754+0000 7f90a26bb640 1 --2- 172.21.15.22:0/178895356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 0x7f909c15f3e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9094009d90 tx=0x7f909402bea0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.754+0000 7f90a26bb640 1 -- 172.21.15.22:0/178895356 shutdown_connections 2023-11-24T06:14:18.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.754+0000 7f90a26bb640 1 --2- 172.21.15.22:0/178895356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 0x7f909c15f3e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.754+0000 7f90a26bb640 1 --2- 172.21.15.22:0/178895356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c06d520 0x7f909c06d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.754+0000 7f90a26bb640 1 -- 172.21.15.22:0/178895356 >> 172.21.15.22:0/178895356 conn(0x7f909c0b0d80 msgr2=0x7f909c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:18.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.754+0000 7f90a26bb640 1 -- 172.21.15.22:0/178895356 shutdown_connections 2023-11-24T06:14:18.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.754+0000 7f90a26bb640 1 -- 172.21.15.22:0/178895356 wait complete. 2023-11-24T06:14:18.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.756+0000 7f90a26bb640 1 Processor -- start 2023-11-24T06:14:18.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.756+0000 7f90a26bb640 1 -- start start 2023-11-24T06:14:18.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.757+0000 7f90a26bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909c06d520 0x7f909c152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.757+0000 7f90a26bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 0x7f909c0b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.757+0000 7f90a26bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c0ad720 0x7f909c0b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.757+0000 7f90a26bb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0cd370 con 0x7f909c0abff0 2023-11-24T06:14:18.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.757+0000 7f90a26bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c15b2f0 con 0x7f909c06d520 2023-11-24T06:14:18.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.757+0000 7f90a26bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0cd5f0 con 0x7f909c0ad720 2023-11-24T06:14:18.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.757+0000 7f90937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 0x7f909c0b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f90937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 0x7f909c0b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38820/0 (socket says 172.21.15.22:38820) 2023-11-24T06:14:18.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f90937fe640 1 -- 172.21.15.22:0/2811329409 learned_addr learned my addr 172.21.15.22:0/2811329409 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:18.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f90a0c58640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c0ad720 0x7f909c0b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f909bfff640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909c06d520 0x7f909c152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f90937fe640 1 -- 172.21.15.22:0/2811329409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c0ad720 msgr2=0x7f909c0b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f90937fe640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c0ad720 0x7f909c0b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f90937fe640 1 -- 172.21.15.22:0/2811329409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909c06d520 msgr2=0x7f909c152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f90937fe640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909c06d520 0x7f909c152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f90937fe640 1 -- 172.21.15.22:0/2811329409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094009a70 con 0x7f909c0abff0 2023-11-24T06:14:18.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f909bfff640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909c06d520 0x7f909c152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:18.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.758+0000 7f90937fe640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 0x7f909c0b1e70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f908400c410 tx=0x7f908400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.759+0000 7f90997fa640 1 -- 172.21.15.22:0/2811329409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90840074e0 con 0x7f909c0abff0 2023-11-24T06:14:18.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.759+0000 7f90997fa640 1 -- 172.21.15.22:0/2811329409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9084007660 con 0x7f909c0abff0 2023-11-24T06:14:18.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.759+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c0cd8d0 con 0x7f909c0abff0 2023-11-24T06:14:18.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.759+0000 7f90997fa640 1 -- 172.21.15.22:0/2811329409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084004a20 con 0x7f909c0abff0 2023-11-24T06:14:18.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.759+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c152e60 con 0x7f909c0abff0 2023-11-24T06:14:18.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.760+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c0cddf0 con 0x7f909c0abff0 2023-11-24T06:14:18.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.761+0000 7f90997fa640 1 -- 172.21.15.22:0/2811329409 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9084004b80 con 0x7f909c0abff0 2023-11-24T06:14:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.762+0000 7f90997fa640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f908006b040 0x7f908006d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.762+0000 7f90997fa640 1 -- 172.21.15.22:0/2811329409 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9084089780 con 0x7f909c0abff0 2023-11-24T06:14:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.762+0000 7f909bfff640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f908006b040 0x7f908006d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.763+0000 7f909bfff640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f908006b040 0x7f908006d500 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f908c006fd0 tx=0x7f908c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.766+0000 7f90997fa640 1 -- 172.21.15.22:0/2811329409 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f909c0cddf0 con 0x7f909c0abff0 2023-11-24T06:14:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:18.999+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f909c0cddf0 con 0x7f909c0abff0 2023-11-24T06:14:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.000+0000 7f90997fa640 1 -- 172.21.15.22:0/2811329409 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f909c0cddf0 con 0x7f909c0abff0 2023-11-24T06:14:19.003 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:19.003 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:14:19.003 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 25 2023-11-24T06:14:19.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.002+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f908006b040 msgr2=0x7f908006d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f908006b040 0x7f908006d500 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f908c006fd0 tx=0x7f908c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 msgr2=0x7f909c0b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 0x7f909c0b1e70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f908400c410 tx=0x7f908400c8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 shutdown_connections 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f908006b040 0x7f908006d500 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909c0ad720 0x7f909c0b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0abff0 0x7f909c0b1e70 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 --2- 172.21.15.22:0/2811329409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909c06d520 0x7f909c152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 >> 172.21.15.22:0/2811329409 conn(0x7f909c0b0d80 msgr2=0x7f909c0af760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 shutdown_connections 2023-11-24T06:14:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.003+0000 7f90a26bb640 1 -- 172.21.15.22:0/2811329409 wait complete. 2023-11-24T06:14:19.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:19.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.249+0000 7f6dbcd43640 1 Processor -- start 2023-11-24T06:14:19.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.250+0000 7f6dbcd43640 1 -- start start 2023-11-24T06:14:19.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.251+0000 7f6dbcd43640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80abff0 0x7f6db80b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.251+0000 7f6dbcd43640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db815c360 con 0x7f6db806d520 2023-11-24T06:14:19.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.251+0000 7f6dbcd43640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db815ba30 con 0x7f6db80ad720 2023-11-24T06:14:19.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.251+0000 7f6dbcd43640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80b41a0 con 0x7f6db80abff0 2023-11-24T06:14:19.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.251+0000 7f6db659c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6db806d520 0x7f6db806d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44916/0 (socket says 172.21.15.22:44916) 2023-11-24T06:14:19.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.251+0000 7f6db659c640 1 -- 172.21.15.22:0/3000106579 learned_addr learned my addr 172.21.15.22:0/3000106579 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:19.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db6d9d640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80abff0 0x7f6db80b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349470720 0 0) 0x7f6db815c360 con 0x7f6db806d520 2023-11-24T06:14:19.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da4003520 con 0x7f6db806d520 2023-11-24T06:14:19.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 453233170 0 0) 0x7f6da4003520 con 0x7f6db806d520 2023-11-24T06:14:19.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80abff0 msgr2=0x7f6db80b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:19.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80abff0 0x7f6db80b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 >> v1:172.21.15.31:6789/0 conn(0x7f6db80ad720 legacy=0x7f6db80b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db815bd10 con 0x7f6db806d520 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f6da80019f0 con 0x7f6db806d520 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 >> v1:172.21.15.22:6789/0 conn(0x7f6db806d520 legacy=0x7f6db806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6da40039a0 0x7f6da4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da40047c0 0x7f6da4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80abff0 0x7f6da4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da400ba30 con 0x7f6da40039a0 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da400bb70 con 0x7f6da40047c0 2023-11-24T06:14:19.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.252+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da400bd30 con 0x7f6db80abff0 2023-11-24T06:14:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.253+0000 7f6db659c640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6da40039a0 0x7f6da4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.253+0000 7f6db5d9b640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da40047c0 0x7f6da4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.253+0000 7f6db6d9d640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80abff0 0x7f6da4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.253+0000 7f6db659c640 1 -- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80abff0 msgr2=0x7f6da4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.253+0000 7f6db659c640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6db80abff0 0x7f6da4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.253+0000 7f6db659c640 1 -- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da40047c0 msgr2=0x7f6da4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.253+0000 7f6db659c640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da40047c0 0x7f6da4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.253+0000 7f6db659c640 1 -- 172.21.15.22:0/3000106579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4003520 con 0x7f6da40039a0 2023-11-24T06:14:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.253+0000 7f6db5d9b640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da40047c0 0x7f6da4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:19.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.254+0000 7f6db659c640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6da40039a0 0x7f6da4003dc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6da800a7f0 tx=0x7f6da40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c424707f5bd6d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.254+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da80072d0 con 0x7f6da40039a0 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.254+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da802f070 con 0x7f6da40039a0 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.254+0000 7f6db559a640 1 -- 172.21.15.22:0/3000106579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da80076b0 con 0x7f6da40039a0 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.255+0000 7f6dbcd43640 1 -- 172.21.15.22:0/3000106579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6da40039a0 msgr2=0x7f6da4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.255+0000 7f6dbcd43640 1 --2- 172.21.15.22:0/3000106579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6da40039a0 0x7f6da4003dc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6da800a7f0 tx=0x7f6da40057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.255+0000 7f6db6d9d640 1 -- 172.21.15.22:0/3000106579 reap_dead start 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.255+0000 7f6dbcd43640 1 -- 172.21.15.22:0/3000106579 shutdown_connections 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.255+0000 7f6dbcd43640 1 -- 172.21.15.22:0/3000106579 >> 172.21.15.22:0/3000106579 conn(0x7f6db80b0d80 msgr2=0x7f6db80b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.255+0000 7f6dbcd43640 1 -- 172.21.15.22:0/3000106579 shutdown_connections 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.255+0000 7f6dbcd43640 1 -- 172.21.15.22:0/3000106579 wait complete. 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.257+0000 7f6dbcd43640 1 Processor -- start 2023-11-24T06:14:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.257+0000 7f6dbcd43640 1 -- start start 2023-11-24T06:14:19.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.258+0000 7f6dbcd43640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6da40039a0 0x7f6db8071a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.258+0000 7f6dbcd43640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db8155dd0 0x7f6db8071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.258+0000 7f6dbcd43640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6db8153630 0x7f6db80704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.258+0000 7f6dbcd43640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db81544f0 con 0x7f6db8153630 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.258+0000 7f6dbcd43640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db815f900 con 0x7f6db8155dd0 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.258+0000 7f6dbcd43640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80c8400 con 0x7f6da40039a0 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.258+0000 7f6db6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6db8153630 0x7f6db80704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.258+0000 7f6db6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6db8153630 0x7f6db80704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38838/0 (socket says 172.21.15.22:38838) 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db6d9d640 1 -- 172.21.15.22:0/2100062797 learned_addr learned my addr 172.21.15.22:0/2100062797 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db659c640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6da40039a0 0x7f6db8071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db5d9b640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db8155dd0 0x7f6db8071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db6d9d640 1 -- 172.21.15.22:0/2100062797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6da40039a0 msgr2=0x7f6db8071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db6d9d640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6da40039a0 0x7f6db8071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db6d9d640 1 -- 172.21.15.22:0/2100062797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db8155dd0 msgr2=0x7f6db8071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db6d9d640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db8155dd0 0x7f6db8071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db6d9d640 1 -- 172.21.15.22:0/2100062797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80cbe70 con 0x7f6db8153630 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db5d9b640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db8155dd0 0x7f6db8071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.259+0000 7f6db6d9d640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6db8153630 0x7f6db80704b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6db80b1e40 tx=0x7f6db0010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.260+0000 7f6daeffd640 1 -- 172.21.15.22:0/2100062797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000e8a0 con 0x7f6db8153630 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.260+0000 7f6daeffd640 1 -- 172.21.15.22:0/2100062797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db000ea00 con 0x7f6db8153630 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.260+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db80cc150 con 0x7f6db8153630 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.260+0000 7f6daeffd640 1 -- 172.21.15.22:0/2100062797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000edb0 con 0x7f6db8153630 2023-11-24T06:14:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.260+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db80cc710 con 0x7f6db8153630 2023-11-24T06:14:19.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.261+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db80cc930 con 0x7f6db8153630 2023-11-24T06:14:19.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.262+0000 7f6daeffd640 1 -- 172.21.15.22:0/2100062797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6db00143f0 con 0x7f6db8153630 2023-11-24T06:14:19.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.263+0000 7f6daeffd640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6d9806b020 0x7f6d9806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.263+0000 7f6daeffd640 1 -- 172.21.15.22:0/2100062797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6db0089a40 con 0x7f6db8153630 2023-11-24T06:14:19.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.263+0000 7f6db659c640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6d9806b020 0x7f6d9806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.264+0000 7f6db659c640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6d9806b020 0x7f6d9806d4e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6da8034000 tx=0x7f6da8007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.267+0000 7f6daeffd640 1 -- 172.21.15.22:0/2100062797 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6db0054860 con 0x7f6db8153630 2023-11-24T06:14:19.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.463+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6db8074770 con 0x7f6db8153630 2023-11-24T06:14:19.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.466+0000 7f6daeffd640 1 -- 172.21.15.22:0/2100062797 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16465 (secure 0 0 0) 0x7f6db0057e80 con 0x7f6db8153630 2023-11-24T06:14:19.469 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:19.469 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":47,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:16.422982+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:19.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.468+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6d9806b020 msgr2=0x7f6d9806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.468+0000 7f6dbcd43640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6d9806b020 0x7f6d9806d4e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6da8034000 tx=0x7f6da8007000 comp rx=0 tx=0).stop 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.468+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6db8153630 msgr2=0x7f6db80704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.468+0000 7f6dbcd43640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6db8153630 0x7f6db80704b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6db80b1e40 tx=0x7f6db0010c20 comp rx=0 tx=0).stop 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.469+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 shutdown_connections 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.469+0000 7f6dbcd43640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6d9806b020 0x7f6d9806d4e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.469+0000 7f6dbcd43640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6db8153630 0x7f6db80704b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.469+0000 7f6dbcd43640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6db8155dd0 0x7f6db8071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.469+0000 7f6dbcd43640 1 --2- 172.21.15.22:0/2100062797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6da40039a0 0x7f6db8071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.469+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 >> 172.21.15.22:0/2100062797 conn(0x7f6db80b0d80 msgr2=0x7f6db80af930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.469+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 shutdown_connections 2023-11-24T06:14:19.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.469+0000 7f6dbcd43640 1 -- 172.21.15.22:0/2100062797 wait complete. 2023-11-24T06:14:19.490 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:14:19.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:14:19.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.713+0000 7f9242bcb640 1 Processor -- start 2023-11-24T06:14:19.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.714+0000 7f9242bcb640 1 -- start start 2023-11-24T06:14:19.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.715+0000 7f9242bcb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c15d5b0 0x7f923c0d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.715+0000 7f9242bcb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f923c0b1650 0x7f923c0d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.715+0000 7f9242bcb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c0cf0c0 con 0x7f923c0d14a0 2023-11-24T06:14:19.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.715+0000 7f9242bcb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c0b01b0 con 0x7f923c0b1650 2023-11-24T06:14:19.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.715+0000 7f9242bcb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c15d990 con 0x7f923c15d5b0 2023-11-24T06:14:19.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f92413c8640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f923c0d14a0 0x7f923c0cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44920/0 (socket says 172.21.15.22:44920) 2023-11-24T06:14:19.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f92413c8640 1 -- 172.21.15.22:0/1048852998 learned_addr learned my addr 172.21.15.22:0/1048852998 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:19.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f92423ca640 1 --2- 172.21.15.22:0/1048852998 >> v2:172.21.15.22:3300/0 conn(0x7f923c0b1650 0x7f923c0d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f9241bc9640 1 --2- 172.21.15.22:0/1048852998 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c15d5b0 0x7f923c0d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f9240bc7640 1 -- 172.21.15.22:0/1048852998 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288068331 0 0) 0x7f923c0cf0c0 con 0x7f923c0d14a0 2023-11-24T06:14:19.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f9240bc7640 1 -- 172.21.15.22:0/1048852998 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9228003520 con 0x7f923c0d14a0 2023-11-24T06:14:19.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f92423ca640 1 -- 172.21.15.22:0/1048852998 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c15d5b0 msgr2=0x7f923c0d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:19.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f92423ca640 1 --2- 172.21.15.22:0/1048852998 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c15d5b0 0x7f923c0d3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f92423ca640 1 -- 172.21.15.22:0/1048852998 >> v1:172.21.15.22:6789/0 conn(0x7f923c0d14a0 legacy=0x7f923c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.716+0000 7f92423ca640 1 -- 172.21.15.22:0/1048852998 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c0d1e40 con 0x7f923c0b1650 2023-11-24T06:14:19.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.717+0000 7f92423ca640 1 --2- 172.21.15.22:0/1048852998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c0b1650 0x7f923c0d1900 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9234009d90 tx=0x7f923402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d78871c922377b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.718+0000 7f9240bc7640 1 -- 172.21.15.22:0/1048852998 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923402cc50 con 0x7f923c0b1650 2023-11-24T06:14:19.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.718+0000 7f9240bc7640 1 -- 172.21.15.22:0/1048852998 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923402cdb0 con 0x7f923c0b1650 2023-11-24T06:14:19.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.718+0000 7f9240bc7640 1 -- 172.21.15.22:0/1048852998 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234034660 con 0x7f923c0b1650 2023-11-24T06:14:19.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.718+0000 7f9242bcb640 1 -- 172.21.15.22:0/1048852998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c0b1650 msgr2=0x7f923c0d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.718+0000 7f9242bcb640 1 --2- 172.21.15.22:0/1048852998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c0b1650 0x7f923c0d1900 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9234009d90 tx=0x7f923402bea0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.718+0000 7f9242bcb640 1 -- 172.21.15.22:0/1048852998 shutdown_connections 2023-11-24T06:14:19.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.718+0000 7f9242bcb640 1 --2- 172.21.15.22:0/1048852998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c0b1650 0x7f923c0d1900 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.718+0000 7f9242bcb640 1 --2- 172.21.15.22:0/1048852998 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c15d5b0 0x7f923c0d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.718+0000 7f9242bcb640 1 -- 172.21.15.22:0/1048852998 >> 172.21.15.22:0/1048852998 conn(0x7f923c09c3b0 msgr2=0x7f923c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.719+0000 7f9242bcb640 1 -- 172.21.15.22:0/1048852998 shutdown_connections 2023-11-24T06:14:19.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.719+0000 7f9242bcb640 1 -- 172.21.15.22:0/1048852998 wait complete. 2023-11-24T06:14:19.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.720+0000 7f9242bcb640 1 Processor -- start 2023-11-24T06:14:19.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.721+0000 7f9242bcb640 1 -- start start 2023-11-24T06:14:19.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f9242bcb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0b1650 0x7f923c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f9242bcb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c0d14a0 0x7f923c0d32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f9242bcb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c15d5b0 0x7f923c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f9242bcb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0b8f60 con 0x7f923c15d5b0 2023-11-24T06:14:19.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f9242bcb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0c7580 con 0x7f923c0b1650 2023-11-24T06:14:19.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f9242bcb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0b7d30 con 0x7f923c0d14a0 2023-11-24T06:14:19.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f92423ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c15d5b0 0x7f923c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f92423ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c15d5b0 0x7f923c1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38846/0 (socket says 172.21.15.22:38846) 2023-11-24T06:14:19.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f92423ca640 1 -- 172.21.15.22:0/613916235 learned_addr learned my addr 172.21.15.22:0/613916235 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:19.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f92413c8640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c0d14a0 0x7f923c0d32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.722+0000 7f9241bc9640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0b1650 0x7f923c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f92423ca640 1 -- 172.21.15.22:0/613916235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c0d14a0 msgr2=0x7f923c0d32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f92423ca640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c0d14a0 0x7f923c0d32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f92423ca640 1 -- 172.21.15.22:0/613916235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0b1650 msgr2=0x7f923c0b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f92423ca640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0b1650 0x7f923c0b8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f92423ca640 1 -- 172.21.15.22:0/613916235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234009a70 con 0x7f923c15d5b0 2023-11-24T06:14:19.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f92423ca640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c15d5b0 0x7f923c1520d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9234009eb0 tx=0x7f9234004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f92327fc640 1 -- 172.21.15.22:0/613916235 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234040650 con 0x7f923c15d5b0 2023-11-24T06:14:19.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f92327fc640 1 -- 172.21.15.22:0/613916235 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92340407b0 con 0x7f923c15d5b0 2023-11-24T06:14:19.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f92327fc640 1 -- 172.21.15.22:0/613916235 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234040b60 con 0x7f923c15d5b0 2023-11-24T06:14:19.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c0b8010 con 0x7f923c15d5b0 2023-11-24T06:14:19.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.723+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c160720 con 0x7f923c15d5b0 2023-11-24T06:14:19.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.725+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c0c7070 con 0x7f923c15d5b0 2023-11-24T06:14:19.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.726+0000 7f92327fc640 1 -- 172.21.15.22:0/613916235 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9234040cc0 con 0x7f923c15d5b0 2023-11-24T06:14:19.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.727+0000 7f92327fc640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922006aff0 0x7f922006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.727+0000 7f92327fc640 1 -- 172.21.15.22:0/613916235 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92340ac6a0 con 0x7f923c15d5b0 2023-11-24T06:14:19.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.727+0000 7f9241bc9640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922006aff0 0x7f922006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.728+0000 7f9241bc9640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922006aff0 0x7f922006d4b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9238006fd0 tx=0x7f9238008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.732+0000 7f92327fc640 1 -- 172.21.15.22:0/613916235 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f923c0c7070 con 0x7f923c15d5b0 2023-11-24T06:14:19.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.923+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f923c0afe40 con 0x7f922006aff0 2023-11-24T06:14:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.950+0000 7f92327fc640 1 -- 172.21.15.22:0/613916235 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276380 (secure 0 0 0) 0x7f9238009d60 con 0x7f922006aff0 2023-11-24T06:14:19.956 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:19.958 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:14:19.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922006aff0 msgr2=0x7f922006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922006aff0 0x7f922006d4b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9238006fd0 tx=0x7f9238008040 comp rx=0 tx=0).stop 2023-11-24T06:14:19.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c15d5b0 msgr2=0x7f923c1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c15d5b0 0x7f923c1520d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9234009eb0 tx=0x7f9234004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:19.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 shutdown_connections 2023-11-24T06:14:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922006aff0 0x7f922006d4b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f923c15d5b0 0x7f923c1520d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923c0d14a0 0x7f923c0d32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 --2- 172.21.15.22:0/613916235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0b1650 0x7f923c0b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.956+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 >> 172.21.15.22:0/613916235 conn(0x7f923c09c3b0 msgr2=0x7f923c06bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.957+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 shutdown_connections 2023-11-24T06:14:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:19.957+0000 7f9242bcb640 1 -- 172.21.15.22:0/613916235 wait complete. 2023-11-24T06:14:19.980 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-11-24T06:14:18.689988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":237960,"kb_used_data":5144,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736760,"statfs":{"total":773094113280,"available":772850442240,"internally_reserved":0,"allocated":5267456,"data_stored":2796748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.260708"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.451245+0000","last_change":"2023-11-24T06:14:14.451245+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.451245+0000","last_undegraded":"2023-11-24T06:14:14.451245+0000","last_fullsized":"2023-11-24T06:14:14.451245+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.453608+0000","last_change":"2023-11-24T06:14:14.453608+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.453608+0000","last_undegraded":"2023-11-24T06:14:14.453608+0000","last_fullsized":"2023-11-24T06:14:14.453608+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.456186+0000","last_change":"2023-11-24T06:14:14.456186+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.456186+0000","last_undegraded":"2023-11-24T06:14:14.456186+0000","last_fullsized":"2023-11-24T06:14:14.456186+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.454922+0000","last_change":"2023-11-24T06:14:14.454922+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.454922+0000","last_undegraded":"2023-11-24T06:14:14.454922+0000","last_fullsized":"2023-11-24T06:14:14.454922+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531657+0000","last_change":"2023-11-24T06:14:15.461105+0000","last_active":"2023-11-24T06:14:16.531657+0000","last_peered":"2023-11-24T06:14:16.531657+0000","last_clean":"2023-11-24T06:14:16.531657+0000","last_became_active":"2023-11-24T06:14:15.458141+0000","last_became_peered":"2023-11-24T06:14:15.458141+0000","last_unstale":"2023-11-24T06:14:16.531657+0000","last_undegraded":"2023-11-24T06:14:16.531657+0000","last_fullsized":"2023-11-24T06:14:16.531657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:59.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445635+0000","last_change":"2023-11-24T06:14:13.445635+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445635+0000","last_undegraded":"2023-11-24T06:14:13.445635+0000","last_fullsized":"2023-11-24T06:14:13.445635+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.447134+0000","last_change":"2023-11-24T06:14:13.447134+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.447134+0000","last_undegraded":"2023-11-24T06:14:13.447134+0000","last_fullsized":"2023-11-24T06:14:13.447134+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.453606+0000","last_change":"2023-11-24T06:14:14.453606+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.453606+0000","last_undegraded":"2023-11-24T06:14:14.453606+0000","last_fullsized":"2023-11-24T06:14:14.453606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532280+0000","last_change":"2023-11-24T06:14:14.466846+0000","last_active":"2023-11-24T06:14:16.532280+0000","last_peered":"2023-11-24T06:14:16.532280+0000","last_clean":"2023-11-24T06:14:16.532280+0000","last_became_active":"2023-11-24T06:14:14.466551+0000","last_became_peered":"2023-11-24T06:14:14.466551+0000","last_unstale":"2023-11-24T06:14:16.532280+0000","last_undegraded":"2023-11-24T06:14:16.532280+0000","last_fullsized":"2023-11-24T06:14:16.532280+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.012140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532216+0000","last_change":"2023-11-24T06:14:15.450388+0000","last_active":"2023-11-24T06:14:16.532216+0000","last_peered":"2023-11-24T06:14:16.532216+0000","last_clean":"2023-11-24T06:14:16.532216+0000","last_became_active":"2023-11-24T06:14:15.449506+0000","last_became_peered":"2023-11-24T06:14:15.449506+0000","last_unstale":"2023-11-24T06:14:16.532216+0000","last_undegraded":"2023-11-24T06:14:16.532216+0000","last_fullsized":"2023-11-24T06:14:16.532216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:42:24.194375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434154+0000","last_change":"2023-11-24T06:14:13.434154+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434154+0000","last_undegraded":"2023-11-24T06:14:13.434154+0000","last_fullsized":"2023-11-24T06:14:13.434154+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445672+0000","last_change":"2023-11-24T06:14:13.445672+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445672+0000","last_undegraded":"2023-11-24T06:14:13.445672+0000","last_fullsized":"2023-11-24T06:14:13.445672+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.449260+0000","last_change":"2023-11-24T06:14:13.449260+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.449260+0000","last_undegraded":"2023-11-24T06:14:13.449260+0000","last_fullsized":"2023-11-24T06:14:13.449260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T06:14:14.472227+0000","last_change":"2023-11-24T06:14:14.463999+0000","last_active":"2023-11-24T06:14:14.472227+0000","last_peered":"2023-11-24T06:14:14.472227+0000","last_clean":"2023-11-24T06:14:14.472227+0000","last_became_active":"2023-11-24T06:14:14.463397+0000","last_became_peered":"2023-11-24T06:14:14.463397+0000","last_unstale":"2023-11-24T06:14:14.472227+0000","last_undegraded":"2023-11-24T06:14:14.472227+0000","last_fullsized":"2023-11-24T06:14:14.472227+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:42:10.952317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.440123+0000","last_change":"2023-11-24T06:14:13.440123+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.440123+0000","last_undegraded":"2023-11-24T06:14:13.440123+0000","last_fullsized":"2023-11-24T06:14:13.440123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.446972+0000","last_change":"2023-11-24T06:14:13.446972+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.446972+0000","last_undegraded":"2023-11-24T06:14:13.446972+0000","last_fullsized":"2023-11-24T06:14:13.446972+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.439488+0000","last_change":"2023-11-24T06:14:13.439488+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.439488+0000","last_undegraded":"2023-11-24T06:14:13.439488+0000","last_fullsized":"2023-11-24T06:14:13.439488+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.436658+0000","last_change":"2023-11-24T06:14:13.436658+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.436658+0000","last_undegraded":"2023-11-24T06:14:13.436658+0000","last_fullsized":"2023-11-24T06:14:13.436658+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.438074+0000","last_change":"2023-11-24T06:14:13.438074+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.438074+0000","last_undegraded":"2023-11-24T06:14:13.438074+0000","last_fullsized":"2023-11-24T06:14:13.438074+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445214+0000","last_change":"2023-11-24T06:14:13.445214+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445214+0000","last_undegraded":"2023-11-24T06:14:13.445214+0000","last_fullsized":"2023-11-24T06:14:13.445214+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434102+0000","last_change":"2023-11-24T06:14:13.434102+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434102+0000","last_undegraded":"2023-11-24T06:14:13.434102+0000","last_fullsized":"2023-11-24T06:14:13.434102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.444999+0000","last_change":"2023-11-24T06:14:13.444999+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.444999+0000","last_undegraded":"2023-11-24T06:14:13.444999+0000","last_fullsized":"2023-11-24T06:14:13.444999+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.439485+0000","last_change":"2023-11-24T06:14:13.439485+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.439485+0000","last_undegraded":"2023-11-24T06:14:13.439485+0000","last_fullsized":"2023-11-24T06:14:13.439485+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.438025+0000","last_change":"2023-11-24T06:14:13.438025+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.438025+0000","last_undegraded":"2023-11-24T06:14:13.438025+0000","last_fullsized":"2023-11-24T06:14:13.438025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445388+0000","last_change":"2023-11-24T06:14:13.445388+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445388+0000","last_undegraded":"2023-11-24T06:14:13.445388+0000","last_fullsized":"2023-11-24T06:14:13.445388+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T06:14:14.472289+0000","last_change":"2023-11-24T06:14:14.465038+0000","last_active":"2023-11-24T06:14:14.472289+0000","last_peered":"2023-11-24T06:14:14.472289+0000","last_clean":"2023-11-24T06:14:14.472289+0000","last_became_active":"2023-11-24T06:14:14.464681+0000","last_became_peered":"2023-11-24T06:14:14.464681+0000","last_unstale":"2023-11-24T06:14:14.472289+0000","last_undegraded":"2023-11-24T06:14:14.472289+0000","last_fullsized":"2023-11-24T06:14:14.472289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:53.472741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.443512+0000","last_change":"2023-11-24T06:14:13.443512+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.443512+0000","last_undegraded":"2023-11-24T06:14:13.443512+0000","last_fullsized":"2023-11-24T06:14:13.443512+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.444006+0000","last_change":"2023-11-24T06:14:13.444006+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.444006+0000","last_undegraded":"2023-11-24T06:14:13.444006+0000","last_fullsized":"2023-11-24T06:14:13.444006+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532105+0000","last_change":"2023-11-24T06:14:15.458585+0000","last_active":"2023-11-24T06:14:16.532105+0000","last_peered":"2023-11-24T06:14:16.532105+0000","last_clean":"2023-11-24T06:14:16.532105+0000","last_became_active":"2023-11-24T06:14:15.458306+0000","last_became_peered":"2023-11-24T06:14:15.458306+0000","last_unstale":"2023-11-24T06:14:16.532105+0000","last_undegraded":"2023-11-24T06:14:16.532105+0000","last_fullsized":"2023-11-24T06:14:16.532105+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:30:16.259583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T06:14:14.476950+0000","last_change":"2023-11-24T06:14:14.471004+0000","last_active":"2023-11-24T06:14:14.476950+0000","last_peered":"2023-11-24T06:14:14.476950+0000","last_clean":"2023-11-24T06:14:14.476950+0000","last_became_active":"2023-11-24T06:14:14.470708+0000","last_became_peered":"2023-11-24T06:14:14.470708+0000","last_unstale":"2023-11-24T06:14:14.476950+0000","last_undegraded":"2023-11-24T06:14:14.476950+0000","last_fullsized":"2023-11-24T06:14:14.476950+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:08.576994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.437540+0000","last_change":"2023-11-24T06:14:13.437540+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.437540+0000","last_undegraded":"2023-11-24T06:14:13.437540+0000","last_fullsized":"2023-11-24T06:14:13.437540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434148+0000","last_change":"2023-11-24T06:14:13.434148+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434148+0000","last_undegraded":"2023-11-24T06:14:13.434148+0000","last_fullsized":"2023-11-24T06:14:13.434148+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445317+0000","last_change":"2023-11-24T06:14:13.445317+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445317+0000","last_undegraded":"2023-11-24T06:14:13.445317+0000","last_fullsized":"2023-11-24T06:14:13.445317+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434189+0000","last_change":"2023-11-24T06:14:13.434189+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434189+0000","last_undegraded":"2023-11-24T06:14:13.434189+0000","last_fullsized":"2023-11-24T06:14:13.434189+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531561+0000","last_change":"2023-11-24T06:14:14.470448+0000","last_active":"2023-11-24T06:14:16.531561+0000","last_peered":"2023-11-24T06:14:16.531561+0000","last_clean":"2023-11-24T06:14:16.531561+0000","last_became_active":"2023-11-24T06:14:14.470152+0000","last_became_peered":"2023-11-24T06:14:14.470152+0000","last_unstale":"2023-11-24T06:14:16.531561+0000","last_undegraded":"2023-11-24T06:14:16.531561+0000","last_fullsized":"2023-11-24T06:14:16.531561+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:00:56.852959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434136+0000","last_change":"2023-11-24T06:14:13.434136+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434136+0000","last_undegraded":"2023-11-24T06:14:13.434136+0000","last_fullsized":"2023-11-24T06:14:13.434136+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.447093+0000","last_change":"2023-11-24T06:14:13.447093+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.447093+0000","last_undegraded":"2023-11-24T06:14:13.447093+0000","last_fullsized":"2023-11-24T06:14:13.447093+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.455705+0000","last_change":"2023-11-24T06:14:14.455705+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.455705+0000","last_undegraded":"2023-11-24T06:14:14.455705+0000","last_fullsized":"2023-11-24T06:14:14.455705+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532235+0000","last_change":"2023-11-24T06:14:14.469167+0000","last_active":"2023-11-24T06:14:16.532235+0000","last_peered":"2023-11-24T06:14:16.532235+0000","last_clean":"2023-11-24T06:14:16.532235+0000","last_became_active":"2023-11-24T06:14:14.468800+0000","last_became_peered":"2023-11-24T06:14:14.468800+0000","last_unstale":"2023-11-24T06:14:16.532235+0000","last_undegraded":"2023-11-24T06:14:16.532235+0000","last_fullsized":"2023-11-24T06:14:16.532235+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:05.447900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.436625+0000","last_change":"2023-11-24T06:14:13.436625+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.436625+0000","last_undegraded":"2023-11-24T06:14:13.436625+0000","last_fullsized":"2023-11-24T06:14:13.436625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T06:14:14.471789+0000","last_change":"2023-11-24T06:14:14.462792+0000","last_active":"2023-11-24T06:14:14.471789+0000","last_peered":"2023-11-24T06:14:14.471789+0000","last_clean":"2023-11-24T06:14:14.471789+0000","last_became_active":"2023-11-24T06:14:14.462410+0000","last_became_peered":"2023-11-24T06:14:14.462410+0000","last_unstale":"2023-11-24T06:14:14.471789+0000","last_undegraded":"2023-11-24T06:14:14.471789+0000","last_fullsized":"2023-11-24T06:14:14.471789+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:11.912302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:14:10.434667+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:14:10.434667+0000","last_peered":"2023-11-24T06:14:10.434667+0000","last_clean":"2023-11-24T06:14:10.434667+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:14:10.434667+0000","last_undegraded":"2023-11-24T06:14:10.434667+0000","last_fullsized":"2023-11-24T06:14:10.434667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":207240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.034,"15min":1.038},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.542,"5min":1.665,"15min":1.665},"last":4.1749999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0249999999999999},"min":{"1min":0.74199999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.48,"5min":1.698,"15min":1.698},"last":2.6240000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.47,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1140000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.643}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1319999999999999,"15min":1.1259999999999999},"min":{"1min":0.71799999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.591,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":2.7719999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.3360000000000001,"15min":1.3540000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5920000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.577}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.306,"15min":1.302},"min":{"1min":0.94899999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.714,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":2.8860000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.335},"min":{"1min":0.95099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7170000000000001,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":2.306}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.288,"15min":1.288},"min":{"1min":0.68500000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8759999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":2.3929999999999998},{"interface":"front","average":{"1min":1.526,"5min":1.3580000000000001,"15min":1.3300000000000001},"min":{"1min":1.0860000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.016,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":2.9990000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.5089999999999999,"15min":1.5169999999999999},"min":{"1min":1.022,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.784,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":2.5750000000000002},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4550000000000001,"15min":1.4470000000000001},"min":{"1min":1.014,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.0880000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":3.1459999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5529999999999999,"15min":1.5469999999999999},"min":{"1min":1.0620000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.153,"5min":2.778,"15min":2.778},"last":3.262},{"interface":"front","average":{"1min":1.609,"5min":1.681,"15min":1.6930000000000001},"min":{"1min":1.3120000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9239999999999999,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":2.4670000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":785524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4279999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.095},{"interface":"front","average":{"1min":1.157,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.746,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.462}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.181,"15min":1.1950000000000001},"min":{"1min":0.68500000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.645,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.264,"5min":1.28,"15min":1.282},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.2270000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2110000000000001,"15min":1.2010000000000001},"min":{"1min":0.90700000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9059999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.544},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2909999999999999,"15min":1.298},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.865,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1910000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3320000000000001,"15min":1.3300000000000001},"min":{"1min":0.872,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9490000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.3640000000000001,"15min":1.3680000000000001},"min":{"1min":0.90900000000000003,"5min":0.745,"15min":0.745},"max":{"1min":1.748,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.284}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.83199999999999996,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.4319999999999999,"15min":1.417},"min":{"1min":1.0329999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.165,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.3460000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.544,"15min":1.53},"min":{"1min":1.1850000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0590000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.75,"5min":1.6779999999999999,"15min":1.6659999999999999},"min":{"1min":1.5069999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.3980000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.597}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.96099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.0230000000000001,"5min":2.5,"15min":2.5},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.831,"5min":1.75,"15min":1.736},"min":{"1min":1.343,"5min":0.875,"15min":0.875},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.9910000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":200973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.034,"15min":1.054},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2609999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.5620000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5409999999999999,"5min":1.619,"15min":1.619},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2549999999999999,"15min":1.2529999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.79,"5min":1.887,"15min":1.887},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3089999999999999,"15min":1.3180000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8080000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.194},{"interface":"front","average":{"1min":1.22,"5min":1.446,"15min":1.484},"min":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5620000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.4339999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3640000000000001,"15min":1.3779999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.756,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.4630000000000001,"15min":1.4950000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8779999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.3620000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.4950000000000001,"15min":1.5029999999999999},"min":{"1min":0.76700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0009999999999999,"5min":2.258,"15min":2.258},"last":0.877},{"interface":"front","average":{"1min":1.347,"5min":1.5309999999999999,"15min":1.5609999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7210000000000001,"5min":2.105,"15min":2.105},"last":1.341}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5600000000000001,"15min":1.5780000000000001},"min":{"1min":0.59099999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8959999999999999,"5min":2.319,"15min":2.319},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.54,"5min":1.6459999999999999,"15min":1.6639999999999999},"min":{"1min":0.81799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.1549999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.609}]},{"osd":7,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6859999999999999,"15min":1.7},"min":{"1min":0.68400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9490000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.456},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.768,"15min":1.792},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.669,"15min":2.669},"last":1.5009999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":195156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0580000000000001,"15min":1.0660000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.579,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0620000000000001,"15min":1.0780000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.82999999999999996}]},{"osd":1,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2769999999999999,"15min":1.296},"min":{"1min":0.67000000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6910000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.2649999999999999,"15min":1.2949999999999999},"min":{"1min":0.70099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7649999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2629999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1830000000000001,"15min":1.181},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.774,"5min":2.04,"15min":2.04},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.262,"5min":1.3939999999999999,"15min":1.4159999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6599999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.95999999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2909999999999999,"15min":1.302},"min":{"1min":0.84899999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.849,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.3500000000000001,"15min":1.3600000000000001},"min":{"1min":0.93400000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8400000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4430000000000001,"15min":1.4550000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.768,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.54,"15min":1.5580000000000001},"min":{"1min":0.87,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.798,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.01}]},{"osd":6,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.5920000000000001,"15min":1.6000000000000001},"min":{"1min":1.004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9490000000000001,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.23},{"interface":"front","average":{"1min":1.448,"5min":1.6160000000000001,"15min":1.6439999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.827,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.4219999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5660000000000001,"15min":1.5840000000000001},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.9730000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.397},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.722,"15min":1.732},"min":{"1min":1.1200000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0910000000000002,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.121}]}]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":200973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.141,"5min":1.607,"15min":1.607},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.86199999999999999,"15min":0.88},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.23,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.038}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88100000000000001,"15min":0.90100000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.3420000000000001,"5min":1.796,"15min":1.796},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1120000000000001,"15min":1.1359999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.621,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.488}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.0189999999999999,"15min":1.038},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.55,"5min":1.835,"15min":1.835},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.075,"15min":1.1020000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4239999999999999,"5min":2.399,"15min":2.399},"last":1.3160000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.2949999999999999,"15min":1.3149999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8200000000000001,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.163},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2649999999999999,"15min":1.2689999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8839999999999999,"5min":2.141,"15min":2.141},"last":1.4410000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.298,"15min":1.3160000000000001},"min":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7330000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.522},{"interface":"front","average":{"1min":1.218,"5min":1.3680000000000001,"15min":1.393},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.671,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.391}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3360000000000001,"15min":1.3420000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.821,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3109999999999999,"15min":1.3200000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.655,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.6559999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3879999999999999,"15min":1.4179999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.772,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4410000000000001,"15min":1.462},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.726,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.619}]}]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31668,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340172,"statfs":{"total":96636764160,"available":96604336128,"internally_reserved":0,"allocated":495616,"data_stored":195156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.538,"5min":2.552,"15min":2.552},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.93899999999999995,"15min":0.96399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4550000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.121,"15min":1.119},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.696,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.468},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6479999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.4910000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1419999999999999,"15min":1.1579999999999999},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.5169999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.55100000000000005,"5min":0.371,"15min":0.371},"max":{"1min":1.25,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.0880000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.325,"15min":1.335},"min":{"1min":0.75900000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.883,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.179},{"interface":"front","average":{"1min":1.383,"5min":1.484,"15min":1.5009999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.804,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.544}]},{"osd":5,"last update":"Fri Nov 24 06:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.21,"15min":1.212},"min":{"1min":0.81000000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.569,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.234},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4330000000000001,"15min":1.444},"min":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.79,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.3260000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3819999999999999,"15min":1.397},"min":{"1min":0.84299999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7030000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.544,"15min":1.5629999999999999},"min":{"1min":1.0880000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8300000000000001,"5min":4.101,"15min":4.101},"last":1.429}]},{"osd":7,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.488,"15min":1.5},"min":{"1min":0.81200000000000006,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7190000000000001,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":0.81399999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7649999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.508}]}]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1101824,"data_stored":791341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.84699999999999998,"15min":0.83799999999999997},"min":{"1min":0.58399999999999996,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.696,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.745},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.45500000000000002,"5min":0.443,"15min":0.443},"max":{"1min":2.0609999999999999,"5min":2.161,"15min":2.161},"last":1.4750000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.032,"15min":1.038},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.806,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.876},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"min":{"1min":0.55500000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.3080000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.194,"15min":1.2170000000000001},"min":{"1min":0.54500000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8160000000000001,"5min":3.766,"15min":3.766},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.22,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1560000000000001,"5min":2.218,"15min":2.218},"last":1.131}]},{"osd":4,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.304,"15min":1.29},"min":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.73},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3799999999999999,"15min":1.3979999999999999},"min":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.853,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2669999999999999,"15min":1.2689999999999999},"min":{"1min":0.85099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.736,"5min":1.829,"15min":1.829},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.2350000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.4139999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.421,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.657,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.349,"15min":1.331},"min":{"1min":0.873,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0270000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.2170000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.429,"15min":1.427},"min":{"1min":0.94599999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.619},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.552,"15min":1.5620000000000001},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1909999999999998,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.1850000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":220385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.93899999999999995,"15min":0.96199999999999997},"min":{"1min":0.439,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5209999999999999,"5min":1.571,"15min":1.571},"last":0.753},{"interface":"front","average":{"1min":0.878,"5min":1,"15min":1.02},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.341,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.99199999999999999,"15min":1.0109999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4239999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.2030000000000001,"15min":1.2390000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.78,"5min":1.792,"15min":1.792},"last":0.98899999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.3280000000000001,"15min":1.3660000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":0.66500000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6739999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.94899999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3089999999999999,"15min":1.321},"min":{"1min":0.79400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.794,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.095},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.55,"15min":1.5780000000000001},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.7909999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.3839999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.1059999999999999,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.454,"15min":1.468},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.2599999999999998,"5min":2.637,"15min":2.637},"last":1.194}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.5389999999999999,"15min":1.5609999999999999},"min":{"1min":0.95099999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.839,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.5229999999999999,"15min":1.5389999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1259999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.486}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.613,"15min":1.6319999999999999},"min":{"1min":1,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.9620000000000002,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.679,"15min":1.6839999999999999},"min":{"1min":1.198,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:14:19.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:14:20.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.250+0000 7f0e06c94640 1 Processor -- start 2023-11-24T06:14:20.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.250+0000 7f0e06c94640 1 -- start start 2023-11-24T06:14:20.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.252+0000 7f0e06c94640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0e0015d4a0 0x7f0e000af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.252+0000 7f0e06c94640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 0x7f0e0006a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.252+0000 7f0e06c94640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e000afb00 con 0x7f0e0006ab40 2023-11-24T06:14:20.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.252+0000 7f0e06c94640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0006afd0 con 0x7f0e0015d4a0 2023-11-24T06:14:20.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.252+0000 7f0e06c94640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0015d880 con 0x7f0e000af6c0 2023-11-24T06:14:20.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.252+0000 7f0e04a30640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0e0015d4a0 0x7f0e000af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.252+0000 7f0e05231640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0e0006ab40 0x7f0e00160f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44930/0 (socket says 172.21.15.22:44930) 2023-11-24T06:14:20.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.252+0000 7f0e05231640 1 -- 172.21.15.22:0/114419200 learned_addr learned my addr 172.21.15.22:0/114419200 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:20.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.253+0000 7f0df7fff640 1 --2- 172.21.15.22:0/114419200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 0x7f0e0006a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.253+0000 7f0e04a30640 1 -- 172.21.15.22:0/114419200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 msgr2=0x7f0e0006a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.253+0000 7f0e04a30640 1 --2- 172.21.15.22:0/114419200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 0x7f0e0006a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.253+0000 7f0e04a30640 1 -- 172.21.15.22:0/114419200 >> v1:172.21.15.22:6789/0 conn(0x7f0e0006ab40 legacy=0x7f0e00160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.253+0000 7f0e04a30640 1 -- 172.21.15.22:0/114419200 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0006fba0 con 0x7f0e0015d4a0 2023-11-24T06:14:20.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.254+0000 7f0e04a30640 1 --2- 172.21.15.22:0/114419200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0015d4a0 0x7f0e000af180 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009d90 tx=0x7f0dfc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89410025f01989 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.254+0000 7f0df77fe640 1 -- 172.21.15.22:0/114419200 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc02cc60 con 0x7f0e0015d4a0 2023-11-24T06:14:20.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.254+0000 7f0df77fe640 1 -- 172.21.15.22:0/114419200 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc02cdc0 con 0x7f0e0015d4a0 2023-11-24T06:14:20.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.255+0000 7f0df77fe640 1 -- 172.21.15.22:0/114419200 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc034660 con 0x7f0e0015d4a0 2023-11-24T06:14:20.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.255+0000 7f0e06c94640 1 -- 172.21.15.22:0/114419200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0015d4a0 msgr2=0x7f0e000af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.255+0000 7f0e06c94640 1 --2- 172.21.15.22:0/114419200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0015d4a0 0x7f0e000af180 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009d90 tx=0x7f0dfc02beb0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.255+0000 7f0e06c94640 1 -- 172.21.15.22:0/114419200 shutdown_connections 2023-11-24T06:14:20.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.255+0000 7f0e06c94640 1 --2- 172.21.15.22:0/114419200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 0x7f0e0006a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.255+0000 7f0e06c94640 1 --2- 172.21.15.22:0/114419200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0015d4a0 0x7f0e000af180 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.255+0000 7f0e06c94640 1 -- 172.21.15.22:0/114419200 >> 172.21.15.22:0/114419200 conn(0x7f0e0006d490 msgr2=0x7f0e0006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:20.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.255+0000 7f0e06c94640 1 -- 172.21.15.22:0/114419200 shutdown_connections 2023-11-24T06:14:20.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.255+0000 7f0e06c94640 1 -- 172.21.15.22:0/114419200 wait complete. 2023-11-24T06:14:20.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.257+0000 7f0e06c94640 1 Processor -- start 2023-11-24T06:14:20.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.257+0000 7f0e06c94640 1 -- start start 2023-11-24T06:14:20.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.258+0000 7f0e06c94640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0006ab40 0x7f0e0015ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.258+0000 7f0e06c94640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 0x7f0e0014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.258+0000 7f0e06c94640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0015d4a0 0x7f0e0014f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.258+0000 7f0e06c94640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0013e380 con 0x7f0e0006ab40 2023-11-24T06:14:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.258+0000 7f0e06c94640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0015ef30 con 0x7f0e0015d4a0 2023-11-24T06:14:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.258+0000 7f0e06c94640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0015f210 con 0x7f0e000af6c0 2023-11-24T06:14:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0e04a30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0006ab40 0x7f0e0015ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0e04a30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0006ab40 0x7f0e0015ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38874/0 (socket says 172.21.15.22:38874) 2023-11-24T06:14:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0e04a30640 1 -- 172.21.15.22:0/54494549 learned_addr learned my addr 172.21.15.22:0/54494549 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0e05231640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0015d4a0 0x7f0e0014f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0df7fff640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 0x7f0e0014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0e04a30640 1 -- 172.21.15.22:0/54494549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 msgr2=0x7f0e0014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0e04a30640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 0x7f0e0014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0e04a30640 1 -- 172.21.15.22:0/54494549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0015d4a0 msgr2=0x7f0e0014f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0e04a30640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0015d4a0 0x7f0e0014f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.259+0000 7f0e04a30640 1 -- 172.21.15.22:0/54494549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc009a70 con 0x7f0e0006ab40 2023-11-24T06:14:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.260+0000 7f0e04a30640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0006ab40 0x7f0e0015ffd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009d90 tx=0x7f0dfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.260+0000 7f0df57fa640 1 -- 172.21.15.22:0/54494549 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc040650 con 0x7f0e0006ab40 2023-11-24T06:14:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.260+0000 7f0df57fa640 1 -- 172.21.15.22:0/54494549 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0407b0 con 0x7f0e0006ab40 2023-11-24T06:14:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.260+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0015f4f0 con 0x7f0e0006ab40 2023-11-24T06:14:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.260+0000 7f0df57fa640 1 -- 172.21.15.22:0/54494549 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc040b60 con 0x7f0e0006ab40 2023-11-24T06:14:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.260+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0015fab0 con 0x7f0e0006ab40 2023-11-24T06:14:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.261+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e00073c90 con 0x7f0e0006ab40 2023-11-24T06:14:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.262+0000 7f0df57fa640 1 -- 172.21.15.22:0/54494549 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0dfc040cc0 con 0x7f0e0006ab40 2023-11-24T06:14:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.264+0000 7f0df57fa640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0dec06aff0 0x7f0dec06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.264+0000 7f0df57fa640 1 -- 172.21.15.22:0/54494549 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dfc0ac810 con 0x7f0e0006ab40 2023-11-24T06:14:20.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.264+0000 7f0df7fff640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0dec06aff0 0x7f0dec06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.265+0000 7f0df7fff640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0dec06aff0 0x7f0dec06d4b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e001f6940 tx=0x7f0df0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.268+0000 7f0df57fa640 1 -- 172.21.15.22:0/54494549 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0dfc0775a0 con 0x7f0e0006ab40 2023-11-24T06:14:20.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.459+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e0006f0c0 con 0x7f0dec06aff0 2023-11-24T06:14:20.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.471+0000 7f0df57fa640 1 -- 172.21.15.22:0/54494549 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276380 (secure 0 0 0) 0x7f0df000b200 con 0x7f0dec06aff0 2023-11-24T06:14:20.476 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:20.479 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:14:20.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0dec06aff0 msgr2=0x7f0dec06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0dec06aff0 0x7f0dec06d4b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e001f6940 tx=0x7f0df0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:20.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0006ab40 msgr2=0x7f0e0015ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0006ab40 0x7f0e0015ffd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009d90 tx=0x7f0dfc004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:20.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 shutdown_connections 2023-11-24T06:14:20.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0dec06aff0 0x7f0dec06d4b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0015d4a0 0x7f0e0014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e000af6c0 0x7f0e0014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 --2- 172.21.15.22:0/54494549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e0006ab40 0x7f0e0015ffd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 >> 172.21.15.22:0/54494549 conn(0x7f0e0006d490 msgr2=0x7f0e000ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:20.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 shutdown_connections 2023-11-24T06:14:20.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.478+0000 7f0e06c94640 1 -- 172.21.15.22:0/54494549 wait complete. 2023-11-24T06:14:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-11-24T06:14:18.689988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":237960,"kb_used_data":5144,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736760,"statfs":{"total":773094113280,"available":772850442240,"internally_reserved":0,"allocated":5267456,"data_stored":2796748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.260708"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.451245+0000","last_change":"2023-11-24T06:14:14.451245+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.451245+0000","last_undegraded":"2023-11-24T06:14:14.451245+0000","last_fullsized":"2023-11-24T06:14:14.451245+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.453608+0000","last_change":"2023-11-24T06:14:14.453608+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.453608+0000","last_undegraded":"2023-11-24T06:14:14.453608+0000","last_fullsized":"2023-11-24T06:14:14.453608+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.456186+0000","last_change":"2023-11-24T06:14:14.456186+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.456186+0000","last_undegraded":"2023-11-24T06:14:14.456186+0000","last_fullsized":"2023-11-24T06:14:14.456186+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.454922+0000","last_change":"2023-11-24T06:14:14.454922+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.454922+0000","last_undegraded":"2023-11-24T06:14:14.454922+0000","last_fullsized":"2023-11-24T06:14:14.454922+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531657+0000","last_change":"2023-11-24T06:14:15.461105+0000","last_active":"2023-11-24T06:14:16.531657+0000","last_peered":"2023-11-24T06:14:16.531657+0000","last_clean":"2023-11-24T06:14:16.531657+0000","last_became_active":"2023-11-24T06:14:15.458141+0000","last_became_peered":"2023-11-24T06:14:15.458141+0000","last_unstale":"2023-11-24T06:14:16.531657+0000","last_undegraded":"2023-11-24T06:14:16.531657+0000","last_fullsized":"2023-11-24T06:14:16.531657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:59.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445635+0000","last_change":"2023-11-24T06:14:13.445635+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445635+0000","last_undegraded":"2023-11-24T06:14:13.445635+0000","last_fullsized":"2023-11-24T06:14:13.445635+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.447134+0000","last_change":"2023-11-24T06:14:13.447134+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.447134+0000","last_undegraded":"2023-11-24T06:14:13.447134+0000","last_fullsized":"2023-11-24T06:14:13.447134+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.453606+0000","last_change":"2023-11-24T06:14:14.453606+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.453606+0000","last_undegraded":"2023-11-24T06:14:14.453606+0000","last_fullsized":"2023-11-24T06:14:14.453606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532280+0000","last_change":"2023-11-24T06:14:14.466846+0000","last_active":"2023-11-24T06:14:16.532280+0000","last_peered":"2023-11-24T06:14:16.532280+0000","last_clean":"2023-11-24T06:14:16.532280+0000","last_became_active":"2023-11-24T06:14:14.466551+0000","last_became_peered":"2023-11-24T06:14:14.466551+0000","last_unstale":"2023-11-24T06:14:16.532280+0000","last_undegraded":"2023-11-24T06:14:16.532280+0000","last_fullsized":"2023-11-24T06:14:16.532280+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.012140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532216+0000","last_change":"2023-11-24T06:14:15.450388+0000","last_active":"2023-11-24T06:14:16.532216+0000","last_peered":"2023-11-24T06:14:16.532216+0000","last_clean":"2023-11-24T06:14:16.532216+0000","last_became_active":"2023-11-24T06:14:15.449506+0000","last_became_peered":"2023-11-24T06:14:15.449506+0000","last_unstale":"2023-11-24T06:14:16.532216+0000","last_undegraded":"2023-11-24T06:14:16.532216+0000","last_fullsized":"2023-11-24T06:14:16.532216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:42:24.194375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434154+0000","last_change":"2023-11-24T06:14:13.434154+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434154+0000","last_undegraded":"2023-11-24T06:14:13.434154+0000","last_fullsized":"2023-11-24T06:14:13.434154+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445672+0000","last_change":"2023-11-24T06:14:13.445672+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445672+0000","last_undegraded":"2023-11-24T06:14:13.445672+0000","last_fullsized":"2023-11-24T06:14:13.445672+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.449260+0000","last_change":"2023-11-24T06:14:13.449260+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.449260+0000","last_undegraded":"2023-11-24T06:14:13.449260+0000","last_fullsized":"2023-11-24T06:14:13.449260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T06:14:14.472227+0000","last_change":"2023-11-24T06:14:14.463999+0000","last_active":"2023-11-24T06:14:14.472227+0000","last_peered":"2023-11-24T06:14:14.472227+0000","last_clean":"2023-11-24T06:14:14.472227+0000","last_became_active":"2023-11-24T06:14:14.463397+0000","last_became_peered":"2023-11-24T06:14:14.463397+0000","last_unstale":"2023-11-24T06:14:14.472227+0000","last_undegraded":"2023-11-24T06:14:14.472227+0000","last_fullsized":"2023-11-24T06:14:14.472227+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:42:10.952317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.440123+0000","last_change":"2023-11-24T06:14:13.440123+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.440123+0000","last_undegraded":"2023-11-24T06:14:13.440123+0000","last_fullsized":"2023-11-24T06:14:13.440123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.446972+0000","last_change":"2023-11-24T06:14:13.446972+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.446972+0000","last_undegraded":"2023-11-24T06:14:13.446972+0000","last_fullsized":"2023-11-24T06:14:13.446972+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.439488+0000","last_change":"2023-11-24T06:14:13.439488+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.439488+0000","last_undegraded":"2023-11-24T06:14:13.439488+0000","last_fullsized":"2023-11-24T06:14:13.439488+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.436658+0000","last_change":"2023-11-24T06:14:13.436658+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.436658+0000","last_undegraded":"2023-11-24T06:14:13.436658+0000","last_fullsized":"2023-11-24T06:14:13.436658+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.438074+0000","last_change":"2023-11-24T06:14:13.438074+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.438074+0000","last_undegraded":"2023-11-24T06:14:13.438074+0000","last_fullsized":"2023-11-24T06:14:13.438074+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445214+0000","last_change":"2023-11-24T06:14:13.445214+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445214+0000","last_undegraded":"2023-11-24T06:14:13.445214+0000","last_fullsized":"2023-11-24T06:14:13.445214+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434102+0000","last_change":"2023-11-24T06:14:13.434102+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434102+0000","last_undegraded":"2023-11-24T06:14:13.434102+0000","last_fullsized":"2023-11-24T06:14:13.434102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.444999+0000","last_change":"2023-11-24T06:14:13.444999+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.444999+0000","last_undegraded":"2023-11-24T06:14:13.444999+0000","last_fullsized":"2023-11-24T06:14:13.444999+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.439485+0000","last_change":"2023-11-24T06:14:13.439485+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.439485+0000","last_undegraded":"2023-11-24T06:14:13.439485+0000","last_fullsized":"2023-11-24T06:14:13.439485+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.438025+0000","last_change":"2023-11-24T06:14:13.438025+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.438025+0000","last_undegraded":"2023-11-24T06:14:13.438025+0000","last_fullsized":"2023-11-24T06:14:13.438025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445388+0000","last_change":"2023-11-24T06:14:13.445388+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445388+0000","last_undegraded":"2023-11-24T06:14:13.445388+0000","last_fullsized":"2023-11-24T06:14:13.445388+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T06:14:14.472289+0000","last_change":"2023-11-24T06:14:14.465038+0000","last_active":"2023-11-24T06:14:14.472289+0000","last_peered":"2023-11-24T06:14:14.472289+0000","last_clean":"2023-11-24T06:14:14.472289+0000","last_became_active":"2023-11-24T06:14:14.464681+0000","last_became_peered":"2023-11-24T06:14:14.464681+0000","last_unstale":"2023-11-24T06:14:14.472289+0000","last_undegraded":"2023-11-24T06:14:14.472289+0000","last_fullsized":"2023-11-24T06:14:14.472289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:53.472741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.443512+0000","last_change":"2023-11-24T06:14:13.443512+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.443512+0000","last_undegraded":"2023-11-24T06:14:13.443512+0000","last_fullsized":"2023-11-24T06:14:13.443512+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.444006+0000","last_change":"2023-11-24T06:14:13.444006+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.444006+0000","last_undegraded":"2023-11-24T06:14:13.444006+0000","last_fullsized":"2023-11-24T06:14:13.444006+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532105+0000","last_change":"2023-11-24T06:14:15.458585+0000","last_active":"2023-11-24T06:14:16.532105+0000","last_peered":"2023-11-24T06:14:16.532105+0000","last_clean":"2023-11-24T06:14:16.532105+0000","last_became_active":"2023-11-24T06:14:15.458306+0000","last_became_peered":"2023-11-24T06:14:15.458306+0000","last_unstale":"2023-11-24T06:14:16.532105+0000","last_undegraded":"2023-11-24T06:14:16.532105+0000","last_fullsized":"2023-11-24T06:14:16.532105+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:30:16.259583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T06:14:14.476950+0000","last_change":"2023-11-24T06:14:14.471004+0000","last_active":"2023-11-24T06:14:14.476950+0000","last_peered":"2023-11-24T06:14:14.476950+0000","last_clean":"2023-11-24T06:14:14.476950+0000","last_became_active":"2023-11-24T06:14:14.470708+0000","last_became_peered":"2023-11-24T06:14:14.470708+0000","last_unstale":"2023-11-24T06:14:14.476950+0000","last_undegraded":"2023-11-24T06:14:14.476950+0000","last_fullsized":"2023-11-24T06:14:14.476950+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:08.576994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.437540+0000","last_change":"2023-11-24T06:14:13.437540+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.437540+0000","last_undegraded":"2023-11-24T06:14:13.437540+0000","last_fullsized":"2023-11-24T06:14:13.437540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434148+0000","last_change":"2023-11-24T06:14:13.434148+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434148+0000","last_undegraded":"2023-11-24T06:14:13.434148+0000","last_fullsized":"2023-11-24T06:14:13.434148+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.445317+0000","last_change":"2023-11-24T06:14:13.445317+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.445317+0000","last_undegraded":"2023-11-24T06:14:13.445317+0000","last_fullsized":"2023-11-24T06:14:13.445317+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434189+0000","last_change":"2023-11-24T06:14:13.434189+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434189+0000","last_undegraded":"2023-11-24T06:14:13.434189+0000","last_fullsized":"2023-11-24T06:14:13.434189+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531561+0000","last_change":"2023-11-24T06:14:14.470448+0000","last_active":"2023-11-24T06:14:16.531561+0000","last_peered":"2023-11-24T06:14:16.531561+0000","last_clean":"2023-11-24T06:14:16.531561+0000","last_became_active":"2023-11-24T06:14:14.470152+0000","last_became_peered":"2023-11-24T06:14:14.470152+0000","last_unstale":"2023-11-24T06:14:16.531561+0000","last_undegraded":"2023-11-24T06:14:16.531561+0000","last_fullsized":"2023-11-24T06:14:16.531561+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:00:56.852959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.434136+0000","last_change":"2023-11-24T06:14:13.434136+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.434136+0000","last_undegraded":"2023-11-24T06:14:13.434136+0000","last_fullsized":"2023-11-24T06:14:13.434136+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.447093+0000","last_change":"2023-11-24T06:14:13.447093+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.447093+0000","last_undegraded":"2023-11-24T06:14:13.447093+0000","last_fullsized":"2023-11-24T06:14:13.447093+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T06:14:14.455705+0000","last_change":"2023-11-24T06:14:14.455705+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.455705+0000","last_undegraded":"2023-11-24T06:14:14.455705+0000","last_fullsized":"2023-11-24T06:14:14.455705+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532235+0000","last_change":"2023-11-24T06:14:14.469167+0000","last_active":"2023-11-24T06:14:16.532235+0000","last_peered":"2023-11-24T06:14:16.532235+0000","last_clean":"2023-11-24T06:14:16.532235+0000","last_became_active":"2023-11-24T06:14:14.468800+0000","last_became_peered":"2023-11-24T06:14:14.468800+0000","last_unstale":"2023-11-24T06:14:16.532235+0000","last_undegraded":"2023-11-24T06:14:16.532235+0000","last_fullsized":"2023-11-24T06:14:16.532235+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:05.447900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-11-24T06:14:13.436625+0000","last_change":"2023-11-24T06:14:13.436625+0000","last_active":"2023-11-24T06:14:13.415066+0000","last_peered":"2023-11-24T06:14:13.415066+0000","last_clean":"2023-11-24T06:14:13.415066+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:13.436625+0000","last_undegraded":"2023-11-24T06:14:13.436625+0000","last_fullsized":"2023-11-24T06:14:13.436625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:14:14.427374+0000","last_change":"2023-11-24T06:14:14.427374+0000","last_active":"2023-11-24T06:14:14.427374+0000","last_peered":"2023-11-24T06:14:14.427374+0000","last_clean":"2023-11-24T06:14:14.427374+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:14:14.427374+0000","last_undegraded":"2023-11-24T06:14:14.427374+0000","last_fullsized":"2023-11-24T06:14:14.427374+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T06:14:14.471789+0000","last_change":"2023-11-24T06:14:14.462792+0000","last_active":"2023-11-24T06:14:14.471789+0000","last_peered":"2023-11-24T06:14:14.471789+0000","last_clean":"2023-11-24T06:14:14.471789+0000","last_became_active":"2023-11-24T06:14:14.462410+0000","last_became_peered":"2023-11-24T06:14:14.462410+0000","last_unstale":"2023-11-24T06:14:14.471789+0000","last_undegraded":"2023-11-24T06:14:14.471789+0000","last_fullsized":"2023-11-24T06:14:14.471789+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:11.912302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-24T06:14:10.434667+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:14:10.434667+0000","last_peered":"2023-11-24T06:14:10.434667+0000","last_clean":"2023-11-24T06:14:10.434667+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:14:10.434667+0000","last_undegraded":"2023-11-24T06:14:10.434667+0000","last_fullsized":"2023-11-24T06:14:10.434667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":207240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.034,"15min":1.038},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.542,"5min":1.665,"15min":1.665},"last":4.1749999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0249999999999999},"min":{"1min":0.74199999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.48,"5min":1.698,"15min":1.698},"last":2.6240000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.47,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1140000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.643}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1319999999999999,"15min":1.1259999999999999},"min":{"1min":0.71799999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.591,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":2.7719999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.3360000000000001,"15min":1.3540000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5920000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.577}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.306,"15min":1.302},"min":{"1min":0.94899999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.714,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":2.8860000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.335},"min":{"1min":0.95099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7170000000000001,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":2.306}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.288,"15min":1.288},"min":{"1min":0.68500000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8759999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":2.3929999999999998},{"interface":"front","average":{"1min":1.526,"5min":1.3580000000000001,"15min":1.3300000000000001},"min":{"1min":1.0860000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.016,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":2.9990000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.5089999999999999,"15min":1.5169999999999999},"min":{"1min":1.022,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.784,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":2.5750000000000002},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4550000000000001,"15min":1.4470000000000001},"min":{"1min":1.014,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.0880000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":3.1459999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5529999999999999,"15min":1.5469999999999999},"min":{"1min":1.0620000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.153,"5min":2.778,"15min":2.778},"last":3.262},{"interface":"front","average":{"1min":1.609,"5min":1.681,"15min":1.6930000000000001},"min":{"1min":1.3120000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9239999999999999,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":2.4670000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":785524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4279999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.095},{"interface":"front","average":{"1min":1.157,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.746,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.462}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.181,"15min":1.1950000000000001},"min":{"1min":0.68500000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.645,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.264,"5min":1.28,"15min":1.282},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.2270000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2110000000000001,"15min":1.2010000000000001},"min":{"1min":0.90700000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9059999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.544},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2909999999999999,"15min":1.298},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.865,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1910000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3320000000000001,"15min":1.3300000000000001},"min":{"1min":0.872,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9490000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.3640000000000001,"15min":1.3680000000000001},"min":{"1min":0.90900000000000003,"5min":0.745,"15min":0.745},"max":{"1min":1.748,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.284}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.83199999999999996,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.4319999999999999,"15min":1.417},"min":{"1min":1.0329999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.165,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.3460000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.544,"15min":1.53},"min":{"1min":1.1850000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0590000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.75,"5min":1.6779999999999999,"15min":1.6659999999999999},"min":{"1min":1.5069999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.3980000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.597}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.96099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.0230000000000001,"5min":2.5,"15min":2.5},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.831,"5min":1.75,"15min":1.736},"min":{"1min":1.343,"5min":0.875,"15min":0.875},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.9910000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":200973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.034,"15min":1.054},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2609999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.5620000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5409999999999999,"5min":1.619,"15min":1.619},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2549999999999999,"15min":1.2529999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.79,"5min":1.887,"15min":1.887},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3089999999999999,"15min":1.3180000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8080000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.194},{"interface":"front","average":{"1min":1.22,"5min":1.446,"15min":1.484},"min":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5620000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.4339999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3640000000000001,"15min":1.3779999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.756,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.4630000000000001,"15min":1.4950000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8779999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.3620000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.4950000000000001,"15min":1.5029999999999999},"min":{"1min":0.76700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0009999999999999,"5min":2.258,"15min":2.258},"last":0.877},{"interface":"front","average":{"1min":1.347,"5min":1.5309999999999999,"15min":1.5609999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7210000000000001,"5min":2.105,"15min":2.105},"last":1.341}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5600000000000001,"15min":1.5780000000000001},"min":{"1min":0.59099999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8959999999999999,"5min":2.319,"15min":2.319},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.54,"5min":1.6459999999999999,"15min":1.6639999999999999},"min":{"1min":0.81799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.1549999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.609}]},{"osd":7,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6859999999999999,"15min":1.7},"min":{"1min":0.68400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9490000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.456},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.768,"15min":1.792},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.669,"15min":2.669},"last":1.5009999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":195156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0580000000000001,"15min":1.0660000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.579,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0620000000000001,"15min":1.0780000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.82999999999999996}]},{"osd":1,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2769999999999999,"15min":1.296},"min":{"1min":0.67000000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6910000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.2649999999999999,"15min":1.2949999999999999},"min":{"1min":0.70099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7649999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2629999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1830000000000001,"15min":1.181},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.774,"5min":2.04,"15min":2.04},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.262,"5min":1.3939999999999999,"15min":1.4159999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6599999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.95999999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2909999999999999,"15min":1.302},"min":{"1min":0.84899999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.849,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.3500000000000001,"15min":1.3600000000000001},"min":{"1min":0.93400000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8400000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4430000000000001,"15min":1.4550000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.768,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.54,"15min":1.5580000000000001},"min":{"1min":0.87,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.798,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.01}]},{"osd":6,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.5920000000000001,"15min":1.6000000000000001},"min":{"1min":1.004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9490000000000001,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.23},{"interface":"front","average":{"1min":1.448,"5min":1.6160000000000001,"15min":1.6439999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.827,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.4219999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5660000000000001,"15min":1.5840000000000001},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.9730000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.397},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.722,"15min":1.732},"min":{"1min":1.1200000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0910000000000002,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.121}]}]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":200973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.141,"5min":1.607,"15min":1.607},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.86199999999999999,"15min":0.88},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.23,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.038}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88100000000000001,"15min":0.90100000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.3420000000000001,"5min":1.796,"15min":1.796},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1120000000000001,"15min":1.1359999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.621,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.488}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.0189999999999999,"15min":1.038},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.55,"5min":1.835,"15min":1.835},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.075,"15min":1.1020000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4239999999999999,"5min":2.399,"15min":2.399},"last":1.3160000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.2949999999999999,"15min":1.3149999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8200000000000001,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.163},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2649999999999999,"15min":1.2689999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8839999999999999,"5min":2.141,"15min":2.141},"last":1.4410000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.298,"15min":1.3160000000000001},"min":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7330000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.522},{"interface":"front","average":{"1min":1.218,"5min":1.3680000000000001,"15min":1.393},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.671,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.391}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3360000000000001,"15min":1.3420000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.821,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3109999999999999,"15min":1.3200000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.655,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.6559999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3879999999999999,"15min":1.4179999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.772,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4410000000000001,"15min":1.462},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.726,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.619}]}]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31668,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340172,"statfs":{"total":96636764160,"available":96604336128,"internally_reserved":0,"allocated":495616,"data_stored":195156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.538,"5min":2.552,"15min":2.552},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.93899999999999995,"15min":0.96399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4550000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.121,"15min":1.119},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.696,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.468},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6479999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.4910000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1419999999999999,"15min":1.1579999999999999},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.5169999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.55100000000000005,"5min":0.371,"15min":0.371},"max":{"1min":1.25,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.0880000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.325,"15min":1.335},"min":{"1min":0.75900000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.883,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.179},{"interface":"front","average":{"1min":1.383,"5min":1.484,"15min":1.5009999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.804,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.544}]},{"osd":5,"last update":"Fri Nov 24 06:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.21,"15min":1.212},"min":{"1min":0.81000000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.569,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.234},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4330000000000001,"15min":1.444},"min":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.79,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.3260000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3819999999999999,"15min":1.397},"min":{"1min":0.84299999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7030000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.544,"15min":1.5629999999999999},"min":{"1min":1.0880000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8300000000000001,"5min":4.101,"15min":4.101},"last":1.429}]},{"osd":7,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.488,"15min":1.5},"min":{"1min":0.81200000000000006,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7190000000000001,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":0.81399999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7649999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.508}]}]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1101824,"data_stored":791341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.84699999999999998,"15min":0.83799999999999997},"min":{"1min":0.58399999999999996,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.696,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.745},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.45500000000000002,"5min":0.443,"15min":0.443},"max":{"1min":2.0609999999999999,"5min":2.161,"15min":2.161},"last":1.4750000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.032,"15min":1.038},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.806,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.876},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"min":{"1min":0.55500000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.3080000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.194,"15min":1.2170000000000001},"min":{"1min":0.54500000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8160000000000001,"5min":3.766,"15min":3.766},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.22,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1560000000000001,"5min":2.218,"15min":2.218},"last":1.131}]},{"osd":4,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.304,"15min":1.29},"min":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.73},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3799999999999999,"15min":1.3979999999999999},"min":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.853,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2669999999999999,"15min":1.2689999999999999},"min":{"1min":0.85099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.736,"5min":1.829,"15min":1.829},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.2350000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.4139999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.421,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.657,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.349,"15min":1.331},"min":{"1min":0.873,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0270000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.2170000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.429,"15min":1.427},"min":{"1min":0.94599999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.619},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.552,"15min":1.5620000000000001},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1909999999999998,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.1850000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":220385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.93899999999999995,"15min":0.96199999999999997},"min":{"1min":0.439,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5209999999999999,"5min":1.571,"15min":1.571},"last":0.753},{"interface":"front","average":{"1min":0.878,"5min":1,"15min":1.02},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.341,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.99199999999999999,"15min":1.0109999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4239999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.2030000000000001,"15min":1.2390000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.78,"5min":1.792,"15min":1.792},"last":0.98899999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.3280000000000001,"15min":1.3660000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":0.66500000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6739999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.94899999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3089999999999999,"15min":1.321},"min":{"1min":0.79400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.794,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.095},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.55,"15min":1.5780000000000001},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.7909999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.3839999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.1059999999999999,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.454,"15min":1.468},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.2599999999999998,"5min":2.637,"15min":2.637},"last":1.194}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.5389999999999999,"15min":1.5609999999999999},"min":{"1min":0.95099999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.839,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.5229999999999999,"15min":1.5389999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1259999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.486}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.613,"15min":1.6319999999999999},"min":{"1min":1,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.9620000000000002,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.679,"15min":1.6839999999999999},"min":{"1min":1.198,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:14:20.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:14:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.770+0000 7fb392f61640 1 Processor -- start 2023-11-24T06:14:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.770+0000 7fb392f61640 1 -- start start 2023-11-24T06:14:20.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.771+0000 7fb392f61640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb38c06d520 0x7fb38c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.771+0000 7fb392f61640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb38c0abff0 0x7fb38c15f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb392f61640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38c15c360 con 0x7fb38c0ad720 2023-11-24T06:14:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb392f61640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c0b41a0 con 0x7fb38c0abff0 2023-11-24T06:14:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb392f61640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c06de40 con 0x7fb38c06d520 2023-11-24T06:14:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb3914fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb38c0abff0 0x7fb38c15f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb3914fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb38c0abff0 0x7fb38c15f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38882/0 (socket says 172.21.15.22:38882) 2023-11-24T06:14:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb3914fe640 1 -- 172.21.15.22:0/800546347 learned_addr learned my addr 172.21.15.22:0/800546347 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb3914fe640 1 -- 172.21.15.22:0/800546347 >> v2:172.21.15.31:3300/0 conn(0x7fb38c06d520 msgr2=0x7fb38c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb3914fe640 1 --2- 172.21.15.22:0/800546347 >> v2:172.21.15.31:3300/0 conn(0x7fb38c06d520 0x7fb38c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb3914fe640 1 -- 172.21.15.22:0/800546347 >> v1:172.21.15.31:6789/0 conn(0x7fb38c0ad720 legacy=0x7fb38c15ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.772+0000 7fb3914fe640 1 -- 172.21.15.22:0/800546347 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c15ba30 con 0x7fb38c0abff0 2023-11-24T06:14:20.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.774+0000 7fb3914fe640 1 --2- 172.21.15.22:0/800546347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c0abff0 0x7fb38c15f3e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb38c06c070 tx=0x7fb38402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e1a12a8ab30375 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.774+0000 7fb38b7fe640 1 -- 172.21.15.22:0/800546347 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38402ca80 con 0x7fb38c0abff0 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.774+0000 7fb38b7fe640 1 -- 172.21.15.22:0/800546347 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38402cbe0 con 0x7fb38c0abff0 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.774+0000 7fb38b7fe640 1 -- 172.21.15.22:0/800546347 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840343f0 con 0x7fb38c0abff0 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.774+0000 7fb392f61640 1 -- 172.21.15.22:0/800546347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c0abff0 msgr2=0x7fb38c15f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.774+0000 7fb392f61640 1 --2- 172.21.15.22:0/800546347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c0abff0 0x7fb38c15f3e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb38c06c070 tx=0x7fb38402bee0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.775+0000 7fb392f61640 1 -- 172.21.15.22:0/800546347 shutdown_connections 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.775+0000 7fb392f61640 1 --2- 172.21.15.22:0/800546347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c0abff0 0x7fb38c15f3e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.775+0000 7fb392f61640 1 --2- 172.21.15.22:0/800546347 >> v2:172.21.15.31:3300/0 conn(0x7fb38c06d520 0x7fb38c06d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.775+0000 7fb392f61640 1 -- 172.21.15.22:0/800546347 >> 172.21.15.22:0/800546347 conn(0x7fb38c0b0d80 msgr2=0x7fb38c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.775+0000 7fb392f61640 1 -- 172.21.15.22:0/800546347 shutdown_connections 2023-11-24T06:14:21.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.775+0000 7fb392f61640 1 -- 172.21.15.22:0/800546347 wait complete. 2023-11-24T06:14:21.001 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:21.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.776+0000 7fb392f61640 1 Processor -- start 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.777+0000 7fb392f61640 1 -- start start 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.777+0000 7fb392f61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c06d520 0x7fb38c14a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.777+0000 7fb392f61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb38c0abff0 0x7fb38c15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.777+0000 7fb392f61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb38c0ad720 0x7fb38c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.777+0000 7fb392f61640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c151990 con 0x7fb38c06d520 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb392f61640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c15aea0 con 0x7fb38c0ad720 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb392f61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c15b180 con 0x7fb38c0abff0 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb390cfd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c06d520 0x7fb38c14a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb390cfd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c06d520 0x7fb38c14a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38894/0 (socket says 172.21.15.22:38894) 2023-11-24T06:14:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb390cfd640 1 -- 172.21.15.22:0/2459584606 learned_addr learned my addr 172.21.15.22:0/2459584606 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb3914fe640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb38c0ad720 0x7fb38c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb38bfff640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb38c0abff0 0x7fb38c15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb390cfd640 1 -- 172.21.15.22:0/2459584606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb38c0abff0 msgr2=0x7fb38c15a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb390cfd640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb38c0abff0 0x7fb38c15a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb390cfd640 1 -- 172.21.15.22:0/2459584606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb38c0ad720 msgr2=0x7fb38c15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb390cfd640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb38c0ad720 0x7fb38c15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb390cfd640 1 -- 172.21.15.22:0/2459584606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009b30 con 0x7fb38c06d520 2023-11-24T06:14:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.778+0000 7fb38bfff640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb38c0abff0 0x7fb38c15a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.779+0000 7fb390cfd640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c06d520 0x7fb38c14a3e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb38000b4a0 tx=0x7fb38000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.779+0000 7fb3897fa640 1 -- 172.21.15.22:0/2459584606 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380010610 con 0x7fb38c06d520 2023-11-24T06:14:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.779+0000 7fb3897fa640 1 -- 172.21.15.22:0/2459584606 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb380010770 con 0x7fb38c06d520 2023-11-24T06:14:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.779+0000 7fb3897fa640 1 -- 172.21.15.22:0/2459584606 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380010b20 con 0x7fb38c06d520 2023-11-24T06:14:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.779+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c151c50 con 0x7fb38c06d520 2023-11-24T06:14:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.779+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c14a920 con 0x7fb38c06d520 2023-11-24T06:14:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.780+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c15b2c0 con 0x7fb38c06d520 2023-11-24T06:14:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.781+0000 7fb3897fa640 1 -- 172.21.15.22:0/2459584606 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb380010c80 con 0x7fb38c06d520 2023-11-24T06:14:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.782+0000 7fb3897fa640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb37006aff0 0x7fb37006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.783+0000 7fb3897fa640 1 -- 172.21.15.22:0/2459584606 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb380089680 con 0x7fb38c06d520 2023-11-24T06:14:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.783+0000 7fb38bfff640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb37006aff0 0x7fb37006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.784+0000 7fb38bfff640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb37006aff0 0x7fb37006d4b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb38c158b90 tx=0x7fb378008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.787+0000 7fb3897fa640 1 -- 172.21.15.22:0/2459584606 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb38c15b2c0 con 0x7fb38c06d520 2023-11-24T06:14:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:20.978+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb38c15fa70 con 0x7fb37006aff0 2023-11-24T06:14:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.001+0000 7fb3897fa640 1 -- 172.21.15.22:0/2459584606 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286884 (secure 0 0 0) 0x7fb38c15fa70 con 0x7fb37006aff0 2023-11-24T06:14:21.008 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:21.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:21.014 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:14:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb37006aff0 msgr2=0x7fb37006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb37006aff0 0x7fb37006d4b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb38c158b90 tx=0x7fb378008040 comp rx=0 tx=0).stop 2023-11-24T06:14:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c06d520 msgr2=0x7fb38c14a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c06d520 0x7fb38c14a3e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb38000b4a0 tx=0x7fb38000b960 comp rx=0 tx=0).stop 2023-11-24T06:14:21.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 shutdown_connections 2023-11-24T06:14:21.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb37006aff0 0x7fb37006d4b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb38c0ad720 0x7fb38c15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb38c0abff0 0x7fb38c15a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 --2- 172.21.15.22:0/2459584606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c06d520 0x7fb38c14a3e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.011+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 >> 172.21.15.22:0/2459584606 conn(0x7fb38c0b0d80 msgr2=0x7fb38c0acc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.012+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 shutdown_connections 2023-11-24T06:14:21.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.012+0000 7fb392f61640 1 -- 172.21.15.22:0/2459584606 wait complete. 2023-11-24T06:14:21.034 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-11-24T06:14:20.690641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238324,"kb_used_data":5480,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736396,"statfs":{"total":773094113280,"available":772850069504,"internally_reserved":0,"allocated":5611520,"data_stored":2948076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.254010"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434757+0000","last_change":"2023-11-24T06:14:15.465175+0000","last_active":"2023-11-24T06:14:16.434757+0000","last_peered":"2023-11-24T06:14:16.434757+0000","last_clean":"2023-11-24T06:14:16.434757+0000","last_became_active":"2023-11-24T06:14:15.456393+0000","last_became_peered":"2023-11-24T06:14:15.456393+0000","last_unstale":"2023-11-24T06:14:16.434757+0000","last_undegraded":"2023-11-24T06:14:16.434757+0000","last_fullsized":"2023-11-24T06:14:16.434757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:51:37.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.432702+0000","last_change":"2023-11-24T06:14:15.472506+0000","last_active":"2023-11-24T06:14:16.432702+0000","last_peered":"2023-11-24T06:14:16.432702+0000","last_clean":"2023-11-24T06:14:16.432702+0000","last_became_active":"2023-11-24T06:14:15.472169+0000","last_became_peered":"2023-11-24T06:14:15.472169+0000","last_unstale":"2023-11-24T06:14:16.432702+0000","last_undegraded":"2023-11-24T06:14:16.432702+0000","last_fullsized":"2023-11-24T06:14:16.432702+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530835+0000","last_change":"2023-11-24T06:14:15.463311+0000","last_active":"2023-11-24T06:14:16.530835+0000","last_peered":"2023-11-24T06:14:16.530835+0000","last_clean":"2023-11-24T06:14:16.530835+0000","last_became_active":"2023-11-24T06:14:15.462897+0000","last_became_peered":"2023-11-24T06:14:15.462897+0000","last_unstale":"2023-11-24T06:14:16.530835+0000","last_undegraded":"2023-11-24T06:14:16.530835+0000","last_fullsized":"2023-11-24T06:14:16.530835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:05.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529563+0000","last_change":"2023-11-24T06:14:15.462467+0000","last_active":"2023-11-24T06:14:16.529563+0000","last_peered":"2023-11-24T06:14:16.529563+0000","last_clean":"2023-11-24T06:14:16.529563+0000","last_became_active":"2023-11-24T06:14:15.461274+0000","last_became_peered":"2023-11-24T06:14:15.461274+0000","last_unstale":"2023-11-24T06:14:16.529563+0000","last_undegraded":"2023-11-24T06:14:16.529563+0000","last_fullsized":"2023-11-24T06:14:16.529563+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.431852+0000","last_change":"2023-11-24T06:14:15.468322+0000","last_active":"2023-11-24T06:14:16.431852+0000","last_peered":"2023-11-24T06:14:16.431852+0000","last_clean":"2023-11-24T06:14:16.431852+0000","last_became_active":"2023-11-24T06:14:15.467944+0000","last_became_peered":"2023-11-24T06:14:15.467944+0000","last_unstale":"2023-11-24T06:14:16.431852+0000","last_undegraded":"2023-11-24T06:14:16.431852+0000","last_fullsized":"2023-11-24T06:14:16.431852+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:05.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429496+0000","last_change":"2023-11-24T06:14:15.456762+0000","last_active":"2023-11-24T06:14:16.429496+0000","last_peered":"2023-11-24T06:14:16.429496+0000","last_clean":"2023-11-24T06:14:16.429496+0000","last_became_active":"2023-11-24T06:14:15.456470+0000","last_became_peered":"2023-11-24T06:14:15.456470+0000","last_unstale":"2023-11-24T06:14:16.429496+0000","last_undegraded":"2023-11-24T06:14:16.429496+0000","last_fullsized":"2023-11-24T06:14:16.429496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:14:21.955170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.433700+0000","last_change":"2023-11-24T06:14:15.452856+0000","last_active":"2023-11-24T06:14:16.433700+0000","last_peered":"2023-11-24T06:14:16.433700+0000","last_clean":"2023-11-24T06:14:16.433700+0000","last_became_active":"2023-11-24T06:14:15.452566+0000","last_became_peered":"2023-11-24T06:14:15.452566+0000","last_unstale":"2023-11-24T06:14:16.433700+0000","last_undegraded":"2023-11-24T06:14:16.433700+0000","last_fullsized":"2023-11-24T06:14:16.433700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529445+0000","last_change":"2023-11-24T06:14:15.460643+0000","last_active":"2023-11-24T06:14:16.529445+0000","last_peered":"2023-11-24T06:14:16.529445+0000","last_clean":"2023-11-24T06:14:16.529445+0000","last_became_active":"2023-11-24T06:14:15.460185+0000","last_became_peered":"2023-11-24T06:14:15.460185+0000","last_unstale":"2023-11-24T06:14:16.529445+0000","last_undegraded":"2023-11-24T06:14:16.529445+0000","last_fullsized":"2023-11-24T06:14:16.529445+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530188+0000","last_change":"2023-11-24T06:14:15.463163+0000","last_active":"2023-11-24T06:14:16.530188+0000","last_peered":"2023-11-24T06:14:16.530188+0000","last_clean":"2023-11-24T06:14:16.530188+0000","last_became_active":"2023-11-24T06:14:15.460198+0000","last_became_peered":"2023-11-24T06:14:15.460198+0000","last_unstale":"2023-11-24T06:14:16.530188+0000","last_undegraded":"2023-11-24T06:14:16.530188+0000","last_fullsized":"2023-11-24T06:14:16.530188+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:35.312894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530702+0000","last_change":"2023-11-24T06:14:15.467076+0000","last_active":"2023-11-24T06:14:16.530702+0000","last_peered":"2023-11-24T06:14:16.530702+0000","last_clean":"2023-11-24T06:14:16.530702+0000","last_became_active":"2023-11-24T06:14:15.461068+0000","last_became_peered":"2023-11-24T06:14:15.461068+0000","last_unstale":"2023-11-24T06:14:16.530702+0000","last_undegraded":"2023-11-24T06:14:16.530702+0000","last_fullsized":"2023-11-24T06:14:16.530702+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:52:19.253662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530413+0000","last_change":"2023-11-24T06:14:15.460243+0000","last_active":"2023-11-24T06:14:16.530413+0000","last_peered":"2023-11-24T06:14:16.530413+0000","last_clean":"2023-11-24T06:14:16.530413+0000","last_became_active":"2023-11-24T06:14:15.459889+0000","last_became_peered":"2023-11-24T06:14:15.459889+0000","last_unstale":"2023-11-24T06:14:16.530413+0000","last_undegraded":"2023-11-24T06:14:16.530413+0000","last_fullsized":"2023-11-24T06:14:16.530413+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:14.283905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.431869+0000","last_change":"2023-11-24T06:14:15.465076+0000","last_active":"2023-11-24T06:14:16.431869+0000","last_peered":"2023-11-24T06:14:16.431869+0000","last_clean":"2023-11-24T06:14:16.431869+0000","last_became_active":"2023-11-24T06:14:15.464088+0000","last_became_peered":"2023-11-24T06:14:15.464088+0000","last_unstale":"2023-11-24T06:14:16.431869+0000","last_undegraded":"2023-11-24T06:14:16.431869+0000","last_fullsized":"2023-11-24T06:14:16.431869+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533093+0000","last_change":"2023-11-24T06:14:15.456309+0000","last_active":"2023-11-24T06:14:16.533093+0000","last_peered":"2023-11-24T06:14:16.533093+0000","last_clean":"2023-11-24T06:14:16.533093+0000","last_became_active":"2023-11-24T06:14:15.455170+0000","last_became_peered":"2023-11-24T06:14:15.455170+0000","last_unstale":"2023-11-24T06:14:16.533093+0000","last_undegraded":"2023-11-24T06:14:16.533093+0000","last_fullsized":"2023-11-24T06:14:16.533093+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:03:53.101315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529426+0000","last_change":"2023-11-24T06:14:15.453814+0000","last_active":"2023-11-24T06:14:16.529426+0000","last_peered":"2023-11-24T06:14:16.529426+0000","last_clean":"2023-11-24T06:14:16.529426+0000","last_became_active":"2023-11-24T06:14:15.453548+0000","last_became_peered":"2023-11-24T06:14:15.453548+0000","last_unstale":"2023-11-24T06:14:16.529426+0000","last_undegraded":"2023-11-24T06:14:16.529426+0000","last_fullsized":"2023-11-24T06:14:16.529426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:05.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429590+0000","last_change":"2023-11-24T06:14:15.468734+0000","last_active":"2023-11-24T06:14:16.429590+0000","last_peered":"2023-11-24T06:14:16.429590+0000","last_clean":"2023-11-24T06:14:16.429590+0000","last_became_active":"2023-11-24T06:14:15.464022+0000","last_became_peered":"2023-11-24T06:14:15.464022+0000","last_unstale":"2023-11-24T06:14:16.429590+0000","last_undegraded":"2023-11-24T06:14:16.429590+0000","last_fullsized":"2023-11-24T06:14:16.429590+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:14.174404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531753+0000","last_change":"2023-11-24T06:14:15.454355+0000","last_active":"2023-11-24T06:14:16.531753+0000","last_peered":"2023-11-24T06:14:16.531753+0000","last_clean":"2023-11-24T06:14:16.531753+0000","last_became_active":"2023-11-24T06:14:15.453954+0000","last_became_peered":"2023-11-24T06:14:15.453954+0000","last_unstale":"2023-11-24T06:14:16.531753+0000","last_undegraded":"2023-11-24T06:14:16.531753+0000","last_fullsized":"2023-11-24T06:14:16.531753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:12.924610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531191+0000","last_change":"2023-11-24T06:14:15.455909+0000","last_active":"2023-11-24T06:14:16.531191+0000","last_peered":"2023-11-24T06:14:16.531191+0000","last_clean":"2023-11-24T06:14:16.531191+0000","last_became_active":"2023-11-24T06:14:15.455600+0000","last_became_peered":"2023-11-24T06:14:15.455600+0000","last_unstale":"2023-11-24T06:14:16.531191+0000","last_undegraded":"2023-11-24T06:14:16.531191+0000","last_fullsized":"2023-11-24T06:14:16.531191+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531653+0000","last_change":"2023-11-24T06:14:15.464787+0000","last_active":"2023-11-24T06:14:16.531653+0000","last_peered":"2023-11-24T06:14:16.531653+0000","last_clean":"2023-11-24T06:14:16.531653+0000","last_became_active":"2023-11-24T06:14:15.464041+0000","last_became_peered":"2023-11-24T06:14:15.464041+0000","last_unstale":"2023-11-24T06:14:16.531653+0000","last_undegraded":"2023-11-24T06:14:16.531653+0000","last_fullsized":"2023-11-24T06:14:16.531653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533559+0000","last_change":"2023-11-24T06:14:15.463515+0000","last_active":"2023-11-24T06:14:16.533559+0000","last_peered":"2023-11-24T06:14:16.533559+0000","last_clean":"2023-11-24T06:14:16.533559+0000","last_became_active":"2023-11-24T06:14:15.463112+0000","last_became_peered":"2023-11-24T06:14:15.463112+0000","last_unstale":"2023-11-24T06:14:16.533559+0000","last_undegraded":"2023-11-24T06:14:16.533559+0000","last_fullsized":"2023-11-24T06:14:16.533559+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:37.937358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533282+0000","last_change":"2023-11-24T06:14:15.470585+0000","last_active":"2023-11-24T06:14:16.533282+0000","last_peered":"2023-11-24T06:14:16.533282+0000","last_clean":"2023-11-24T06:14:16.533282+0000","last_became_active":"2023-11-24T06:14:15.470285+0000","last_became_peered":"2023-11-24T06:14:15.470285+0000","last_unstale":"2023-11-24T06:14:16.533282+0000","last_undegraded":"2023-11-24T06:14:16.533282+0000","last_fullsized":"2023-11-24T06:14:16.533282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:19.397131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429764+0000","last_change":"2023-11-24T06:14:15.462713+0000","last_active":"2023-11-24T06:14:16.429764+0000","last_peered":"2023-11-24T06:14:16.429764+0000","last_clean":"2023-11-24T06:14:16.429764+0000","last_became_active":"2023-11-24T06:14:15.459623+0000","last_became_peered":"2023-11-24T06:14:15.459623+0000","last_unstale":"2023-11-24T06:14:16.429764+0000","last_undegraded":"2023-11-24T06:14:16.429764+0000","last_fullsized":"2023-11-24T06:14:16.429764+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:12.189277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529423+0000","last_change":"2023-11-24T06:14:15.454971+0000","last_active":"2023-11-24T06:14:16.529423+0000","last_peered":"2023-11-24T06:14:16.529423+0000","last_clean":"2023-11-24T06:14:16.529423+0000","last_became_active":"2023-11-24T06:14:15.454687+0000","last_became_peered":"2023-11-24T06:14:15.454687+0000","last_unstale":"2023-11-24T06:14:16.529423+0000","last_undegraded":"2023-11-24T06:14:16.529423+0000","last_fullsized":"2023-11-24T06:14:16.529423+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:20.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531689+0000","last_change":"2023-11-24T06:14:15.452875+0000","last_active":"2023-11-24T06:14:16.531689+0000","last_peered":"2023-11-24T06:14:16.531689+0000","last_clean":"2023-11-24T06:14:16.531689+0000","last_became_active":"2023-11-24T06:14:15.452533+0000","last_became_peered":"2023-11-24T06:14:15.452533+0000","last_unstale":"2023-11-24T06:14:16.531689+0000","last_undegraded":"2023-11-24T06:14:16.531689+0000","last_fullsized":"2023-11-24T06:14:16.531689+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:09.589303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532073+0000","last_change":"2023-11-24T06:14:15.451547+0000","last_active":"2023-11-24T06:14:16.532073+0000","last_peered":"2023-11-24T06:14:16.532073+0000","last_clean":"2023-11-24T06:14:16.532073+0000","last_became_active":"2023-11-24T06:14:15.450548+0000","last_became_peered":"2023-11-24T06:14:15.450548+0000","last_unstale":"2023-11-24T06:14:16.532073+0000","last_undegraded":"2023-11-24T06:14:16.532073+0000","last_fullsized":"2023-11-24T06:14:16.532073+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:50.556446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533197+0000","last_change":"2023-11-24T06:14:15.448866+0000","last_active":"2023-11-24T06:14:16.533197+0000","last_peered":"2023-11-24T06:14:16.533197+0000","last_clean":"2023-11-24T06:14:16.533197+0000","last_became_active":"2023-11-24T06:14:15.448583+0000","last_became_peered":"2023-11-24T06:14:15.448583+0000","last_unstale":"2023-11-24T06:14:16.533197+0000","last_undegraded":"2023-11-24T06:14:16.533197+0000","last_fullsized":"2023-11-24T06:14:16.533197+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:16.470025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533280+0000","last_change":"2023-11-24T06:14:15.459471+0000","last_active":"2023-11-24T06:14:16.533280+0000","last_peered":"2023-11-24T06:14:16.533280+0000","last_clean":"2023-11-24T06:14:16.533280+0000","last_became_active":"2023-11-24T06:14:15.459183+0000","last_became_peered":"2023-11-24T06:14:15.459183+0000","last_unstale":"2023-11-24T06:14:16.533280+0000","last_undegraded":"2023-11-24T06:14:16.533280+0000","last_fullsized":"2023-11-24T06:14:16.533280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:07:40.373840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531283+0000","last_change":"2023-11-24T06:14:15.456470+0000","last_active":"2023-11-24T06:14:16.531283+0000","last_peered":"2023-11-24T06:14:16.531283+0000","last_clean":"2023-11-24T06:14:16.531283+0000","last_became_active":"2023-11-24T06:14:15.456166+0000","last_became_peered":"2023-11-24T06:14:15.456166+0000","last_unstale":"2023-11-24T06:14:16.531283+0000","last_undegraded":"2023-11-24T06:14:16.531283+0000","last_fullsized":"2023-11-24T06:14:16.531283+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.432298+0000","last_change":"2023-11-24T06:14:15.465252+0000","last_active":"2023-11-24T06:14:16.432298+0000","last_peered":"2023-11-24T06:14:16.432298+0000","last_clean":"2023-11-24T06:14:16.432298+0000","last_became_active":"2023-11-24T06:14:15.463585+0000","last_became_peered":"2023-11-24T06:14:15.463585+0000","last_unstale":"2023-11-24T06:14:16.432298+0000","last_undegraded":"2023-11-24T06:14:16.432298+0000","last_fullsized":"2023-11-24T06:14:16.432298+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532456+0000","last_change":"2023-11-24T06:14:15.448391+0000","last_active":"2023-11-24T06:14:16.532456+0000","last_peered":"2023-11-24T06:14:16.532456+0000","last_clean":"2023-11-24T06:14:16.532456+0000","last_became_active":"2023-11-24T06:14:15.448061+0000","last_became_peered":"2023-11-24T06:14:15.448061+0000","last_unstale":"2023-11-24T06:14:16.532456+0000","last_undegraded":"2023-11-24T06:14:16.532456+0000","last_fullsized":"2023-11-24T06:14:16.532456+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:52.793134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530580+0000","last_change":"2023-11-24T06:14:15.456760+0000","last_active":"2023-11-24T06:14:16.530580+0000","last_peered":"2023-11-24T06:14:16.530580+0000","last_clean":"2023-11-24T06:14:16.530580+0000","last_became_active":"2023-11-24T06:14:15.456438+0000","last_became_peered":"2023-11-24T06:14:15.456438+0000","last_unstale":"2023-11-24T06:14:16.530580+0000","last_undegraded":"2023-11-24T06:14:16.530580+0000","last_fullsized":"2023-11-24T06:14:16.530580+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:47.443002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429476+0000","last_change":"2023-11-24T06:14:15.465806+0000","last_active":"2023-11-24T06:14:16.429476+0000","last_peered":"2023-11-24T06:14:16.429476+0000","last_clean":"2023-11-24T06:14:16.429476+0000","last_became_active":"2023-11-24T06:14:15.464436+0000","last_became_peered":"2023-11-24T06:14:15.464436+0000","last_unstale":"2023-11-24T06:14:16.429476+0000","last_undegraded":"2023-11-24T06:14:16.429476+0000","last_fullsized":"2023-11-24T06:14:16.429476+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:51:28.140293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533344+0000","last_change":"2023-11-24T06:14:15.453814+0000","last_active":"2023-11-24T06:14:16.533344+0000","last_peered":"2023-11-24T06:14:16.533344+0000","last_clean":"2023-11-24T06:14:16.533344+0000","last_became_active":"2023-11-24T06:14:15.453484+0000","last_became_peered":"2023-11-24T06:14:15.453484+0000","last_unstale":"2023-11-24T06:14:16.533344+0000","last_undegraded":"2023-11-24T06:14:16.533344+0000","last_fullsized":"2023-11-24T06:14:16.533344+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:49:48.523158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531657+0000","last_change":"2023-11-24T06:14:15.461105+0000","last_active":"2023-11-24T06:14:16.531657+0000","last_peered":"2023-11-24T06:14:16.531657+0000","last_clean":"2023-11-24T06:14:16.531657+0000","last_became_active":"2023-11-24T06:14:15.458141+0000","last_became_peered":"2023-11-24T06:14:15.458141+0000","last_unstale":"2023-11-24T06:14:16.531657+0000","last_undegraded":"2023-11-24T06:14:16.531657+0000","last_fullsized":"2023-11-24T06:14:16.531657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:59.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.489180+0000","last_change":"2023-11-24T06:14:14.473536+0000","last_active":"2023-11-24T06:14:15.489180+0000","last_peered":"2023-11-24T06:14:15.489180+0000","last_clean":"2023-11-24T06:14:15.489180+0000","last_became_active":"2023-11-24T06:14:14.473231+0000","last_became_peered":"2023-11-24T06:14:14.473231+0000","last_unstale":"2023-11-24T06:14:15.489180+0000","last_undegraded":"2023-11-24T06:14:15.489180+0000","last_fullsized":"2023-11-24T06:14:15.489180+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:08.401655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533242+0000","last_change":"2023-11-24T06:14:15.460242+0000","last_active":"2023-11-24T06:14:16.533242+0000","last_peered":"2023-11-24T06:14:16.533242+0000","last_clean":"2023-11-24T06:14:16.533242+0000","last_became_active":"2023-11-24T06:14:15.459929+0000","last_became_peered":"2023-11-24T06:14:15.459929+0000","last_unstale":"2023-11-24T06:14:16.533242+0000","last_undegraded":"2023-11-24T06:14:16.533242+0000","last_fullsized":"2023-11-24T06:14:16.533242+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:10.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.487075+0000","last_change":"2023-11-24T06:14:14.475915+0000","last_active":"2023-11-24T06:14:15.487075+0000","last_peered":"2023-11-24T06:14:15.487075+0000","last_clean":"2023-11-24T06:14:15.487075+0000","last_became_active":"2023-11-24T06:14:14.475552+0000","last_became_peered":"2023-11-24T06:14:14.475552+0000","last_unstale":"2023-11-24T06:14:15.487075+0000","last_undegraded":"2023-11-24T06:14:15.487075+0000","last_fullsized":"2023-11-24T06:14:15.487075+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:09.909600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.432472+0000","last_change":"2023-11-24T06:14:15.461285+0000","last_active":"2023-11-24T06:14:16.432472+0000","last_peered":"2023-11-24T06:14:16.432472+0000","last_clean":"2023-11-24T06:14:16.432472+0000","last_became_active":"2023-11-24T06:14:15.460956+0000","last_became_peered":"2023-11-24T06:14:15.460956+0000","last_unstale":"2023-11-24T06:14:16.432472+0000","last_undegraded":"2023-11-24T06:14:16.432472+0000","last_fullsized":"2023-11-24T06:14:16.432472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532280+0000","last_change":"2023-11-24T06:14:14.466846+0000","last_active":"2023-11-24T06:14:16.532280+0000","last_peered":"2023-11-24T06:14:16.532280+0000","last_clean":"2023-11-24T06:14:16.532280+0000","last_became_active":"2023-11-24T06:14:14.466551+0000","last_became_peered":"2023-11-24T06:14:14.466551+0000","last_unstale":"2023-11-24T06:14:16.532280+0000","last_undegraded":"2023-11-24T06:14:16.532280+0000","last_fullsized":"2023-11-24T06:14:16.532280+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.012140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532216+0000","last_change":"2023-11-24T06:14:15.450388+0000","last_active":"2023-11-24T06:14:16.532216+0000","last_peered":"2023-11-24T06:14:16.532216+0000","last_clean":"2023-11-24T06:14:16.532216+0000","last_became_active":"2023-11-24T06:14:15.449506+0000","last_became_peered":"2023-11-24T06:14:15.449506+0000","last_unstale":"2023-11-24T06:14:16.532216+0000","last_undegraded":"2023-11-24T06:14:16.532216+0000","last_fullsized":"2023-11-24T06:14:16.532216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:42:24.194375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.487041+0000","last_change":"2023-11-24T06:14:14.474823+0000","last_active":"2023-11-24T06:14:15.487041+0000","last_peered":"2023-11-24T06:14:15.487041+0000","last_clean":"2023-11-24T06:14:15.487041+0000","last_became_active":"2023-11-24T06:14:14.474389+0000","last_became_peered":"2023-11-24T06:14:14.474389+0000","last_unstale":"2023-11-24T06:14:15.487041+0000","last_undegraded":"2023-11-24T06:14:15.487041+0000","last_fullsized":"2023-11-24T06:14:15.487041+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:15.457717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530708+0000","last_change":"2023-11-24T06:14:15.456489+0000","last_active":"2023-11-24T06:14:16.530708+0000","last_peered":"2023-11-24T06:14:16.530708+0000","last_clean":"2023-11-24T06:14:16.530708+0000","last_became_active":"2023-11-24T06:14:15.455546+0000","last_became_peered":"2023-11-24T06:14:15.455546+0000","last_unstale":"2023-11-24T06:14:16.530708+0000","last_undegraded":"2023-11-24T06:14:16.530708+0000","last_fullsized":"2023-11-24T06:14:16.530708+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:20.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.490426+0000","last_change":"2023-11-24T06:14:14.465504+0000","last_active":"2023-11-24T06:14:15.490426+0000","last_peered":"2023-11-24T06:14:15.490426+0000","last_clean":"2023-11-24T06:14:15.490426+0000","last_became_active":"2023-11-24T06:14:14.463218+0000","last_became_peered":"2023-11-24T06:14:14.463218+0000","last_unstale":"2023-11-24T06:14:15.490426+0000","last_undegraded":"2023-11-24T06:14:15.490426+0000","last_fullsized":"2023-11-24T06:14:15.490426+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:13.271597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529888+0000","last_change":"2023-11-24T06:14:15.466490+0000","last_active":"2023-11-24T06:14:16.529888+0000","last_peered":"2023-11-24T06:14:16.529888+0000","last_clean":"2023-11-24T06:14:16.529888+0000","last_became_active":"2023-11-24T06:14:15.466122+0000","last_became_peered":"2023-11-24T06:14:15.466122+0000","last_unstale":"2023-11-24T06:14:16.529888+0000","last_undegraded":"2023-11-24T06:14:16.529888+0000","last_fullsized":"2023-11-24T06:14:16.529888+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:51:37.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.483552+0000","last_change":"2023-11-24T06:14:14.473902+0000","last_active":"2023-11-24T06:14:15.483552+0000","last_peered":"2023-11-24T06:14:15.483552+0000","last_clean":"2023-11-24T06:14:15.483552+0000","last_became_active":"2023-11-24T06:14:14.472463+0000","last_became_peered":"2023-11-24T06:14:14.472463+0000","last_unstale":"2023-11-24T06:14:15.483552+0000","last_undegraded":"2023-11-24T06:14:15.483552+0000","last_fullsized":"2023-11-24T06:14:15.483552+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:36.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529824+0000","last_change":"2023-11-24T06:14:15.460430+0000","last_active":"2023-11-24T06:14:16.529824+0000","last_peered":"2023-11-24T06:14:16.529824+0000","last_clean":"2023-11-24T06:14:16.529824+0000","last_became_active":"2023-11-24T06:14:15.459760+0000","last_became_peered":"2023-11-24T06:14:15.459760+0000","last_unstale":"2023-11-24T06:14:16.529824+0000","last_undegraded":"2023-11-24T06:14:16.529824+0000","last_fullsized":"2023-11-24T06:14:16.529824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.446761+0000","last_change":"2023-11-24T06:14:14.463999+0000","last_active":"2023-11-24T06:14:15.446761+0000","last_peered":"2023-11-24T06:14:15.446761+0000","last_clean":"2023-11-24T06:14:15.446761+0000","last_became_active":"2023-11-24T06:14:14.463397+0000","last_became_peered":"2023-11-24T06:14:14.463397+0000","last_unstale":"2023-11-24T06:14:15.446761+0000","last_undegraded":"2023-11-24T06:14:15.446761+0000","last_fullsized":"2023-11-24T06:14:15.446761+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:58.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531694+0000","last_change":"2023-11-24T06:14:15.449308+0000","last_active":"2023-11-24T06:14:16.531694+0000","last_peered":"2023-11-24T06:14:16.531694+0000","last_clean":"2023-11-24T06:14:16.531694+0000","last_became_active":"2023-11-24T06:14:15.448927+0000","last_became_peered":"2023-11-24T06:14:15.448927+0000","last_unstale":"2023-11-24T06:14:16.531694+0000","last_undegraded":"2023-11-24T06:14:16.531694+0000","last_fullsized":"2023-11-24T06:14:16.531694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:42:11.964625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.448787+0000","last_change":"2023-11-24T06:14:14.460282+0000","last_active":"2023-11-24T06:14:15.448787+0000","last_peered":"2023-11-24T06:14:15.448787+0000","last_clean":"2023-11-24T06:14:15.448787+0000","last_became_active":"2023-11-24T06:14:14.459975+0000","last_became_peered":"2023-11-24T06:14:14.459975+0000","last_unstale":"2023-11-24T06:14:15.448787+0000","last_undegraded":"2023-11-24T06:14:15.448787+0000","last_fullsized":"2023-11-24T06:14:15.448787+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:32.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532001+0000","last_change":"2023-11-24T06:14:15.464334+0000","last_active":"2023-11-24T06:14:16.532001+0000","last_peered":"2023-11-24T06:14:16.532001+0000","last_clean":"2023-11-24T06:14:16.532001+0000","last_became_active":"2023-11-24T06:14:15.463320+0000","last_became_peered":"2023-11-24T06:14:15.463320+0000","last_unstale":"2023-11-24T06:14:16.532001+0000","last_undegraded":"2023-11-24T06:14:16.532001+0000","last_fullsized":"2023-11-24T06:14:16.532001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.446737+0000","last_change":"2023-11-24T06:14:14.470638+0000","last_active":"2023-11-24T06:14:15.446737+0000","last_peered":"2023-11-24T06:14:15.446737+0000","last_clean":"2023-11-24T06:14:15.446737+0000","last_became_active":"2023-11-24T06:14:14.470336+0000","last_became_peered":"2023-11-24T06:14:14.470336+0000","last_unstale":"2023-11-24T06:14:15.446737+0000","last_undegraded":"2023-11-24T06:14:15.446737+0000","last_fullsized":"2023-11-24T06:14:15.446737+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:18.219329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434855+0000","last_change":"2023-11-24T06:14:15.458205+0000","last_active":"2023-11-24T06:14:16.434855+0000","last_peered":"2023-11-24T06:14:16.434855+0000","last_clean":"2023-11-24T06:14:16.434855+0000","last_became_active":"2023-11-24T06:14:15.457862+0000","last_became_peered":"2023-11-24T06:14:15.457862+0000","last_unstale":"2023-11-24T06:14:16.434855+0000","last_undegraded":"2023-11-24T06:14:16.434855+0000","last_fullsized":"2023-11-24T06:14:16.434855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:35.312894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.448617+0000","last_change":"2023-11-24T06:14:14.470585+0000","last_active":"2023-11-24T06:14:15.448617+0000","last_peered":"2023-11-24T06:14:15.448617+0000","last_clean":"2023-11-24T06:14:15.448617+0000","last_became_active":"2023-11-24T06:14:14.470306+0000","last_became_peered":"2023-11-24T06:14:14.470306+0000","last_unstale":"2023-11-24T06:14:15.448617+0000","last_undegraded":"2023-11-24T06:14:15.448617+0000","last_fullsized":"2023-11-24T06:14:15.448617+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:36.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430984+0000","last_change":"2023-11-24T06:14:15.474018+0000","last_active":"2023-11-24T06:14:16.430984+0000","last_peered":"2023-11-24T06:14:16.430984+0000","last_clean":"2023-11-24T06:14:16.430984+0000","last_became_active":"2023-11-24T06:14:15.470825+0000","last_became_peered":"2023-11-24T06:14:15.470825+0000","last_unstale":"2023-11-24T06:14:16.430984+0000","last_undegraded":"2023-11-24T06:14:16.430984+0000","last_fullsized":"2023-11-24T06:14:16.430984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:02.888485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.488943+0000","last_change":"2023-11-24T06:14:14.476720+0000","last_active":"2023-11-24T06:14:15.488943+0000","last_peered":"2023-11-24T06:14:15.488943+0000","last_clean":"2023-11-24T06:14:15.488943+0000","last_became_active":"2023-11-24T06:14:14.476422+0000","last_became_peered":"2023-11-24T06:14:14.476422+0000","last_unstale":"2023-11-24T06:14:15.488943+0000","last_undegraded":"2023-11-24T06:14:15.488943+0000","last_fullsized":"2023-11-24T06:14:15.488943+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:46.430693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434479+0000","last_change":"2023-11-24T06:14:15.452920+0000","last_active":"2023-11-24T06:14:16.434479+0000","last_peered":"2023-11-24T06:14:16.434479+0000","last_clean":"2023-11-24T06:14:16.434479+0000","last_became_active":"2023-11-24T06:14:15.452489+0000","last_became_peered":"2023-11-24T06:14:15.452489+0000","last_unstale":"2023-11-24T06:14:16.434479+0000","last_undegraded":"2023-11-24T06:14:16.434479+0000","last_fullsized":"2023-11-24T06:14:16.434479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.492266+0000","last_change":"2023-11-24T06:14:14.469038+0000","last_active":"2023-11-24T06:14:15.492266+0000","last_peered":"2023-11-24T06:14:15.492266+0000","last_clean":"2023-11-24T06:14:15.492266+0000","last_became_active":"2023-11-24T06:14:14.468405+0000","last_became_peered":"2023-11-24T06:14:14.468405+0000","last_unstale":"2023-11-24T06:14:15.492266+0000","last_undegraded":"2023-11-24T06:14:15.492266+0000","last_fullsized":"2023-11-24T06:14:15.492266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:54.931363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532442+0000","last_change":"2023-11-24T06:14:15.462373+0000","last_active":"2023-11-24T06:14:16.532442+0000","last_peered":"2023-11-24T06:14:16.532442+0000","last_clean":"2023-11-24T06:14:16.532442+0000","last_became_active":"2023-11-24T06:14:15.462091+0000","last_became_peered":"2023-11-24T06:14:15.462091+0000","last_unstale":"2023-11-24T06:14:16.532442+0000","last_undegraded":"2023-11-24T06:14:16.532442+0000","last_fullsized":"2023-11-24T06:14:16.532442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:12.442248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.489253+0000","last_change":"2023-11-24T06:14:14.464231+0000","last_active":"2023-11-24T06:14:15.489253+0000","last_peered":"2023-11-24T06:14:15.489253+0000","last_clean":"2023-11-24T06:14:15.489253+0000","last_became_active":"2023-11-24T06:14:14.463983+0000","last_became_peered":"2023-11-24T06:14:14.463983+0000","last_unstale":"2023-11-24T06:14:15.489253+0000","last_undegraded":"2023-11-24T06:14:15.489253+0000","last_fullsized":"2023-11-24T06:14:15.489253+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:12.974527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530243+0000","last_change":"2023-11-24T06:14:15.456224+0000","last_active":"2023-11-24T06:14:16.530243+0000","last_peered":"2023-11-24T06:14:16.530243+0000","last_clean":"2023-11-24T06:14:16.530243+0000","last_became_active":"2023-11-24T06:14:15.455982+0000","last_became_peered":"2023-11-24T06:14:15.455982+0000","last_unstale":"2023-11-24T06:14:16.530243+0000","last_undegraded":"2023-11-24T06:14:16.530243+0000","last_fullsized":"2023-11-24T06:14:16.530243+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:32.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.435658+0000","last_change":"2023-11-24T06:14:14.464071+0000","last_active":"2023-11-24T06:14:15.435658+0000","last_peered":"2023-11-24T06:14:15.435658+0000","last_clean":"2023-11-24T06:14:15.435658+0000","last_became_active":"2023-11-24T06:14:14.463400+0000","last_became_peered":"2023-11-24T06:14:14.463400+0000","last_unstale":"2023-11-24T06:14:15.435658+0000","last_undegraded":"2023-11-24T06:14:15.435658+0000","last_fullsized":"2023-11-24T06:14:15.435658+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:18.219329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429208+0000","last_change":"2023-11-24T06:14:15.456873+0000","last_active":"2023-11-24T06:14:16.429208+0000","last_peered":"2023-11-24T06:14:16.429208+0000","last_clean":"2023-11-24T06:14:16.429208+0000","last_became_active":"2023-11-24T06:14:15.456605+0000","last_became_peered":"2023-11-24T06:14:15.456605+0000","last_unstale":"2023-11-24T06:14:16.429208+0000","last_undegraded":"2023-11-24T06:14:16.429208+0000","last_fullsized":"2023-11-24T06:14:16.429208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:19.012475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.452131+0000","last_change":"2023-11-24T06:14:14.465760+0000","last_active":"2023-11-24T06:14:15.452131+0000","last_peered":"2023-11-24T06:14:15.452131+0000","last_clean":"2023-11-24T06:14:15.452131+0000","last_became_active":"2023-11-24T06:14:14.464414+0000","last_became_peered":"2023-11-24T06:14:14.464414+0000","last_unstale":"2023-11-24T06:14:15.452131+0000","last_undegraded":"2023-11-24T06:14:15.452131+0000","last_fullsized":"2023-11-24T06:14:15.452131+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:23.405611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434057+0000","last_change":"2023-11-24T06:14:15.455901+0000","last_active":"2023-11-24T06:14:16.434057+0000","last_peered":"2023-11-24T06:14:16.434057+0000","last_clean":"2023-11-24T06:14:16.434057+0000","last_became_active":"2023-11-24T06:14:15.455543+0000","last_became_peered":"2023-11-24T06:14:15.455543+0000","last_unstale":"2023-11-24T06:14:16.434057+0000","last_undegraded":"2023-11-24T06:14:16.434057+0000","last_fullsized":"2023-11-24T06:14:16.434057+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.491888+0000","last_change":"2023-11-24T06:14:14.472295+0000","last_active":"2023-11-24T06:14:15.491888+0000","last_peered":"2023-11-24T06:14:15.491888+0000","last_clean":"2023-11-24T06:14:15.491888+0000","last_became_active":"2023-11-24T06:14:14.471955+0000","last_became_peered":"2023-11-24T06:14:14.471955+0000","last_unstale":"2023-11-24T06:14:15.491888+0000","last_undegraded":"2023-11-24T06:14:15.491888+0000","last_fullsized":"2023-11-24T06:14:15.491888+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:11.517836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533475+0000","last_change":"2023-11-24T06:14:15.455854+0000","last_active":"2023-11-24T06:14:16.533475+0000","last_peered":"2023-11-24T06:14:16.533475+0000","last_clean":"2023-11-24T06:14:16.533475+0000","last_became_active":"2023-11-24T06:14:15.454664+0000","last_became_peered":"2023-11-24T06:14:15.454664+0000","last_unstale":"2023-11-24T06:14:16.533475+0000","last_undegraded":"2023-11-24T06:14:16.533475+0000","last_fullsized":"2023-11-24T06:14:16.533475+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:40.126632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.487470+0000","last_change":"2023-11-24T06:14:14.462131+0000","last_active":"2023-11-24T06:14:15.487470+0000","last_peered":"2023-11-24T06:14:15.487470+0000","last_clean":"2023-11-24T06:14:15.487470+0000","last_became_active":"2023-11-24T06:14:14.461069+0000","last_became_peered":"2023-11-24T06:14:14.461069+0000","last_unstale":"2023-11-24T06:14:15.487470+0000","last_undegraded":"2023-11-24T06:14:15.487470+0000","last_fullsized":"2023-11-24T06:14:15.487470+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:10.311807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530452+0000","last_change":"2023-11-24T06:14:15.460541+0000","last_active":"2023-11-24T06:14:16.530452+0000","last_peered":"2023-11-24T06:14:16.530452+0000","last_clean":"2023-11-24T06:14:16.530452+0000","last_became_active":"2023-11-24T06:14:15.459802+0000","last_became_peered":"2023-11-24T06:14:15.459802+0000","last_unstale":"2023-11-24T06:14:16.530452+0000","last_undegraded":"2023-11-24T06:14:16.530452+0000","last_fullsized":"2023-11-24T06:14:16.530452+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:13.986835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.485770+0000","last_change":"2023-11-24T06:14:14.464681+0000","last_active":"2023-11-24T06:14:15.485770+0000","last_peered":"2023-11-24T06:14:15.485770+0000","last_clean":"2023-11-24T06:14:15.485770+0000","last_became_active":"2023-11-24T06:14:14.464313+0000","last_became_peered":"2023-11-24T06:14:14.464313+0000","last_unstale":"2023-11-24T06:14:15.485770+0000","last_undegraded":"2023-11-24T06:14:15.485770+0000","last_fullsized":"2023-11-24T06:14:15.485770+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:58.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532827+0000","last_change":"2023-11-24T06:14:15.458054+0000","last_active":"2023-11-24T06:14:16.532827+0000","last_peered":"2023-11-24T06:14:16.532827+0000","last_clean":"2023-11-24T06:14:16.532827+0000","last_became_active":"2023-11-24T06:14:15.457751+0000","last_became_peered":"2023-11-24T06:14:15.457751+0000","last_unstale":"2023-11-24T06:14:16.532827+0000","last_undegraded":"2023-11-24T06:14:16.532827+0000","last_fullsized":"2023-11-24T06:14:16.532827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:19.231637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.486965+0000","last_change":"2023-11-24T06:14:14.465038+0000","last_active":"2023-11-24T06:14:15.486965+0000","last_peered":"2023-11-24T06:14:15.486965+0000","last_clean":"2023-11-24T06:14:15.486965+0000","last_became_active":"2023-11-24T06:14:14.464681+0000","last_became_peered":"2023-11-24T06:14:14.464681+0000","last_unstale":"2023-11-24T06:14:15.486965+0000","last_undegraded":"2023-11-24T06:14:15.486965+0000","last_fullsized":"2023-11-24T06:14:15.486965+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:15.457717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533282+0000","last_change":"2023-11-24T06:14:15.449256+0000","last_active":"2023-11-24T06:14:16.533282+0000","last_peered":"2023-11-24T06:14:16.533282+0000","last_clean":"2023-11-24T06:14:16.533282+0000","last_became_active":"2023-11-24T06:14:15.448893+0000","last_became_peered":"2023-11-24T06:14:15.448893+0000","last_unstale":"2023-11-24T06:14:16.533282+0000","last_undegraded":"2023-11-24T06:14:16.533282+0000","last_fullsized":"2023-11-24T06:14:16.533282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:59.774563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.437522+0000","last_change":"2023-11-24T06:14:14.469950+0000","last_active":"2023-11-24T06:14:15.437522+0000","last_peered":"2023-11-24T06:14:15.437522+0000","last_clean":"2023-11-24T06:14:15.437522+0000","last_became_active":"2023-11-24T06:14:14.469326+0000","last_became_peered":"2023-11-24T06:14:14.469326+0000","last_unstale":"2023-11-24T06:14:15.437522+0000","last_undegraded":"2023-11-24T06:14:15.437522+0000","last_fullsized":"2023-11-24T06:14:15.437522+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:04.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429593+0000","last_change":"2023-11-24T06:14:15.460954+0000","last_active":"2023-11-24T06:14:16.429593+0000","last_peered":"2023-11-24T06:14:16.429593+0000","last_clean":"2023-11-24T06:14:16.429593+0000","last_became_active":"2023-11-24T06:14:15.460182+0000","last_became_peered":"2023-11-24T06:14:15.460182+0000","last_unstale":"2023-11-24T06:14:16.429593+0000","last_undegraded":"2023-11-24T06:14:16.429593+0000","last_fullsized":"2023-11-24T06:14:16.429593+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:26.637529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.490554+0000","last_change":"2023-11-24T06:14:14.467845+0000","last_active":"2023-11-24T06:14:15.490554+0000","last_peered":"2023-11-24T06:14:15.490554+0000","last_clean":"2023-11-24T06:14:15.490554+0000","last_became_active":"2023-11-24T06:14:14.467516+0000","last_became_peered":"2023-11-24T06:14:14.467516+0000","last_unstale":"2023-11-24T06:14:15.490554+0000","last_undegraded":"2023-11-24T06:14:15.490554+0000","last_fullsized":"2023-11-24T06:14:15.490554+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:57.706334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532105+0000","last_change":"2023-11-24T06:14:15.458585+0000","last_active":"2023-11-24T06:14:16.532105+0000","last_peered":"2023-11-24T06:14:16.532105+0000","last_clean":"2023-11-24T06:14:16.532105+0000","last_became_active":"2023-11-24T06:14:15.458306+0000","last_became_peered":"2023-11-24T06:14:15.458306+0000","last_unstale":"2023-11-24T06:14:16.532105+0000","last_undegraded":"2023-11-24T06:14:16.532105+0000","last_fullsized":"2023-11-24T06:14:16.532105+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:30:16.259583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.443880+0000","last_change":"2023-11-24T06:14:14.471004+0000","last_active":"2023-11-24T06:14:15.443880+0000","last_peered":"2023-11-24T06:14:15.443880+0000","last_clean":"2023-11-24T06:14:15.443880+0000","last_became_active":"2023-11-24T06:14:14.470708+0000","last_became_peered":"2023-11-24T06:14:14.470708+0000","last_unstale":"2023-11-24T06:14:15.443880+0000","last_undegraded":"2023-11-24T06:14:15.443880+0000","last_fullsized":"2023-11-24T06:14:15.443880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:49.544138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533628+0000","last_change":"2023-11-24T06:14:15.454754+0000","last_active":"2023-11-24T06:14:16.533628+0000","last_peered":"2023-11-24T06:14:16.533628+0000","last_clean":"2023-11-24T06:14:16.533628+0000","last_became_active":"2023-11-24T06:14:15.454082+0000","last_became_peered":"2023-11-24T06:14:15.454082+0000","last_unstale":"2023-11-24T06:14:16.533628+0000","last_undegraded":"2023-11-24T06:14:16.533628+0000","last_fullsized":"2023-11-24T06:14:16.533628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:14.186208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.448123+0000","last_change":"2023-11-24T06:14:14.471817+0000","last_active":"2023-11-24T06:14:15.448123+0000","last_peered":"2023-11-24T06:14:15.448123+0000","last_clean":"2023-11-24T06:14:15.448123+0000","last_became_active":"2023-11-24T06:14:14.470909+0000","last_became_peered":"2023-11-24T06:14:14.470909+0000","last_unstale":"2023-11-24T06:14:15.448123+0000","last_undegraded":"2023-11-24T06:14:15.448123+0000","last_fullsized":"2023-11-24T06:14:15.448123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:58.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530663+0000","last_change":"2023-11-24T06:14:15.464586+0000","last_active":"2023-11-24T06:14:16.530663+0000","last_peered":"2023-11-24T06:14:16.530663+0000","last_clean":"2023-11-24T06:14:16.530663+0000","last_became_active":"2023-11-24T06:14:15.464224+0000","last_became_peered":"2023-11-24T06:14:15.464224+0000","last_unstale":"2023-11-24T06:14:16.530663+0000","last_undegraded":"2023-11-24T06:14:16.530663+0000","last_fullsized":"2023-11-24T06:14:16.530663+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:58.718642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.434682+0000","last_change":"2023-11-24T06:14:14.463684+0000","last_active":"2023-11-24T06:14:15.434682+0000","last_peered":"2023-11-24T06:14:15.434682+0000","last_clean":"2023-11-24T06:14:15.434682+0000","last_became_active":"2023-11-24T06:14:14.463242+0000","last_became_peered":"2023-11-24T06:14:14.463242+0000","last_unstale":"2023-11-24T06:14:15.434682+0000","last_undegraded":"2023-11-24T06:14:15.434682+0000","last_fullsized":"2023-11-24T06:14:15.434682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:51.780825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533621+0000","last_change":"2023-11-24T06:14:15.464805+0000","last_active":"2023-11-24T06:14:16.533621+0000","last_peered":"2023-11-24T06:14:16.533621+0000","last_clean":"2023-11-24T06:14:16.533621+0000","last_became_active":"2023-11-24T06:14:15.464463+0000","last_became_peered":"2023-11-24T06:14:15.464463+0000","last_unstale":"2023-11-24T06:14:16.533621+0000","last_undegraded":"2023-11-24T06:14:16.533621+0000","last_fullsized":"2023-11-24T06:14:16.533621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:33.873807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.444020+0000","last_change":"2023-11-24T06:14:14.469820+0000","last_active":"2023-11-24T06:14:15.444020+0000","last_peered":"2023-11-24T06:14:15.444020+0000","last_clean":"2023-11-24T06:14:15.444020+0000","last_became_active":"2023-11-24T06:14:14.469514+0000","last_became_peered":"2023-11-24T06:14:14.469514+0000","last_unstale":"2023-11-24T06:14:15.444020+0000","last_undegraded":"2023-11-24T06:14:15.444020+0000","last_fullsized":"2023-11-24T06:14:15.444020+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:52:18.241353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529839+0000","last_change":"2023-11-24T06:14:15.457988+0000","last_active":"2023-11-24T06:14:16.529839+0000","last_peered":"2023-11-24T06:14:16.529839+0000","last_clean":"2023-11-24T06:14:16.529839+0000","last_became_active":"2023-11-24T06:14:15.457669+0000","last_became_peered":"2023-11-24T06:14:15.457669+0000","last_unstale":"2023-11-24T06:14:16.529839+0000","last_undegraded":"2023-11-24T06:14:16.529839+0000","last_fullsized":"2023-11-24T06:14:16.529839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.439681+0000","last_change":"2023-11-24T06:14:14.476090+0000","last_active":"2023-11-24T06:14:15.439681+0000","last_peered":"2023-11-24T06:14:15.439681+0000","last_clean":"2023-11-24T06:14:15.439681+0000","last_became_active":"2023-11-24T06:14:14.475761+0000","last_became_peered":"2023-11-24T06:14:14.475761+0000","last_unstale":"2023-11-24T06:14:15.439681+0000","last_undegraded":"2023-11-24T06:14:15.439681+0000","last_fullsized":"2023-11-24T06:14:15.439681+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:19.629827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434442+0000","last_change":"2023-11-24T06:14:15.460998+0000","last_active":"2023-11-24T06:14:16.434442+0000","last_peered":"2023-11-24T06:14:16.434442+0000","last_clean":"2023-11-24T06:14:16.434442+0000","last_became_active":"2023-11-24T06:14:15.460663+0000","last_became_peered":"2023-11-24T06:14:15.460663+0000","last_unstale":"2023-11-24T06:14:16.434442+0000","last_undegraded":"2023-11-24T06:14:16.434442+0000","last_fullsized":"2023-11-24T06:14:16.434442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531561+0000","last_change":"2023-11-24T06:14:14.470448+0000","last_active":"2023-11-24T06:14:16.531561+0000","last_peered":"2023-11-24T06:14:16.531561+0000","last_clean":"2023-11-24T06:14:16.531561+0000","last_became_active":"2023-11-24T06:14:14.470152+0000","last_became_peered":"2023-11-24T06:14:14.470152+0000","last_unstale":"2023-11-24T06:14:16.531561+0000","last_undegraded":"2023-11-24T06:14:16.531561+0000","last_fullsized":"2023-11-24T06:14:16.531561+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:00:56.852959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429694+0000","last_change":"2023-11-24T06:14:15.467003+0000","last_active":"2023-11-24T06:14:16.429694+0000","last_peered":"2023-11-24T06:14:16.429694+0000","last_clean":"2023-11-24T06:14:16.429694+0000","last_became_active":"2023-11-24T06:14:15.466684+0000","last_became_peered":"2023-11-24T06:14:15.466684+0000","last_unstale":"2023-11-24T06:14:16.429694+0000","last_undegraded":"2023-11-24T06:14:16.429694+0000","last_fullsized":"2023-11-24T06:14:16.429694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:15:58.084222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.437948+0000","last_change":"2023-11-24T06:14:14.474412+0000","last_active":"2023-11-24T06:14:15.437948+0000","last_peered":"2023-11-24T06:14:15.437948+0000","last_clean":"2023-11-24T06:14:15.437948+0000","last_became_active":"2023-11-24T06:14:14.472912+0000","last_became_peered":"2023-11-24T06:14:14.472912+0000","last_unstale":"2023-11-24T06:14:15.437948+0000","last_undegraded":"2023-11-24T06:14:15.437948+0000","last_fullsized":"2023-11-24T06:14:15.437948+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:32.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430062+0000","last_change":"2023-11-24T06:14:15.463478+0000","last_active":"2023-11-24T06:14:16.430062+0000","last_peered":"2023-11-24T06:14:16.430062+0000","last_clean":"2023-11-24T06:14:16.430062+0000","last_became_active":"2023-11-24T06:14:15.463171+0000","last_became_peered":"2023-11-24T06:14:15.463171+0000","last_unstale":"2023-11-24T06:14:16.430062+0000","last_undegraded":"2023-11-24T06:14:16.430062+0000","last_fullsized":"2023-11-24T06:14:16.430062+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:52:05.003288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.447990+0000","last_change":"2023-11-24T06:14:14.469336+0000","last_active":"2023-11-24T06:14:15.447990+0000","last_peered":"2023-11-24T06:14:15.447990+0000","last_clean":"2023-11-24T06:14:15.447990+0000","last_became_active":"2023-11-24T06:14:14.468897+0000","last_became_peered":"2023-11-24T06:14:14.468897+0000","last_unstale":"2023-11-24T06:14:15.447990+0000","last_undegraded":"2023-11-24T06:14:15.447990+0000","last_fullsized":"2023-11-24T06:14:15.447990+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:32.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430864+0000","last_change":"2023-11-24T06:14:15.454276+0000","last_active":"2023-11-24T06:14:16.430864+0000","last_peered":"2023-11-24T06:14:16.430864+0000","last_clean":"2023-11-24T06:14:16.430864+0000","last_became_active":"2023-11-24T06:14:15.453961+0000","last_became_peered":"2023-11-24T06:14:15.453961+0000","last_unstale":"2023-11-24T06:14:16.430864+0000","last_undegraded":"2023-11-24T06:14:16.430864+0000","last_fullsized":"2023-11-24T06:14:16.430864+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:20.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532235+0000","last_change":"2023-11-24T06:14:14.469167+0000","last_active":"2023-11-24T06:14:16.532235+0000","last_peered":"2023-11-24T06:14:16.532235+0000","last_clean":"2023-11-24T06:14:16.532235+0000","last_became_active":"2023-11-24T06:14:14.468800+0000","last_became_peered":"2023-11-24T06:14:14.468800+0000","last_unstale":"2023-11-24T06:14:16.532235+0000","last_undegraded":"2023-11-24T06:14:16.532235+0000","last_fullsized":"2023-11-24T06:14:16.532235+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:05.447900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530384+0000","last_change":"2023-11-24T06:14:15.459400+0000","last_active":"2023-11-24T06:14:16.530384+0000","last_peered":"2023-11-24T06:14:16.530384+0000","last_clean":"2023-11-24T06:14:16.530384+0000","last_became_active":"2023-11-24T06:14:15.458546+0000","last_became_peered":"2023-11-24T06:14:15.458546+0000","last_unstale":"2023-11-24T06:14:16.530384+0000","last_undegraded":"2023-11-24T06:14:16.530384+0000","last_fullsized":"2023-11-24T06:14:16.530384+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:12.530144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.449106+0000","last_change":"2023-11-24T06:14:14.462523+0000","last_active":"2023-11-24T06:14:15.449106+0000","last_peered":"2023-11-24T06:14:15.449106+0000","last_clean":"2023-11-24T06:14:15.449106+0000","last_became_active":"2023-11-24T06:14:14.461882+0000","last_became_peered":"2023-11-24T06:14:14.461882+0000","last_unstale":"2023-11-24T06:14:15.449106+0000","last_undegraded":"2023-11-24T06:14:15.449106+0000","last_fullsized":"2023-11-24T06:14:15.449106+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:46.430693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531032+0000","last_change":"2023-11-24T06:14:15.460794+0000","last_active":"2023-11-24T06:14:16.531032+0000","last_peered":"2023-11-24T06:14:16.531032+0000","last_clean":"2023-11-24T06:14:16.531032+0000","last_became_active":"2023-11-24T06:14:15.457653+0000","last_became_peered":"2023-11-24T06:14:15.457653+0000","last_unstale":"2023-11-24T06:14:16.531032+0000","last_undegraded":"2023-11-24T06:14:16.531032+0000","last_fullsized":"2023-11-24T06:14:16.531032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:07:48.082618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.486520+0000","last_change":"2023-11-24T06:14:14.462792+0000","last_active":"2023-11-24T06:14:15.486520+0000","last_peered":"2023-11-24T06:14:15.486520+0000","last_clean":"2023-11-24T06:14:15.486520+0000","last_became_active":"2023-11-24T06:14:14.462410+0000","last_became_peered":"2023-11-24T06:14:14.462410+0000","last_unstale":"2023-11-24T06:14:15.486520+0000","last_undegraded":"2023-11-24T06:14:15.486520+0000","last_fullsized":"2023-11-24T06:14:15.486520+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:11.517836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.434934+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:14:15.434934+0000","last_peered":"2023-11-24T06:14:15.434934+0000","last_clean":"2023-11-24T06:14:15.434934+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:14:15.434934+0000","last_undegraded":"2023-11-24T06:14:15.434934+0000","last_fullsized":"2023-11-24T06:14:15.434934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476769,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":220385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.034,"15min":1.038},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.542,"5min":1.665,"15min":1.665},"last":1.363},{"interface":"front","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0249999999999999},"min":{"1min":0.74199999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.48,"5min":1.698,"15min":1.698},"last":1.1699999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.47,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.593},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1140000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.095}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1319999999999999,"15min":1.1259999999999999},"min":{"1min":0.71799999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.591,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.302},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.3360000000000001,"15min":1.3540000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5920000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.018}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.306,"15min":1.302},"min":{"1min":0.94899999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.714,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.335},"min":{"1min":0.95099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7170000000000001,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.466}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.288,"15min":1.288},"min":{"1min":0.68500000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8759999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.3580000000000001,"15min":1.3300000000000001},"min":{"1min":1.0860000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.016,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.8580000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.5089999999999999,"15min":1.5169999999999999},"min":{"1min":1.022,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.784,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.728},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4550000000000001,"15min":1.4470000000000001},"min":{"1min":1.014,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.0880000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.7829999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5529999999999999,"15min":1.5469999999999999},"min":{"1min":1.0620000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.153,"5min":2.778,"15min":2.778},"last":1.9930000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.681,"15min":1.6930000000000001},"min":{"1min":1.3120000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9239999999999999,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.921}]}]},{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":810773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4279999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.746,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.6060000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.181,"15min":1.1950000000000001},"min":{"1min":0.68500000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.645,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.28,"15min":1.282},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.4630000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2110000000000001,"15min":1.2010000000000001},"min":{"1min":0.90700000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9059999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.093},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2909999999999999,"15min":1.298},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.865,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6879999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3320000000000001,"15min":1.3300000000000001},"min":{"1min":0.872,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9490000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.359},{"interface":"front","average":{"1min":1.343,"5min":1.3640000000000001,"15min":1.3680000000000001},"min":{"1min":0.90900000000000003,"5min":0.745,"15min":0.745},"max":{"1min":1.748,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.391}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.83199999999999996,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.202},{"interface":"front","average":{"1min":1.524,"5min":1.4319999999999999,"15min":1.417},"min":{"1min":1.0329999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.165,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.6539999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.544,"15min":1.53},"min":{"1min":1.1850000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0590000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.75,"5min":1.6779999999999999,"15min":1.6659999999999999},"min":{"1min":1.5069999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.3980000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.51}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.96099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.0230000000000001,"5min":2.5,"15min":2.5},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.75,"15min":1.736},"min":{"1min":1.343,"5min":0.875,"15min":0.875},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.7350000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":220987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.034,"15min":1.054},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2609999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.246}]},{"osd":1,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5409999999999999,"5min":1.619,"15min":1.619},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2549999999999999,"15min":1.2529999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.79,"5min":1.887,"15min":1.887},"last":1.3939999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3089999999999999,"15min":1.3180000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8080000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.327},{"interface":"front","average":{"1min":1.22,"5min":1.446,"15min":1.484},"min":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5620000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.0700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3640000000000001,"15min":1.3779999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.756,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.512},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.4630000000000001,"15min":1.4950000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8779999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.1080000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.4950000000000001,"15min":1.5029999999999999},"min":{"1min":0.76700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0009999999999999,"5min":2.258,"15min":2.258},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.5309999999999999,"15min":1.5609999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7210000000000001,"5min":2.105,"15min":2.105},"last":1.1779999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5600000000000001,"15min":1.5780000000000001},"min":{"1min":0.59099999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8959999999999999,"5min":2.319,"15min":2.319},"last":1.732},{"interface":"front","average":{"1min":1.54,"5min":1.6459999999999999,"15min":1.6639999999999999},"min":{"1min":0.81799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.1549999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.4570000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6859999999999999,"15min":1.7},"min":{"1min":0.68400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9490000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":2.0110000000000001},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.768,"15min":1.792},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.669,"15min":2.669},"last":1.6619999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":557056,"data_stored":221927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0580000000000001,"15min":1.0660000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.579,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0620000000000001,"15min":1.0780000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.3049999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2769999999999999,"15min":1.296},"min":{"1min":0.67000000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6910000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.2649999999999999,"15min":1.2949999999999999},"min":{"1min":0.70099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7649999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.484}]},{"osd":2,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1830000000000001,"15min":1.181},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.774,"5min":2.04,"15min":2.04},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.3939999999999999,"15min":1.4159999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6599999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.0529999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2909999999999999,"15min":1.302},"min":{"1min":0.84899999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.849,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.3500000000000001,"15min":1.3600000000000001},"min":{"1min":0.93400000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8400000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.373}]},{"osd":5,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4430000000000001,"15min":1.4550000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.768,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.54,"15min":1.5580000000000001},"min":{"1min":0.87,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.798,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.7090000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.5920000000000001,"15min":1.6000000000000001},"min":{"1min":1.004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9490000000000001,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.859},{"interface":"front","average":{"1min":1.448,"5min":1.6160000000000001,"15min":1.6439999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.827,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.427}]},{"osd":7,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5660000000000001,"15min":1.5840000000000001},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.9730000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.722,"15min":1.732},"min":{"1min":1.1200000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0910000000000002,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.798}]}]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":557056,"data_stored":220953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.141,"5min":1.607,"15min":1.607},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.86199999999999999,"15min":0.88},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.23,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88100000000000001,"15min":0.90100000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.3420000000000001,"5min":1.796,"15min":1.796},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1120000000000001,"15min":1.1359999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.621,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.7629999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.0189999999999999,"15min":1.038},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.55,"5min":1.835,"15min":1.835},"last":1.3520000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.075,"15min":1.1020000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4239999999999999,"5min":2.399,"15min":2.399},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.2949999999999999,"15min":1.3149999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8200000000000001,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2649999999999999,"15min":1.2689999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8839999999999999,"5min":2.141,"15min":2.141},"last":1.71}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.298,"15min":1.3160000000000001},"min":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7330000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.853},{"interface":"front","average":{"1min":1.218,"5min":1.3680000000000001,"15min":1.393},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.671,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.655}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3360000000000001,"15min":1.3420000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.821,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":2.02},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3109999999999999,"15min":1.3200000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.655,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.6020000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3879999999999999,"15min":1.4179999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.772,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":2.1349999999999998},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4410000000000001,"15min":1.462},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.726,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.9630000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":221949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.538,"5min":2.552,"15min":2.552},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.93899999999999995,"15min":0.96399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4550000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.85499999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.121,"15min":1.119},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.696,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.214},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6479999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.0069999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1419999999999999,"15min":1.1579999999999999},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.5169999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.55100000000000005,"5min":0.371,"15min":0.371},"max":{"1min":1.25,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.325,"15min":1.335},"min":{"1min":0.75900000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.883,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.484,"15min":1.5009999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.804,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.528}]},{"osd":5,"last update":"Fri Nov 24 06:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.21,"15min":1.212},"min":{"1min":0.81000000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.569,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4330000000000001,"15min":1.444},"min":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.79,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.484}]},{"osd":6,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3819999999999999,"15min":1.397},"min":{"1min":0.84299999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7030000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.29},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.544,"15min":1.5629999999999999},"min":{"1min":1.0880000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8300000000000001,"5min":4.101,"15min":4.101},"last":1.411}]},{"osd":7,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.488,"15min":1.5},"min":{"1min":0.81200000000000006,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7190000000000001,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":0.81399999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7649999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.619}]}]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":810717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.84699999999999998,"15min":0.83799999999999997},"min":{"1min":0.58399999999999996,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.696,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.45500000000000002,"5min":0.443,"15min":0.443},"max":{"1min":2.0609999999999999,"5min":2.161,"15min":2.161},"last":1.2689999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.032,"15min":1.038},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.806,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.071},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"min":{"1min":0.55500000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.194,"15min":1.2170000000000001},"min":{"1min":0.54500000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8160000000000001,"5min":3.766,"15min":3.766},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.264,"5min":1.22,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1560000000000001,"5min":2.218,"15min":2.218},"last":1.4199999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.304,"15min":1.29},"min":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3799999999999999,"15min":1.3979999999999999},"min":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.853,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.0369999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2669999999999999,"15min":1.2689999999999999},"min":{"1min":0.85099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.736,"5min":1.829,"15min":1.829},"last":1.516},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.2350000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.339}]},{"osd":6,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.421,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.657,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.147},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.349,"15min":1.331},"min":{"1min":0.873,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0270000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.482}]},{"osd":7,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.429,"15min":1.427},"min":{"1min":0.94599999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.552,"15min":1.5620000000000001},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1909999999999998,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.6799999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":220385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.93899999999999995,"15min":0.96199999999999997},"min":{"1min":0.439,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5209999999999999,"5min":1.571,"15min":1.571},"last":0.753},{"interface":"front","average":{"1min":0.878,"5min":1,"15min":1.02},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.341,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.99199999999999999,"15min":1.0109999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4239999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.2030000000000001,"15min":1.2390000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.78,"5min":1.792,"15min":1.792},"last":0.98899999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.3280000000000001,"15min":1.3660000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":0.66500000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6739999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.94899999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3089999999999999,"15min":1.321},"min":{"1min":0.79400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.794,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.095},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.55,"15min":1.5780000000000001},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.7909999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.3839999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.1059999999999999,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.454,"15min":1.468},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.2599999999999998,"5min":2.637,"15min":2.637},"last":1.194}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.5389999999999999,"15min":1.5609999999999999},"min":{"1min":0.95099999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.839,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.5229999999999999,"15min":1.5389999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1259999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.486}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.613,"15min":1.6319999999999999},"min":{"1min":1,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.9620000000000002,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.679,"15min":1.6839999999999999},"min":{"1min":1.198,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:14:21.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-24T06:14:21.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.296+0000 7f5b86f48640 1 Processor -- start 2023-11-24T06:14:21.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.296+0000 7f5b86f48640 1 -- start start 2023-11-24T06:14:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.298+0000 7f5b86f48640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b8015a100 0x7f5b800b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.298+0000 7f5b86f48640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5b800ae7e0 0x7f5b800b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.298+0000 7f5b86f48640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8013da30 con 0x7f5b800abff0 2023-11-24T06:14:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.298+0000 7f5b86f48640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b800ac840 con 0x7f5b800ae7e0 2023-11-24T06:14:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.298+0000 7f5b86f48640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800ac560 con 0x7f5b8015a100 2023-11-24T06:14:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.298+0000 7f5b7ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5b800abff0 0x7f5b8006d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60726/0 (socket says 172.21.15.22:60726) 2023-11-24T06:14:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.298+0000 7f5b7ffff640 1 -- 172.21.15.22:0/133217872 learned_addr learned my addr 172.21.15.22:0/133217872 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b84ce4640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b8015a100 0x7f5b800b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035962783 0 0) 0x7f5b8013da30 con 0x7f5b800abff0 2023-11-24T06:14:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b70003520 con 0x7f5b800abff0 2023-11-24T06:14:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b854e5640 1 --2- 172.21.15.22:0/133217872 >> v2:172.21.15.31:3300/0 conn(0x7f5b800ae7e0 0x7f5b800b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1265857209 0 0) 0x7f5b70003520 con 0x7f5b800abff0 2023-11-24T06:14:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b8015a100 msgr2=0x7f5b800b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b8015a100 0x7f5b800b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 >> v2:172.21.15.31:3300/0 conn(0x7f5b800ae7e0 msgr2=0x7f5b800b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 --2- 172.21.15.22:0/133217872 >> v2:172.21.15.31:3300/0 conn(0x7f5b800ae7e0 0x7f5b800b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80070650 con 0x7f5b800abff0 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f5b6c001670 con 0x7f5b800abff0 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 >> v1:172.21.15.22:6789/0 conn(0x7f5b800abff0 legacy=0x7f5b8006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b70003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.299+0000 7f5b7f7fe640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b700047c0 0x7f5b70004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b7f7fe640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b8015a100 0x7f5b70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800ac840 con 0x7f5b70003970 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800ac560 con 0x7f5b700047c0 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7000ba80 con 0x7f5b8015a100 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b84ce4640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b70003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b84ce4640 1 -- 172.21.15.22:0/133217872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b8015a100 msgr2=0x7f5b70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b84ce4640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b8015a100 0x7f5b70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b84ce4640 1 -- 172.21.15.22:0/133217872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b700047c0 msgr2=0x7f5b70004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b84ce4640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b700047c0 0x7f5b70004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.300+0000 7f5b84ce4640 1 -- 172.21.15.22:0/133217872 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70003520 con 0x7f5b70003970 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.301+0000 7f5b84ce4640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b70003d90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009ac0 tx=0x7f5b700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af02fa201cdd6df5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402c680 con 0x7f5b70003970 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7402c7e0 con 0x7f5b70003970 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b7f7fe640 1 -- 172.21.15.22:0/133217872 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402cb70 con 0x7f5b70003970 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b86f48640 1 -- 172.21.15.22:0/133217872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 msgr2=0x7f5b70003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b86f48640 1 --2- 172.21.15.22:0/133217872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b70003d90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009ac0 tx=0x7f5b700057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b854e5640 1 -- 172.21.15.22:0/133217872 reap_dead start 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b86f48640 1 -- 172.21.15.22:0/133217872 shutdown_connections 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b86f48640 1 -- 172.21.15.22:0/133217872 >> 172.21.15.22:0/133217872 conn(0x7f5b800b0d80 msgr2=0x7f5b800b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b86f48640 1 -- 172.21.15.22:0/133217872 shutdown_connections 2023-11-24T06:14:21.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.302+0000 7f5b86f48640 1 -- 172.21.15.22:0/133217872 wait complete. 2023-11-24T06:14:21.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.304+0000 7f5b86f48640 1 Processor -- start 2023-11-24T06:14:21.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.304+0000 7f5b86f48640 1 -- start start 2023-11-24T06:14:21.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.305+0000 7f5b86f48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b801f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.305+0000 7f5b86f48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800cce20 0x7f5b80153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.305+0000 7f5b86f48640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b800b2fc0 0x7f5b800b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.305+0000 7f5b86f48640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800b3980 con 0x7f5b70003970 2023-11-24T06:14:21.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.305+0000 7f5b86f48640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800ce040 con 0x7f5b800cce20 2023-11-24T06:14:21.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.305+0000 7f5b86f48640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800cd430 con 0x7f5b800b2fc0 2023-11-24T06:14:21.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b84ce4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b801f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b84ce4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b801f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37966/0 (socket says 172.21.15.22:37966) 2023-11-24T06:14:21.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b84ce4640 1 -- 172.21.15.22:0/1156728052 learned_addr learned my addr 172.21.15.22:0/1156728052 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b7ffff640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800cce20 0x7f5b80153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b84ce4640 1 -- 172.21.15.22:0/1156728052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b800b2fc0 msgr2=0x7f5b800b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b84ce4640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b800b2fc0 0x7f5b800b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b84ce4640 1 -- 172.21.15.22:0/1156728052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800cce20 msgr2=0x7f5b80153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b84ce4640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800cce20 0x7f5b80153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b84ce4640 1 -- 172.21.15.22:0/1156728052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800cd710 con 0x7f5b70003970 2023-11-24T06:14:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.306+0000 7f5b7ffff640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800cce20 0x7f5b80153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.307+0000 7f5b84ce4640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b801f2bb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5b7402c220 tx=0x7f5b74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.307+0000 7f5b7d7fa640 1 -- 172.21.15.22:0/1156728052 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74003810 con 0x7f5b70003970 2023-11-24T06:14:21.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.307+0000 7f5b7d7fa640 1 -- 172.21.15.22:0/1156728052 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74003970 con 0x7f5b70003970 2023-11-24T06:14:21.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.307+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b800cd9f0 con 0x7f5b70003970 2023-11-24T06:14:21.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.307+0000 7f5b7d7fa640 1 -- 172.21.15.22:0/1156728052 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74003ce0 con 0x7f5b70003970 2023-11-24T06:14:21.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.307+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b80154280 con 0x7f5b70003970 2023-11-24T06:14:21.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.308+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b800cd200 con 0x7f5b70003970 2023-11-24T06:14:21.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.309+0000 7f5b7d7fa640 1 -- 172.21.15.22:0/1156728052 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5b74040450 con 0x7f5b70003970 2023-11-24T06:14:21.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.310+0000 7f5b7d7fa640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5b6406aff0 0x7f5b6406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.310+0000 7f5b7d7fa640 1 -- 172.21.15.22:0/1156728052 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b740ab800 con 0x7f5b70003970 2023-11-24T06:14:21.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.310+0000 7f5b7ffff640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5b6406aff0 0x7f5b6406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.311+0000 7f5b7ffff640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5b6406aff0 0x7f5b6406d4b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c001eb0 tx=0x7f5b6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.315+0000 7f5b7d7fa640 1 -- 172.21.15.22:0/1156728052 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b74076590 con 0x7f5b70003970 2023-11-24T06:14:21.421 INFO:tasks.ceph.mds.c.smithi022.stderr:2023-11-24T06:14:21.419+0000 7fd2bebdd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:14:21.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.582+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5b800cedd0 con 0x7f5b70003970 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.583+0000 7f5b7d7fa640 1 -- 172.21.15.22:0/1156728052 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1431 (secure 0 0 0) 0x7f5b740044e0 con 0x7f5b70003970 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:21.586 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":165,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1700806309,"num_in_osds":8,"osd_in_since":1700806299,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":244043776,"bytes_avail":772850069504,"bytes_total":773094113280,"write_bytes_sec":2292,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5784}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-24T06:14:02.686049+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5b6406aff0 msgr2=0x7f5b6406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5b6406aff0 0x7f5b6406d4b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c001eb0 tx=0x7f5b6c009040 comp rx=0 tx=0).stop 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 msgr2=0x7f5b801f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b801f2bb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5b7402c220 tx=0x7f5b74004730 comp rx=0 tx=0).stop 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 shutdown_connections 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5b6406aff0 0x7f5b6406d4b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b800b2fc0 0x7f5b800b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800cce20 0x7f5b80153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 --2- 172.21.15.22:0/1156728052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b70003970 0x7f5b801f2bb0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 >> 172.21.15.22:0/1156728052 conn(0x7f5b800b0d80 msgr2=0x7f5b8013dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.586+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 shutdown_connections 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.587+0000 7f5b86f48640 1 -- 172.21.15.22:0/1156728052 wait complete. 2023-11-24T06:14:21.609 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-24T06:14:21.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:14:21.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.832+0000 7f3caa021640 1 Processor -- start 2023-11-24T06:14:21.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.833+0000 7f3caa021640 1 -- start start 2023-11-24T06:14:21.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.834+0000 7f3caa021640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca415d5b0 0x7f3ca40d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.834+0000 7f3caa021640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3ca40d14a0 0x7f3ca40d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.834+0000 7f3caa021640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ca40cf7a0 0x7f3ca40cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.834+0000 7f3caa021640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40cf0c0 con 0x7f3ca40cf7a0 2023-11-24T06:14:21.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.834+0000 7f3caa021640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40d1e40 con 0x7f3ca40d14a0 2023-11-24T06:14:21.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.834+0000 7f3caa021640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40b01b0 con 0x7f3ca415d5b0 2023-11-24T06:14:21.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.835+0000 7f3ca9820640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ca40cf7a0 0x7f3ca40cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.835+0000 7f3ca9820640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ca40cf7a0 0x7f3ca40cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37976/0 (socket says 172.21.15.22:37976) 2023-11-24T06:14:21.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.835+0000 7f3ca9820640 1 -- 172.21.15.22:0/896817841 learned_addr learned my addr 172.21.15.22:0/896817841 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:21.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.835+0000 7f3ca9820640 1 -- 172.21.15.22:0/896817841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca415d5b0 msgr2=0x7f3ca40d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.835+0000 7f3ca9820640 1 --2- 172.21.15.22:0/896817841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca415d5b0 0x7f3ca40d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.835+0000 7f3ca9820640 1 -- 172.21.15.22:0/896817841 >> v2:172.21.15.31:3300/0 conn(0x7f3ca40d14a0 msgr2=0x7f3ca40d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.835+0000 7f3ca9820640 1 --2- 172.21.15.22:0/896817841 >> v2:172.21.15.31:3300/0 conn(0x7f3ca40d14a0 0x7f3ca40d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.835+0000 7f3ca9820640 1 -- 172.21.15.22:0/896817841 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca415d990 con 0x7f3ca40cf7a0 2023-11-24T06:14:21.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.836+0000 7f3ca9820640 1 --2- 172.21.15.22:0/896817841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40cf7a0 0x7f3ca40cfc00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3ca408bf60 tx=0x7f3c9c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770f7855550e4b96 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.837+0000 7f3c9bfff640 1 -- 172.21.15.22:0/896817841 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c02ca80 con 0x7f3ca40cf7a0 2023-11-24T06:14:21.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.837+0000 7f3c9bfff640 1 -- 172.21.15.22:0/896817841 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c02cbe0 con 0x7f3ca40cf7a0 2023-11-24T06:14:21.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.837+0000 7f3c9bfff640 1 -- 172.21.15.22:0/896817841 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0343f0 con 0x7f3ca40cf7a0 2023-11-24T06:14:21.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.837+0000 7f3caa021640 1 -- 172.21.15.22:0/896817841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40cf7a0 msgr2=0x7f3ca40cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.837+0000 7f3caa021640 1 --2- 172.21.15.22:0/896817841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40cf7a0 0x7f3ca40cfc00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3ca408bf60 tx=0x7f3c9c02bee0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.838+0000 7f3caa021640 1 -- 172.21.15.22:0/896817841 shutdown_connections 2023-11-24T06:14:21.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.838+0000 7f3caa021640 1 --2- 172.21.15.22:0/896817841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40cf7a0 0x7f3ca40cfc00 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.838+0000 7f3caa021640 1 --2- 172.21.15.22:0/896817841 >> v2:172.21.15.31:3300/0 conn(0x7f3ca40d14a0 0x7f3ca40d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.838+0000 7f3caa021640 1 --2- 172.21.15.22:0/896817841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca415d5b0 0x7f3ca40d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.838+0000 7f3caa021640 1 -- 172.21.15.22:0/896817841 >> 172.21.15.22:0/896817841 conn(0x7f3ca409c3b0 msgr2=0x7f3ca40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.838+0000 7f3caa021640 1 -- 172.21.15.22:0/896817841 shutdown_connections 2023-11-24T06:14:21.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.838+0000 7f3caa021640 1 -- 172.21.15.22:0/896817841 wait complete. 2023-11-24T06:14:21.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.839+0000 7f3caa021640 1 Processor -- start 2023-11-24T06:14:21.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.840+0000 7f3caa021640 1 -- start start 2023-11-24T06:14:21.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.840+0000 7f3caa021640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca40cf7a0 0x7f3ca41f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.840+0000 7f3caa021640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40d14a0 0x7f3ca40b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.840+0000 7f3caa021640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca415d5b0 0x7f3ca40b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.840+0000 7f3caa021640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40b7230 con 0x7f3ca40d14a0 2023-11-24T06:14:21.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.840+0000 7f3caa021640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40c9ae0 con 0x7f3ca415d5b0 2023-11-24T06:14:21.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.840+0000 7f3caa021640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca415eb20 con 0x7f3ca40cf7a0 2023-11-24T06:14:21.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca881e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40d14a0 0x7f3ca40b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca881e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40d14a0 0x7f3ca40b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37986/0 (socket says 172.21.15.22:37986) 2023-11-24T06:14:21.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca881e640 1 -- 172.21.15.22:0/258953399 learned_addr learned my addr 172.21.15.22:0/258953399 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:21.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca901f640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca40cf7a0 0x7f3ca41f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca9820640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca415d5b0 0x7f3ca40b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca881e640 1 -- 172.21.15.22:0/258953399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca40cf7a0 msgr2=0x7f3ca41f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca881e640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca40cf7a0 0x7f3ca41f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca881e640 1 -- 172.21.15.22:0/258953399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca415d5b0 msgr2=0x7f3ca40b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca881e640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca415d5b0 0x7f3ca40b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca881e640 1 -- 172.21.15.22:0/258953399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c009b30 con 0x7f3ca40d14a0 2023-11-24T06:14:21.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.841+0000 7f3ca901f640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca40cf7a0 0x7f3ca41f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:21.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.842+0000 7f3ca881e640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40d14a0 0x7f3ca40b6670 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400b410 tx=0x7f3c9400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.842+0000 7f3c99ffb640 1 -- 172.21.15.22:0/258953399 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94011830 con 0x7f3ca40d14a0 2023-11-24T06:14:21.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.842+0000 7f3c99ffb640 1 -- 172.21.15.22:0/258953399 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940119b0 con 0x7f3ca40d14a0 2023-11-24T06:14:21.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.842+0000 7f3c99ffb640 1 -- 172.21.15.22:0/258953399 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94011d60 con 0x7f3ca40d14a0 2023-11-24T06:14:21.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.842+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca415ee00 con 0x7f3ca40d14a0 2023-11-24T06:14:21.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.842+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca415f3c0 con 0x7f3ca40d14a0 2023-11-24T06:14:21.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.843+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca40b73a0 con 0x7f3ca40d14a0 2023-11-24T06:14:21.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.844+0000 7f3c99ffb640 1 -- 172.21.15.22:0/258953399 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3c9401a400 con 0x7f3ca40d14a0 2023-11-24T06:14:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.845+0000 7f3c99ffb640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c8806aff0 0x7f3c8806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.845+0000 7f3c99ffb640 1 -- 172.21.15.22:0/258953399 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c94089ac0 con 0x7f3ca40d14a0 2023-11-24T06:14:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.846+0000 7f3ca901f640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c8806aff0 0x7f3c8806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.846+0000 7f3ca901f640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c8806aff0 0x7f3c8806d4b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0006fd0 tx=0x7f3ca0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:21.850+0000 7f3c99ffb640 1 -- 172.21.15.22:0/258953399 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ca40b73a0 con 0x7f3ca40d14a0 2023-11-24T06:14:22.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.042+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ca40afe40 con 0x7f3c8806aff0 2023-11-24T06:14:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.065+0000 7f3c99ffb640 1 -- 172.21.15.22:0/258953399 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286884 (secure 0 0 0) 0x7f3ca000ae20 con 0x7f3c8806aff0 2023-11-24T06:14:22.072 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:14:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c8806aff0 msgr2=0x7f3c8806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c8806aff0 0x7f3c8806d4b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0006fd0 tx=0x7f3ca0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40d14a0 msgr2=0x7f3ca40b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40d14a0 0x7f3ca40b6670 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400b410 tx=0x7f3c9400b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 shutdown_connections 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c8806aff0 0x7f3c8806d4b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca415d5b0 0x7f3ca40b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40d14a0 0x7f3ca40b6670 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 --2- 172.21.15.22:0/258953399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ca40cf7a0 0x7f3ca41f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 >> 172.21.15.22:0/258953399 conn(0x7f3ca409c3b0 msgr2=0x7f3ca406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 shutdown_connections 2023-11-24T06:14:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:22.072+0000 7f3caa021640 1 -- 172.21.15.22:0/258953399 wait complete. 2023-11-24T06:14:22.094 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-11-24T06:14:20.690641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238324,"kb_used_data":5480,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736396,"statfs":{"total":773094113280,"available":772850069504,"internally_reserved":0,"allocated":5611520,"data_stored":2948076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.254010"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434757+0000","last_change":"2023-11-24T06:14:15.465175+0000","last_active":"2023-11-24T06:14:16.434757+0000","last_peered":"2023-11-24T06:14:16.434757+0000","last_clean":"2023-11-24T06:14:16.434757+0000","last_became_active":"2023-11-24T06:14:15.456393+0000","last_became_peered":"2023-11-24T06:14:15.456393+0000","last_unstale":"2023-11-24T06:14:16.434757+0000","last_undegraded":"2023-11-24T06:14:16.434757+0000","last_fullsized":"2023-11-24T06:14:16.434757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:51:37.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.432702+0000","last_change":"2023-11-24T06:14:15.472506+0000","last_active":"2023-11-24T06:14:16.432702+0000","last_peered":"2023-11-24T06:14:16.432702+0000","last_clean":"2023-11-24T06:14:16.432702+0000","last_became_active":"2023-11-24T06:14:15.472169+0000","last_became_peered":"2023-11-24T06:14:15.472169+0000","last_unstale":"2023-11-24T06:14:16.432702+0000","last_undegraded":"2023-11-24T06:14:16.432702+0000","last_fullsized":"2023-11-24T06:14:16.432702+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530835+0000","last_change":"2023-11-24T06:14:15.463311+0000","last_active":"2023-11-24T06:14:16.530835+0000","last_peered":"2023-11-24T06:14:16.530835+0000","last_clean":"2023-11-24T06:14:16.530835+0000","last_became_active":"2023-11-24T06:14:15.462897+0000","last_became_peered":"2023-11-24T06:14:15.462897+0000","last_unstale":"2023-11-24T06:14:16.530835+0000","last_undegraded":"2023-11-24T06:14:16.530835+0000","last_fullsized":"2023-11-24T06:14:16.530835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:05.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529563+0000","last_change":"2023-11-24T06:14:15.462467+0000","last_active":"2023-11-24T06:14:16.529563+0000","last_peered":"2023-11-24T06:14:16.529563+0000","last_clean":"2023-11-24T06:14:16.529563+0000","last_became_active":"2023-11-24T06:14:15.461274+0000","last_became_peered":"2023-11-24T06:14:15.461274+0000","last_unstale":"2023-11-24T06:14:16.529563+0000","last_undegraded":"2023-11-24T06:14:16.529563+0000","last_fullsized":"2023-11-24T06:14:16.529563+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.431852+0000","last_change":"2023-11-24T06:14:15.468322+0000","last_active":"2023-11-24T06:14:16.431852+0000","last_peered":"2023-11-24T06:14:16.431852+0000","last_clean":"2023-11-24T06:14:16.431852+0000","last_became_active":"2023-11-24T06:14:15.467944+0000","last_became_peered":"2023-11-24T06:14:15.467944+0000","last_unstale":"2023-11-24T06:14:16.431852+0000","last_undegraded":"2023-11-24T06:14:16.431852+0000","last_fullsized":"2023-11-24T06:14:16.431852+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:05.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429496+0000","last_change":"2023-11-24T06:14:15.456762+0000","last_active":"2023-11-24T06:14:16.429496+0000","last_peered":"2023-11-24T06:14:16.429496+0000","last_clean":"2023-11-24T06:14:16.429496+0000","last_became_active":"2023-11-24T06:14:15.456470+0000","last_became_peered":"2023-11-24T06:14:15.456470+0000","last_unstale":"2023-11-24T06:14:16.429496+0000","last_undegraded":"2023-11-24T06:14:16.429496+0000","last_fullsized":"2023-11-24T06:14:16.429496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:14:21.955170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.433700+0000","last_change":"2023-11-24T06:14:15.452856+0000","last_active":"2023-11-24T06:14:16.433700+0000","last_peered":"2023-11-24T06:14:16.433700+0000","last_clean":"2023-11-24T06:14:16.433700+0000","last_became_active":"2023-11-24T06:14:15.452566+0000","last_became_peered":"2023-11-24T06:14:15.452566+0000","last_unstale":"2023-11-24T06:14:16.433700+0000","last_undegraded":"2023-11-24T06:14:16.433700+0000","last_fullsized":"2023-11-24T06:14:16.433700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529445+0000","last_change":"2023-11-24T06:14:15.460643+0000","last_active":"2023-11-24T06:14:16.529445+0000","last_peered":"2023-11-24T06:14:16.529445+0000","last_clean":"2023-11-24T06:14:16.529445+0000","last_became_active":"2023-11-24T06:14:15.460185+0000","last_became_peered":"2023-11-24T06:14:15.460185+0000","last_unstale":"2023-11-24T06:14:16.529445+0000","last_undegraded":"2023-11-24T06:14:16.529445+0000","last_fullsized":"2023-11-24T06:14:16.529445+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530188+0000","last_change":"2023-11-24T06:14:15.463163+0000","last_active":"2023-11-24T06:14:16.530188+0000","last_peered":"2023-11-24T06:14:16.530188+0000","last_clean":"2023-11-24T06:14:16.530188+0000","last_became_active":"2023-11-24T06:14:15.460198+0000","last_became_peered":"2023-11-24T06:14:15.460198+0000","last_unstale":"2023-11-24T06:14:16.530188+0000","last_undegraded":"2023-11-24T06:14:16.530188+0000","last_fullsized":"2023-11-24T06:14:16.530188+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:35.312894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530702+0000","last_change":"2023-11-24T06:14:15.467076+0000","last_active":"2023-11-24T06:14:16.530702+0000","last_peered":"2023-11-24T06:14:16.530702+0000","last_clean":"2023-11-24T06:14:16.530702+0000","last_became_active":"2023-11-24T06:14:15.461068+0000","last_became_peered":"2023-11-24T06:14:15.461068+0000","last_unstale":"2023-11-24T06:14:16.530702+0000","last_undegraded":"2023-11-24T06:14:16.530702+0000","last_fullsized":"2023-11-24T06:14:16.530702+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:52:19.253662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530413+0000","last_change":"2023-11-24T06:14:15.460243+0000","last_active":"2023-11-24T06:14:16.530413+0000","last_peered":"2023-11-24T06:14:16.530413+0000","last_clean":"2023-11-24T06:14:16.530413+0000","last_became_active":"2023-11-24T06:14:15.459889+0000","last_became_peered":"2023-11-24T06:14:15.459889+0000","last_unstale":"2023-11-24T06:14:16.530413+0000","last_undegraded":"2023-11-24T06:14:16.530413+0000","last_fullsized":"2023-11-24T06:14:16.530413+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:14.283905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.431869+0000","last_change":"2023-11-24T06:14:15.465076+0000","last_active":"2023-11-24T06:14:16.431869+0000","last_peered":"2023-11-24T06:14:16.431869+0000","last_clean":"2023-11-24T06:14:16.431869+0000","last_became_active":"2023-11-24T06:14:15.464088+0000","last_became_peered":"2023-11-24T06:14:15.464088+0000","last_unstale":"2023-11-24T06:14:16.431869+0000","last_undegraded":"2023-11-24T06:14:16.431869+0000","last_fullsized":"2023-11-24T06:14:16.431869+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533093+0000","last_change":"2023-11-24T06:14:15.456309+0000","last_active":"2023-11-24T06:14:16.533093+0000","last_peered":"2023-11-24T06:14:16.533093+0000","last_clean":"2023-11-24T06:14:16.533093+0000","last_became_active":"2023-11-24T06:14:15.455170+0000","last_became_peered":"2023-11-24T06:14:15.455170+0000","last_unstale":"2023-11-24T06:14:16.533093+0000","last_undegraded":"2023-11-24T06:14:16.533093+0000","last_fullsized":"2023-11-24T06:14:16.533093+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:03:53.101315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529426+0000","last_change":"2023-11-24T06:14:15.453814+0000","last_active":"2023-11-24T06:14:16.529426+0000","last_peered":"2023-11-24T06:14:16.529426+0000","last_clean":"2023-11-24T06:14:16.529426+0000","last_became_active":"2023-11-24T06:14:15.453548+0000","last_became_peered":"2023-11-24T06:14:15.453548+0000","last_unstale":"2023-11-24T06:14:16.529426+0000","last_undegraded":"2023-11-24T06:14:16.529426+0000","last_fullsized":"2023-11-24T06:14:16.529426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:05.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429590+0000","last_change":"2023-11-24T06:14:15.468734+0000","last_active":"2023-11-24T06:14:16.429590+0000","last_peered":"2023-11-24T06:14:16.429590+0000","last_clean":"2023-11-24T06:14:16.429590+0000","last_became_active":"2023-11-24T06:14:15.464022+0000","last_became_peered":"2023-11-24T06:14:15.464022+0000","last_unstale":"2023-11-24T06:14:16.429590+0000","last_undegraded":"2023-11-24T06:14:16.429590+0000","last_fullsized":"2023-11-24T06:14:16.429590+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:14.174404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531753+0000","last_change":"2023-11-24T06:14:15.454355+0000","last_active":"2023-11-24T06:14:16.531753+0000","last_peered":"2023-11-24T06:14:16.531753+0000","last_clean":"2023-11-24T06:14:16.531753+0000","last_became_active":"2023-11-24T06:14:15.453954+0000","last_became_peered":"2023-11-24T06:14:15.453954+0000","last_unstale":"2023-11-24T06:14:16.531753+0000","last_undegraded":"2023-11-24T06:14:16.531753+0000","last_fullsized":"2023-11-24T06:14:16.531753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:12.924610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531191+0000","last_change":"2023-11-24T06:14:15.455909+0000","last_active":"2023-11-24T06:14:16.531191+0000","last_peered":"2023-11-24T06:14:16.531191+0000","last_clean":"2023-11-24T06:14:16.531191+0000","last_became_active":"2023-11-24T06:14:15.455600+0000","last_became_peered":"2023-11-24T06:14:15.455600+0000","last_unstale":"2023-11-24T06:14:16.531191+0000","last_undegraded":"2023-11-24T06:14:16.531191+0000","last_fullsized":"2023-11-24T06:14:16.531191+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531653+0000","last_change":"2023-11-24T06:14:15.464787+0000","last_active":"2023-11-24T06:14:16.531653+0000","last_peered":"2023-11-24T06:14:16.531653+0000","last_clean":"2023-11-24T06:14:16.531653+0000","last_became_active":"2023-11-24T06:14:15.464041+0000","last_became_peered":"2023-11-24T06:14:15.464041+0000","last_unstale":"2023-11-24T06:14:16.531653+0000","last_undegraded":"2023-11-24T06:14:16.531653+0000","last_fullsized":"2023-11-24T06:14:16.531653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533559+0000","last_change":"2023-11-24T06:14:15.463515+0000","last_active":"2023-11-24T06:14:16.533559+0000","last_peered":"2023-11-24T06:14:16.533559+0000","last_clean":"2023-11-24T06:14:16.533559+0000","last_became_active":"2023-11-24T06:14:15.463112+0000","last_became_peered":"2023-11-24T06:14:15.463112+0000","last_unstale":"2023-11-24T06:14:16.533559+0000","last_undegraded":"2023-11-24T06:14:16.533559+0000","last_fullsized":"2023-11-24T06:14:16.533559+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:37.937358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533282+0000","last_change":"2023-11-24T06:14:15.470585+0000","last_active":"2023-11-24T06:14:16.533282+0000","last_peered":"2023-11-24T06:14:16.533282+0000","last_clean":"2023-11-24T06:14:16.533282+0000","last_became_active":"2023-11-24T06:14:15.470285+0000","last_became_peered":"2023-11-24T06:14:15.470285+0000","last_unstale":"2023-11-24T06:14:16.533282+0000","last_undegraded":"2023-11-24T06:14:16.533282+0000","last_fullsized":"2023-11-24T06:14:16.533282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:19.397131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429764+0000","last_change":"2023-11-24T06:14:15.462713+0000","last_active":"2023-11-24T06:14:16.429764+0000","last_peered":"2023-11-24T06:14:16.429764+0000","last_clean":"2023-11-24T06:14:16.429764+0000","last_became_active":"2023-11-24T06:14:15.459623+0000","last_became_peered":"2023-11-24T06:14:15.459623+0000","last_unstale":"2023-11-24T06:14:16.429764+0000","last_undegraded":"2023-11-24T06:14:16.429764+0000","last_fullsized":"2023-11-24T06:14:16.429764+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:12.189277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529423+0000","last_change":"2023-11-24T06:14:15.454971+0000","last_active":"2023-11-24T06:14:16.529423+0000","last_peered":"2023-11-24T06:14:16.529423+0000","last_clean":"2023-11-24T06:14:16.529423+0000","last_became_active":"2023-11-24T06:14:15.454687+0000","last_became_peered":"2023-11-24T06:14:15.454687+0000","last_unstale":"2023-11-24T06:14:16.529423+0000","last_undegraded":"2023-11-24T06:14:16.529423+0000","last_fullsized":"2023-11-24T06:14:16.529423+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:20.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531689+0000","last_change":"2023-11-24T06:14:15.452875+0000","last_active":"2023-11-24T06:14:16.531689+0000","last_peered":"2023-11-24T06:14:16.531689+0000","last_clean":"2023-11-24T06:14:16.531689+0000","last_became_active":"2023-11-24T06:14:15.452533+0000","last_became_peered":"2023-11-24T06:14:15.452533+0000","last_unstale":"2023-11-24T06:14:16.531689+0000","last_undegraded":"2023-11-24T06:14:16.531689+0000","last_fullsized":"2023-11-24T06:14:16.531689+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:09.589303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532073+0000","last_change":"2023-11-24T06:14:15.451547+0000","last_active":"2023-11-24T06:14:16.532073+0000","last_peered":"2023-11-24T06:14:16.532073+0000","last_clean":"2023-11-24T06:14:16.532073+0000","last_became_active":"2023-11-24T06:14:15.450548+0000","last_became_peered":"2023-11-24T06:14:15.450548+0000","last_unstale":"2023-11-24T06:14:16.532073+0000","last_undegraded":"2023-11-24T06:14:16.532073+0000","last_fullsized":"2023-11-24T06:14:16.532073+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:50.556446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533197+0000","last_change":"2023-11-24T06:14:15.448866+0000","last_active":"2023-11-24T06:14:16.533197+0000","last_peered":"2023-11-24T06:14:16.533197+0000","last_clean":"2023-11-24T06:14:16.533197+0000","last_became_active":"2023-11-24T06:14:15.448583+0000","last_became_peered":"2023-11-24T06:14:15.448583+0000","last_unstale":"2023-11-24T06:14:16.533197+0000","last_undegraded":"2023-11-24T06:14:16.533197+0000","last_fullsized":"2023-11-24T06:14:16.533197+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:16.470025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533280+0000","last_change":"2023-11-24T06:14:15.459471+0000","last_active":"2023-11-24T06:14:16.533280+0000","last_peered":"2023-11-24T06:14:16.533280+0000","last_clean":"2023-11-24T06:14:16.533280+0000","last_became_active":"2023-11-24T06:14:15.459183+0000","last_became_peered":"2023-11-24T06:14:15.459183+0000","last_unstale":"2023-11-24T06:14:16.533280+0000","last_undegraded":"2023-11-24T06:14:16.533280+0000","last_fullsized":"2023-11-24T06:14:16.533280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:07:40.373840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531283+0000","last_change":"2023-11-24T06:14:15.456470+0000","last_active":"2023-11-24T06:14:16.531283+0000","last_peered":"2023-11-24T06:14:16.531283+0000","last_clean":"2023-11-24T06:14:16.531283+0000","last_became_active":"2023-11-24T06:14:15.456166+0000","last_became_peered":"2023-11-24T06:14:15.456166+0000","last_unstale":"2023-11-24T06:14:16.531283+0000","last_undegraded":"2023-11-24T06:14:16.531283+0000","last_fullsized":"2023-11-24T06:14:16.531283+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.432298+0000","last_change":"2023-11-24T06:14:15.465252+0000","last_active":"2023-11-24T06:14:16.432298+0000","last_peered":"2023-11-24T06:14:16.432298+0000","last_clean":"2023-11-24T06:14:16.432298+0000","last_became_active":"2023-11-24T06:14:15.463585+0000","last_became_peered":"2023-11-24T06:14:15.463585+0000","last_unstale":"2023-11-24T06:14:16.432298+0000","last_undegraded":"2023-11-24T06:14:16.432298+0000","last_fullsized":"2023-11-24T06:14:16.432298+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532456+0000","last_change":"2023-11-24T06:14:15.448391+0000","last_active":"2023-11-24T06:14:16.532456+0000","last_peered":"2023-11-24T06:14:16.532456+0000","last_clean":"2023-11-24T06:14:16.532456+0000","last_became_active":"2023-11-24T06:14:15.448061+0000","last_became_peered":"2023-11-24T06:14:15.448061+0000","last_unstale":"2023-11-24T06:14:16.532456+0000","last_undegraded":"2023-11-24T06:14:16.532456+0000","last_fullsized":"2023-11-24T06:14:16.532456+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:52.793134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530580+0000","last_change":"2023-11-24T06:14:15.456760+0000","last_active":"2023-11-24T06:14:16.530580+0000","last_peered":"2023-11-24T06:14:16.530580+0000","last_clean":"2023-11-24T06:14:16.530580+0000","last_became_active":"2023-11-24T06:14:15.456438+0000","last_became_peered":"2023-11-24T06:14:15.456438+0000","last_unstale":"2023-11-24T06:14:16.530580+0000","last_undegraded":"2023-11-24T06:14:16.530580+0000","last_fullsized":"2023-11-24T06:14:16.530580+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:47.443002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429476+0000","last_change":"2023-11-24T06:14:15.465806+0000","last_active":"2023-11-24T06:14:16.429476+0000","last_peered":"2023-11-24T06:14:16.429476+0000","last_clean":"2023-11-24T06:14:16.429476+0000","last_became_active":"2023-11-24T06:14:15.464436+0000","last_became_peered":"2023-11-24T06:14:15.464436+0000","last_unstale":"2023-11-24T06:14:16.429476+0000","last_undegraded":"2023-11-24T06:14:16.429476+0000","last_fullsized":"2023-11-24T06:14:16.429476+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:51:28.140293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533344+0000","last_change":"2023-11-24T06:14:15.453814+0000","last_active":"2023-11-24T06:14:16.533344+0000","last_peered":"2023-11-24T06:14:16.533344+0000","last_clean":"2023-11-24T06:14:16.533344+0000","last_became_active":"2023-11-24T06:14:15.453484+0000","last_became_peered":"2023-11-24T06:14:15.453484+0000","last_unstale":"2023-11-24T06:14:16.533344+0000","last_undegraded":"2023-11-24T06:14:16.533344+0000","last_fullsized":"2023-11-24T06:14:16.533344+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:49:48.523158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531657+0000","last_change":"2023-11-24T06:14:15.461105+0000","last_active":"2023-11-24T06:14:16.531657+0000","last_peered":"2023-11-24T06:14:16.531657+0000","last_clean":"2023-11-24T06:14:16.531657+0000","last_became_active":"2023-11-24T06:14:15.458141+0000","last_became_peered":"2023-11-24T06:14:15.458141+0000","last_unstale":"2023-11-24T06:14:16.531657+0000","last_undegraded":"2023-11-24T06:14:16.531657+0000","last_fullsized":"2023-11-24T06:14:16.531657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:59.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.489180+0000","last_change":"2023-11-24T06:14:14.473536+0000","last_active":"2023-11-24T06:14:15.489180+0000","last_peered":"2023-11-24T06:14:15.489180+0000","last_clean":"2023-11-24T06:14:15.489180+0000","last_became_active":"2023-11-24T06:14:14.473231+0000","last_became_peered":"2023-11-24T06:14:14.473231+0000","last_unstale":"2023-11-24T06:14:15.489180+0000","last_undegraded":"2023-11-24T06:14:15.489180+0000","last_fullsized":"2023-11-24T06:14:15.489180+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:08.401655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533242+0000","last_change":"2023-11-24T06:14:15.460242+0000","last_active":"2023-11-24T06:14:16.533242+0000","last_peered":"2023-11-24T06:14:16.533242+0000","last_clean":"2023-11-24T06:14:16.533242+0000","last_became_active":"2023-11-24T06:14:15.459929+0000","last_became_peered":"2023-11-24T06:14:15.459929+0000","last_unstale":"2023-11-24T06:14:16.533242+0000","last_undegraded":"2023-11-24T06:14:16.533242+0000","last_fullsized":"2023-11-24T06:14:16.533242+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:10.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.487075+0000","last_change":"2023-11-24T06:14:14.475915+0000","last_active":"2023-11-24T06:14:15.487075+0000","last_peered":"2023-11-24T06:14:15.487075+0000","last_clean":"2023-11-24T06:14:15.487075+0000","last_became_active":"2023-11-24T06:14:14.475552+0000","last_became_peered":"2023-11-24T06:14:14.475552+0000","last_unstale":"2023-11-24T06:14:15.487075+0000","last_undegraded":"2023-11-24T06:14:15.487075+0000","last_fullsized":"2023-11-24T06:14:15.487075+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:09.909600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.432472+0000","last_change":"2023-11-24T06:14:15.461285+0000","last_active":"2023-11-24T06:14:16.432472+0000","last_peered":"2023-11-24T06:14:16.432472+0000","last_clean":"2023-11-24T06:14:16.432472+0000","last_became_active":"2023-11-24T06:14:15.460956+0000","last_became_peered":"2023-11-24T06:14:15.460956+0000","last_unstale":"2023-11-24T06:14:16.432472+0000","last_undegraded":"2023-11-24T06:14:16.432472+0000","last_fullsized":"2023-11-24T06:14:16.432472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532280+0000","last_change":"2023-11-24T06:14:14.466846+0000","last_active":"2023-11-24T06:14:16.532280+0000","last_peered":"2023-11-24T06:14:16.532280+0000","last_clean":"2023-11-24T06:14:16.532280+0000","last_became_active":"2023-11-24T06:14:14.466551+0000","last_became_peered":"2023-11-24T06:14:14.466551+0000","last_unstale":"2023-11-24T06:14:16.532280+0000","last_undegraded":"2023-11-24T06:14:16.532280+0000","last_fullsized":"2023-11-24T06:14:16.532280+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.012140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532216+0000","last_change":"2023-11-24T06:14:15.450388+0000","last_active":"2023-11-24T06:14:16.532216+0000","last_peered":"2023-11-24T06:14:16.532216+0000","last_clean":"2023-11-24T06:14:16.532216+0000","last_became_active":"2023-11-24T06:14:15.449506+0000","last_became_peered":"2023-11-24T06:14:15.449506+0000","last_unstale":"2023-11-24T06:14:16.532216+0000","last_undegraded":"2023-11-24T06:14:16.532216+0000","last_fullsized":"2023-11-24T06:14:16.532216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:42:24.194375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.487041+0000","last_change":"2023-11-24T06:14:14.474823+0000","last_active":"2023-11-24T06:14:15.487041+0000","last_peered":"2023-11-24T06:14:15.487041+0000","last_clean":"2023-11-24T06:14:15.487041+0000","last_became_active":"2023-11-24T06:14:14.474389+0000","last_became_peered":"2023-11-24T06:14:14.474389+0000","last_unstale":"2023-11-24T06:14:15.487041+0000","last_undegraded":"2023-11-24T06:14:15.487041+0000","last_fullsized":"2023-11-24T06:14:15.487041+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:15.457717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530708+0000","last_change":"2023-11-24T06:14:15.456489+0000","last_active":"2023-11-24T06:14:16.530708+0000","last_peered":"2023-11-24T06:14:16.530708+0000","last_clean":"2023-11-24T06:14:16.530708+0000","last_became_active":"2023-11-24T06:14:15.455546+0000","last_became_peered":"2023-11-24T06:14:15.455546+0000","last_unstale":"2023-11-24T06:14:16.530708+0000","last_undegraded":"2023-11-24T06:14:16.530708+0000","last_fullsized":"2023-11-24T06:14:16.530708+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:20.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.490426+0000","last_change":"2023-11-24T06:14:14.465504+0000","last_active":"2023-11-24T06:14:15.490426+0000","last_peered":"2023-11-24T06:14:15.490426+0000","last_clean":"2023-11-24T06:14:15.490426+0000","last_became_active":"2023-11-24T06:14:14.463218+0000","last_became_peered":"2023-11-24T06:14:14.463218+0000","last_unstale":"2023-11-24T06:14:15.490426+0000","last_undegraded":"2023-11-24T06:14:15.490426+0000","last_fullsized":"2023-11-24T06:14:15.490426+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:13.271597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529888+0000","last_change":"2023-11-24T06:14:15.466490+0000","last_active":"2023-11-24T06:14:16.529888+0000","last_peered":"2023-11-24T06:14:16.529888+0000","last_clean":"2023-11-24T06:14:16.529888+0000","last_became_active":"2023-11-24T06:14:15.466122+0000","last_became_peered":"2023-11-24T06:14:15.466122+0000","last_unstale":"2023-11-24T06:14:16.529888+0000","last_undegraded":"2023-11-24T06:14:16.529888+0000","last_fullsized":"2023-11-24T06:14:16.529888+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:51:37.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.483552+0000","last_change":"2023-11-24T06:14:14.473902+0000","last_active":"2023-11-24T06:14:15.483552+0000","last_peered":"2023-11-24T06:14:15.483552+0000","last_clean":"2023-11-24T06:14:15.483552+0000","last_became_active":"2023-11-24T06:14:14.472463+0000","last_became_peered":"2023-11-24T06:14:14.472463+0000","last_unstale":"2023-11-24T06:14:15.483552+0000","last_undegraded":"2023-11-24T06:14:15.483552+0000","last_fullsized":"2023-11-24T06:14:15.483552+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:36.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529824+0000","last_change":"2023-11-24T06:14:15.460430+0000","last_active":"2023-11-24T06:14:16.529824+0000","last_peered":"2023-11-24T06:14:16.529824+0000","last_clean":"2023-11-24T06:14:16.529824+0000","last_became_active":"2023-11-24T06:14:15.459760+0000","last_became_peered":"2023-11-24T06:14:15.459760+0000","last_unstale":"2023-11-24T06:14:16.529824+0000","last_undegraded":"2023-11-24T06:14:16.529824+0000","last_fullsized":"2023-11-24T06:14:16.529824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.446761+0000","last_change":"2023-11-24T06:14:14.463999+0000","last_active":"2023-11-24T06:14:15.446761+0000","last_peered":"2023-11-24T06:14:15.446761+0000","last_clean":"2023-11-24T06:14:15.446761+0000","last_became_active":"2023-11-24T06:14:14.463397+0000","last_became_peered":"2023-11-24T06:14:14.463397+0000","last_unstale":"2023-11-24T06:14:15.446761+0000","last_undegraded":"2023-11-24T06:14:15.446761+0000","last_fullsized":"2023-11-24T06:14:15.446761+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:58.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531694+0000","last_change":"2023-11-24T06:14:15.449308+0000","last_active":"2023-11-24T06:14:16.531694+0000","last_peered":"2023-11-24T06:14:16.531694+0000","last_clean":"2023-11-24T06:14:16.531694+0000","last_became_active":"2023-11-24T06:14:15.448927+0000","last_became_peered":"2023-11-24T06:14:15.448927+0000","last_unstale":"2023-11-24T06:14:16.531694+0000","last_undegraded":"2023-11-24T06:14:16.531694+0000","last_fullsized":"2023-11-24T06:14:16.531694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:42:11.964625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.448787+0000","last_change":"2023-11-24T06:14:14.460282+0000","last_active":"2023-11-24T06:14:15.448787+0000","last_peered":"2023-11-24T06:14:15.448787+0000","last_clean":"2023-11-24T06:14:15.448787+0000","last_became_active":"2023-11-24T06:14:14.459975+0000","last_became_peered":"2023-11-24T06:14:14.459975+0000","last_unstale":"2023-11-24T06:14:15.448787+0000","last_undegraded":"2023-11-24T06:14:15.448787+0000","last_fullsized":"2023-11-24T06:14:15.448787+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:32.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532001+0000","last_change":"2023-11-24T06:14:15.464334+0000","last_active":"2023-11-24T06:14:16.532001+0000","last_peered":"2023-11-24T06:14:16.532001+0000","last_clean":"2023-11-24T06:14:16.532001+0000","last_became_active":"2023-11-24T06:14:15.463320+0000","last_became_peered":"2023-11-24T06:14:15.463320+0000","last_unstale":"2023-11-24T06:14:16.532001+0000","last_undegraded":"2023-11-24T06:14:16.532001+0000","last_fullsized":"2023-11-24T06:14:16.532001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.446737+0000","last_change":"2023-11-24T06:14:14.470638+0000","last_active":"2023-11-24T06:14:15.446737+0000","last_peered":"2023-11-24T06:14:15.446737+0000","last_clean":"2023-11-24T06:14:15.446737+0000","last_became_active":"2023-11-24T06:14:14.470336+0000","last_became_peered":"2023-11-24T06:14:14.470336+0000","last_unstale":"2023-11-24T06:14:15.446737+0000","last_undegraded":"2023-11-24T06:14:15.446737+0000","last_fullsized":"2023-11-24T06:14:15.446737+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:18.219329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434855+0000","last_change":"2023-11-24T06:14:15.458205+0000","last_active":"2023-11-24T06:14:16.434855+0000","last_peered":"2023-11-24T06:14:16.434855+0000","last_clean":"2023-11-24T06:14:16.434855+0000","last_became_active":"2023-11-24T06:14:15.457862+0000","last_became_peered":"2023-11-24T06:14:15.457862+0000","last_unstale":"2023-11-24T06:14:16.434855+0000","last_undegraded":"2023-11-24T06:14:16.434855+0000","last_fullsized":"2023-11-24T06:14:16.434855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:35.312894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.448617+0000","last_change":"2023-11-24T06:14:14.470585+0000","last_active":"2023-11-24T06:14:15.448617+0000","last_peered":"2023-11-24T06:14:15.448617+0000","last_clean":"2023-11-24T06:14:15.448617+0000","last_became_active":"2023-11-24T06:14:14.470306+0000","last_became_peered":"2023-11-24T06:14:14.470306+0000","last_unstale":"2023-11-24T06:14:15.448617+0000","last_undegraded":"2023-11-24T06:14:15.448617+0000","last_fullsized":"2023-11-24T06:14:15.448617+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:36.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430984+0000","last_change":"2023-11-24T06:14:15.474018+0000","last_active":"2023-11-24T06:14:16.430984+0000","last_peered":"2023-11-24T06:14:16.430984+0000","last_clean":"2023-11-24T06:14:16.430984+0000","last_became_active":"2023-11-24T06:14:15.470825+0000","last_became_peered":"2023-11-24T06:14:15.470825+0000","last_unstale":"2023-11-24T06:14:16.430984+0000","last_undegraded":"2023-11-24T06:14:16.430984+0000","last_fullsized":"2023-11-24T06:14:16.430984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:02.888485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.488943+0000","last_change":"2023-11-24T06:14:14.476720+0000","last_active":"2023-11-24T06:14:15.488943+0000","last_peered":"2023-11-24T06:14:15.488943+0000","last_clean":"2023-11-24T06:14:15.488943+0000","last_became_active":"2023-11-24T06:14:14.476422+0000","last_became_peered":"2023-11-24T06:14:14.476422+0000","last_unstale":"2023-11-24T06:14:15.488943+0000","last_undegraded":"2023-11-24T06:14:15.488943+0000","last_fullsized":"2023-11-24T06:14:15.488943+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:46.430693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434479+0000","last_change":"2023-11-24T06:14:15.452920+0000","last_active":"2023-11-24T06:14:16.434479+0000","last_peered":"2023-11-24T06:14:16.434479+0000","last_clean":"2023-11-24T06:14:16.434479+0000","last_became_active":"2023-11-24T06:14:15.452489+0000","last_became_peered":"2023-11-24T06:14:15.452489+0000","last_unstale":"2023-11-24T06:14:16.434479+0000","last_undegraded":"2023-11-24T06:14:16.434479+0000","last_fullsized":"2023-11-24T06:14:16.434479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.492266+0000","last_change":"2023-11-24T06:14:14.469038+0000","last_active":"2023-11-24T06:14:15.492266+0000","last_peered":"2023-11-24T06:14:15.492266+0000","last_clean":"2023-11-24T06:14:15.492266+0000","last_became_active":"2023-11-24T06:14:14.468405+0000","last_became_peered":"2023-11-24T06:14:14.468405+0000","last_unstale":"2023-11-24T06:14:15.492266+0000","last_undegraded":"2023-11-24T06:14:15.492266+0000","last_fullsized":"2023-11-24T06:14:15.492266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:54.931363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532442+0000","last_change":"2023-11-24T06:14:15.462373+0000","last_active":"2023-11-24T06:14:16.532442+0000","last_peered":"2023-11-24T06:14:16.532442+0000","last_clean":"2023-11-24T06:14:16.532442+0000","last_became_active":"2023-11-24T06:14:15.462091+0000","last_became_peered":"2023-11-24T06:14:15.462091+0000","last_unstale":"2023-11-24T06:14:16.532442+0000","last_undegraded":"2023-11-24T06:14:16.532442+0000","last_fullsized":"2023-11-24T06:14:16.532442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:12.442248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.489253+0000","last_change":"2023-11-24T06:14:14.464231+0000","last_active":"2023-11-24T06:14:15.489253+0000","last_peered":"2023-11-24T06:14:15.489253+0000","last_clean":"2023-11-24T06:14:15.489253+0000","last_became_active":"2023-11-24T06:14:14.463983+0000","last_became_peered":"2023-11-24T06:14:14.463983+0000","last_unstale":"2023-11-24T06:14:15.489253+0000","last_undegraded":"2023-11-24T06:14:15.489253+0000","last_fullsized":"2023-11-24T06:14:15.489253+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:12.974527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530243+0000","last_change":"2023-11-24T06:14:15.456224+0000","last_active":"2023-11-24T06:14:16.530243+0000","last_peered":"2023-11-24T06:14:16.530243+0000","last_clean":"2023-11-24T06:14:16.530243+0000","last_became_active":"2023-11-24T06:14:15.455982+0000","last_became_peered":"2023-11-24T06:14:15.455982+0000","last_unstale":"2023-11-24T06:14:16.530243+0000","last_undegraded":"2023-11-24T06:14:16.530243+0000","last_fullsized":"2023-11-24T06:14:16.530243+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:32.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.435658+0000","last_change":"2023-11-24T06:14:14.464071+0000","last_active":"2023-11-24T06:14:15.435658+0000","last_peered":"2023-11-24T06:14:15.435658+0000","last_clean":"2023-11-24T06:14:15.435658+0000","last_became_active":"2023-11-24T06:14:14.463400+0000","last_became_peered":"2023-11-24T06:14:14.463400+0000","last_unstale":"2023-11-24T06:14:15.435658+0000","last_undegraded":"2023-11-24T06:14:15.435658+0000","last_fullsized":"2023-11-24T06:14:15.435658+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:18.219329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429208+0000","last_change":"2023-11-24T06:14:15.456873+0000","last_active":"2023-11-24T06:14:16.429208+0000","last_peered":"2023-11-24T06:14:16.429208+0000","last_clean":"2023-11-24T06:14:16.429208+0000","last_became_active":"2023-11-24T06:14:15.456605+0000","last_became_peered":"2023-11-24T06:14:15.456605+0000","last_unstale":"2023-11-24T06:14:16.429208+0000","last_undegraded":"2023-11-24T06:14:16.429208+0000","last_fullsized":"2023-11-24T06:14:16.429208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:19.012475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.452131+0000","last_change":"2023-11-24T06:14:14.465760+0000","last_active":"2023-11-24T06:14:15.452131+0000","last_peered":"2023-11-24T06:14:15.452131+0000","last_clean":"2023-11-24T06:14:15.452131+0000","last_became_active":"2023-11-24T06:14:14.464414+0000","last_became_peered":"2023-11-24T06:14:14.464414+0000","last_unstale":"2023-11-24T06:14:15.452131+0000","last_undegraded":"2023-11-24T06:14:15.452131+0000","last_fullsized":"2023-11-24T06:14:15.452131+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:23.405611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434057+0000","last_change":"2023-11-24T06:14:15.455901+0000","last_active":"2023-11-24T06:14:16.434057+0000","last_peered":"2023-11-24T06:14:16.434057+0000","last_clean":"2023-11-24T06:14:16.434057+0000","last_became_active":"2023-11-24T06:14:15.455543+0000","last_became_peered":"2023-11-24T06:14:15.455543+0000","last_unstale":"2023-11-24T06:14:16.434057+0000","last_undegraded":"2023-11-24T06:14:16.434057+0000","last_fullsized":"2023-11-24T06:14:16.434057+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.491888+0000","last_change":"2023-11-24T06:14:14.472295+0000","last_active":"2023-11-24T06:14:15.491888+0000","last_peered":"2023-11-24T06:14:15.491888+0000","last_clean":"2023-11-24T06:14:15.491888+0000","last_became_active":"2023-11-24T06:14:14.471955+0000","last_became_peered":"2023-11-24T06:14:14.471955+0000","last_unstale":"2023-11-24T06:14:15.491888+0000","last_undegraded":"2023-11-24T06:14:15.491888+0000","last_fullsized":"2023-11-24T06:14:15.491888+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:11.517836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533475+0000","last_change":"2023-11-24T06:14:15.455854+0000","last_active":"2023-11-24T06:14:16.533475+0000","last_peered":"2023-11-24T06:14:16.533475+0000","last_clean":"2023-11-24T06:14:16.533475+0000","last_became_active":"2023-11-24T06:14:15.454664+0000","last_became_peered":"2023-11-24T06:14:15.454664+0000","last_unstale":"2023-11-24T06:14:16.533475+0000","last_undegraded":"2023-11-24T06:14:16.533475+0000","last_fullsized":"2023-11-24T06:14:16.533475+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:40.126632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.487470+0000","last_change":"2023-11-24T06:14:14.462131+0000","last_active":"2023-11-24T06:14:15.487470+0000","last_peered":"2023-11-24T06:14:15.487470+0000","last_clean":"2023-11-24T06:14:15.487470+0000","last_became_active":"2023-11-24T06:14:14.461069+0000","last_became_peered":"2023-11-24T06:14:14.461069+0000","last_unstale":"2023-11-24T06:14:15.487470+0000","last_undegraded":"2023-11-24T06:14:15.487470+0000","last_fullsized":"2023-11-24T06:14:15.487470+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:10.311807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530452+0000","last_change":"2023-11-24T06:14:15.460541+0000","last_active":"2023-11-24T06:14:16.530452+0000","last_peered":"2023-11-24T06:14:16.530452+0000","last_clean":"2023-11-24T06:14:16.530452+0000","last_became_active":"2023-11-24T06:14:15.459802+0000","last_became_peered":"2023-11-24T06:14:15.459802+0000","last_unstale":"2023-11-24T06:14:16.530452+0000","last_undegraded":"2023-11-24T06:14:16.530452+0000","last_fullsized":"2023-11-24T06:14:16.530452+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:13.986835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.485770+0000","last_change":"2023-11-24T06:14:14.464681+0000","last_active":"2023-11-24T06:14:15.485770+0000","last_peered":"2023-11-24T06:14:15.485770+0000","last_clean":"2023-11-24T06:14:15.485770+0000","last_became_active":"2023-11-24T06:14:14.464313+0000","last_became_peered":"2023-11-24T06:14:14.464313+0000","last_unstale":"2023-11-24T06:14:15.485770+0000","last_undegraded":"2023-11-24T06:14:15.485770+0000","last_fullsized":"2023-11-24T06:14:15.485770+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:58.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532827+0000","last_change":"2023-11-24T06:14:15.458054+0000","last_active":"2023-11-24T06:14:16.532827+0000","last_peered":"2023-11-24T06:14:16.532827+0000","last_clean":"2023-11-24T06:14:16.532827+0000","last_became_active":"2023-11-24T06:14:15.457751+0000","last_became_peered":"2023-11-24T06:14:15.457751+0000","last_unstale":"2023-11-24T06:14:16.532827+0000","last_undegraded":"2023-11-24T06:14:16.532827+0000","last_fullsized":"2023-11-24T06:14:16.532827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:19.231637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.486965+0000","last_change":"2023-11-24T06:14:14.465038+0000","last_active":"2023-11-24T06:14:15.486965+0000","last_peered":"2023-11-24T06:14:15.486965+0000","last_clean":"2023-11-24T06:14:15.486965+0000","last_became_active":"2023-11-24T06:14:14.464681+0000","last_became_peered":"2023-11-24T06:14:14.464681+0000","last_unstale":"2023-11-24T06:14:15.486965+0000","last_undegraded":"2023-11-24T06:14:15.486965+0000","last_fullsized":"2023-11-24T06:14:15.486965+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:15.457717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533282+0000","last_change":"2023-11-24T06:14:15.449256+0000","last_active":"2023-11-24T06:14:16.533282+0000","last_peered":"2023-11-24T06:14:16.533282+0000","last_clean":"2023-11-24T06:14:16.533282+0000","last_became_active":"2023-11-24T06:14:15.448893+0000","last_became_peered":"2023-11-24T06:14:15.448893+0000","last_unstale":"2023-11-24T06:14:16.533282+0000","last_undegraded":"2023-11-24T06:14:16.533282+0000","last_fullsized":"2023-11-24T06:14:16.533282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:59.774563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.437522+0000","last_change":"2023-11-24T06:14:14.469950+0000","last_active":"2023-11-24T06:14:15.437522+0000","last_peered":"2023-11-24T06:14:15.437522+0000","last_clean":"2023-11-24T06:14:15.437522+0000","last_became_active":"2023-11-24T06:14:14.469326+0000","last_became_peered":"2023-11-24T06:14:14.469326+0000","last_unstale":"2023-11-24T06:14:15.437522+0000","last_undegraded":"2023-11-24T06:14:15.437522+0000","last_fullsized":"2023-11-24T06:14:15.437522+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:04.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429593+0000","last_change":"2023-11-24T06:14:15.460954+0000","last_active":"2023-11-24T06:14:16.429593+0000","last_peered":"2023-11-24T06:14:16.429593+0000","last_clean":"2023-11-24T06:14:16.429593+0000","last_became_active":"2023-11-24T06:14:15.460182+0000","last_became_peered":"2023-11-24T06:14:15.460182+0000","last_unstale":"2023-11-24T06:14:16.429593+0000","last_undegraded":"2023-11-24T06:14:16.429593+0000","last_fullsized":"2023-11-24T06:14:16.429593+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:26.637529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.490554+0000","last_change":"2023-11-24T06:14:14.467845+0000","last_active":"2023-11-24T06:14:15.490554+0000","last_peered":"2023-11-24T06:14:15.490554+0000","last_clean":"2023-11-24T06:14:15.490554+0000","last_became_active":"2023-11-24T06:14:14.467516+0000","last_became_peered":"2023-11-24T06:14:14.467516+0000","last_unstale":"2023-11-24T06:14:15.490554+0000","last_undegraded":"2023-11-24T06:14:15.490554+0000","last_fullsized":"2023-11-24T06:14:15.490554+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:57.706334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532105+0000","last_change":"2023-11-24T06:14:15.458585+0000","last_active":"2023-11-24T06:14:16.532105+0000","last_peered":"2023-11-24T06:14:16.532105+0000","last_clean":"2023-11-24T06:14:16.532105+0000","last_became_active":"2023-11-24T06:14:15.458306+0000","last_became_peered":"2023-11-24T06:14:15.458306+0000","last_unstale":"2023-11-24T06:14:16.532105+0000","last_undegraded":"2023-11-24T06:14:16.532105+0000","last_fullsized":"2023-11-24T06:14:16.532105+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:30:16.259583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.443880+0000","last_change":"2023-11-24T06:14:14.471004+0000","last_active":"2023-11-24T06:14:15.443880+0000","last_peered":"2023-11-24T06:14:15.443880+0000","last_clean":"2023-11-24T06:14:15.443880+0000","last_became_active":"2023-11-24T06:14:14.470708+0000","last_became_peered":"2023-11-24T06:14:14.470708+0000","last_unstale":"2023-11-24T06:14:15.443880+0000","last_undegraded":"2023-11-24T06:14:15.443880+0000","last_fullsized":"2023-11-24T06:14:15.443880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:49.544138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533628+0000","last_change":"2023-11-24T06:14:15.454754+0000","last_active":"2023-11-24T06:14:16.533628+0000","last_peered":"2023-11-24T06:14:16.533628+0000","last_clean":"2023-11-24T06:14:16.533628+0000","last_became_active":"2023-11-24T06:14:15.454082+0000","last_became_peered":"2023-11-24T06:14:15.454082+0000","last_unstale":"2023-11-24T06:14:16.533628+0000","last_undegraded":"2023-11-24T06:14:16.533628+0000","last_fullsized":"2023-11-24T06:14:16.533628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:14.186208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.448123+0000","last_change":"2023-11-24T06:14:14.471817+0000","last_active":"2023-11-24T06:14:15.448123+0000","last_peered":"2023-11-24T06:14:15.448123+0000","last_clean":"2023-11-24T06:14:15.448123+0000","last_became_active":"2023-11-24T06:14:14.470909+0000","last_became_peered":"2023-11-24T06:14:14.470909+0000","last_unstale":"2023-11-24T06:14:15.448123+0000","last_undegraded":"2023-11-24T06:14:15.448123+0000","last_fullsized":"2023-11-24T06:14:15.448123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:58.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530663+0000","last_change":"2023-11-24T06:14:15.464586+0000","last_active":"2023-11-24T06:14:16.530663+0000","last_peered":"2023-11-24T06:14:16.530663+0000","last_clean":"2023-11-24T06:14:16.530663+0000","last_became_active":"2023-11-24T06:14:15.464224+0000","last_became_peered":"2023-11-24T06:14:15.464224+0000","last_unstale":"2023-11-24T06:14:16.530663+0000","last_undegraded":"2023-11-24T06:14:16.530663+0000","last_fullsized":"2023-11-24T06:14:16.530663+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:58.718642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.434682+0000","last_change":"2023-11-24T06:14:14.463684+0000","last_active":"2023-11-24T06:14:15.434682+0000","last_peered":"2023-11-24T06:14:15.434682+0000","last_clean":"2023-11-24T06:14:15.434682+0000","last_became_active":"2023-11-24T06:14:14.463242+0000","last_became_peered":"2023-11-24T06:14:14.463242+0000","last_unstale":"2023-11-24T06:14:15.434682+0000","last_undegraded":"2023-11-24T06:14:15.434682+0000","last_fullsized":"2023-11-24T06:14:15.434682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:51.780825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533621+0000","last_change":"2023-11-24T06:14:15.464805+0000","last_active":"2023-11-24T06:14:16.533621+0000","last_peered":"2023-11-24T06:14:16.533621+0000","last_clean":"2023-11-24T06:14:16.533621+0000","last_became_active":"2023-11-24T06:14:15.464463+0000","last_became_peered":"2023-11-24T06:14:15.464463+0000","last_unstale":"2023-11-24T06:14:16.533621+0000","last_undegraded":"2023-11-24T06:14:16.533621+0000","last_fullsized":"2023-11-24T06:14:16.533621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:33.873807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.444020+0000","last_change":"2023-11-24T06:14:14.469820+0000","last_active":"2023-11-24T06:14:15.444020+0000","last_peered":"2023-11-24T06:14:15.444020+0000","last_clean":"2023-11-24T06:14:15.444020+0000","last_became_active":"2023-11-24T06:14:14.469514+0000","last_became_peered":"2023-11-24T06:14:14.469514+0000","last_unstale":"2023-11-24T06:14:15.444020+0000","last_undegraded":"2023-11-24T06:14:15.444020+0000","last_fullsized":"2023-11-24T06:14:15.444020+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:52:18.241353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529839+0000","last_change":"2023-11-24T06:14:15.457988+0000","last_active":"2023-11-24T06:14:16.529839+0000","last_peered":"2023-11-24T06:14:16.529839+0000","last_clean":"2023-11-24T06:14:16.529839+0000","last_became_active":"2023-11-24T06:14:15.457669+0000","last_became_peered":"2023-11-24T06:14:15.457669+0000","last_unstale":"2023-11-24T06:14:16.529839+0000","last_undegraded":"2023-11-24T06:14:16.529839+0000","last_fullsized":"2023-11-24T06:14:16.529839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.439681+0000","last_change":"2023-11-24T06:14:14.476090+0000","last_active":"2023-11-24T06:14:15.439681+0000","last_peered":"2023-11-24T06:14:15.439681+0000","last_clean":"2023-11-24T06:14:15.439681+0000","last_became_active":"2023-11-24T06:14:14.475761+0000","last_became_peered":"2023-11-24T06:14:14.475761+0000","last_unstale":"2023-11-24T06:14:15.439681+0000","last_undegraded":"2023-11-24T06:14:15.439681+0000","last_fullsized":"2023-11-24T06:14:15.439681+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:19.629827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434442+0000","last_change":"2023-11-24T06:14:15.460998+0000","last_active":"2023-11-24T06:14:16.434442+0000","last_peered":"2023-11-24T06:14:16.434442+0000","last_clean":"2023-11-24T06:14:16.434442+0000","last_became_active":"2023-11-24T06:14:15.460663+0000","last_became_peered":"2023-11-24T06:14:15.460663+0000","last_unstale":"2023-11-24T06:14:16.434442+0000","last_undegraded":"2023-11-24T06:14:16.434442+0000","last_fullsized":"2023-11-24T06:14:16.434442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531561+0000","last_change":"2023-11-24T06:14:14.470448+0000","last_active":"2023-11-24T06:14:16.531561+0000","last_peered":"2023-11-24T06:14:16.531561+0000","last_clean":"2023-11-24T06:14:16.531561+0000","last_became_active":"2023-11-24T06:14:14.470152+0000","last_became_peered":"2023-11-24T06:14:14.470152+0000","last_unstale":"2023-11-24T06:14:16.531561+0000","last_undegraded":"2023-11-24T06:14:16.531561+0000","last_fullsized":"2023-11-24T06:14:16.531561+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:00:56.852959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429694+0000","last_change":"2023-11-24T06:14:15.467003+0000","last_active":"2023-11-24T06:14:16.429694+0000","last_peered":"2023-11-24T06:14:16.429694+0000","last_clean":"2023-11-24T06:14:16.429694+0000","last_became_active":"2023-11-24T06:14:15.466684+0000","last_became_peered":"2023-11-24T06:14:15.466684+0000","last_unstale":"2023-11-24T06:14:16.429694+0000","last_undegraded":"2023-11-24T06:14:16.429694+0000","last_fullsized":"2023-11-24T06:14:16.429694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:15:58.084222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.437948+0000","last_change":"2023-11-24T06:14:14.474412+0000","last_active":"2023-11-24T06:14:15.437948+0000","last_peered":"2023-11-24T06:14:15.437948+0000","last_clean":"2023-11-24T06:14:15.437948+0000","last_became_active":"2023-11-24T06:14:14.472912+0000","last_became_peered":"2023-11-24T06:14:14.472912+0000","last_unstale":"2023-11-24T06:14:15.437948+0000","last_undegraded":"2023-11-24T06:14:15.437948+0000","last_fullsized":"2023-11-24T06:14:15.437948+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:32.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430062+0000","last_change":"2023-11-24T06:14:15.463478+0000","last_active":"2023-11-24T06:14:16.430062+0000","last_peered":"2023-11-24T06:14:16.430062+0000","last_clean":"2023-11-24T06:14:16.430062+0000","last_became_active":"2023-11-24T06:14:15.463171+0000","last_became_peered":"2023-11-24T06:14:15.463171+0000","last_unstale":"2023-11-24T06:14:16.430062+0000","last_undegraded":"2023-11-24T06:14:16.430062+0000","last_fullsized":"2023-11-24T06:14:16.430062+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:52:05.003288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.447990+0000","last_change":"2023-11-24T06:14:14.469336+0000","last_active":"2023-11-24T06:14:15.447990+0000","last_peered":"2023-11-24T06:14:15.447990+0000","last_clean":"2023-11-24T06:14:15.447990+0000","last_became_active":"2023-11-24T06:14:14.468897+0000","last_became_peered":"2023-11-24T06:14:14.468897+0000","last_unstale":"2023-11-24T06:14:15.447990+0000","last_undegraded":"2023-11-24T06:14:15.447990+0000","last_fullsized":"2023-11-24T06:14:15.447990+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:32.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430864+0000","last_change":"2023-11-24T06:14:15.454276+0000","last_active":"2023-11-24T06:14:16.430864+0000","last_peered":"2023-11-24T06:14:16.430864+0000","last_clean":"2023-11-24T06:14:16.430864+0000","last_became_active":"2023-11-24T06:14:15.453961+0000","last_became_peered":"2023-11-24T06:14:15.453961+0000","last_unstale":"2023-11-24T06:14:16.430864+0000","last_undegraded":"2023-11-24T06:14:16.430864+0000","last_fullsized":"2023-11-24T06:14:16.430864+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:20.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532235+0000","last_change":"2023-11-24T06:14:14.469167+0000","last_active":"2023-11-24T06:14:16.532235+0000","last_peered":"2023-11-24T06:14:16.532235+0000","last_clean":"2023-11-24T06:14:16.532235+0000","last_became_active":"2023-11-24T06:14:14.468800+0000","last_became_peered":"2023-11-24T06:14:14.468800+0000","last_unstale":"2023-11-24T06:14:16.532235+0000","last_undegraded":"2023-11-24T06:14:16.532235+0000","last_fullsized":"2023-11-24T06:14:16.532235+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:05.447900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530384+0000","last_change":"2023-11-24T06:14:15.459400+0000","last_active":"2023-11-24T06:14:16.530384+0000","last_peered":"2023-11-24T06:14:16.530384+0000","last_clean":"2023-11-24T06:14:16.530384+0000","last_became_active":"2023-11-24T06:14:15.458546+0000","last_became_peered":"2023-11-24T06:14:15.458546+0000","last_unstale":"2023-11-24T06:14:16.530384+0000","last_undegraded":"2023-11-24T06:14:16.530384+0000","last_fullsized":"2023-11-24T06:14:16.530384+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:12.530144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.449106+0000","last_change":"2023-11-24T06:14:14.462523+0000","last_active":"2023-11-24T06:14:15.449106+0000","last_peered":"2023-11-24T06:14:15.449106+0000","last_clean":"2023-11-24T06:14:15.449106+0000","last_became_active":"2023-11-24T06:14:14.461882+0000","last_became_peered":"2023-11-24T06:14:14.461882+0000","last_unstale":"2023-11-24T06:14:15.449106+0000","last_undegraded":"2023-11-24T06:14:15.449106+0000","last_fullsized":"2023-11-24T06:14:15.449106+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:46.430693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531032+0000","last_change":"2023-11-24T06:14:15.460794+0000","last_active":"2023-11-24T06:14:16.531032+0000","last_peered":"2023-11-24T06:14:16.531032+0000","last_clean":"2023-11-24T06:14:16.531032+0000","last_became_active":"2023-11-24T06:14:15.457653+0000","last_became_peered":"2023-11-24T06:14:15.457653+0000","last_unstale":"2023-11-24T06:14:16.531032+0000","last_undegraded":"2023-11-24T06:14:16.531032+0000","last_fullsized":"2023-11-24T06:14:16.531032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:07:48.082618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.486520+0000","last_change":"2023-11-24T06:14:14.462792+0000","last_active":"2023-11-24T06:14:15.486520+0000","last_peered":"2023-11-24T06:14:15.486520+0000","last_clean":"2023-11-24T06:14:15.486520+0000","last_became_active":"2023-11-24T06:14:14.462410+0000","last_became_peered":"2023-11-24T06:14:14.462410+0000","last_unstale":"2023-11-24T06:14:15.486520+0000","last_undegraded":"2023-11-24T06:14:15.486520+0000","last_fullsized":"2023-11-24T06:14:15.486520+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:11.517836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.434934+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:14:15.434934+0000","last_peered":"2023-11-24T06:14:15.434934+0000","last_clean":"2023-11-24T06:14:15.434934+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:14:15.434934+0000","last_undegraded":"2023-11-24T06:14:15.434934+0000","last_fullsized":"2023-11-24T06:14:15.434934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476769,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":220385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.034,"15min":1.038},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.542,"5min":1.665,"15min":1.665},"last":1.363},{"interface":"front","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0249999999999999},"min":{"1min":0.74199999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.48,"5min":1.698,"15min":1.698},"last":1.1699999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.47,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.593},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1140000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.095}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1319999999999999,"15min":1.1259999999999999},"min":{"1min":0.71799999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.591,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.302},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.3360000000000001,"15min":1.3540000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5920000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.018}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.306,"15min":1.302},"min":{"1min":0.94899999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.714,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.335},"min":{"1min":0.95099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7170000000000001,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.466}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.288,"15min":1.288},"min":{"1min":0.68500000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8759999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.3580000000000001,"15min":1.3300000000000001},"min":{"1min":1.0860000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.016,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.8580000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.5089999999999999,"15min":1.5169999999999999},"min":{"1min":1.022,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.784,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.728},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4550000000000001,"15min":1.4470000000000001},"min":{"1min":1.014,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.0880000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.7829999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5529999999999999,"15min":1.5469999999999999},"min":{"1min":1.0620000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.153,"5min":2.778,"15min":2.778},"last":1.9930000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.681,"15min":1.6930000000000001},"min":{"1min":1.3120000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9239999999999999,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.921}]}]},{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":810773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4279999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.746,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.6060000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.181,"15min":1.1950000000000001},"min":{"1min":0.68500000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.645,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.28,"15min":1.282},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.4630000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2110000000000001,"15min":1.2010000000000001},"min":{"1min":0.90700000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9059999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.093},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2909999999999999,"15min":1.298},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.865,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6879999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3320000000000001,"15min":1.3300000000000001},"min":{"1min":0.872,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9490000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.359},{"interface":"front","average":{"1min":1.343,"5min":1.3640000000000001,"15min":1.3680000000000001},"min":{"1min":0.90900000000000003,"5min":0.745,"15min":0.745},"max":{"1min":1.748,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.391}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.83199999999999996,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.202},{"interface":"front","average":{"1min":1.524,"5min":1.4319999999999999,"15min":1.417},"min":{"1min":1.0329999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.165,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.6539999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.544,"15min":1.53},"min":{"1min":1.1850000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0590000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.75,"5min":1.6779999999999999,"15min":1.6659999999999999},"min":{"1min":1.5069999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.3980000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.51}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.96099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.0230000000000001,"5min":2.5,"15min":2.5},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.75,"15min":1.736},"min":{"1min":1.343,"5min":0.875,"15min":0.875},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.7350000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":220987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.034,"15min":1.054},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2609999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.246}]},{"osd":1,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5409999999999999,"5min":1.619,"15min":1.619},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2549999999999999,"15min":1.2529999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.79,"5min":1.887,"15min":1.887},"last":1.3939999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3089999999999999,"15min":1.3180000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8080000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.327},{"interface":"front","average":{"1min":1.22,"5min":1.446,"15min":1.484},"min":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5620000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.0700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3640000000000001,"15min":1.3779999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.756,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.512},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.4630000000000001,"15min":1.4950000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8779999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.1080000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.4950000000000001,"15min":1.5029999999999999},"min":{"1min":0.76700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0009999999999999,"5min":2.258,"15min":2.258},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.5309999999999999,"15min":1.5609999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7210000000000001,"5min":2.105,"15min":2.105},"last":1.1779999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5600000000000001,"15min":1.5780000000000001},"min":{"1min":0.59099999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8959999999999999,"5min":2.319,"15min":2.319},"last":1.732},{"interface":"front","average":{"1min":1.54,"5min":1.6459999999999999,"15min":1.6639999999999999},"min":{"1min":0.81799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.1549999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.4570000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6859999999999999,"15min":1.7},"min":{"1min":0.68400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9490000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":2.0110000000000001},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.768,"15min":1.792},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.669,"15min":2.669},"last":1.6619999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":557056,"data_stored":221927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0580000000000001,"15min":1.0660000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.579,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0620000000000001,"15min":1.0780000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.3049999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2769999999999999,"15min":1.296},"min":{"1min":0.67000000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6910000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.2649999999999999,"15min":1.2949999999999999},"min":{"1min":0.70099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7649999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.484}]},{"osd":2,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1830000000000001,"15min":1.181},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.774,"5min":2.04,"15min":2.04},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.3939999999999999,"15min":1.4159999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6599999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.0529999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2909999999999999,"15min":1.302},"min":{"1min":0.84899999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.849,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.3500000000000001,"15min":1.3600000000000001},"min":{"1min":0.93400000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8400000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.373}]},{"osd":5,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4430000000000001,"15min":1.4550000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.768,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.54,"15min":1.5580000000000001},"min":{"1min":0.87,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.798,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.7090000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.5920000000000001,"15min":1.6000000000000001},"min":{"1min":1.004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9490000000000001,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.859},{"interface":"front","average":{"1min":1.448,"5min":1.6160000000000001,"15min":1.6439999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.827,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.427}]},{"osd":7,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5660000000000001,"15min":1.5840000000000001},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.9730000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.722,"15min":1.732},"min":{"1min":1.1200000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0910000000000002,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.798}]}]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":557056,"data_stored":220953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.141,"5min":1.607,"15min":1.607},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.86199999999999999,"15min":0.88},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.23,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88100000000000001,"15min":0.90100000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.3420000000000001,"5min":1.796,"15min":1.796},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1120000000000001,"15min":1.1359999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.621,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.7629999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.0189999999999999,"15min":1.038},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.55,"5min":1.835,"15min":1.835},"last":1.3520000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.075,"15min":1.1020000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4239999999999999,"5min":2.399,"15min":2.399},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.2949999999999999,"15min":1.3149999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8200000000000001,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2649999999999999,"15min":1.2689999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8839999999999999,"5min":2.141,"15min":2.141},"last":1.71}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.298,"15min":1.3160000000000001},"min":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7330000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.853},{"interface":"front","average":{"1min":1.218,"5min":1.3680000000000001,"15min":1.393},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.671,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.655}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3360000000000001,"15min":1.3420000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.821,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":2.02},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3109999999999999,"15min":1.3200000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.655,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.6020000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3879999999999999,"15min":1.4179999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.772,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":2.1349999999999998},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4410000000000001,"15min":1.462},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.726,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.9630000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":221949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.538,"5min":2.552,"15min":2.552},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.93899999999999995,"15min":0.96399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4550000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.85499999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.121,"15min":1.119},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.696,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.214},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6479999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.0069999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1419999999999999,"15min":1.1579999999999999},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.5169999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.55100000000000005,"5min":0.371,"15min":0.371},"max":{"1min":1.25,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.325,"15min":1.335},"min":{"1min":0.75900000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.883,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.484,"15min":1.5009999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.804,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.528}]},{"osd":5,"last update":"Fri Nov 24 06:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.21,"15min":1.212},"min":{"1min":0.81000000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.569,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4330000000000001,"15min":1.444},"min":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.79,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.484}]},{"osd":6,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3819999999999999,"15min":1.397},"min":{"1min":0.84299999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7030000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.29},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.544,"15min":1.5629999999999999},"min":{"1min":1.0880000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8300000000000001,"5min":4.101,"15min":4.101},"last":1.411}]},{"osd":7,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.488,"15min":1.5},"min":{"1min":0.81200000000000006,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7190000000000001,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":0.81399999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7649999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.619}]}]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":810717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.84699999999999998,"15min":0.83799999999999997},"min":{"1min":0.58399999999999996,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.696,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.45500000000000002,"5min":0.443,"15min":0.443},"max":{"1min":2.0609999999999999,"5min":2.161,"15min":2.161},"last":1.2689999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.032,"15min":1.038},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.806,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.071},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"min":{"1min":0.55500000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.194,"15min":1.2170000000000001},"min":{"1min":0.54500000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8160000000000001,"5min":3.766,"15min":3.766},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.264,"5min":1.22,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1560000000000001,"5min":2.218,"15min":2.218},"last":1.4199999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.304,"15min":1.29},"min":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3799999999999999,"15min":1.3979999999999999},"min":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.853,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.0369999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2669999999999999,"15min":1.2689999999999999},"min":{"1min":0.85099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.736,"5min":1.829,"15min":1.829},"last":1.516},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.2350000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.339}]},{"osd":6,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.421,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.657,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.147},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.349,"15min":1.331},"min":{"1min":0.873,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0270000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.482}]},{"osd":7,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.429,"15min":1.427},"min":{"1min":0.94599999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.552,"15min":1.5620000000000001},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1909999999999998,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.6799999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":220385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.93899999999999995,"15min":0.96199999999999997},"min":{"1min":0.439,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5209999999999999,"5min":1.571,"15min":1.571},"last":0.753},{"interface":"front","average":{"1min":0.878,"5min":1,"15min":1.02},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.341,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.99199999999999999,"15min":1.0109999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4239999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.2030000000000001,"15min":1.2390000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.78,"5min":1.792,"15min":1.792},"last":0.98899999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.3280000000000001,"15min":1.3660000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":0.66500000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6739999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.94899999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3089999999999999,"15min":1.321},"min":{"1min":0.79400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.794,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.095},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.55,"15min":1.5780000000000001},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.7909999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.3839999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.1059999999999999,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.454,"15min":1.468},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.2599999999999998,"5min":2.637,"15min":2.637},"last":1.194}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.5389999999999999,"15min":1.5609999999999999},"min":{"1min":0.95099999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.839,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.5229999999999999,"15min":1.5389999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1259999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.486}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.613,"15min":1.6319999999999999},"min":{"1min":1,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.9620000000000002,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.679,"15min":1.6839999999999999},"min":{"1min":1.198,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:14:25.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:14:25.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.332+0000 7fa4b5ea6640 1 Processor -- start 2023-11-24T06:14:25.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.332+0000 7fa4b5ea6640 1 -- start start 2023-11-24T06:14:25.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.333+0000 7fa4b5ea6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4b015d5b0 0x7fa4b00d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.333+0000 7fa4b5ea6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b00b1650 0x7fa4b00d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b5ea6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b00cf0c0 con 0x7fa4b00d14a0 2023-11-24T06:14:25.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b5ea6640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b00b01b0 con 0x7fa4b015d5b0 2023-11-24T06:14:25.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b5ea6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b015d990 con 0x7fa4b00b1650 2023-11-24T06:14:25.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b4ea4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4b015d5b0 0x7fa4b00d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b4ea4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4b015d5b0 0x7fa4b00d3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37998/0 (socket says 172.21.15.22:37998) 2023-11-24T06:14:25.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b4ea4640 1 -- 172.21.15.22:0/804767776 learned_addr learned my addr 172.21.15.22:0/804767776 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:25.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b4ea4640 1 -- 172.21.15.22:0/804767776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b00b1650 msgr2=0x7fa4b00d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:25.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b4ea4640 1 --2- 172.21.15.22:0/804767776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b00b1650 0x7fa4b00d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b4ea4640 1 -- 172.21.15.22:0/804767776 >> v1:172.21.15.31:6789/0 conn(0x7fa4b00d14a0 legacy=0x7fa4b00cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:25.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.334+0000 7fa4b4ea4640 1 -- 172.21.15.22:0/804767776 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b00d1e40 con 0x7fa4b015d5b0 2023-11-24T06:14:25.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.335+0000 7fa4b4ea4640 1 --2- 172.21.15.22:0/804767776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b015d5b0 0x7fa4b00d3990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009e50 tx=0x7fa4a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d15faf187c573fa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.336+0000 7fa4af7fe640 1 -- 172.21.15.22:0/804767776 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a002ca70 con 0x7fa4b015d5b0 2023-11-24T06:14:25.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.336+0000 7fa4af7fe640 1 -- 172.21.15.22:0/804767776 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a002cbd0 con 0x7fa4b015d5b0 2023-11-24T06:14:25.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.336+0000 7fa4af7fe640 1 -- 172.21.15.22:0/804767776 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00343f0 con 0x7fa4b015d5b0 2023-11-24T06:14:25.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.336+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/804767776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b015d5b0 msgr2=0x7fa4b00d3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.336+0000 7fa4b5ea6640 1 --2- 172.21.15.22:0/804767776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b015d5b0 0x7fa4b00d3990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009e50 tx=0x7fa4a002bed0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.337+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/804767776 shutdown_connections 2023-11-24T06:14:25.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.337+0000 7fa4b5ea6640 1 --2- 172.21.15.22:0/804767776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b00b1650 0x7fa4b00d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.337+0000 7fa4b5ea6640 1 --2- 172.21.15.22:0/804767776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b015d5b0 0x7fa4b00d3990 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.337+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/804767776 >> 172.21.15.22:0/804767776 conn(0x7fa4b009c3b0 msgr2=0x7fa4b00d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:25.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.337+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/804767776 shutdown_connections 2023-11-24T06:14:25.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.337+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/804767776 wait complete. 2023-11-24T06:14:25.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.339+0000 7fa4b5ea6640 1 Processor -- start 2023-11-24T06:14:25.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.339+0000 7fa4b5ea6640 1 -- start start 2023-11-24T06:14:25.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.340+0000 7fa4b5ea6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b00b1650 0x7fa4b0151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.340+0000 7fa4b5ea6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b00d14a0 0x7fa4b015f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.340+0000 7fa4b5ea6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b015d5b0 0x7fa4b015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.340+0000 7fa4b5ea6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0151ac0 con 0x7fa4b00d14a0 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.340+0000 7fa4b5ea6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b00d1b30 con 0x7fa4b00b1650 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.340+0000 7fa4b5ea6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b015ff20 con 0x7fa4b015d5b0 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.340+0000 7fa4affff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b00d14a0 0x7fa4b015f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.340+0000 7fa4affff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b00d14a0 0x7fa4b015f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38014/0 (socket says 172.21.15.22:38014) 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.340+0000 7fa4affff640 1 -- 172.21.15.22:0/2502784152 learned_addr learned my addr 172.21.15.22:0/2502784152 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4b4ea4640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b00b1650 0x7fa4b0151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4b56a5640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b015d5b0 0x7fa4b015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4affff640 1 -- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b015d5b0 msgr2=0x7fa4b015a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4affff640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b015d5b0 0x7fa4b015a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4affff640 1 -- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b00b1650 msgr2=0x7fa4b0151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4affff640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b00b1650 0x7fa4b0151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4affff640 1 -- 172.21.15.22:0/2502784152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0009b30 con 0x7fa4b00d14a0 2023-11-24T06:14:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4b4ea4640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b00b1650 0x7fa4b0151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4b56a5640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b015d5b0 0x7fa4b015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4affff640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b00d14a0 0x7fa4b015f9e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400c410 tx=0x7fa4a400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4ad7fa640 1 -- 172.21.15.22:0/2502784152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40035f0 con 0x7fa4b00d14a0 2023-11-24T06:14:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4ad7fa640 1 -- 172.21.15.22:0/2502784152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4003750 con 0x7fa4b00d14a0 2023-11-24T06:14:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b01593d0 con 0x7fa4b00d14a0 2023-11-24T06:14:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.341+0000 7fa4ad7fa640 1 -- 172.21.15.22:0/2502784152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4003b40 con 0x7fa4b00d14a0 2023-11-24T06:14:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.342+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b0159990 con 0x7fa4b00d14a0 2023-11-24T06:14:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.343+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b00cd530 con 0x7fa4b00d14a0 2023-11-24T06:14:25.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.344+0000 7fa4ad7fa640 1 -- 172.21.15.22:0/2502784152 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa4a4003ca0 con 0x7fa4b00d14a0 2023-11-24T06:14:25.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.345+0000 7fa4ad7fa640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa49c06aff0 0x7fa49c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.345+0000 7fa4ad7fa640 1 -- 172.21.15.22:0/2502784152 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4a4088f20 con 0x7fa4b00d14a0 2023-11-24T06:14:25.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.345+0000 7fa4b4ea4640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa49c06aff0 0x7fa49c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.346+0000 7fa4b4ea4640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa49c06aff0 0x7fa49c06d4b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0035000 tx=0x7fa4a0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.349+0000 7fa4ad7fa640 1 -- 172.21.15.22:0/2502784152 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4a4053de0 con 0x7fa4b00d14a0 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.540+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4b006b090 con 0x7fa49c06aff0 2023-11-24T06:14:25.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.563+0000 7fa4ad7fa640 1 -- 172.21.15.22:0/2502784152 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286724 (secure 0 0 0) 0x7fa4b006b090 con 0x7fa49c06aff0 2023-11-24T06:14:25.571 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:25.572 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:14:25.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa49c06aff0 msgr2=0x7fa49c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa49c06aff0 0x7fa49c06d4b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0035000 tx=0x7fa4a0030000 comp rx=0 tx=0).stop 2023-11-24T06:14:25.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b00d14a0 msgr2=0x7fa4b015f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b00d14a0 0x7fa4b015f9e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400c410 tx=0x7fa4a400c8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 shutdown_connections 2023-11-24T06:14:25.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa49c06aff0 0x7fa49c06d4b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa4b015d5b0 0x7fa4b015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4b00d14a0 0x7fa4b015f9e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 --2- 172.21.15.22:0/2502784152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b00b1650 0x7fa4b0151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.570+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 >> 172.21.15.22:0/2502784152 conn(0x7fa4b009c3b0 msgr2=0x7fa4b00d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:25.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.571+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 shutdown_connections 2023-11-24T06:14:25.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.571+0000 7fa4b5ea6640 1 -- 172.21.15.22:0/2502784152 wait complete. 2023-11-24T06:14:25.595 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2023-11-24T06:14:24.692451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238324,"kb_used_data":5480,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736396,"statfs":{"total":773094113280,"available":772850069504,"internally_reserved":0,"allocated":5611520,"data_stored":2948076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.267719"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434757+0000","last_change":"2023-11-24T06:14:15.465175+0000","last_active":"2023-11-24T06:14:16.434757+0000","last_peered":"2023-11-24T06:14:16.434757+0000","last_clean":"2023-11-24T06:14:16.434757+0000","last_became_active":"2023-11-24T06:14:15.456393+0000","last_became_peered":"2023-11-24T06:14:15.456393+0000","last_unstale":"2023-11-24T06:14:16.434757+0000","last_undegraded":"2023-11-24T06:14:16.434757+0000","last_fullsized":"2023-11-24T06:14:16.434757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:51:37.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.432702+0000","last_change":"2023-11-24T06:14:15.472506+0000","last_active":"2023-11-24T06:14:16.432702+0000","last_peered":"2023-11-24T06:14:16.432702+0000","last_clean":"2023-11-24T06:14:16.432702+0000","last_became_active":"2023-11-24T06:14:15.472169+0000","last_became_peered":"2023-11-24T06:14:15.472169+0000","last_unstale":"2023-11-24T06:14:16.432702+0000","last_undegraded":"2023-11-24T06:14:16.432702+0000","last_fullsized":"2023-11-24T06:14:16.432702+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530835+0000","last_change":"2023-11-24T06:14:15.463311+0000","last_active":"2023-11-24T06:14:16.530835+0000","last_peered":"2023-11-24T06:14:16.530835+0000","last_clean":"2023-11-24T06:14:16.530835+0000","last_became_active":"2023-11-24T06:14:15.462897+0000","last_became_peered":"2023-11-24T06:14:15.462897+0000","last_unstale":"2023-11-24T06:14:16.530835+0000","last_undegraded":"2023-11-24T06:14:16.530835+0000","last_fullsized":"2023-11-24T06:14:16.530835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:05.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529563+0000","last_change":"2023-11-24T06:14:15.462467+0000","last_active":"2023-11-24T06:14:16.529563+0000","last_peered":"2023-11-24T06:14:16.529563+0000","last_clean":"2023-11-24T06:14:16.529563+0000","last_became_active":"2023-11-24T06:14:15.461274+0000","last_became_peered":"2023-11-24T06:14:15.461274+0000","last_unstale":"2023-11-24T06:14:16.529563+0000","last_undegraded":"2023-11-24T06:14:16.529563+0000","last_fullsized":"2023-11-24T06:14:16.529563+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.431852+0000","last_change":"2023-11-24T06:14:15.468322+0000","last_active":"2023-11-24T06:14:16.431852+0000","last_peered":"2023-11-24T06:14:16.431852+0000","last_clean":"2023-11-24T06:14:16.431852+0000","last_became_active":"2023-11-24T06:14:15.467944+0000","last_became_peered":"2023-11-24T06:14:15.467944+0000","last_unstale":"2023-11-24T06:14:16.431852+0000","last_undegraded":"2023-11-24T06:14:16.431852+0000","last_fullsized":"2023-11-24T06:14:16.431852+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:05.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429496+0000","last_change":"2023-11-24T06:14:15.456762+0000","last_active":"2023-11-24T06:14:16.429496+0000","last_peered":"2023-11-24T06:14:16.429496+0000","last_clean":"2023-11-24T06:14:16.429496+0000","last_became_active":"2023-11-24T06:14:15.456470+0000","last_became_peered":"2023-11-24T06:14:15.456470+0000","last_unstale":"2023-11-24T06:14:16.429496+0000","last_undegraded":"2023-11-24T06:14:16.429496+0000","last_fullsized":"2023-11-24T06:14:16.429496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:14:21.955170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.433700+0000","last_change":"2023-11-24T06:14:15.452856+0000","last_active":"2023-11-24T06:14:16.433700+0000","last_peered":"2023-11-24T06:14:16.433700+0000","last_clean":"2023-11-24T06:14:16.433700+0000","last_became_active":"2023-11-24T06:14:15.452566+0000","last_became_peered":"2023-11-24T06:14:15.452566+0000","last_unstale":"2023-11-24T06:14:16.433700+0000","last_undegraded":"2023-11-24T06:14:16.433700+0000","last_fullsized":"2023-11-24T06:14:16.433700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529445+0000","last_change":"2023-11-24T06:14:15.460643+0000","last_active":"2023-11-24T06:14:16.529445+0000","last_peered":"2023-11-24T06:14:16.529445+0000","last_clean":"2023-11-24T06:14:16.529445+0000","last_became_active":"2023-11-24T06:14:15.460185+0000","last_became_peered":"2023-11-24T06:14:15.460185+0000","last_unstale":"2023-11-24T06:14:16.529445+0000","last_undegraded":"2023-11-24T06:14:16.529445+0000","last_fullsized":"2023-11-24T06:14:16.529445+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530188+0000","last_change":"2023-11-24T06:14:15.463163+0000","last_active":"2023-11-24T06:14:16.530188+0000","last_peered":"2023-11-24T06:14:16.530188+0000","last_clean":"2023-11-24T06:14:16.530188+0000","last_became_active":"2023-11-24T06:14:15.460198+0000","last_became_peered":"2023-11-24T06:14:15.460198+0000","last_unstale":"2023-11-24T06:14:16.530188+0000","last_undegraded":"2023-11-24T06:14:16.530188+0000","last_fullsized":"2023-11-24T06:14:16.530188+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:35.312894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530702+0000","last_change":"2023-11-24T06:14:15.467076+0000","last_active":"2023-11-24T06:14:16.530702+0000","last_peered":"2023-11-24T06:14:16.530702+0000","last_clean":"2023-11-24T06:14:16.530702+0000","last_became_active":"2023-11-24T06:14:15.461068+0000","last_became_peered":"2023-11-24T06:14:15.461068+0000","last_unstale":"2023-11-24T06:14:16.530702+0000","last_undegraded":"2023-11-24T06:14:16.530702+0000","last_fullsized":"2023-11-24T06:14:16.530702+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:52:19.253662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530413+0000","last_change":"2023-11-24T06:14:15.460243+0000","last_active":"2023-11-24T06:14:16.530413+0000","last_peered":"2023-11-24T06:14:16.530413+0000","last_clean":"2023-11-24T06:14:16.530413+0000","last_became_active":"2023-11-24T06:14:15.459889+0000","last_became_peered":"2023-11-24T06:14:15.459889+0000","last_unstale":"2023-11-24T06:14:16.530413+0000","last_undegraded":"2023-11-24T06:14:16.530413+0000","last_fullsized":"2023-11-24T06:14:16.530413+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:14.283905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.431869+0000","last_change":"2023-11-24T06:14:15.465076+0000","last_active":"2023-11-24T06:14:16.431869+0000","last_peered":"2023-11-24T06:14:16.431869+0000","last_clean":"2023-11-24T06:14:16.431869+0000","last_became_active":"2023-11-24T06:14:15.464088+0000","last_became_peered":"2023-11-24T06:14:15.464088+0000","last_unstale":"2023-11-24T06:14:16.431869+0000","last_undegraded":"2023-11-24T06:14:16.431869+0000","last_fullsized":"2023-11-24T06:14:16.431869+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533093+0000","last_change":"2023-11-24T06:14:15.456309+0000","last_active":"2023-11-24T06:14:16.533093+0000","last_peered":"2023-11-24T06:14:16.533093+0000","last_clean":"2023-11-24T06:14:16.533093+0000","last_became_active":"2023-11-24T06:14:15.455170+0000","last_became_peered":"2023-11-24T06:14:15.455170+0000","last_unstale":"2023-11-24T06:14:16.533093+0000","last_undegraded":"2023-11-24T06:14:16.533093+0000","last_fullsized":"2023-11-24T06:14:16.533093+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:03:53.101315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529426+0000","last_change":"2023-11-24T06:14:15.453814+0000","last_active":"2023-11-24T06:14:16.529426+0000","last_peered":"2023-11-24T06:14:16.529426+0000","last_clean":"2023-11-24T06:14:16.529426+0000","last_became_active":"2023-11-24T06:14:15.453548+0000","last_became_peered":"2023-11-24T06:14:15.453548+0000","last_unstale":"2023-11-24T06:14:16.529426+0000","last_undegraded":"2023-11-24T06:14:16.529426+0000","last_fullsized":"2023-11-24T06:14:16.529426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:05.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429590+0000","last_change":"2023-11-24T06:14:15.468734+0000","last_active":"2023-11-24T06:14:16.429590+0000","last_peered":"2023-11-24T06:14:16.429590+0000","last_clean":"2023-11-24T06:14:16.429590+0000","last_became_active":"2023-11-24T06:14:15.464022+0000","last_became_peered":"2023-11-24T06:14:15.464022+0000","last_unstale":"2023-11-24T06:14:16.429590+0000","last_undegraded":"2023-11-24T06:14:16.429590+0000","last_fullsized":"2023-11-24T06:14:16.429590+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:14.174404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531753+0000","last_change":"2023-11-24T06:14:15.454355+0000","last_active":"2023-11-24T06:14:16.531753+0000","last_peered":"2023-11-24T06:14:16.531753+0000","last_clean":"2023-11-24T06:14:16.531753+0000","last_became_active":"2023-11-24T06:14:15.453954+0000","last_became_peered":"2023-11-24T06:14:15.453954+0000","last_unstale":"2023-11-24T06:14:16.531753+0000","last_undegraded":"2023-11-24T06:14:16.531753+0000","last_fullsized":"2023-11-24T06:14:16.531753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:12.924610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531191+0000","last_change":"2023-11-24T06:14:15.455909+0000","last_active":"2023-11-24T06:14:16.531191+0000","last_peered":"2023-11-24T06:14:16.531191+0000","last_clean":"2023-11-24T06:14:16.531191+0000","last_became_active":"2023-11-24T06:14:15.455600+0000","last_became_peered":"2023-11-24T06:14:15.455600+0000","last_unstale":"2023-11-24T06:14:16.531191+0000","last_undegraded":"2023-11-24T06:14:16.531191+0000","last_fullsized":"2023-11-24T06:14:16.531191+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:09.413963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531653+0000","last_change":"2023-11-24T06:14:15.464787+0000","last_active":"2023-11-24T06:14:16.531653+0000","last_peered":"2023-11-24T06:14:16.531653+0000","last_clean":"2023-11-24T06:14:16.531653+0000","last_became_active":"2023-11-24T06:14:15.464041+0000","last_became_peered":"2023-11-24T06:14:15.464041+0000","last_unstale":"2023-11-24T06:14:16.531653+0000","last_undegraded":"2023-11-24T06:14:16.531653+0000","last_fullsized":"2023-11-24T06:14:16.531653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533559+0000","last_change":"2023-11-24T06:14:15.463515+0000","last_active":"2023-11-24T06:14:16.533559+0000","last_peered":"2023-11-24T06:14:16.533559+0000","last_clean":"2023-11-24T06:14:16.533559+0000","last_became_active":"2023-11-24T06:14:15.463112+0000","last_became_peered":"2023-11-24T06:14:15.463112+0000","last_unstale":"2023-11-24T06:14:16.533559+0000","last_undegraded":"2023-11-24T06:14:16.533559+0000","last_fullsized":"2023-11-24T06:14:16.533559+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:37.937358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533282+0000","last_change":"2023-11-24T06:14:15.470585+0000","last_active":"2023-11-24T06:14:16.533282+0000","last_peered":"2023-11-24T06:14:16.533282+0000","last_clean":"2023-11-24T06:14:16.533282+0000","last_became_active":"2023-11-24T06:14:15.470285+0000","last_became_peered":"2023-11-24T06:14:15.470285+0000","last_unstale":"2023-11-24T06:14:16.533282+0000","last_undegraded":"2023-11-24T06:14:16.533282+0000","last_fullsized":"2023-11-24T06:14:16.533282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:19.397131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429764+0000","last_change":"2023-11-24T06:14:15.462713+0000","last_active":"2023-11-24T06:14:16.429764+0000","last_peered":"2023-11-24T06:14:16.429764+0000","last_clean":"2023-11-24T06:14:16.429764+0000","last_became_active":"2023-11-24T06:14:15.459623+0000","last_became_peered":"2023-11-24T06:14:15.459623+0000","last_unstale":"2023-11-24T06:14:16.429764+0000","last_undegraded":"2023-11-24T06:14:16.429764+0000","last_fullsized":"2023-11-24T06:14:16.429764+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:12.189277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529423+0000","last_change":"2023-11-24T06:14:15.454971+0000","last_active":"2023-11-24T06:14:16.529423+0000","last_peered":"2023-11-24T06:14:16.529423+0000","last_clean":"2023-11-24T06:14:16.529423+0000","last_became_active":"2023-11-24T06:14:15.454687+0000","last_became_peered":"2023-11-24T06:14:15.454687+0000","last_unstale":"2023-11-24T06:14:16.529423+0000","last_undegraded":"2023-11-24T06:14:16.529423+0000","last_fullsized":"2023-11-24T06:14:16.529423+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:20.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531689+0000","last_change":"2023-11-24T06:14:15.452875+0000","last_active":"2023-11-24T06:14:16.531689+0000","last_peered":"2023-11-24T06:14:16.531689+0000","last_clean":"2023-11-24T06:14:16.531689+0000","last_became_active":"2023-11-24T06:14:15.452533+0000","last_became_peered":"2023-11-24T06:14:15.452533+0000","last_unstale":"2023-11-24T06:14:16.531689+0000","last_undegraded":"2023-11-24T06:14:16.531689+0000","last_fullsized":"2023-11-24T06:14:16.531689+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:09.589303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532073+0000","last_change":"2023-11-24T06:14:15.451547+0000","last_active":"2023-11-24T06:14:16.532073+0000","last_peered":"2023-11-24T06:14:16.532073+0000","last_clean":"2023-11-24T06:14:16.532073+0000","last_became_active":"2023-11-24T06:14:15.450548+0000","last_became_peered":"2023-11-24T06:14:15.450548+0000","last_unstale":"2023-11-24T06:14:16.532073+0000","last_undegraded":"2023-11-24T06:14:16.532073+0000","last_fullsized":"2023-11-24T06:14:16.532073+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:50.556446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533197+0000","last_change":"2023-11-24T06:14:15.448866+0000","last_active":"2023-11-24T06:14:16.533197+0000","last_peered":"2023-11-24T06:14:16.533197+0000","last_clean":"2023-11-24T06:14:16.533197+0000","last_became_active":"2023-11-24T06:14:15.448583+0000","last_became_peered":"2023-11-24T06:14:15.448583+0000","last_unstale":"2023-11-24T06:14:16.533197+0000","last_undegraded":"2023-11-24T06:14:16.533197+0000","last_fullsized":"2023-11-24T06:14:16.533197+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:16.470025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533280+0000","last_change":"2023-11-24T06:14:15.459471+0000","last_active":"2023-11-24T06:14:16.533280+0000","last_peered":"2023-11-24T06:14:16.533280+0000","last_clean":"2023-11-24T06:14:16.533280+0000","last_became_active":"2023-11-24T06:14:15.459183+0000","last_became_peered":"2023-11-24T06:14:15.459183+0000","last_unstale":"2023-11-24T06:14:16.533280+0000","last_undegraded":"2023-11-24T06:14:16.533280+0000","last_fullsized":"2023-11-24T06:14:16.533280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:07:40.373840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531283+0000","last_change":"2023-11-24T06:14:15.456470+0000","last_active":"2023-11-24T06:14:16.531283+0000","last_peered":"2023-11-24T06:14:16.531283+0000","last_clean":"2023-11-24T06:14:16.531283+0000","last_became_active":"2023-11-24T06:14:15.456166+0000","last_became_peered":"2023-11-24T06:14:15.456166+0000","last_unstale":"2023-11-24T06:14:16.531283+0000","last_undegraded":"2023-11-24T06:14:16.531283+0000","last_fullsized":"2023-11-24T06:14:16.531283+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.432298+0000","last_change":"2023-11-24T06:14:15.465252+0000","last_active":"2023-11-24T06:14:16.432298+0000","last_peered":"2023-11-24T06:14:16.432298+0000","last_clean":"2023-11-24T06:14:16.432298+0000","last_became_active":"2023-11-24T06:14:15.463585+0000","last_became_peered":"2023-11-24T06:14:15.463585+0000","last_unstale":"2023-11-24T06:14:16.432298+0000","last_undegraded":"2023-11-24T06:14:16.432298+0000","last_fullsized":"2023-11-24T06:14:16.432298+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532456+0000","last_change":"2023-11-24T06:14:15.448391+0000","last_active":"2023-11-24T06:14:16.532456+0000","last_peered":"2023-11-24T06:14:16.532456+0000","last_clean":"2023-11-24T06:14:16.532456+0000","last_became_active":"2023-11-24T06:14:15.448061+0000","last_became_peered":"2023-11-24T06:14:15.448061+0000","last_unstale":"2023-11-24T06:14:16.532456+0000","last_undegraded":"2023-11-24T06:14:16.532456+0000","last_fullsized":"2023-11-24T06:14:16.532456+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:52.793134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530580+0000","last_change":"2023-11-24T06:14:15.456760+0000","last_active":"2023-11-24T06:14:16.530580+0000","last_peered":"2023-11-24T06:14:16.530580+0000","last_clean":"2023-11-24T06:14:16.530580+0000","last_became_active":"2023-11-24T06:14:15.456438+0000","last_became_peered":"2023-11-24T06:14:15.456438+0000","last_unstale":"2023-11-24T06:14:16.530580+0000","last_undegraded":"2023-11-24T06:14:16.530580+0000","last_fullsized":"2023-11-24T06:14:16.530580+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:47.443002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429476+0000","last_change":"2023-11-24T06:14:15.465806+0000","last_active":"2023-11-24T06:14:16.429476+0000","last_peered":"2023-11-24T06:14:16.429476+0000","last_clean":"2023-11-24T06:14:16.429476+0000","last_became_active":"2023-11-24T06:14:15.464436+0000","last_became_peered":"2023-11-24T06:14:15.464436+0000","last_unstale":"2023-11-24T06:14:16.429476+0000","last_undegraded":"2023-11-24T06:14:16.429476+0000","last_fullsized":"2023-11-24T06:14:16.429476+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:51:28.140293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533344+0000","last_change":"2023-11-24T06:14:15.453814+0000","last_active":"2023-11-24T06:14:16.533344+0000","last_peered":"2023-11-24T06:14:16.533344+0000","last_clean":"2023-11-24T06:14:16.533344+0000","last_became_active":"2023-11-24T06:14:15.453484+0000","last_became_peered":"2023-11-24T06:14:15.453484+0000","last_unstale":"2023-11-24T06:14:16.533344+0000","last_undegraded":"2023-11-24T06:14:16.533344+0000","last_fullsized":"2023-11-24T06:14:16.533344+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:49:48.523158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531657+0000","last_change":"2023-11-24T06:14:15.461105+0000","last_active":"2023-11-24T06:14:16.531657+0000","last_peered":"2023-11-24T06:14:16.531657+0000","last_clean":"2023-11-24T06:14:16.531657+0000","last_became_active":"2023-11-24T06:14:15.458141+0000","last_became_peered":"2023-11-24T06:14:15.458141+0000","last_unstale":"2023-11-24T06:14:16.531657+0000","last_undegraded":"2023-11-24T06:14:16.531657+0000","last_fullsized":"2023-11-24T06:14:16.531657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:59.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.489180+0000","last_change":"2023-11-24T06:14:14.473536+0000","last_active":"2023-11-24T06:14:15.489180+0000","last_peered":"2023-11-24T06:14:15.489180+0000","last_clean":"2023-11-24T06:14:15.489180+0000","last_became_active":"2023-11-24T06:14:14.473231+0000","last_became_peered":"2023-11-24T06:14:14.473231+0000","last_unstale":"2023-11-24T06:14:15.489180+0000","last_undegraded":"2023-11-24T06:14:15.489180+0000","last_fullsized":"2023-11-24T06:14:15.489180+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:08.401655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533242+0000","last_change":"2023-11-24T06:14:15.460242+0000","last_active":"2023-11-24T06:14:16.533242+0000","last_peered":"2023-11-24T06:14:16.533242+0000","last_clean":"2023-11-24T06:14:16.533242+0000","last_became_active":"2023-11-24T06:14:15.459929+0000","last_became_peered":"2023-11-24T06:14:15.459929+0000","last_unstale":"2023-11-24T06:14:16.533242+0000","last_undegraded":"2023-11-24T06:14:16.533242+0000","last_fullsized":"2023-11-24T06:14:16.533242+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:10.921908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.487075+0000","last_change":"2023-11-24T06:14:14.475915+0000","last_active":"2023-11-24T06:14:15.487075+0000","last_peered":"2023-11-24T06:14:15.487075+0000","last_clean":"2023-11-24T06:14:15.487075+0000","last_became_active":"2023-11-24T06:14:14.475552+0000","last_became_peered":"2023-11-24T06:14:14.475552+0000","last_unstale":"2023-11-24T06:14:15.487075+0000","last_undegraded":"2023-11-24T06:14:15.487075+0000","last_fullsized":"2023-11-24T06:14:15.487075+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:09.909600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.432472+0000","last_change":"2023-11-24T06:14:15.461285+0000","last_active":"2023-11-24T06:14:16.432472+0000","last_peered":"2023-11-24T06:14:16.432472+0000","last_clean":"2023-11-24T06:14:16.432472+0000","last_became_active":"2023-11-24T06:14:15.460956+0000","last_became_peered":"2023-11-24T06:14:15.460956+0000","last_unstale":"2023-11-24T06:14:16.432472+0000","last_undegraded":"2023-11-24T06:14:16.432472+0000","last_fullsized":"2023-11-24T06:14:16.432472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532280+0000","last_change":"2023-11-24T06:14:14.466846+0000","last_active":"2023-11-24T06:14:16.532280+0000","last_peered":"2023-11-24T06:14:16.532280+0000","last_clean":"2023-11-24T06:14:16.532280+0000","last_became_active":"2023-11-24T06:14:14.466551+0000","last_became_peered":"2023-11-24T06:14:14.466551+0000","last_unstale":"2023-11-24T06:14:16.532280+0000","last_undegraded":"2023-11-24T06:14:16.532280+0000","last_fullsized":"2023-11-24T06:14:16.532280+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.012140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532216+0000","last_change":"2023-11-24T06:14:15.450388+0000","last_active":"2023-11-24T06:14:16.532216+0000","last_peered":"2023-11-24T06:14:16.532216+0000","last_clean":"2023-11-24T06:14:16.532216+0000","last_became_active":"2023-11-24T06:14:15.449506+0000","last_became_peered":"2023-11-24T06:14:15.449506+0000","last_unstale":"2023-11-24T06:14:16.532216+0000","last_undegraded":"2023-11-24T06:14:16.532216+0000","last_fullsized":"2023-11-24T06:14:16.532216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:42:24.194375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.487041+0000","last_change":"2023-11-24T06:14:14.474823+0000","last_active":"2023-11-24T06:14:15.487041+0000","last_peered":"2023-11-24T06:14:15.487041+0000","last_clean":"2023-11-24T06:14:15.487041+0000","last_became_active":"2023-11-24T06:14:14.474389+0000","last_became_peered":"2023-11-24T06:14:14.474389+0000","last_unstale":"2023-11-24T06:14:15.487041+0000","last_undegraded":"2023-11-24T06:14:15.487041+0000","last_fullsized":"2023-11-24T06:14:15.487041+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:15.457717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530708+0000","last_change":"2023-11-24T06:14:15.456489+0000","last_active":"2023-11-24T06:14:16.530708+0000","last_peered":"2023-11-24T06:14:16.530708+0000","last_clean":"2023-11-24T06:14:16.530708+0000","last_became_active":"2023-11-24T06:14:15.455546+0000","last_became_peered":"2023-11-24T06:14:15.455546+0000","last_unstale":"2023-11-24T06:14:16.530708+0000","last_undegraded":"2023-11-24T06:14:16.530708+0000","last_fullsized":"2023-11-24T06:14:16.530708+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:20.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.490426+0000","last_change":"2023-11-24T06:14:14.465504+0000","last_active":"2023-11-24T06:14:15.490426+0000","last_peered":"2023-11-24T06:14:15.490426+0000","last_clean":"2023-11-24T06:14:15.490426+0000","last_became_active":"2023-11-24T06:14:14.463218+0000","last_became_peered":"2023-11-24T06:14:14.463218+0000","last_unstale":"2023-11-24T06:14:15.490426+0000","last_undegraded":"2023-11-24T06:14:15.490426+0000","last_fullsized":"2023-11-24T06:14:15.490426+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:13.271597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529888+0000","last_change":"2023-11-24T06:14:15.466490+0000","last_active":"2023-11-24T06:14:16.529888+0000","last_peered":"2023-11-24T06:14:16.529888+0000","last_clean":"2023-11-24T06:14:16.529888+0000","last_became_active":"2023-11-24T06:14:15.466122+0000","last_became_peered":"2023-11-24T06:14:15.466122+0000","last_unstale":"2023-11-24T06:14:16.529888+0000","last_undegraded":"2023-11-24T06:14:16.529888+0000","last_fullsized":"2023-11-24T06:14:16.529888+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:51:37.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.483552+0000","last_change":"2023-11-24T06:14:14.473902+0000","last_active":"2023-11-24T06:14:15.483552+0000","last_peered":"2023-11-24T06:14:15.483552+0000","last_clean":"2023-11-24T06:14:15.483552+0000","last_became_active":"2023-11-24T06:14:14.472463+0000","last_became_peered":"2023-11-24T06:14:14.472463+0000","last_unstale":"2023-11-24T06:14:15.483552+0000","last_undegraded":"2023-11-24T06:14:15.483552+0000","last_fullsized":"2023-11-24T06:14:15.483552+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:36.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529824+0000","last_change":"2023-11-24T06:14:15.460430+0000","last_active":"2023-11-24T06:14:16.529824+0000","last_peered":"2023-11-24T06:14:16.529824+0000","last_clean":"2023-11-24T06:14:16.529824+0000","last_became_active":"2023-11-24T06:14:15.459760+0000","last_became_peered":"2023-11-24T06:14:15.459760+0000","last_unstale":"2023-11-24T06:14:16.529824+0000","last_undegraded":"2023-11-24T06:14:16.529824+0000","last_fullsized":"2023-11-24T06:14:16.529824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.446761+0000","last_change":"2023-11-24T06:14:14.463999+0000","last_active":"2023-11-24T06:14:15.446761+0000","last_peered":"2023-11-24T06:14:15.446761+0000","last_clean":"2023-11-24T06:14:15.446761+0000","last_became_active":"2023-11-24T06:14:14.463397+0000","last_became_peered":"2023-11-24T06:14:14.463397+0000","last_unstale":"2023-11-24T06:14:15.446761+0000","last_undegraded":"2023-11-24T06:14:15.446761+0000","last_fullsized":"2023-11-24T06:14:15.446761+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:58.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531694+0000","last_change":"2023-11-24T06:14:15.449308+0000","last_active":"2023-11-24T06:14:16.531694+0000","last_peered":"2023-11-24T06:14:16.531694+0000","last_clean":"2023-11-24T06:14:16.531694+0000","last_became_active":"2023-11-24T06:14:15.448927+0000","last_became_peered":"2023-11-24T06:14:15.448927+0000","last_unstale":"2023-11-24T06:14:16.531694+0000","last_undegraded":"2023-11-24T06:14:16.531694+0000","last_fullsized":"2023-11-24T06:14:16.531694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:42:11.964625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.448787+0000","last_change":"2023-11-24T06:14:14.460282+0000","last_active":"2023-11-24T06:14:15.448787+0000","last_peered":"2023-11-24T06:14:15.448787+0000","last_clean":"2023-11-24T06:14:15.448787+0000","last_became_active":"2023-11-24T06:14:14.459975+0000","last_became_peered":"2023-11-24T06:14:14.459975+0000","last_unstale":"2023-11-24T06:14:15.448787+0000","last_undegraded":"2023-11-24T06:14:15.448787+0000","last_fullsized":"2023-11-24T06:14:15.448787+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:32.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532001+0000","last_change":"2023-11-24T06:14:15.464334+0000","last_active":"2023-11-24T06:14:16.532001+0000","last_peered":"2023-11-24T06:14:16.532001+0000","last_clean":"2023-11-24T06:14:16.532001+0000","last_became_active":"2023-11-24T06:14:15.463320+0000","last_became_peered":"2023-11-24T06:14:15.463320+0000","last_unstale":"2023-11-24T06:14:16.532001+0000","last_undegraded":"2023-11-24T06:14:16.532001+0000","last_fullsized":"2023-11-24T06:14:16.532001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.446737+0000","last_change":"2023-11-24T06:14:14.470638+0000","last_active":"2023-11-24T06:14:15.446737+0000","last_peered":"2023-11-24T06:14:15.446737+0000","last_clean":"2023-11-24T06:14:15.446737+0000","last_became_active":"2023-11-24T06:14:14.470336+0000","last_became_peered":"2023-11-24T06:14:14.470336+0000","last_unstale":"2023-11-24T06:14:15.446737+0000","last_undegraded":"2023-11-24T06:14:15.446737+0000","last_fullsized":"2023-11-24T06:14:15.446737+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:18.219329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434855+0000","last_change":"2023-11-24T06:14:15.458205+0000","last_active":"2023-11-24T06:14:16.434855+0000","last_peered":"2023-11-24T06:14:16.434855+0000","last_clean":"2023-11-24T06:14:16.434855+0000","last_became_active":"2023-11-24T06:14:15.457862+0000","last_became_peered":"2023-11-24T06:14:15.457862+0000","last_unstale":"2023-11-24T06:14:16.434855+0000","last_undegraded":"2023-11-24T06:14:16.434855+0000","last_fullsized":"2023-11-24T06:14:16.434855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:35.312894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.448617+0000","last_change":"2023-11-24T06:14:14.470585+0000","last_active":"2023-11-24T06:14:15.448617+0000","last_peered":"2023-11-24T06:14:15.448617+0000","last_clean":"2023-11-24T06:14:15.448617+0000","last_became_active":"2023-11-24T06:14:14.470306+0000","last_became_peered":"2023-11-24T06:14:14.470306+0000","last_unstale":"2023-11-24T06:14:15.448617+0000","last_undegraded":"2023-11-24T06:14:15.448617+0000","last_fullsized":"2023-11-24T06:14:15.448617+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:36.925050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430984+0000","last_change":"2023-11-24T06:14:15.474018+0000","last_active":"2023-11-24T06:14:16.430984+0000","last_peered":"2023-11-24T06:14:16.430984+0000","last_clean":"2023-11-24T06:14:16.430984+0000","last_became_active":"2023-11-24T06:14:15.470825+0000","last_became_peered":"2023-11-24T06:14:15.470825+0000","last_unstale":"2023-11-24T06:14:16.430984+0000","last_undegraded":"2023-11-24T06:14:16.430984+0000","last_fullsized":"2023-11-24T06:14:16.430984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:55:02.888485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.488943+0000","last_change":"2023-11-24T06:14:14.476720+0000","last_active":"2023-11-24T06:14:15.488943+0000","last_peered":"2023-11-24T06:14:15.488943+0000","last_clean":"2023-11-24T06:14:15.488943+0000","last_became_active":"2023-11-24T06:14:14.476422+0000","last_became_peered":"2023-11-24T06:14:14.476422+0000","last_unstale":"2023-11-24T06:14:15.488943+0000","last_undegraded":"2023-11-24T06:14:15.488943+0000","last_fullsized":"2023-11-24T06:14:15.488943+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:46.430693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434479+0000","last_change":"2023-11-24T06:14:15.452920+0000","last_active":"2023-11-24T06:14:16.434479+0000","last_peered":"2023-11-24T06:14:16.434479+0000","last_clean":"2023-11-24T06:14:16.434479+0000","last_became_active":"2023-11-24T06:14:15.452489+0000","last_became_peered":"2023-11-24T06:14:15.452489+0000","last_unstale":"2023-11-24T06:14:16.434479+0000","last_undegraded":"2023-11-24T06:14:16.434479+0000","last_fullsized":"2023-11-24T06:14:16.434479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.492266+0000","last_change":"2023-11-24T06:14:14.469038+0000","last_active":"2023-11-24T06:14:15.492266+0000","last_peered":"2023-11-24T06:14:15.492266+0000","last_clean":"2023-11-24T06:14:15.492266+0000","last_became_active":"2023-11-24T06:14:14.468405+0000","last_became_peered":"2023-11-24T06:14:14.468405+0000","last_unstale":"2023-11-24T06:14:15.492266+0000","last_undegraded":"2023-11-24T06:14:15.492266+0000","last_fullsized":"2023-11-24T06:14:15.492266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:54.931363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532442+0000","last_change":"2023-11-24T06:14:15.462373+0000","last_active":"2023-11-24T06:14:16.532442+0000","last_peered":"2023-11-24T06:14:16.532442+0000","last_clean":"2023-11-24T06:14:16.532442+0000","last_became_active":"2023-11-24T06:14:15.462091+0000","last_became_peered":"2023-11-24T06:14:15.462091+0000","last_unstale":"2023-11-24T06:14:16.532442+0000","last_undegraded":"2023-11-24T06:14:16.532442+0000","last_fullsized":"2023-11-24T06:14:16.532442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:12.442248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.489253+0000","last_change":"2023-11-24T06:14:14.464231+0000","last_active":"2023-11-24T06:14:15.489253+0000","last_peered":"2023-11-24T06:14:15.489253+0000","last_clean":"2023-11-24T06:14:15.489253+0000","last_became_active":"2023-11-24T06:14:14.463983+0000","last_became_peered":"2023-11-24T06:14:14.463983+0000","last_unstale":"2023-11-24T06:14:15.489253+0000","last_undegraded":"2023-11-24T06:14:15.489253+0000","last_fullsized":"2023-11-24T06:14:15.489253+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:12.974527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530243+0000","last_change":"2023-11-24T06:14:15.456224+0000","last_active":"2023-11-24T06:14:16.530243+0000","last_peered":"2023-11-24T06:14:16.530243+0000","last_clean":"2023-11-24T06:14:16.530243+0000","last_became_active":"2023-11-24T06:14:15.455982+0000","last_became_peered":"2023-11-24T06:14:15.455982+0000","last_unstale":"2023-11-24T06:14:16.530243+0000","last_undegraded":"2023-11-24T06:14:16.530243+0000","last_fullsized":"2023-11-24T06:14:16.530243+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:32.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.435658+0000","last_change":"2023-11-24T06:14:14.464071+0000","last_active":"2023-11-24T06:14:15.435658+0000","last_peered":"2023-11-24T06:14:15.435658+0000","last_clean":"2023-11-24T06:14:15.435658+0000","last_became_active":"2023-11-24T06:14:14.463400+0000","last_became_peered":"2023-11-24T06:14:14.463400+0000","last_unstale":"2023-11-24T06:14:15.435658+0000","last_undegraded":"2023-11-24T06:14:15.435658+0000","last_fullsized":"2023-11-24T06:14:15.435658+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:18.219329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429208+0000","last_change":"2023-11-24T06:14:15.456873+0000","last_active":"2023-11-24T06:14:16.429208+0000","last_peered":"2023-11-24T06:14:16.429208+0000","last_clean":"2023-11-24T06:14:16.429208+0000","last_became_active":"2023-11-24T06:14:15.456605+0000","last_became_peered":"2023-11-24T06:14:15.456605+0000","last_unstale":"2023-11-24T06:14:16.429208+0000","last_undegraded":"2023-11-24T06:14:16.429208+0000","last_fullsized":"2023-11-24T06:14:16.429208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:19.012475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.452131+0000","last_change":"2023-11-24T06:14:14.465760+0000","last_active":"2023-11-24T06:14:15.452131+0000","last_peered":"2023-11-24T06:14:15.452131+0000","last_clean":"2023-11-24T06:14:15.452131+0000","last_became_active":"2023-11-24T06:14:14.464414+0000","last_became_peered":"2023-11-24T06:14:14.464414+0000","last_unstale":"2023-11-24T06:14:15.452131+0000","last_undegraded":"2023-11-24T06:14:15.452131+0000","last_fullsized":"2023-11-24T06:14:15.452131+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:23.405611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434057+0000","last_change":"2023-11-24T06:14:15.455901+0000","last_active":"2023-11-24T06:14:16.434057+0000","last_peered":"2023-11-24T06:14:16.434057+0000","last_clean":"2023-11-24T06:14:16.434057+0000","last_became_active":"2023-11-24T06:14:15.455543+0000","last_became_peered":"2023-11-24T06:14:15.455543+0000","last_unstale":"2023-11-24T06:14:16.434057+0000","last_undegraded":"2023-11-24T06:14:16.434057+0000","last_fullsized":"2023-11-24T06:14:16.434057+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.173043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.491888+0000","last_change":"2023-11-24T06:14:14.472295+0000","last_active":"2023-11-24T06:14:15.491888+0000","last_peered":"2023-11-24T06:14:15.491888+0000","last_clean":"2023-11-24T06:14:15.491888+0000","last_became_active":"2023-11-24T06:14:14.471955+0000","last_became_peered":"2023-11-24T06:14:14.471955+0000","last_unstale":"2023-11-24T06:14:15.491888+0000","last_undegraded":"2023-11-24T06:14:15.491888+0000","last_fullsized":"2023-11-24T06:14:15.491888+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:11.517836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533475+0000","last_change":"2023-11-24T06:14:15.455854+0000","last_active":"2023-11-24T06:14:16.533475+0000","last_peered":"2023-11-24T06:14:16.533475+0000","last_clean":"2023-11-24T06:14:16.533475+0000","last_became_active":"2023-11-24T06:14:15.454664+0000","last_became_peered":"2023-11-24T06:14:15.454664+0000","last_unstale":"2023-11-24T06:14:16.533475+0000","last_undegraded":"2023-11-24T06:14:16.533475+0000","last_fullsized":"2023-11-24T06:14:16.533475+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:29:40.126632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.487470+0000","last_change":"2023-11-24T06:14:14.462131+0000","last_active":"2023-11-24T06:14:15.487470+0000","last_peered":"2023-11-24T06:14:15.487470+0000","last_clean":"2023-11-24T06:14:15.487470+0000","last_became_active":"2023-11-24T06:14:14.461069+0000","last_became_peered":"2023-11-24T06:14:14.461069+0000","last_unstale":"2023-11-24T06:14:15.487470+0000","last_undegraded":"2023-11-24T06:14:15.487470+0000","last_fullsized":"2023-11-24T06:14:15.487470+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:10.311807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530452+0000","last_change":"2023-11-24T06:14:15.460541+0000","last_active":"2023-11-24T06:14:16.530452+0000","last_peered":"2023-11-24T06:14:16.530452+0000","last_clean":"2023-11-24T06:14:16.530452+0000","last_became_active":"2023-11-24T06:14:15.459802+0000","last_became_peered":"2023-11-24T06:14:15.459802+0000","last_unstale":"2023-11-24T06:14:16.530452+0000","last_undegraded":"2023-11-24T06:14:16.530452+0000","last_fullsized":"2023-11-24T06:14:16.530452+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:13.986835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.485770+0000","last_change":"2023-11-24T06:14:14.464681+0000","last_active":"2023-11-24T06:14:15.485770+0000","last_peered":"2023-11-24T06:14:15.485770+0000","last_clean":"2023-11-24T06:14:15.485770+0000","last_became_active":"2023-11-24T06:14:14.464313+0000","last_became_peered":"2023-11-24T06:14:14.464313+0000","last_unstale":"2023-11-24T06:14:15.485770+0000","last_undegraded":"2023-11-24T06:14:15.485770+0000","last_fullsized":"2023-11-24T06:14:15.485770+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:58.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532827+0000","last_change":"2023-11-24T06:14:15.458054+0000","last_active":"2023-11-24T06:14:16.532827+0000","last_peered":"2023-11-24T06:14:16.532827+0000","last_clean":"2023-11-24T06:14:16.532827+0000","last_became_active":"2023-11-24T06:14:15.457751+0000","last_became_peered":"2023-11-24T06:14:15.457751+0000","last_unstale":"2023-11-24T06:14:16.532827+0000","last_undegraded":"2023-11-24T06:14:16.532827+0000","last_fullsized":"2023-11-24T06:14:16.532827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:53:19.231637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.486965+0000","last_change":"2023-11-24T06:14:14.465038+0000","last_active":"2023-11-24T06:14:15.486965+0000","last_peered":"2023-11-24T06:14:15.486965+0000","last_clean":"2023-11-24T06:14:15.486965+0000","last_became_active":"2023-11-24T06:14:14.464681+0000","last_became_peered":"2023-11-24T06:14:14.464681+0000","last_unstale":"2023-11-24T06:14:15.486965+0000","last_undegraded":"2023-11-24T06:14:15.486965+0000","last_fullsized":"2023-11-24T06:14:15.486965+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:15.457717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533282+0000","last_change":"2023-11-24T06:14:15.449256+0000","last_active":"2023-11-24T06:14:16.533282+0000","last_peered":"2023-11-24T06:14:16.533282+0000","last_clean":"2023-11-24T06:14:16.533282+0000","last_became_active":"2023-11-24T06:14:15.448893+0000","last_became_peered":"2023-11-24T06:14:15.448893+0000","last_unstale":"2023-11-24T06:14:16.533282+0000","last_undegraded":"2023-11-24T06:14:16.533282+0000","last_fullsized":"2023-11-24T06:14:16.533282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:59.774563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.437522+0000","last_change":"2023-11-24T06:14:14.469950+0000","last_active":"2023-11-24T06:14:15.437522+0000","last_peered":"2023-11-24T06:14:15.437522+0000","last_clean":"2023-11-24T06:14:15.437522+0000","last_became_active":"2023-11-24T06:14:14.469326+0000","last_became_peered":"2023-11-24T06:14:14.469326+0000","last_unstale":"2023-11-24T06:14:15.437522+0000","last_undegraded":"2023-11-24T06:14:15.437522+0000","last_fullsized":"2023-11-24T06:14:15.437522+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:04.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429593+0000","last_change":"2023-11-24T06:14:15.460954+0000","last_active":"2023-11-24T06:14:16.429593+0000","last_peered":"2023-11-24T06:14:16.429593+0000","last_clean":"2023-11-24T06:14:16.429593+0000","last_became_active":"2023-11-24T06:14:15.460182+0000","last_became_peered":"2023-11-24T06:14:15.460182+0000","last_unstale":"2023-11-24T06:14:16.429593+0000","last_undegraded":"2023-11-24T06:14:16.429593+0000","last_fullsized":"2023-11-24T06:14:16.429593+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:26.637529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.490554+0000","last_change":"2023-11-24T06:14:14.467845+0000","last_active":"2023-11-24T06:14:15.490554+0000","last_peered":"2023-11-24T06:14:15.490554+0000","last_clean":"2023-11-24T06:14:15.490554+0000","last_became_active":"2023-11-24T06:14:14.467516+0000","last_became_peered":"2023-11-24T06:14:14.467516+0000","last_unstale":"2023-11-24T06:14:15.490554+0000","last_undegraded":"2023-11-24T06:14:15.490554+0000","last_fullsized":"2023-11-24T06:14:15.490554+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:57.706334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532105+0000","last_change":"2023-11-24T06:14:15.458585+0000","last_active":"2023-11-24T06:14:16.532105+0000","last_peered":"2023-11-24T06:14:16.532105+0000","last_clean":"2023-11-24T06:14:16.532105+0000","last_became_active":"2023-11-24T06:14:15.458306+0000","last_became_peered":"2023-11-24T06:14:15.458306+0000","last_unstale":"2023-11-24T06:14:16.532105+0000","last_undegraded":"2023-11-24T06:14:16.532105+0000","last_fullsized":"2023-11-24T06:14:16.532105+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:30:16.259583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.443880+0000","last_change":"2023-11-24T06:14:14.471004+0000","last_active":"2023-11-24T06:14:15.443880+0000","last_peered":"2023-11-24T06:14:15.443880+0000","last_clean":"2023-11-24T06:14:15.443880+0000","last_became_active":"2023-11-24T06:14:14.470708+0000","last_became_peered":"2023-11-24T06:14:14.470708+0000","last_unstale":"2023-11-24T06:14:15.443880+0000","last_undegraded":"2023-11-24T06:14:15.443880+0000","last_fullsized":"2023-11-24T06:14:15.443880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:49.544138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533628+0000","last_change":"2023-11-24T06:14:15.454754+0000","last_active":"2023-11-24T06:14:16.533628+0000","last_peered":"2023-11-24T06:14:16.533628+0000","last_clean":"2023-11-24T06:14:16.533628+0000","last_became_active":"2023-11-24T06:14:15.454082+0000","last_became_peered":"2023-11-24T06:14:15.454082+0000","last_unstale":"2023-11-24T06:14:16.533628+0000","last_undegraded":"2023-11-24T06:14:16.533628+0000","last_fullsized":"2023-11-24T06:14:16.533628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:14.186208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.448123+0000","last_change":"2023-11-24T06:14:14.471817+0000","last_active":"2023-11-24T06:14:15.448123+0000","last_peered":"2023-11-24T06:14:15.448123+0000","last_clean":"2023-11-24T06:14:15.448123+0000","last_became_active":"2023-11-24T06:14:14.470909+0000","last_became_peered":"2023-11-24T06:14:14.470909+0000","last_unstale":"2023-11-24T06:14:15.448123+0000","last_undegraded":"2023-11-24T06:14:15.448123+0000","last_fullsized":"2023-11-24T06:14:15.448123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:58.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530663+0000","last_change":"2023-11-24T06:14:15.464586+0000","last_active":"2023-11-24T06:14:16.530663+0000","last_peered":"2023-11-24T06:14:16.530663+0000","last_clean":"2023-11-24T06:14:16.530663+0000","last_became_active":"2023-11-24T06:14:15.464224+0000","last_became_peered":"2023-11-24T06:14:15.464224+0000","last_unstale":"2023-11-24T06:14:16.530663+0000","last_undegraded":"2023-11-24T06:14:16.530663+0000","last_fullsized":"2023-11-24T06:14:16.530663+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:58.718642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.434682+0000","last_change":"2023-11-24T06:14:14.463684+0000","last_active":"2023-11-24T06:14:15.434682+0000","last_peered":"2023-11-24T06:14:15.434682+0000","last_clean":"2023-11-24T06:14:15.434682+0000","last_became_active":"2023-11-24T06:14:14.463242+0000","last_became_peered":"2023-11-24T06:14:14.463242+0000","last_unstale":"2023-11-24T06:14:15.434682+0000","last_undegraded":"2023-11-24T06:14:15.434682+0000","last_fullsized":"2023-11-24T06:14:15.434682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:51.780825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.533621+0000","last_change":"2023-11-24T06:14:15.464805+0000","last_active":"2023-11-24T06:14:16.533621+0000","last_peered":"2023-11-24T06:14:16.533621+0000","last_clean":"2023-11-24T06:14:16.533621+0000","last_became_active":"2023-11-24T06:14:15.464463+0000","last_became_peered":"2023-11-24T06:14:15.464463+0000","last_unstale":"2023-11-24T06:14:16.533621+0000","last_undegraded":"2023-11-24T06:14:16.533621+0000","last_fullsized":"2023-11-24T06:14:16.533621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:33.873807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430231+0000","last_change":"2023-11-24T06:14:14.469820+0000","last_active":"2023-11-24T06:14:16.430231+0000","last_peered":"2023-11-24T06:14:16.430231+0000","last_clean":"2023-11-24T06:14:16.430231+0000","last_became_active":"2023-11-24T06:14:14.469514+0000","last_became_peered":"2023-11-24T06:14:14.469514+0000","last_unstale":"2023-11-24T06:14:16.430231+0000","last_undegraded":"2023-11-24T06:14:16.430231+0000","last_fullsized":"2023-11-24T06:14:16.430231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:52:18.241353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.529839+0000","last_change":"2023-11-24T06:14:15.457988+0000","last_active":"2023-11-24T06:14:16.529839+0000","last_peered":"2023-11-24T06:14:16.529839+0000","last_clean":"2023-11-24T06:14:16.529839+0000","last_became_active":"2023-11-24T06:14:15.457669+0000","last_became_peered":"2023-11-24T06:14:15.457669+0000","last_unstale":"2023-11-24T06:14:16.529839+0000","last_undegraded":"2023-11-24T06:14:16.529839+0000","last_fullsized":"2023-11-24T06:14:16.529839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:23:51.255920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.439681+0000","last_change":"2023-11-24T06:14:14.476090+0000","last_active":"2023-11-24T06:14:15.439681+0000","last_peered":"2023-11-24T06:14:15.439681+0000","last_clean":"2023-11-24T06:14:15.439681+0000","last_became_active":"2023-11-24T06:14:14.475761+0000","last_became_peered":"2023-11-24T06:14:14.475761+0000","last_unstale":"2023-11-24T06:14:15.439681+0000","last_undegraded":"2023-11-24T06:14:15.439681+0000","last_fullsized":"2023-11-24T06:14:15.439681+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:19.629827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.434442+0000","last_change":"2023-11-24T06:14:15.460998+0000","last_active":"2023-11-24T06:14:16.434442+0000","last_peered":"2023-11-24T06:14:16.434442+0000","last_clean":"2023-11-24T06:14:16.434442+0000","last_became_active":"2023-11-24T06:14:15.460663+0000","last_became_peered":"2023-11-24T06:14:15.460663+0000","last_unstale":"2023-11-24T06:14:16.434442+0000","last_undegraded":"2023-11-24T06:14:16.434442+0000","last_fullsized":"2023-11-24T06:14:16.434442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:55.739010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531561+0000","last_change":"2023-11-24T06:14:14.470448+0000","last_active":"2023-11-24T06:14:16.531561+0000","last_peered":"2023-11-24T06:14:16.531561+0000","last_clean":"2023-11-24T06:14:16.531561+0000","last_became_active":"2023-11-24T06:14:14.470152+0000","last_became_peered":"2023-11-24T06:14:14.470152+0000","last_unstale":"2023-11-24T06:14:16.531561+0000","last_undegraded":"2023-11-24T06:14:16.531561+0000","last_fullsized":"2023-11-24T06:14:16.531561+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:00:56.852959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.429694+0000","last_change":"2023-11-24T06:14:15.467003+0000","last_active":"2023-11-24T06:14:16.429694+0000","last_peered":"2023-11-24T06:14:16.429694+0000","last_clean":"2023-11-24T06:14:16.429694+0000","last_became_active":"2023-11-24T06:14:15.466684+0000","last_became_peered":"2023-11-24T06:14:15.466684+0000","last_unstale":"2023-11-24T06:14:16.429694+0000","last_undegraded":"2023-11-24T06:14:16.429694+0000","last_fullsized":"2023-11-24T06:14:16.429694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:15:58.084222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.437948+0000","last_change":"2023-11-24T06:14:14.474412+0000","last_active":"2023-11-24T06:14:15.437948+0000","last_peered":"2023-11-24T06:14:15.437948+0000","last_clean":"2023-11-24T06:14:15.437948+0000","last_became_active":"2023-11-24T06:14:14.472912+0000","last_became_peered":"2023-11-24T06:14:14.472912+0000","last_unstale":"2023-11-24T06:14:15.437948+0000","last_undegraded":"2023-11-24T06:14:15.437948+0000","last_fullsized":"2023-11-24T06:14:15.437948+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:32.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430062+0000","last_change":"2023-11-24T06:14:15.463478+0000","last_active":"2023-11-24T06:14:16.430062+0000","last_peered":"2023-11-24T06:14:16.430062+0000","last_clean":"2023-11-24T06:14:16.430062+0000","last_became_active":"2023-11-24T06:14:15.463171+0000","last_became_peered":"2023-11-24T06:14:15.463171+0000","last_unstale":"2023-11-24T06:14:16.430062+0000","last_undegraded":"2023-11-24T06:14:16.430062+0000","last_fullsized":"2023-11-24T06:14:16.430062+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:52:05.003288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.447990+0000","last_change":"2023-11-24T06:14:14.469336+0000","last_active":"2023-11-24T06:14:15.447990+0000","last_peered":"2023-11-24T06:14:15.447990+0000","last_clean":"2023-11-24T06:14:15.447990+0000","last_became_active":"2023-11-24T06:14:14.468897+0000","last_became_peered":"2023-11-24T06:14:14.468897+0000","last_unstale":"2023-11-24T06:14:15.447990+0000","last_undegraded":"2023-11-24T06:14:15.447990+0000","last_fullsized":"2023-11-24T06:14:15.447990+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:48:32.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.430864+0000","last_change":"2023-11-24T06:14:15.454276+0000","last_active":"2023-11-24T06:14:16.430864+0000","last_peered":"2023-11-24T06:14:16.430864+0000","last_clean":"2023-11-24T06:14:16.430864+0000","last_became_active":"2023-11-24T06:14:15.453961+0000","last_became_peered":"2023-11-24T06:14:15.453961+0000","last_unstale":"2023-11-24T06:14:16.430864+0000","last_undegraded":"2023-11-24T06:14:16.430864+0000","last_fullsized":"2023-11-24T06:14:16.430864+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:20.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.532235+0000","last_change":"2023-11-24T06:14:14.469167+0000","last_active":"2023-11-24T06:14:16.532235+0000","last_peered":"2023-11-24T06:14:16.532235+0000","last_clean":"2023-11-24T06:14:16.532235+0000","last_became_active":"2023-11-24T06:14:14.468800+0000","last_became_peered":"2023-11-24T06:14:14.468800+0000","last_unstale":"2023-11-24T06:14:16.532235+0000","last_undegraded":"2023-11-24T06:14:16.532235+0000","last_fullsized":"2023-11-24T06:14:16.532235+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:05.447900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.530384+0000","last_change":"2023-11-24T06:14:15.459400+0000","last_active":"2023-11-24T06:14:16.530384+0000","last_peered":"2023-11-24T06:14:16.530384+0000","last_clean":"2023-11-24T06:14:16.530384+0000","last_became_active":"2023-11-24T06:14:15.458546+0000","last_became_peered":"2023-11-24T06:14:15.458546+0000","last_unstale":"2023-11-24T06:14:16.530384+0000","last_undegraded":"2023-11-24T06:14:16.530384+0000","last_fullsized":"2023-11-24T06:14:16.530384+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:12.530144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.449106+0000","last_change":"2023-11-24T06:14:14.462523+0000","last_active":"2023-11-24T06:14:15.449106+0000","last_peered":"2023-11-24T06:14:15.449106+0000","last_clean":"2023-11-24T06:14:15.449106+0000","last_became_active":"2023-11-24T06:14:14.461882+0000","last_became_peered":"2023-11-24T06:14:14.461882+0000","last_unstale":"2023-11-24T06:14:15.449106+0000","last_undegraded":"2023-11-24T06:14:15.449106+0000","last_fullsized":"2023-11-24T06:14:15.449106+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:25:46.430693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T06:14:16.531032+0000","last_change":"2023-11-24T06:14:15.460794+0000","last_active":"2023-11-24T06:14:16.531032+0000","last_peered":"2023-11-24T06:14:16.531032+0000","last_clean":"2023-11-24T06:14:16.531032+0000","last_became_active":"2023-11-24T06:14:15.457653+0000","last_became_peered":"2023-11-24T06:14:15.457653+0000","last_unstale":"2023-11-24T06:14:16.531032+0000","last_undegraded":"2023-11-24T06:14:16.531032+0000","last_fullsized":"2023-11-24T06:14:16.531032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:14.427374+0000","last_clean_scrub_stamp":"2023-11-24T06:14:14.427374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:07:48.082618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.486520+0000","last_change":"2023-11-24T06:14:14.462792+0000","last_active":"2023-11-24T06:14:15.486520+0000","last_peered":"2023-11-24T06:14:15.486520+0000","last_clean":"2023-11-24T06:14:15.486520+0000","last_became_active":"2023-11-24T06:14:14.462410+0000","last_became_peered":"2023-11-24T06:14:14.462410+0000","last_unstale":"2023-11-24T06:14:15.486520+0000","last_undegraded":"2023-11-24T06:14:15.486520+0000","last_fullsized":"2023-11-24T06:14:15.486520+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:13.415066+0000","last_clean_scrub_stamp":"2023-11-24T06:14:13.415066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:21:11.517836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T06:14:15.434934+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:14:15.434934+0000","last_peered":"2023-11-24T06:14:15.434934+0000","last_clean":"2023-11-24T06:14:15.434934+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:14:15.434934+0000","last_undegraded":"2023-11-24T06:14:15.434934+0000","last_fullsized":"2023-11-24T06:14:15.434934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476769,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":220385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.034,"15min":1.038},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.542,"5min":1.665,"15min":1.665},"last":1.363},{"interface":"front","average":{"1min":1.081,"5min":1.0329999999999999,"15min":1.0249999999999999},"min":{"1min":0.74199999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.48,"5min":1.698,"15min":1.698},"last":1.1699999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.47,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.593},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1140000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.095}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1319999999999999,"15min":1.1259999999999999},"min":{"1min":0.71799999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.591,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.302},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.3360000000000001,"15min":1.3540000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5920000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.018}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.306,"15min":1.302},"min":{"1min":0.94899999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.714,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.339,"15min":1.335},"min":{"1min":0.95099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.7170000000000001,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.466}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.288,"15min":1.288},"min":{"1min":0.68500000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8759999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.3580000000000001,"15min":1.3300000000000001},"min":{"1min":1.0860000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.016,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.8580000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.5089999999999999,"15min":1.5169999999999999},"min":{"1min":1.022,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.784,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.728},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.4550000000000001,"15min":1.4470000000000001},"min":{"1min":1.014,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.0880000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.7829999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5529999999999999,"15min":1.5469999999999999},"min":{"1min":1.0620000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.153,"5min":2.778,"15min":2.778},"last":1.9930000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.681,"15min":1.6930000000000001},"min":{"1min":1.3120000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9239999999999999,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.921}]}]},{"osd":7,"up_from":15,"seq":64424509474,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":810773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4279999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.1359999999999999,"15min":1.1319999999999999},"min":{"1min":0.746,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.95899999999999996}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.181,"15min":1.1950000000000001},"min":{"1min":0.68500000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.645,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.264,"5min":1.28,"15min":1.282},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.075}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2110000000000001,"15min":1.2010000000000001},"min":{"1min":0.90700000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9059999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2909999999999999,"15min":1.298},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.865,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.171}]},{"osd":3,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3320000000000001,"15min":1.3300000000000001},"min":{"1min":0.872,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9490000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.343,"5min":1.3640000000000001,"15min":1.3680000000000001},"min":{"1min":0.90900000000000003,"5min":0.745,"15min":0.745},"max":{"1min":1.748,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.399}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.83199999999999996,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.339},{"interface":"front","average":{"1min":1.524,"5min":1.4319999999999999,"15min":1.417},"min":{"1min":1.0329999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.165,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.5269999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.544,"15min":1.53},"min":{"1min":1.1850000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0590000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.288},{"interface":"front","average":{"1min":1.75,"5min":1.6779999999999999,"15min":1.6659999999999999},"min":{"1min":1.5069999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.3980000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4630000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.96099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.0230000000000001,"5min":2.5,"15min":2.5},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.75,"15min":1.736},"min":{"1min":1.343,"5min":0.875,"15min":0.875},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.5860000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":220987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.034,"15min":1.054},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2609999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.446},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.2090000000000001,"15min":1.2430000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5409999999999999,"5min":1.619,"15min":1.619},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2549999999999999,"15min":1.2529999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.79,"5min":1.887,"15min":1.887},"last":1.391}]},{"osd":2,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3089999999999999,"15min":1.3180000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8080000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.998},{"interface":"front","average":{"1min":1.22,"5min":1.446,"15min":1.484},"min":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5620000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.6100000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3640000000000001,"15min":1.3779999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.756,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.878},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.4630000000000001,"15min":1.4950000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8779999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.5329999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.4950000000000001,"15min":1.5029999999999999},"min":{"1min":0.76700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0009999999999999,"5min":2.258,"15min":2.258},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.5309999999999999,"15min":1.5609999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7210000000000001,"5min":2.105,"15min":2.105},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5600000000000001,"15min":1.5780000000000001},"min":{"1min":0.59099999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8959999999999999,"5min":2.319,"15min":2.319},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.54,"5min":1.6459999999999999,"15min":1.6639999999999999},"min":{"1min":0.81799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.1549999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.7}]},{"osd":7,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6859999999999999,"15min":1.7},"min":{"1min":0.68400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9490000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.768,"15min":1.792},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.669,"15min":2.669},"last":1.7789999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":557056,"data_stored":221927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0580000000000001,"15min":1.0660000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.579,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.137},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0620000000000001,"15min":1.0780000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.298}]},{"osd":1,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2769999999999999,"15min":1.296},"min":{"1min":0.67000000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6910000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.2649999999999999,"15min":1.2949999999999999},"min":{"1min":0.70099999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7649999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.254}]},{"osd":2,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1830000000000001,"15min":1.181},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.774,"5min":2.04,"15min":2.04},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.3939999999999999,"15min":1.4159999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6599999999999999,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.532}]},{"osd":3,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2909999999999999,"15min":1.302},"min":{"1min":0.84899999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.849,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.569},{"interface":"front","average":{"1min":1.29,"5min":1.3500000000000001,"15min":1.3600000000000001},"min":{"1min":0.93400000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.8400000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.4850000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4430000000000001,"15min":1.4550000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.768,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.429},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.54,"15min":1.5580000000000001},"min":{"1min":0.87,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.798,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.7430000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.5920000000000001,"15min":1.6000000000000001},"min":{"1min":1.004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9490000000000001,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.371},{"interface":"front","average":{"1min":1.448,"5min":1.6160000000000001,"15min":1.6439999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.827,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.677}]},{"osd":7,"last update":"Fri Nov 24 06:13:50 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5660000000000001,"15min":1.5840000000000001},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.9730000000000001,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.722,"15min":1.732},"min":{"1min":1.1200000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0910000000000002,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.806}]}]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":557056,"data_stored":220953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.141,"5min":1.607,"15min":1.607},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.86199999999999999,"15min":0.88},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.23,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.179}]},{"osd":1,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88100000000000001,"15min":0.90100000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.3420000000000001,"5min":1.796,"15min":1.796},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1120000000000001,"15min":1.1359999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.621,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.556}]},{"osd":2,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.0189999999999999,"15min":1.038},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.55,"5min":1.835,"15min":1.835},"last":1.5960000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.075,"15min":1.1020000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4239999999999999,"5min":2.399,"15min":2.399},"last":1.5269999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.2949999999999999,"15min":1.3149999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8200000000000001,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.407},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2649999999999999,"15min":1.2689999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8839999999999999,"5min":2.141,"15min":2.141},"last":1.351}]},{"osd":5,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.298,"15min":1.3160000000000001},"min":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7330000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.669},{"interface":"front","average":{"1min":1.218,"5min":1.3680000000000001,"15min":1.393},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.671,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.6359999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3360000000000001,"15min":1.3420000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.821,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3109999999999999,"15min":1.3200000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.655,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.2410000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:13:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3879999999999999,"15min":1.4179999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.772,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.377},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4410000000000001,"15min":1.462},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.726,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.6859999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":221949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.538,"5min":2.552,"15min":2.552},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.93899999999999995,"15min":0.96399999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4550000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.878}]},{"osd":1,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.121,"15min":1.119},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.696,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.613},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6479999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.274}]},{"osd":3,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1419999999999999,"15min":1.1579999999999999},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.5169999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.55100000000000005,"5min":0.371,"15min":0.371},"max":{"1min":1.25,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.006}]},{"osd":4,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.325,"15min":1.335},"min":{"1min":0.75900000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.883,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.484,"15min":1.5009999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.804,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.383}]},{"osd":5,"last update":"Fri Nov 24 06:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.21,"15min":1.212},"min":{"1min":0.81000000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.569,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":2},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.4330000000000001,"15min":1.444},"min":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.79,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.8540000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3819999999999999,"15min":1.397},"min":{"1min":0.84299999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7030000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.9059999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.544,"15min":1.5629999999999999},"min":{"1min":1.0880000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8300000000000001,"5min":4.101,"15min":4.101},"last":1.712}]},{"osd":7,"last update":"Fri Nov 24 06:13:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.488,"15min":1.5},"min":{"1min":0.81200000000000006,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7190000000000001,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.456,"15min":1.4850000000000001},"min":{"1min":0.81399999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7649999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":2.0720000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":810717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.84699999999999998,"15min":0.83799999999999997},"min":{"1min":0.58399999999999996,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.696,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.667},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.45500000000000002,"5min":0.443,"15min":0.443},"max":{"1min":2.0609999999999999,"5min":2.161,"15min":2.161},"last":0.93799999999999994}]},{"osd":2,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.032,"15min":1.038},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.806,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"min":{"1min":0.55500000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.198}]},{"osd":3,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.194,"15min":1.2170000000000001},"min":{"1min":0.54500000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8160000000000001,"5min":3.766,"15min":3.766},"last":3.8180000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.22,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1560000000000001,"5min":2.218,"15min":2.218},"last":2.9569999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.304,"15min":1.29},"min":{"1min":0.83499999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3799999999999999,"15min":1.3979999999999999},"min":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.853,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":4.4189999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:13:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2669999999999999,"15min":1.2689999999999999},"min":{"1min":0.85099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.736,"5min":1.829,"15min":1.829},"last":4.6840000000000002},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.2350000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.458}]},{"osd":6,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.421,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.657,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":4.5060000000000002},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.349,"15min":1.331},"min":{"1min":0.873,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0270000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.827}]},{"osd":7,"last update":"Fri Nov 24 06:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.429,"15min":1.427},"min":{"1min":0.94599999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.7589999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.552,"15min":1.5620000000000001},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.1909999999999998,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":4.6109999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":220385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.93899999999999995,"15min":0.96199999999999997},"min":{"1min":0.439,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5209999999999999,"5min":1.571,"15min":1.571},"last":0.753},{"interface":"front","average":{"1min":0.878,"5min":1,"15min":1.02},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.341,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.99199999999999999,"15min":1.0109999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4239999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.2030000000000001,"15min":1.2390000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.78,"5min":1.792,"15min":1.792},"last":0.98899999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.3280000000000001,"15min":1.3660000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":0.66500000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6739999999999999,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.94899999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3089999999999999,"15min":1.321},"min":{"1min":0.79400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.794,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.095},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.55,"15min":1.5780000000000001},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.7909999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.3839999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.1059999999999999,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.454,"15min":1.468},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.2599999999999998,"5min":2.637,"15min":2.637},"last":1.194}]},{"osd":6,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.5389999999999999,"15min":1.5609999999999999},"min":{"1min":0.95099999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.839,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.5229999999999999,"15min":1.5389999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1259999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.486}]},{"osd":7,"last update":"Fri Nov 24 06:13:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.613,"15min":1.6319999999999999},"min":{"1min":1,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.9620000000000002,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.679,"15min":1.6839999999999999},"min":{"1min":1.198,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:14:25.603 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:14:25.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:14:25.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.877+0000 7f47f10d3640 1 Processor -- start 2023-11-24T06:14:25.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.877+0000 7f47f10d3640 1 -- start start 2023-11-24T06:14:25.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.879+0000 7f47f10d3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47ec15b350 0x7f47ec0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.879+0000 7f47f10d3640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f47ec0adb60 0x7f47ec0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.879+0000 7f47f10d3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec15b730 con 0x7f47ec09cb30 2023-11-24T06:14:25.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.879+0000 7f47f10d3640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec0ac740 con 0x7f47ec0adb60 2023-11-24T06:14:25.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.879+0000 7f47f10d3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0ac460 con 0x7f47ec15b350 2023-11-24T06:14:25.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.879+0000 7f47eb59e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f47ec0adb60 0x7f47ec0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.879+0000 7f47eb59e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f47ec0adb60 0x7f47ec0adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38018/0 (socket says 172.21.15.22:38018) 2023-11-24T06:14:25.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.879+0000 7f47eb59e640 1 -- 172.21.15.22:0/2568317779 learned_addr learned my addr 172.21.15.22:0/2568317779 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:25.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.880+0000 7f47ead9d640 1 --2- 172.21.15.22:0/2568317779 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47ec15b350 0x7f47ec0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.880+0000 7f47eb59e640 1 -- 172.21.15.22:0/2568317779 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47ec15b350 msgr2=0x7f47ec0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:25.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.880+0000 7f47eb59e640 1 --2- 172.21.15.22:0/2568317779 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47ec15b350 0x7f47ec0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.880+0000 7f47eb59e640 1 -- 172.21.15.22:0/2568317779 >> v1:172.21.15.31:6789/0 conn(0x7f47ec09cb30 legacy=0x7f47ec0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:25.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.880+0000 7f47eb59e640 1 -- 172.21.15.22:0/2568317779 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec0b2a50 con 0x7f47ec0adb60 2023-11-24T06:14:25.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.881+0000 7f47eb59e640 1 --2- 172.21.15.22:0/2568317779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 0x7f47ec0adfb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009e50 tx=0x7f47e402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3558239189be53 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.882+0000 7f47e9d9b640 1 -- 172.21.15.22:0/2568317779 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e402ca70 con 0x7f47ec0adb60 2023-11-24T06:14:25.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.882+0000 7f47e9d9b640 1 -- 172.21.15.22:0/2568317779 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e402cbd0 con 0x7f47ec0adb60 2023-11-24T06:14:25.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.882+0000 7f47e9d9b640 1 -- 172.21.15.22:0/2568317779 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e40343f0 con 0x7f47ec0adb60 2023-11-24T06:14:25.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.883+0000 7f47f10d3640 1 -- 172.21.15.22:0/2568317779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 msgr2=0x7f47ec0adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.883+0000 7f47f10d3640 1 --2- 172.21.15.22:0/2568317779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 0x7f47ec0adfb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009e50 tx=0x7f47e402bed0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.883+0000 7f47f10d3640 1 -- 172.21.15.22:0/2568317779 shutdown_connections 2023-11-24T06:14:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.883+0000 7f47f10d3640 1 --2- 172.21.15.22:0/2568317779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 0x7f47ec0adfb0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.883+0000 7f47f10d3640 1 --2- 172.21.15.22:0/2568317779 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47ec15b350 0x7f47ec0abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.883+0000 7f47f10d3640 1 -- 172.21.15.22:0/2568317779 >> 172.21.15.22:0/2568317779 conn(0x7f47ec0b0ba0 msgr2=0x7f47ec0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.883+0000 7f47f10d3640 1 -- 172.21.15.22:0/2568317779 shutdown_connections 2023-11-24T06:14:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.883+0000 7f47f10d3640 1 -- 172.21.15.22:0/2568317779 wait complete. 2023-11-24T06:14:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.885+0000 7f47f10d3640 1 Processor -- start 2023-11-24T06:14:25.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.885+0000 7f47f10d3640 1 -- start start 2023-11-24T06:14:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.887+0000 7f47f10d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47ec09cb30 0x7f47ec1e0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.887+0000 7f47f10d3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 0x7f47ec1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.887+0000 7f47f10d3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47ec15b350 0x7f47ec1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.887+0000 7f47f10d3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec154900 con 0x7f47ec0adb60 2023-11-24T06:14:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.887+0000 7f47f10d3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec154be0 con 0x7f47ec09cb30 2023-11-24T06:14:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.887+0000 7f47f10d3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec154ec0 con 0x7f47ec15b350 2023-11-24T06:14:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.887+0000 7f47ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 0x7f47ec1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.887+0000 7f47ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 0x7f47ec1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38030/0 (socket says 172.21.15.22:38030) 2023-11-24T06:14:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.887+0000 7f47ea59c640 1 -- 172.21.15.22:0/2935385125 learned_addr learned my addr 172.21.15.22:0/2935385125 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47ea59c640 1 -- 172.21.15.22:0/2935385125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47ec15b350 msgr2=0x7f47ec1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47ea59c640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47ec15b350 0x7f47ec1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47ea59c640 1 -- 172.21.15.22:0/2935385125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47ec09cb30 msgr2=0x7f47ec1e0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47ea59c640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47ec09cb30 0x7f47ec1e0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47ea59c640 1 -- 172.21.15.22:0/2935385125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e4009b30 con 0x7f47ec0adb60 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47ea59c640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 0x7f47ec1559a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f47d400b3f0 tx=0x7f47d400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47e37fe640 1 -- 172.21.15.22:0/2935385125 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4011830 con 0x7f47ec0adb60 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47e37fe640 1 -- 172.21.15.22:0/2935385125 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4011990 con 0x7f47ec0adb60 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47e37fe640 1 -- 172.21.15.22:0/2935385125 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4011d40 con 0x7f47ec0adb60 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.888+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec1551a0 con 0x7f47ec0adb60 2023-11-24T06:14:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.889+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec1545f0 con 0x7f47ec0adb60 2023-11-24T06:14:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.890+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec1556c0 con 0x7f47ec0adb60 2023-11-24T06:14:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.891+0000 7f47e37fe640 1 -- 172.21.15.22:0/2935385125 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f47d401a400 con 0x7f47ec0adb60 2023-11-24T06:14:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.892+0000 7f47e37fe640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f47cc06aff0 0x7f47cc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.892+0000 7f47e37fe640 1 -- 172.21.15.22:0/2935385125 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47d4089880 con 0x7f47ec0adb60 2023-11-24T06:14:25.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.892+0000 7f47ead9d640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f47cc06aff0 0x7f47cc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.893+0000 7f47ead9d640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f47cc06aff0 0x7f47cc06d4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0098f0 tx=0x7f47dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:25.897+0000 7f47e37fe640 1 -- 172.21.15.22:0/2935385125 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47ec1556c0 con 0x7f47ec0adb60 2023-11-24T06:14:26.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.158+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f47ec1556c0 con 0x7f47ec0adb60 2023-11-24T06:14:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.162+0000 7f47e37fe640 1 -- 172.21.15.22:0/2935385125 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f47d40150b0 con 0x7f47ec0adb60 2023-11-24T06:14:26.165 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2023-11-24T06:14:26.165 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBvPmBlp6jYJxAA527jQJV49tBf9Am4wak0NA== 2023-11-24T06:14:26.165 INFO:teuthology.orchestra.run.smithi022.stdout: caps mds = "allow" 2023-11-24T06:14:26.166 INFO:teuthology.orchestra.run.smithi022.stdout: caps mon = "allow r" 2023-11-24T06:14:26.166 INFO:teuthology.orchestra.run.smithi022.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:14:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-11-24T06:14:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f47cc06aff0 msgr2=0x7f47cc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f47cc06aff0 0x7f47cc06d4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0098f0 tx=0x7f47dc008040 comp rx=0 tx=0).stop 2023-11-24T06:14:26.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 msgr2=0x7f47ec1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 0x7f47ec1559a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f47d400b3f0 tx=0x7f47d400b8b0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 shutdown_connections 2023-11-24T06:14:26.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f47cc06aff0 0x7f47cc06d4b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47ec15b350 0x7f47ec1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec0adb60 0x7f47ec1559a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 --2- 172.21.15.22:0/2935385125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47ec09cb30 0x7f47ec1e0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 >> 172.21.15.22:0/2935385125 conn(0x7f47ec0b0ba0 msgr2=0x7f47ec099a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.165+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 shutdown_connections 2023-11-24T06:14:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.166+0000 7f47f10d3640 1 -- 172.21.15.22:0/2935385125 wait complete. 2023-11-24T06:14:26.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:26.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.401+0000 7f069ea71640 1 Processor -- start 2023-11-24T06:14:26.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.401+0000 7f069ea71640 1 -- start start 2023-11-24T06:14:26.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.402+0000 7f069ea71640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f069815d5b0 0x7f06980d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.402+0000 7f069ea71640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06980cf0c0 con 0x7f06980d14a0 2023-11-24T06:14:26.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.402+0000 7f069ea71640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06980b01b0 con 0x7f06980b1650 2023-11-24T06:14:26.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.402+0000 7f069ea71640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980d05c0 con 0x7f069815d5b0 2023-11-24T06:14:26.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.402+0000 7f069d26e640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f06980d14a0 0x7f06980cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60738/0 (socket says 172.21.15.22:60738) 2023-11-24T06:14:26.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069d26e640 1 -- 172.21.15.22:0/1593455804 learned_addr learned my addr 172.21.15.22:0/1593455804 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:26.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069da6f640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f069815d5b0 0x7f06980d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835477310 0 0) 0x7f06980cf0c0 con 0x7f06980d14a0 2023-11-24T06:14:26.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0688003520 con 0x7f06980d14a0 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2890130477 0 0) 0x7f0688003520 con 0x7f06980d14a0 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f069815d5b0 msgr2=0x7f06980d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069ca6d640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f069815d5b0 0x7f06980d3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 >> v1:172.21.15.31:6789/0 conn(0x7f06980b1650 legacy=0x7f06980cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069815d990 con 0x7f06980d14a0 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.403+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f0684001670 con 0x7f06980d14a0 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 >> v1:172.21.15.22:6789/0 conn(0x7f06980d14a0 legacy=0x7f06980cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069ca6d640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0688003a10 0x7f0688003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069ca6d640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06880047c0 0x7f0688004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069ca6d640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f069815d5b0 0x7f06880051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980d05c0 con 0x7f0688003a10 2023-11-24T06:14:26.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068800bb40 con 0x7f06880047c0 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068800bd00 con 0x7f069815d5b0 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069da6f640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0688003a10 0x7f0688003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069da6f640 1 -- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f069815d5b0 msgr2=0x7f06880051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069da6f640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f069815d5b0 0x7f06880051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069d26e640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06880047c0 0x7f0688004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069da6f640 1 -- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06880047c0 msgr2=0x7f0688004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069da6f640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06880047c0 0x7f0688004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069da6f640 1 -- 172.21.15.22:0/1593455804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0688003520 con 0x7f0688003a10 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.404+0000 7f069d26e640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06880047c0 0x7f0688004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.405+0000 7f069da6f640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0688003a10 0x7f0688003e30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f068c009fc0 tx=0x7f06880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7868f4b883957b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:26.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.406+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c02cc60 con 0x7f0688003a10 2023-11-24T06:14:26.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.406+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00f040 con 0x7f0688003a10 2023-11-24T06:14:26.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.406+0000 7f069ca6d640 1 -- 172.21.15.22:0/1593455804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c034440 con 0x7f0688003a10 2023-11-24T06:14:26.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.406+0000 7f069ea71640 1 -- 172.21.15.22:0/1593455804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0688003a10 msgr2=0x7f0688003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.406+0000 7f069ea71640 1 --2- 172.21.15.22:0/1593455804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0688003a10 0x7f0688003e30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f068c009fc0 tx=0x7f06880057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.406+0000 7f069e270640 1 -- 172.21.15.22:0/1593455804 reap_dead start 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.406+0000 7f069ea71640 1 -- 172.21.15.22:0/1593455804 shutdown_connections 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.406+0000 7f069ea71640 1 -- 172.21.15.22:0/1593455804 >> 172.21.15.22:0/1593455804 conn(0x7f069809c3b0 msgr2=0x7f06980d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.406+0000 7f069ea71640 1 -- 172.21.15.22:0/1593455804 shutdown_connections 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.407+0000 7f069ea71640 1 -- 172.21.15.22:0/1593455804 wait complete. 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.408+0000 7f069ea71640 1 Processor -- start 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.408+0000 7f069ea71640 1 -- start start 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.409+0000 7f069ea71640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0688003a10 0x7f0698151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.409+0000 7f069ea71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b2510 0x7f06980b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.409+0000 7f069ea71640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06980cc150 0x7f06980cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.409+0000 7f069ea71640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980ccb10 con 0x7f06980b2510 2023-11-24T06:14:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.409+0000 7f069ea71640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980b36b0 con 0x7f0688003a10 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.409+0000 7f069ea71640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0698151a60 con 0x7f06980cc150 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069d26e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b2510 0x7f06980b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069d26e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b2510 0x7f06980b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38044/0 (socket says 172.21.15.22:38044) 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069d26e640 1 -- 172.21.15.22:0/3371404407 learned_addr learned my addr 172.21.15.22:0/3371404407 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069da6f640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0688003a10 0x7f0698151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069d26e640 1 -- 172.21.15.22:0/3371404407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06980cc150 msgr2=0x7f06980cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069d26e640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06980cc150 0x7f06980cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069d26e640 1 -- 172.21.15.22:0/3371404407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0688003a10 msgr2=0x7f0698151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069d26e640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0688003a10 0x7f0698151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069d26e640 1 -- 172.21.15.22:0/3371404407 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980b2fd0 con 0x7f06980b2510 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069da6f640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0688003a10 0x7f0698151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.410+0000 7f069d26e640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b2510 0x7f06980b2990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f068400d7f0 tx=0x7f068400dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:26.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.411+0000 7f06967fc640 1 -- 172.21.15.22:0/3371404407 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840074e0 con 0x7f06980b2510 2023-11-24T06:14:26.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.411+0000 7f06967fc640 1 -- 172.21.15.22:0/3371404407 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684007640 con 0x7f06980b2510 2023-11-24T06:14:26.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.411+0000 7f06967fc640 1 -- 172.21.15.22:0/3371404407 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840049e0 con 0x7f06980b2510 2023-11-24T06:14:26.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.411+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06980b32b0 con 0x7f06980b2510 2023-11-24T06:14:26.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.411+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06980b3be0 con 0x7f06980b2510 2023-11-24T06:14:26.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.412+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06980b34a0 con 0x7f06980b2510 2023-11-24T06:14:26.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.413+0000 7f06967fc640 1 -- 172.21.15.22:0/3371404407 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0684004b40 con 0x7f06980b2510 2023-11-24T06:14:26.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.414+0000 7f06967fc640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f067c06b040 0x7f067c06d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.414+0000 7f06967fc640 1 -- 172.21.15.22:0/3371404407 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0684089670 con 0x7f06980b2510 2023-11-24T06:14:26.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.414+0000 7f069da6f640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f067c06b040 0x7f067c06d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.415+0000 7f069da6f640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f067c06b040 0x7f067c06d500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f068c036000 tx=0x7f068c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.418+0000 7f06967fc640 1 -- 172.21.15.22:0/3371404407 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0684054420 con 0x7f06980b2510 2023-11-24T06:14:26.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.651+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f069804e840 con 0x7f06980b2510 2023-11-24T06:14:26.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.652+0000 7f06967fc640 1 -- 172.21.15.22:0/3371404407 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f0684057a40 con 0x7f06980b2510 2023-11-24T06:14:26.655 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:26.655 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:14:26.656 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 25 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f067c06b040 msgr2=0x7f067c06d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f067c06b040 0x7f067c06d500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f068c036000 tx=0x7f068c02e000 comp rx=0 tx=0).stop 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b2510 msgr2=0x7f06980b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b2510 0x7f06980b2990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f068400d7f0 tx=0x7f068400dcb0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 shutdown_connections 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f067c06b040 0x7f067c06d500 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06980cc150 0x7f06980cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b2510 0x7f06980b2990 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 --2- 172.21.15.22:0/3371404407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0688003a10 0x7f0698151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 >> 172.21.15.22:0/3371404407 conn(0x7f069809c3b0 msgr2=0x7f06980d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:26.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 shutdown_connections 2023-11-24T06:14:26.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:26.655+0000 7f069ea71640 1 -- 172.21.15.22:0/3371404407 wait complete. 2023-11-24T06:14:27.079 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:14:14.915463+0000', 'modified': '2023-11-24T06:14:18.001307+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5784}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5784': {'gid': 5784, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6837/2759331881', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6835', 'nonce': 2759331881}, {'type': 'v1', 'addr': '172.21.15.22:6837', 'nonce': 2759331881}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:14:27.079 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:14:27.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-24T06:14:27.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.316+0000 7fc95359e640 1 Processor -- start 2023-11-24T06:14:27.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.316+0000 7fc95359e640 1 -- start start 2023-11-24T06:14:27.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.317+0000 7fc95359e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc95415f8c0 0x7fc9540b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.317+0000 7fc95359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc9540d1b80 0x7fc9540cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.317+0000 7fc95359e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9540cdc70 con 0x7fc9540cfa30 2023-11-24T06:14:27.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.317+0000 7fc95359e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9540d0ab0 con 0x7fc95415f8c0 2023-11-24T06:14:27.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.317+0000 7fc95359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9540d04f0 con 0x7fc9540d1b80 2023-11-24T06:14:27.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.318+0000 7fc95259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc95415f8c0 0x7fc9540b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.318+0000 7fc95259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc95415f8c0 0x7fc9540b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38060/0 (socket says 172.21.15.22:38060) 2023-11-24T06:14:27.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.318+0000 7fc95259c640 1 -- 172.21.15.22:0/1259020720 learned_addr learned my addr 172.21.15.22:0/1259020720 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:27.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.318+0000 7fc952d9d640 1 --2- 172.21.15.22:0/1259020720 >> v2:172.21.15.31:3300/0 conn(0x7fc9540d1b80 0x7fc9540cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.318+0000 7fc95259c640 1 -- 172.21.15.22:0/1259020720 >> v2:172.21.15.31:3300/0 conn(0x7fc9540d1b80 msgr2=0x7fc9540cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.318+0000 7fc95259c640 1 --2- 172.21.15.22:0/1259020720 >> v2:172.21.15.31:3300/0 conn(0x7fc9540d1b80 0x7fc9540cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.318+0000 7fc95259c640 1 -- 172.21.15.22:0/1259020720 >> v1:172.21.15.31:6789/0 conn(0x7fc9540cfa30 legacy=0x7fc9540d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.318+0000 7fc95259c640 1 -- 172.21.15.22:0/1259020720 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540d07d0 con 0x7fc95415f8c0 2023-11-24T06:14:27.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.318+0000 7fc952d9d640 1 --2- 172.21.15.22:0/1259020720 >> v2:172.21.15.31:3300/0 conn(0x7fc9540d1b80 0x7fc9540cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:27.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.320+0000 7fc95259c640 1 --2- 172.21.15.22:0/1259020720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc95415f8c0 0x7fc9540b2a30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc9540d0400 tx=0x7fc94402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ead54421039ca70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.320+0000 7fc95159a640 1 -- 172.21.15.22:0/1259020720 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94402ca80 con 0x7fc95415f8c0 2023-11-24T06:14:27.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.320+0000 7fc95159a640 1 -- 172.21.15.22:0/1259020720 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94402cbe0 con 0x7fc95415f8c0 2023-11-24T06:14:27.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.320+0000 7fc95159a640 1 -- 172.21.15.22:0/1259020720 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440343f0 con 0x7fc95415f8c0 2023-11-24T06:14:27.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.320+0000 7fc95359e640 1 -- 172.21.15.22:0/1259020720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc95415f8c0 msgr2=0x7fc9540b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.320+0000 7fc95359e640 1 --2- 172.21.15.22:0/1259020720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc95415f8c0 0x7fc9540b2a30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc9540d0400 tx=0x7fc94402bee0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.321+0000 7fc95359e640 1 -- 172.21.15.22:0/1259020720 shutdown_connections 2023-11-24T06:14:27.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.321+0000 7fc95359e640 1 --2- 172.21.15.22:0/1259020720 >> v2:172.21.15.31:3300/0 conn(0x7fc9540d1b80 0x7fc9540cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.321+0000 7fc95359e640 1 --2- 172.21.15.22:0/1259020720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc95415f8c0 0x7fc9540b2a30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.321+0000 7fc95359e640 1 -- 172.21.15.22:0/1259020720 >> 172.21.15.22:0/1259020720 conn(0x7fc95409c400 msgr2=0x7fc9540d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.321+0000 7fc95359e640 1 -- 172.21.15.22:0/1259020720 shutdown_connections 2023-11-24T06:14:27.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.321+0000 7fc95359e640 1 -- 172.21.15.22:0/1259020720 wait complete. 2023-11-24T06:14:27.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.323+0000 7fc95359e640 1 Processor -- start 2023-11-24T06:14:27.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.323+0000 7fc95359e640 1 -- start start 2023-11-24T06:14:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9540cfa30 0x7fc95415e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9540d1b80 0x7fc9541525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95415f8c0 0x7fc95415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95415e730 con 0x7fc9540cfa30 2023-11-24T06:14:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9541f61f0 con 0x7fc95415f8c0 2023-11-24T06:14:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9541f64d0 con 0x7fc9540d1b80 2023-11-24T06:14:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9540cfa30 0x7fc95415e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9540cfa30 0x7fc95415e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38064/0 (socket says 172.21.15.22:38064) 2023-11-24T06:14:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95259c640 1 -- 172.21.15.22:0/64891358 learned_addr learned my addr 172.21.15.22:0/64891358 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:27.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95259c640 1 -- 172.21.15.22:0/64891358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9540d1b80 msgr2=0x7fc9541525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95259c640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9540d1b80 0x7fc9541525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95259c640 1 -- 172.21.15.22:0/64891358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95415f8c0 msgr2=0x7fc95415ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95259c640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95415f8c0 0x7fc95415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.324+0000 7fc95259c640 1 -- 172.21.15.22:0/64891358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009b30 con 0x7fc9540cfa30 2023-11-24T06:14:27.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.325+0000 7fc95259c640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9540cfa30 0x7fc95415e1f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc944000f80 tx=0x7fc944004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.325+0000 7fc942ffd640 1 -- 172.21.15.22:0/64891358 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94403e450 con 0x7fc9540cfa30 2023-11-24T06:14:27.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.325+0000 7fc942ffd640 1 -- 172.21.15.22:0/64891358 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94403e5f0 con 0x7fc9540cfa30 2023-11-24T06:14:27.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.325+0000 7fc942ffd640 1 -- 172.21.15.22:0/64891358 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94403e9a0 con 0x7fc9540cfa30 2023-11-24T06:14:27.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.325+0000 7fc95359e640 1 -- 172.21.15.22:0/64891358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9541f67b0 con 0x7fc9540cfa30 2023-11-24T06:14:27.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.325+0000 7fc95359e640 1 -- 172.21.15.22:0/64891358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9541f6d70 con 0x7fc9540cfa30 2023-11-24T06:14:27.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.328+0000 7fc942ffd640 1 -- 172.21.15.22:0/64891358 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc94402cd50 con 0x7fc9540cfa30 2023-11-24T06:14:27.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.329+0000 7fc942ffd640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc93406aff0 0x7fc93406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.329+0000 7fc942ffd640 1 -- 172.21.15.22:0/64891358 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9440ac620 con 0x7fc9540cfa30 2023-11-24T06:14:27.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.330+0000 7fc951d9b640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc93406aff0 0x7fc93406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.330+0000 7fc95b7a9740 1 Processor -- start 2023-11-24T06:14:27.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.330+0000 7fc95b7a9740 1 -- start start 2023-11-24T06:14:27.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.330+0000 7fc951d9b640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc93406aff0 0x7fc93406d4b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc95415df70 tx=0x7fc9480079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.331+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e65e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.331+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e65d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.331+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6a1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.331+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049e5bc880 con 0x56049e65d7b0 2023-11-24T06:14:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.331+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049e5cbae0 con 0x56049e65e070 2023-11-24T06:14:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.331+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x56049e5c91d0 con 0x56049e658d70 2023-11-24T06:14:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.331+0000 7fc952d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.331+0000 7fc952d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38068/0 (socket says 172.21.15.22:38068) 2023-11-24T06:14:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.331+0000 7fc952d9d640 1 -- 172.21.15.22:0/1464095438 learned_addr learned my addr 172.21.15.22:0/1464095438 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc951d9b640 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e65d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc95259c640 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e65e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc952d9d640 1 -- 172.21.15.22:0/1464095438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 msgr2=0x56049e65d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc952d9d640 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e65d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc952d9d640 1 -- 172.21.15.22:0/1464095438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 msgr2=0x56049e65e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc952d9d640 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e65e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc952d9d640 1 -- 172.21.15.22:0/1464095438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56049e58c860 con 0x56049e65d7b0 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc95259c640 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e65e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc952d9d640 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6a1730 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00a9b0 tx=0x7fc94c00ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7767747bf484e291 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.332+0000 7fc933fff640 1 -- 172.21.15.22:0/1464095438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c00cc00 con 0x56049e65d7b0 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc933fff640 1 -- 172.21.15.22:0/1464095438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c00cd60 con 0x56049e65d7b0 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc933fff640 1 -- 172.21.15.22:0/1464095438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c011630 con 0x56049e65d7b0 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1464095438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 msgr2=0x56049e6a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6a1730 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00a9b0 tx=0x7fc94c00ae70 comp rx=0 tx=0).stop 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1464095438 shutdown_connections 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6a1730 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e65d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1464095438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e65e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1464095438 >> 172.21.15.22:0/1464095438 conn(0x56049e61fc70 msgr2=0x56049e6a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1464095438 shutdown_connections 2023-11-24T06:14:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.333+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1464095438 wait complete. 2023-11-24T06:14:27.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.334+0000 7fc95b7a9740 1 -- start start 2023-11-24T06:14:27.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.334+0000 7fc95b7a9740 1 Processor -- start 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.335+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e6845d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.335+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.335+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e6abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.335+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049e5c4ac0 con 0x56049e65d7b0 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.335+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049e5612f0 con 0x56049e65e070 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.335+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x56049e57ec70 con 0x56049e658d70 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.335+0000 7fc95b7a9740 10 client.0 _ll_register_callbacks cb 0x56049e5833b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc951d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc951d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6ab5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38072/0 (socket says 172.21.15.22:38072) 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc951d9b640 1 -- 172.21.15.22:0/1332806451 learned_addr learned my addr 172.21.15.22:0/1332806451 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc95259c640 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e6845d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc952d9d640 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e6abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc951d9b640 1 -- 172.21.15.22:0/1332806451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 msgr2=0x56049e6845d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc951d9b640 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e6845d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc951d9b640 1 -- 172.21.15.22:0/1332806451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 msgr2=0x56049e6abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc951d9b640 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e6abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc951d9b640 1 -- 172.21.15.22:0/1332806451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c00a580 con 0x56049e65d7b0 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc95259c640 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e6845d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc951d9b640 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6ab5d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc948014fd0 tx=0x7fc948003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bc788bc82acf4a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.336+0000 7fc9317fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc9317fa640 1 -- 172.21.15.22:0/1332806451 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948011570 con 0x56049e65d7b0 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1332806451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56049e5bdaa0 con 0x56049e65d7b0 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc9317fa640 1 -- 172.21.15.22:0/1332806451 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9480116d0 con 0x56049e65d7b0 2023-11-24T06:14:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc9317fa640 1 -- 172.21.15.22:0/1332806451 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc948011890 con 0x56049e65d7b0 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc95b7a9740 10 client.5958 fetch_fsmap learned FSMap version 25 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1332806451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x56049e5c3140 con 0x56049e65d7b0 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc9317fa640 1 -- 172.21.15.22:0/1332806451 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56049e5bdaa0 con 0x56049e65d7b0 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc9317fa640 1 -- 172.21.15.22:0/1332806451 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc9480119f0 con 0x56049e65d7b0 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc95b7a9740 10 client.5958 fetch_fsmap finished waiting for FSMap version 25 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc95b7a9740 10 client.5958 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.337+0000 7fc95b7a9740 20 client.5958 populate_metadata read hostname 'smithi022' 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.338+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] conn(0x56049e6a9b70 0x56049e6b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.338+0000 7fc95b7a9740 4 client.5958 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.338+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1332806451 --> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56049e5bd7c0 con 0x56049e6a9b70 2023-11-24T06:14:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.338+0000 7fc95259c640 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] conn(0x56049e6a9b70 0x56049e6b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.338+0000 7fc95259c640 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] conn(0x56049e6a9b70 0x56049e6b6a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d8226e521870ec3 server_cookie=a03b731b3d18c85a in_seq=0 out_seq=0 2023-11-24T06:14:27.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.338+0000 7fc9317fa640 10 client.5958 ms_handle_connect on v2:172.21.15.22:6835/2759331881 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.339+0000 7fc9317fa640 1 -- 172.21.15.22:0/1332806451 <== mds.0 v2:172.21.15.22:6835/2759331881 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56049e5bd7c0 con 0x56049e6a9b70 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.339+0000 7fc9317fa640 10 client.5958 handle_command_reply: tid=0 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.339+0000 7fc95b7a9740 1 client.5958 shutdown 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1332806451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 msgr2=0x56049e6ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6ab5d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc948014fd0 tx=0x7fc948003760 comp rx=0 tx=0).stop 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1332806451 shutdown_connections 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] conn(0x56049e6a9b70 0x56049e6b6a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e6abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65d7b0 0x56049e6ab5d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1332806451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e6845d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1332806451 >> 172.21.15.22:0/1332806451 conn(0x56049e61fc70 msgr2=0x56049e657dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc9317fa640 0 client.5958 ms_handle_reset on v2:172.21.15.22:6835/2759331881 2023-11-24T06:14:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1332806451 shutdown_connections 2023-11-24T06:14:27.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1332806451 wait complete. 2023-11-24T06:14:27.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.340+0000 7fc95b7a9740 20 client.5958 trim_cache size 0 max 16384 2023-11-24T06:14:27.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.356+0000 7fc95b7a9740 1 Processor -- start 2023-11-24T06:14:27.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.357+0000 7fc95b7a9740 1 -- start start 2023-11-24T06:14:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.357+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e683910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.357+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65d7b0 0x56049e6a0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.357+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65e070 0x56049e6a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.357+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049e327f20 con 0x56049e65e070 2023-11-24T06:14:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.357+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049e68cdf0 con 0x56049e65d7b0 2023-11-24T06:14:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.357+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x56049e6aa050 con 0x56049e658d70 2023-11-24T06:14:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.358+0000 7fc952d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65e070 0x56049e6a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.358+0000 7fc952d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65e070 0x56049e6a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38082/0 (socket says 172.21.15.22:38082) 2023-11-24T06:14:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.358+0000 7fc952d9d640 1 -- 172.21.15.22:0/3215628987 learned_addr learned my addr 172.21.15.22:0/3215628987 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.358+0000 7fc95259c640 1 --2- 172.21.15.22:0/3215628987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e683910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.358+0000 7fc952d9d640 1 -- 172.21.15.22:0/3215628987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 msgr2=0x56049e683910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.358+0000 7fc952d9d640 1 --2- 172.21.15.22:0/3215628987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e683910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.358+0000 7fc952d9d640 1 -- 172.21.15.22:0/3215628987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65d7b0 msgr2=0x56049e6a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.358+0000 7fc952d9d640 1 --2- 172.21.15.22:0/3215628987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65d7b0 0x56049e6a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.358+0000 7fc952d9d640 1 -- 172.21.15.22:0/3215628987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56049e560b80 con 0x56049e65e070 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc952d9d640 1 --2- 172.21.15.22:0/3215628987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65e070 0x56049e6a0a70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00a950 tx=0x7fc94c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f5b2ac41765c03 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc940ff9640 1 -- 172.21.15.22:0/3215628987 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c01f040 con 0x56049e65e070 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc940ff9640 1 -- 172.21.15.22:0/3215628987 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c00ca00 con 0x56049e65e070 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc940ff9640 1 -- 172.21.15.22:0/3215628987 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c004260 con 0x56049e65e070 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc95b7a9740 1 -- 172.21.15.22:0/3215628987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65e070 msgr2=0x56049e6a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/3215628987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65e070 0x56049e6a0a70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00a950 tx=0x7fc94c012000 comp rx=0 tx=0).stop 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc95b7a9740 1 -- 172.21.15.22:0/3215628987 shutdown_connections 2023-11-24T06:14:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/3215628987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e65e070 0x56049e6a0a70 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/3215628987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65d7b0 0x56049e6a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/3215628987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e658d70 0x56049e683910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.359+0000 7fc95b7a9740 1 -- 172.21.15.22:0/3215628987 >> 172.21.15.22:0/3215628987 conn(0x56049e61fc70 msgr2=0x56049e6c5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.360+0000 7fc95b7a9740 1 -- 172.21.15.22:0/3215628987 shutdown_connections 2023-11-24T06:14:27.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.360+0000 7fc95b7a9740 1 -- 172.21.15.22:0/3215628987 wait complete. 2023-11-24T06:14:27.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.360+0000 7fc95b7a9740 1 -- start start 2023-11-24T06:14:27.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.360+0000 7fc95b7a9740 1 Processor -- start 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.361+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e658d70 0x56049e657e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.361+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e65d7b0 0x56049e6880c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.361+0000 7fc95b7a9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e688600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.361+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049e6f5ac0 con 0x56049e658d70 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.361+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049e6a15c0 con 0x56049e65e070 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.361+0000 7fc95b7a9740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x56049e6a2420 con 0x56049e65d7b0 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.361+0000 7fc95b7a9740 10 client.0 _ll_register_callbacks cb 0x7fc948014420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc95259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e658d70 0x56049e657e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc95259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e658d70 0x56049e657e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38096/0 (socket says 172.21.15.22:38096) 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc95259c640 1 -- 172.21.15.22:0/1630803442 learned_addr learned my addr 172.21.15.22:0/1630803442 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:27.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc95259c640 1 -- 172.21.15.22:0/1630803442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e65d7b0 msgr2=0x56049e6880c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc95259c640 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e65d7b0 0x56049e6880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc95259c640 1 -- 172.21.15.22:0/1630803442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 msgr2=0x56049e688600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc95259c640 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e688600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc95259c640 1 -- 172.21.15.22:0/1630803442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56049e58c860 con 0x56049e658d70 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc95259c640 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e658d70 0x56049e657e40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc944007050 tx=0x7fc944009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa84cb693ea5ce8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc9317fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc9317fa640 1 -- 172.21.15.22:0/1630803442 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944083370 con 0x56049e658d70 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.362+0000 7fc9317fa640 1 -- 172.21.15.22:0/1630803442 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9440810b0 con 0x56049e658d70 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1630803442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc94c00cd60 con 0x56049e658d70 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc9317fa640 1 -- 172.21.15.22:0/1630803442 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc944081270 con 0x56049e658d70 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc95b7a9740 10 client.5964 fetch_fsmap learned FSMap version 25 2023-11-24T06:14:27.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1630803442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x56049e586170 con 0x56049e658d70 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc9317fa640 1 -- 172.21.15.22:0/1630803442 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c00cd60 con 0x56049e658d70 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc9317fa640 1 -- 172.21.15.22:0/1630803442 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc94404f020 con 0x56049e658d70 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc95b7a9740 10 client.5964 fetch_fsmap finished waiting for FSMap version 25 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc95b7a9740 10 client.5964 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc95b7a9740 20 client.5964 populate_metadata read hostname 'smithi022' 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] conn(0x56049e6f4c30 0x56049e6f5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc95b7a9740 4 client.5964 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1630803442 --> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56049e2c56c0 con 0x56049e6f4c30 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.363+0000 7fc951d9b640 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] conn(0x56049e6f4c30 0x56049e6f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc951d9b640 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] conn(0x56049e6f4c30 0x56049e6f5010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d5738e71d61150 server_cookie=67f8ecf9ef3a2129 in_seq=0 out_seq=0 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc9317fa640 10 client.5964 ms_handle_connect on v2:172.21.15.22:6835/2759331881 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc9317fa640 1 -- 172.21.15.22:0/1630803442 <== mds.0 v2:172.21.15.22:6835/2759331881 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56049e2c56c0 con 0x56049e6f4c30 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc9317fa640 10 client.5964 handle_command_reply: tid=0 2023-11-24T06:14:27.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc95b7a9740 1 client.5964 shutdown 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1630803442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e658d70 msgr2=0x56049e657e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e658d70 0x56049e657e40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc944007050 tx=0x7fc944009040 comp rx=0 tx=0).stop 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1630803442 shutdown_connections 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.22:6835/2759331881,v1:172.21.15.22:6837/2759331881] conn(0x56049e6f4c30 0x56049e6f5010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56049e65e070 0x56049e688600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x56049e65d7b0 0x56049e6880c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc9317fa640 0 client.5964 ms_handle_reset on v2:172.21.15.22:6835/2759331881 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc95b7a9740 1 --2- 172.21.15.22:0/1630803442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56049e658d70 0x56049e657e40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.364+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1630803442 >> 172.21.15.22:0/1630803442 conn(0x56049e61fc70 msgr2=0x56049e683910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1630803442 shutdown_connections 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95b7a9740 1 -- 172.21.15.22:0/1630803442 wait complete. 2023-11-24T06:14:27.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95b7a9740 20 client.5964 trim_cache size 0 max 16384 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d0664f6f-6758-42fa-85ad-04f9384b4bc8", 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 5784, 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 11.895649047999999, 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 25, 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 47, 2023-11-24T06:14:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 47, 2023-11-24T06:14:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 17.703643741 2023-11-24T06:14:27.373 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:14:27.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 -- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc93406aff0 msgr2=0x7fc93406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc93406aff0 0x7fc93406d4b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc95415df70 tx=0x7fc9480079b0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 -- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9540cfa30 msgr2=0x7fc95415e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9540cfa30 0x7fc95415e1f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc944000f80 tx=0x7fc944004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 -- 172.21.15.22:0/64891358 shutdown_connections 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc93406aff0 0x7fc93406d4b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95415f8c0 0x7fc95415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9540d1b80 0x7fc9541525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 --2- 172.21.15.22:0/64891358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9540cfa30 0x7fc95415e1f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.365+0000 7fc95359e640 1 -- 172.21.15.22:0/64891358 >> 172.21.15.22:0/64891358 conn(0x7fc95409c400 msgr2=0x7fc9540b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.366+0000 7fc95359e640 1 -- 172.21.15.22:0/64891358 shutdown_connections 2023-11-24T06:14:27.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.366+0000 7fc95359e640 1 -- 172.21.15.22:0/64891358 wait complete. 2023-11-24T06:14:27.384 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:14:27.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.604+0000 7f3fbc3be640 1 Processor -- start 2023-11-24T06:14:27.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.605+0000 7f3fbc3be640 1 -- start start 2023-11-24T06:14:27.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.606+0000 7f3fbc3be640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3fb4160970 0x7f3fb40b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.606+0000 7f3fbc3be640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb406dc30 0x7f3fb40acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.606+0000 7f3fbc3be640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb4071cd0 con 0x7f3fb40b3140 2023-11-24T06:14:27.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.606+0000 7f3fbc3be640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40b2120 con 0x7f3fb4160970 2023-11-24T06:14:27.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.607+0000 7f3fbc3be640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40b2400 con 0x7f3fb406dc30 2023-11-24T06:14:27.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.607+0000 7f3fba95b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb406dc30 0x7f3fb40acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.607+0000 7f3fba95b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb406dc30 0x7f3fb40acbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:40446/0 (socket says 172.21.15.22:40446) 2023-11-24T06:14:27.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.607+0000 7f3fba95b640 1 -- 172.21.15.22:0/1623926768 learned_addr learned my addr 172.21.15.22:0/1623926768 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:27.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.608+0000 7f3fba15a640 1 --2- 172.21.15.22:0/1623926768 >> v2:172.21.15.31:3300/0 conn(0x7f3fb4160970 0x7f3fb40b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.608+0000 7f3fba95b640 1 -- 172.21.15.22:0/1623926768 >> v2:172.21.15.31:3300/0 conn(0x7f3fb4160970 msgr2=0x7f3fb40b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.608+0000 7f3fba95b640 1 --2- 172.21.15.22:0/1623926768 >> v2:172.21.15.31:3300/0 conn(0x7f3fb4160970 0x7f3fb40b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.608+0000 7f3fba95b640 1 -- 172.21.15.22:0/1623926768 >> v1:172.21.15.31:6789/0 conn(0x7f3fb40b3140 legacy=0x7f3fb406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.608+0000 7f3fba95b640 1 -- 172.21.15.22:0/1623926768 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40b26e0 con 0x7f3fb406dc30 2023-11-24T06:14:27.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.609+0000 7f3fba95b640 1 --2- 172.21.15.22:0/1623926768 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb406dc30 0x7f3fb40acbe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009e50 tx=0x7f3fac02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67aa727b2fdbbb22 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.610+0000 7f3fb9158640 1 -- 172.21.15.22:0/1623926768 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac02ca70 con 0x7f3fb406dc30 2023-11-24T06:14:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.610+0000 7f3fb9158640 1 -- 172.21.15.22:0/1623926768 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac02cbd0 con 0x7f3fb406dc30 2023-11-24T06:14:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.610+0000 7f3fb9158640 1 -- 172.21.15.22:0/1623926768 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0343f0 con 0x7f3fb406dc30 2023-11-24T06:14:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.611+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1623926768 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb406dc30 msgr2=0x7f3fb40acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.611+0000 7f3fbc3be640 1 --2- 172.21.15.22:0/1623926768 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb406dc30 0x7f3fb40acbe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009e50 tx=0x7f3fac02bed0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.611+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1623926768 shutdown_connections 2023-11-24T06:14:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.611+0000 7f3fbc3be640 1 --2- 172.21.15.22:0/1623926768 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb406dc30 0x7f3fb40acbe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.611+0000 7f3fbc3be640 1 --2- 172.21.15.22:0/1623926768 >> v2:172.21.15.31:3300/0 conn(0x7f3fb4160970 0x7f3fb40b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.611+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1623926768 >> 172.21.15.22:0/1623926768 conn(0x7f3fb40b0d80 msgr2=0x7f3fb40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.611+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1623926768 shutdown_connections 2023-11-24T06:14:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.611+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1623926768 wait complete. 2023-11-24T06:14:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.613+0000 7f3fbc3be640 1 Processor -- start 2023-11-24T06:14:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.613+0000 7f3fbc3be640 1 -- start start 2023-11-24T06:14:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.614+0000 7f3fbc3be640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fb406dc30 0x7f3fb414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.614+0000 7f3fbc3be640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb40b3140 0x7f3fb415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.614+0000 7f3fbc3be640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb4160970 0x7f3fb415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.614+0000 7f3fbc3be640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb41f6630 con 0x7f3fb40b3140 2023-11-24T06:14:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.614+0000 7f3fbc3be640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb41f68d0 con 0x7f3fb406dc30 2023-11-24T06:14:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.614+0000 7f3fbc3be640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb41f6bb0 con 0x7f3fb4160970 2023-11-24T06:14:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.614+0000 7f3fb9959640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb40b3140 0x7f3fb415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.614+0000 7f3fb9959640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb40b3140 0x7f3fb415ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38102/0 (socket says 172.21.15.22:38102) 2023-11-24T06:14:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fb9959640 1 -- 172.21.15.22:0/1050040073 learned_addr learned my addr 172.21.15.22:0/1050040073 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fba15a640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fb406dc30 0x7f3fb414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fba95b640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb4160970 0x7f3fb415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fb9959640 1 -- 172.21.15.22:0/1050040073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb4160970 msgr2=0x7f3fb415bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fb9959640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb4160970 0x7f3fb415bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fb9959640 1 -- 172.21.15.22:0/1050040073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fb406dc30 msgr2=0x7f3fb414d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fb9959640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fb406dc30 0x7f3fb414d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fb9959640 1 -- 172.21.15.22:0/1050040073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac009b30 con 0x7f3fb40b3140 2023-11-24T06:14:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fba95b640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb4160970 0x7f3fb415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.615+0000 7f3fb9959640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb40b3140 0x7f3fb415ba30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c400 tx=0x7f3fa400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.616+0000 7f3faaffd640 1 -- 172.21.15.22:0/1050040073 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa40052d0 con 0x7f3fb40b3140 2023-11-24T06:14:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.616+0000 7f3faaffd640 1 -- 172.21.15.22:0/1050040073 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa4005450 con 0x7f3fb40b3140 2023-11-24T06:14:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.616+0000 7f3faaffd640 1 -- 172.21.15.22:0/1050040073 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4007260 con 0x7f3fb40b3140 2023-11-24T06:14:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.616+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb41f6e90 con 0x7f3fb40b3140 2023-11-24T06:14:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.616+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb414d830 con 0x7f3fb40b3140 2023-11-24T06:14:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.617+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb41f73b0 con 0x7f3fb40b3140 2023-11-24T06:14:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.618+0000 7f3faaffd640 1 -- 172.21.15.22:0/1050040073 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3fa40073c0 con 0x7f3fb40b3140 2023-11-24T06:14:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.619+0000 7f3faaffd640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3f9806aff0 0x7f3f9806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.619+0000 7f3faaffd640 1 -- 172.21.15.22:0/1050040073 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fa4088c80 con 0x7f3fb40b3140 2023-11-24T06:14:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.619+0000 7f3fba15a640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3f9806aff0 0x7f3f9806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.620+0000 7f3fba15a640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3f9806aff0 0x7f3f9806d4b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009aa0 tx=0x7f3fb0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.624+0000 7f3faaffd640 1 -- 172.21.15.22:0/1050040073 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3fb41f73b0 con 0x7f3fb40b3140 2023-11-24T06:14:27.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.858+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3fb41f73b0 con 0x7f3fb40b3140 2023-11-24T06:14:27.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.859+0000 7f3faaffd640 1 -- 172.21.15.22:0/1050040073 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3fb41f73b0 con 0x7f3fb40b3140 2023-11-24T06:14:27.862 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:14:27.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3f9806aff0 msgr2=0x7f3f9806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3f9806aff0 0x7f3f9806d4b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009aa0 tx=0x7f3fb0009190 comp rx=0 tx=0).stop 2023-11-24T06:14:27.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb40b3140 msgr2=0x7f3fb415ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb40b3140 0x7f3fb415ba30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c400 tx=0x7f3fa400c8c0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 shutdown_connections 2023-11-24T06:14:27.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3f9806aff0 0x7f3f9806d4b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3fb4160970 0x7f3fb415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb40b3140 0x7f3fb415ba30 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 --2- 172.21.15.22:0/1050040073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fb406dc30 0x7f3fb414d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 >> 172.21.15.22:0/1050040073 conn(0x7f3fb40b0d80 msgr2=0x7f3fb415d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.862+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 shutdown_connections 2023-11-24T06:14:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:27.863+0000 7f3fbc3be640 1 -- 172.21.15.22:0/1050040073 wait complete. 2023-11-24T06:14:27.882 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:14:27.882 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:14:27.882 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-11-24T06:14:27.882 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:14:27.882 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:27.882 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:14:27.882 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:14:27.882 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:14:27.883 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:14:27.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:27.883 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-11-24T06:14:27.937 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:14:27.937 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:14:27.937 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:14:27.937 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:27.937 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:14:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42143sec preferred_lft 42143sec 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 12:91:dd:4c:3b:77 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::5c65:45ff:fef2:bf3b/64 scope link 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:14:27.939 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 42:17:0d:d1:91:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:14:27.940 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::4017:dff:fed1:9132/64 scope link 2023-11-24T06:14:27.940 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:27.940 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:14:27.940 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 12:91:dd:4c:3b:77 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:14:27.940 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::1091:ddff:fe4c:3b77/64 scope link 2023-11-24T06:14:27.940 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:27.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:27.942 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:14:28.033 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-11-24T06:14:28.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:28.037 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-11-24T06:14:28.097 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-11-24T06:14:28.097 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:14:28.097 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:14:28.097 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:14:28.097 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:14:28.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:28.098 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:14:28.098 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:14:28.098 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:14:28.098 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:14:28.098 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:14:28.098 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:14:28.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:28.295 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-11-24T06:14:28.353 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:14:28.353 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:14:28.354 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:14:28.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:28.354 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-11-24T06:14:28.457 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T06:14:28.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:28.458 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:28.514 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:14:28.514 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:28.514 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:28.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:14:28.664 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:14:28.726 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:14:28.726 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:14:28.726 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:14:28.727 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:14:28.727 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:14:28.727 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:14:28.727 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:14:28.727 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:14:28.727 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:14:28.727 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:14:28.727 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:14:28.728 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:14:28.728 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:14:28.728 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:14:28.728 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:14:28.728 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:14:28.728 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:14:28.728 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:14:28.729 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:14:28.729 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:14:28.729 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:14:28.729 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:14:28.729 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:14:28.731 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:14:28.731 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:14:28.731 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:14:28.731 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:14:28.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:28.732 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:14:28.790 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T06:14:28.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T06:14:28.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:14:28.875 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:14:28.920 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:14:28.920 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:14:28.920 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:14:28.920 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:14:28.920 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:14:28.920 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:14:28.920 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:14:28.920 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:14:28.921 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:14:28.921 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:14:28.921 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:14:28.921 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:14:28.921 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:14:28.921 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:14:28.921 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:14:28.921 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:14:28.921 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:14:28.922 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:14:28.922 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:14:28.922 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:14:28.922 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:14:28.922 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:14:28.922 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:14:28.922 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:14:28.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:14:28.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:14:28.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:14:28.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:14:28.923 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:14:28.924 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:14:28.924 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:14:28.924 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:14:28.924 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:14:28.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:28.926 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:14:28.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:2023-11-24T06:14:28.985+0000 7f0117979480 -1 init, newargv = 0x55de83d62bc0 newargc=15 2023-11-24T06:14:28.988 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[105064]: starting ceph client 2023-11-24T06:14:28.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[105064]: starting fuse 2023-11-24T06:14:29.015 INFO:teuthology.orchestra.run.smithi022.stdout:41 2023-11-24T06:14:29.015 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> import re 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> import os 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:14:29.016 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> return f 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.0")) 2023-11-24T06:14:29.017 DEBUG:teuthology.orchestra.run.smithi022:> ' 2023-11-24T06:14:29.234 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.0.105064.asok 2023-11-24T06:14:29.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:14:29.251 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.105064.asok 2023-11-24T06:14:29.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:29.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.105064.asok status 2023-11-24T06:14:29.505 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:14:29.505 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2023-11-24T06:14:29.505 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:14:29.505 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:14:29.505 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "0", 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "105064", 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/" 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 5973, 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2023-11-24T06:14:29.506 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 5973 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4241488859 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:14:29.507 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4241488859 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.5973 192.168.0.1:0/4241488859", 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.1:0/4241488859", 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 1, 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 25, 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 47, 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2023-11-24T06:14:29.508 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:14:29.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:29.520 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2023-11-24T06:14:29.520 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:29.580 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2023-11-24T06:14:29.580 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:29.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:29.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:29.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:14:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.910+0000 7f41bc9fa640 1 Processor -- start 2023-11-24T06:14:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.910+0000 7f41bc9fa640 1 -- start start 2023-11-24T06:14:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.912+0000 7f41bc9fa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b813dfd0 0x7f41b815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.912+0000 7f41bc9fa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41b80cf050 0x7f41b80cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.912+0000 7f41bc9fa640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b80ce7c0 con 0x7f41b806c130 2023-11-24T06:14:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.912+0000 7f41bc9fa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b80cfa10 con 0x7f41b80cf050 2023-11-24T06:14:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.912+0000 7f41bc9fa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8140900 con 0x7f41b813dfd0 2023-11-24T06:14:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.913+0000 7f41b7fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f41b806c130 0x7f41b806c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60740/0 (socket says 172.21.15.22:60740) 2023-11-24T06:14:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.913+0000 7f41b7fff640 1 -- 172.21.15.22:0/3258221742 learned_addr learned my addr 172.21.15.22:0/3258221742 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.913+0000 7f41affff640 1 --2- 172.21.15.22:0/3258221742 >> v2:172.21.15.31:3300/0 conn(0x7f41b80cf050 0x7f41b80cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.913+0000 7f41b77fe640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b813dfd0 0x7f41b815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.913+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011429212 0 0) 0x7f41b80ce7c0 con 0x7f41b806c130 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.913+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a4003520 con 0x7f41b806c130 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3241065 0 0) 0x7f41a4003520 con 0x7f41b806c130 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b813dfd0 msgr2=0x7f41b815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b813dfd0 0x7f41b815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 >> v2:172.21.15.31:3300/0 conn(0x7f41b80cf050 msgr2=0x7f41b80cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 --2- 172.21.15.22:0/3258221742 >> v2:172.21.15.31:3300/0 conn(0x7f41b80cf050 0x7f41b80cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b815fa70 con 0x7f41b806c130 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f41b00019f0 con 0x7f41b806c130 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 >> v1:172.21.15.22:6789/0 conn(0x7f41b806c130 legacy=0x7f41b806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a40047c0 0x7f41a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b813dfd0 0x7f41a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80cfa10 con 0x7f41a40039e0 2023-11-24T06:14:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8140900 con 0x7f41a40047c0 2023-11-24T06:14:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a400b980 con 0x7f41b813dfd0 2023-11-24T06:14:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.914+0000 7f41b77fe640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.915+0000 7f41affff640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a40047c0 0x7f41a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.915+0000 7f41b77fe640 1 -- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b813dfd0 msgr2=0x7f41a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.915+0000 7f41b77fe640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b813dfd0 0x7f41a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.915+0000 7f41b77fe640 1 -- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a40047c0 msgr2=0x7f41a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.915+0000 7f41b77fe640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a40047c0 0x7f41a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.915+0000 7f41b77fe640 1 -- 172.21.15.22:0/3258221742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4003520 con 0x7f41a40039e0 2023-11-24T06:14:29.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.915+0000 7f41affff640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a40047c0 0x7f41a4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:29.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.916+0000 7f41b77fe640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41a4003e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009af0 tx=0x7f41a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10caffe2bbc9c38 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.916+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a802c710 con 0x7f41a40039e0 2023-11-24T06:14:29.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.916+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a802c870 con 0x7f41a40039e0 2023-11-24T06:14:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.916+0000 7f41b6ffd640 1 -- 172.21.15.22:0/3258221742 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a802cc00 con 0x7f41a40039e0 2023-11-24T06:14:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.917+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3258221742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 msgr2=0x7f41a4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.917+0000 7f41bc9fa640 1 --2- 172.21.15.22:0/3258221742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41a4003e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009af0 tx=0x7f41a40057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.917+0000 7f41b7fff640 1 -- 172.21.15.22:0/3258221742 reap_dead start 2023-11-24T06:14:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.917+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3258221742 shutdown_connections 2023-11-24T06:14:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.917+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3258221742 >> 172.21.15.22:0/3258221742 conn(0x7f41b806a860 msgr2=0x7f41b806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.917+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3258221742 shutdown_connections 2023-11-24T06:14:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.917+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3258221742 wait complete. 2023-11-24T06:14:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.919+0000 7f41bc9fa640 1 Processor -- start 2023-11-24T06:14:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.919+0000 7f41bc9fa640 1 -- start start 2023-11-24T06:14:29.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.920+0000 7f41bc9fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41b80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.920+0000 7f41bc9fa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b81552b0 0x7f41b8154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.920+0000 7f41bc9fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b8152d40 0x7f41b81531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.920+0000 7f41bc9fa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8155150 con 0x7f41a40039e0 2023-11-24T06:14:29.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.920+0000 7f41bc9fa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8070200 con 0x7f41b8152d40 2023-11-24T06:14:29.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.920+0000 7f41bc9fa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80b3950 con 0x7f41b81552b0 2023-11-24T06:14:29.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.920+0000 7f41b77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41b80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.920+0000 7f41b77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41b80b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38120/0 (socket says 172.21.15.22:38120) 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.920+0000 7f41b77fe640 1 -- 172.21.15.22:0/3464192835 learned_addr learned my addr 172.21.15.22:0/3464192835 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41affff640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b81552b0 0x7f41b8154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b7fff640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b8152d40 0x7f41b81531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b77fe640 1 -- 172.21.15.22:0/3464192835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b81552b0 msgr2=0x7f41b8154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b77fe640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b81552b0 0x7f41b8154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b77fe640 1 -- 172.21.15.22:0/3464192835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b8152d40 msgr2=0x7f41b81531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b77fe640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b8152d40 0x7f41b81531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b77fe640 1 -- 172.21.15.22:0/3464192835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8071490 con 0x7f41a40039e0 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b77fe640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41b80b3330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f41a802c2b0 tx=0x7f41a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b4ff9640 1 -- 172.21.15.22:0/3464192835 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8003810 con 0x7f41a40039e0 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b4ff9640 1 -- 172.21.15.22:0/3464192835 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a802de90 con 0x7f41a40039e0 2023-11-24T06:14:29.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41b4ff9640 1 -- 172.21.15.22:0/3464192835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8003b70 con 0x7f41a40039e0 2023-11-24T06:14:29.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.921+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b8071770 con 0x7f41a40039e0 2023-11-24T06:14:29.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.922+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b813a0c0 con 0x7f41a40039e0 2023-11-24T06:14:29.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.923+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b804e840 con 0x7f41a40039e0 2023-11-24T06:14:29.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.924+0000 7f41b4ff9640 1 -- 172.21.15.22:0/3464192835 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f41a8003cd0 con 0x7f41a40039e0 2023-11-24T06:14:29.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.925+0000 7f41b4ff9640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419806aff0 0x7f419806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.925+0000 7f41b4ff9640 1 -- 172.21.15.22:0/3464192835 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41a80ab750 con 0x7f41a40039e0 2023-11-24T06:14:29.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.925+0000 7f41affff640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419806aff0 0x7f419806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.926+0000 7f41affff640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419806aff0 0x7f419806d4b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41b80ae6f0 tx=0x7f41a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:29.929+0000 7f41b4ff9640 1 -- 172.21.15.22:0/3464192835 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41a8076610 con 0x7f41a40039e0 2023-11-24T06:14:30.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.166+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f41b813a250 con 0x7f41a40039e0 2023-11-24T06:14:30.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.167+0000 7f41b4ff9640 1 -- 172.21.15.22:0/3464192835 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f41a8079c30 con 0x7f41a40039e0 2023-11-24T06:14:30.169 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:14:30.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419806aff0 msgr2=0x7f419806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419806aff0 0x7f419806d4b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41b80ae6f0 tx=0x7f41a0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:30.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 msgr2=0x7f41b80b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41b80b3330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f41a802c2b0 tx=0x7f41a8004730 comp rx=0 tx=0).stop 2023-11-24T06:14:30.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 shutdown_connections 2023-11-24T06:14:30.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f419806aff0 0x7f419806d4b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b8152d40 0x7f41b81531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41b81552b0 0x7f41b8154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 --2- 172.21.15.22:0/3464192835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a40039e0 0x7f41b80b3330 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 >> 172.21.15.22:0/3464192835 conn(0x7f41b806a860 msgr2=0x7f41b813cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:30.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 shutdown_connections 2023-11-24T06:14:30.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:30.170+0000 7f41bc9fa640 1 -- 172.21.15.22:0/3464192835 wait complete. 2023-11-24T06:14:30.192 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:14:30.192 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:14:30.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-11-24T06:14:30.192 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:14:30.192 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:30.192 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:14:30.192 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:14:30.192 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:14:30.192 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:14:30.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:30.193 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-11-24T06:14:30.256 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:14:30.256 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:14:30.256 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:14:30.256 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-11-24T06:14:30.257 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42131sec preferred_lft 42131sec 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:5c:4a:a6:48:09 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c062:1fff:fe91:be78/64 scope link 2023-11-24T06:14:30.258 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:30.259 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:14:30.259 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:5c:4a:a6:48:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:30.259 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c45c:4aff:fea6:4809/64 scope link 2023-11-24T06:14:30.259 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:30.259 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:14:30.259 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether e2:ba:d2:fd:ba:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:14:30.259 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::e0ba:d2ff:fefd:bac8/64 scope link 2023-11-24T06:14:30.259 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:30.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:30.260 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:14:30.355 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-11-24T06:14:30.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:30.359 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:30.417 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:14:30.417 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:14:30.417 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:14:30.417 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:14:30.417 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:14:30.417 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:14:30.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:30.613 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-24T06:14:30.666 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:14:30.666 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:14:30.667 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:14:30.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:30.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-11-24T06:14:30.768 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T06:14:30.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:30.768 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:30.827 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:14:30.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:30.828 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:30.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:14:30.987 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:14:31.049 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:14:31.049 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:14:31.049 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:14:31.049 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:14:31.049 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:14:31.049 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:14:31.049 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:14:31.050 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:31.051 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:31.052 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:14:31.052 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:14:31.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:31.053 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:14:31.112 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T06:14:31.113 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T06:14:31.119 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:14:31.201 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:14:31.247 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:14:31.247 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:14:31.247 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:14:31.247 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:14:31.247 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:14:31.247 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:14:31.247 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:14:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:14:31.250 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:31.250 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:31.250 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:14:31.250 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:14:31.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:31.251 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:14:31.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:2023-11-24T06:14:31.309+0000 7f3c9303a480 -1 init, newargv = 0x5557c257ac50 newargc=15 2023-11-24T06:14:31.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[95933]: starting ceph client 2023-11-24T06:14:31.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[95933]: starting fuse 2023-11-24T06:14:32.398 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:14:32.511 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:14:32.575 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:14:32.576 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:14:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:14:32.578 INFO:teuthology.orchestra.run.smithi031.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:32.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:32.580 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:14:32.636 INFO:teuthology.orchestra.run.smithi031.stdout:41 2023-11-24T06:14:32.636 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T06:14:32.636 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:14:32.636 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> import re 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2023-11-24T06:14:32.637 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> return f 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.1")) 2023-11-24T06:14:32.638 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-11-24T06:14:32.831 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.1.95933.asok 2023-11-24T06:14:32.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:14:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:14:32.849 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.95933.asok 2023-11-24T06:14:32.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:32.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.95933.asok status 2023-11-24T06:14:33.104 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-24T06:14:33.104 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2023-11-24T06:14:33.104 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:14:33.104 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:14:33.104 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "1", 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "95933", 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5176, 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2023-11-24T06:14:33.105 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 5176 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1265988326 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1265988326 2023-11-24T06:14:33.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:14:33.107 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.5176 192.168.0.1:0/1265988326", 2023-11-24T06:14:33.107 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/1265988326", 2023-11-24T06:14:33.107 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2023-11-24T06:14:33.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 25, 2023-11-24T06:14:33.107 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 47, 2023-11-24T06:14:33.107 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:14:33.107 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2023-11-24T06:14:33.107 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2023-11-24T06:14:33.107 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-24T06:14:33.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:33.119 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2023-11-24T06:14:33.119 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:33.175 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2023-11-24T06:14:33.176 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:33.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:33.176 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:33.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:14:33.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.517+0000 7fc5b3f33640 1 Processor -- start 2023-11-24T06:14:33.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.517+0000 7fc5b3f33640 1 -- start start 2023-11-24T06:14:33.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.519+0000 7fc5b3f33640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac09cb30 0x7fc5ac0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.519+0000 7fc5b3f33640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5ac0adb60 0x7fc5ac0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.519+0000 7fc5b3f33640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac15b730 con 0x7fc5ac15b350 2023-11-24T06:14:33.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.519+0000 7fc5b3f33640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac0ac740 con 0x7fc5ac0adb60 2023-11-24T06:14:33.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.519+0000 7fc5b3f33640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0ac460 con 0x7fc5ac09cb30 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.519+0000 7fc5b24d0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5ac0adb60 0x7fc5ac0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.519+0000 7fc5b24d0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5ac0adb60 0x7fc5ac0adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40822/0 (socket says 172.21.15.22:40822) 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.519+0000 7fc5b24d0640 1 -- 172.21.15.22:0/920250732 learned_addr learned my addr 172.21.15.22:0/920250732 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.519+0000 7fc5b1ccf640 1 --1- 172.21.15.22:0/920250732 >> v1:172.21.15.22:6789/0 conn(0x7fc5ac15b350 0x7fc5ac0b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37092/0 (socket says 172.21.15.22:37092) 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.520+0000 7fc5b14ce640 1 --2- 172.21.15.22:0/920250732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac09cb30 0x7fc5ac0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.520+0000 7fc5b24d0640 1 -- 172.21.15.22:0/920250732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac09cb30 msgr2=0x7fc5ac0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.520+0000 7fc5b24d0640 1 --2- 172.21.15.22:0/920250732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac09cb30 0x7fc5ac0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.520+0000 7fc5b24d0640 1 -- 172.21.15.22:0/920250732 >> v1:172.21.15.22:6789/0 conn(0x7fc5ac15b350 legacy=0x7fc5ac0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.520+0000 7fc5b24d0640 1 -- 172.21.15.22:0/920250732 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac0b2a50 con 0x7fc5ac0adb60 2023-11-24T06:14:33.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.520+0000 7fc5b14ce640 1 --2- 172.21.15.22:0/920250732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac09cb30 0x7fc5ac0abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:33.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.521+0000 7fc5b24d0640 1 --2- 172.21.15.22:0/920250732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0adb60 0x7fc5ac0adfb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e50 tx=0x7fc5a402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc7a68e45f170e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.521+0000 7fc5b0ccd640 1 -- 172.21.15.22:0/920250732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a402c8d0 con 0x7fc5ac0adb60 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.521+0000 7fc5b0ccd640 1 -- 172.21.15.22:0/920250732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a402ca30 con 0x7fc5ac0adb60 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.521+0000 7fc5b0ccd640 1 -- 172.21.15.22:0/920250732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a402cdc0 con 0x7fc5ac0adb60 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.522+0000 7fc5b3f33640 1 -- 172.21.15.22:0/920250732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0adb60 msgr2=0x7fc5ac0adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.522+0000 7fc5b3f33640 1 --2- 172.21.15.22:0/920250732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0adb60 0x7fc5ac0adfb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e50 tx=0x7fc5a402bdb0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.522+0000 7fc5b3f33640 1 -- 172.21.15.22:0/920250732 shutdown_connections 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.522+0000 7fc5b3f33640 1 --2- 172.21.15.22:0/920250732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0adb60 0x7fc5ac0adfb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.522+0000 7fc5b3f33640 1 --2- 172.21.15.22:0/920250732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac09cb30 0x7fc5ac0abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.522+0000 7fc5b3f33640 1 -- 172.21.15.22:0/920250732 >> 172.21.15.22:0/920250732 conn(0x7fc5ac0b0ba0 msgr2=0x7fc5ac0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.522+0000 7fc5b3f33640 1 -- 172.21.15.22:0/920250732 shutdown_connections 2023-11-24T06:14:33.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.522+0000 7fc5b3f33640 1 -- 172.21.15.22:0/920250732 wait complete. 2023-11-24T06:14:33.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.524+0000 7fc5b3f33640 1 Processor -- start 2023-11-24T06:14:33.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.524+0000 7fc5b3f33640 1 -- start start 2023-11-24T06:14:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.525+0000 7fc5b3f33640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac09cb30 0x7fc5ac1409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.525+0000 7fc5b3f33640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5ac0adb60 0x7fc5ac154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.525+0000 7fc5b3f33640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac15b350 0x7fc5ac1512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.525+0000 7fc5b3f33640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac140f10 con 0x7fc5ac09cb30 2023-11-24T06:14:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.525+0000 7fc5b3f33640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac1532c0 con 0x7fc5ac0adb60 2023-11-24T06:14:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.525+0000 7fc5b3f33640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac1535a0 con 0x7fc5ac15b350 2023-11-24T06:14:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.525+0000 7fc5b1ccf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac09cb30 0x7fc5ac1409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.525+0000 7fc5b1ccf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac09cb30 0x7fc5ac1409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40836/0 (socket says 172.21.15.22:40836) 2023-11-24T06:14:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.525+0000 7fc5b1ccf640 1 -- 172.21.15.22:0/64866861 learned_addr learned my addr 172.21.15.22:0/64866861 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5b1ccf640 1 -- 172.21.15.22:0/64866861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac15b350 msgr2=0x7fc5ac1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5b24d0640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac15b350 0x7fc5ac1512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5b1ccf640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac15b350 0x7fc5ac1512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5b14ce640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5ac0adb60 0x7fc5ac154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5b1ccf640 1 -- 172.21.15.22:0/64866861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5ac0adb60 msgr2=0x7fc5ac154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5b1ccf640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5ac0adb60 0x7fc5ac154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5b1ccf640 1 -- 172.21.15.22:0/64866861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009b30 con 0x7fc5ac09cb30 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5b1ccf640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac09cb30 0x7fc5ac1409d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800c7d0 tx=0x7fc5a800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5a27fc640 1 -- 172.21.15.22:0/64866861 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a80074e0 con 0x7fc5ac09cb30 2023-11-24T06:14:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5a27fc640 1 -- 172.21.15.22:0/64866861 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a8007640 con 0x7fc5ac09cb30 2023-11-24T06:14:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5a27fc640 1 -- 172.21.15.22:0/64866861 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8004a00 con 0x7fc5ac09cb30 2023-11-24T06:14:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.526+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac153880 con 0x7fc5ac09cb30 2023-11-24T06:14:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.527+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac153e40 con 0x7fc5ac09cb30 2023-11-24T06:14:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.528+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac09d200 con 0x7fc5ac09cb30 2023-11-24T06:14:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.529+0000 7fc5a27fc640 1 -- 172.21.15.22:0/64866861 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc5a8004b60 con 0x7fc5ac09cb30 2023-11-24T06:14:33.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.530+0000 7fc5a27fc640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59006aff0 0x7fc59006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.530+0000 7fc5a27fc640 1 -- 172.21.15.22:0/64866861 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5a8088db0 con 0x7fc5ac09cb30 2023-11-24T06:14:33.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.530+0000 7fc5b14ce640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59006aff0 0x7fc59006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.531+0000 7fc5b14ce640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59006aff0 0x7fc59006d4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac150f50 tx=0x7fc59c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.535+0000 7fc5a27fc640 1 -- 172.21.15.22:0/64866861 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5a8053b50 con 0x7fc5ac09cb30 2023-11-24T06:14:33.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.768+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5ac15b730 con 0x7fc5ac09cb30 2023-11-24T06:14:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.822+0000 7fc5a27fc640 1 -- 172.21.15.22:0/64866861 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 136+0+0 (secure 0 0 0) 0x7fc5ac15b730 con 0x7fc5ac09cb30 2023-11-24T06:14:33.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.825+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59006aff0 msgr2=0x7fc59006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.825+0000 7fc5b3f33640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59006aff0 0x7fc59006d4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac150f50 tx=0x7fc59c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:33.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.825+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac09cb30 msgr2=0x7fc5ac1409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.825+0000 7fc5b3f33640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac09cb30 0x7fc5ac1409d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800c7d0 tx=0x7fc5a800cc90 comp rx=0 tx=0).stop 2023-11-24T06:14:33.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.826+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 shutdown_connections 2023-11-24T06:14:33.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.826+0000 7fc5b3f33640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc59006aff0 0x7fc59006d4b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.826+0000 7fc5b3f33640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5ac15b350 0x7fc5ac1512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.826+0000 7fc5b3f33640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5ac0adb60 0x7fc5ac154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.826+0000 7fc5b3f33640 1 --2- 172.21.15.22:0/64866861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac09cb30 0x7fc5ac1409d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.826+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 >> 172.21.15.22:0/64866861 conn(0x7fc5ac0b0ba0 msgr2=0x7fc5ac06db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:33.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.826+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 shutdown_connections 2023-11-24T06:14:33.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:33.827+0000 7fc5b3f33640 1 -- 172.21.15.22:0/64866861 wait complete. 2023-11-24T06:14:33.850 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:14:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.075+0000 7f3ac87de640 1 Processor -- start 2023-11-24T06:14:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.076+0000 7f3ac87de640 1 -- start start 2023-11-24T06:14:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.077+0000 7f3ac87de640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ac006fdf0 0x7f3ac015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.077+0000 7f3ac87de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3ac00701d0 0x7f3ac015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.077+0000 7f3ac87de640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ac015c4f0 0x7f3ac0140840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.077+0000 7f3ac87de640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac015fd40 con 0x7f3ac006fdf0 2023-11-24T06:14:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.077+0000 7f3ac87de640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac013e530 con 0x7f3ac00701d0 2023-11-24T06:14:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.077+0000 7f3ac87de640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac015f270 con 0x7f3ac015c4f0 2023-11-24T06:14:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.078+0000 7f3ac657a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ac006fdf0 0x7f3ac015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.078+0000 7f3ac657a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ac006fdf0 0x7f3ac015ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40838/0 (socket says 172.21.15.22:40838) 2023-11-24T06:14:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.078+0000 7f3ac657a640 1 -- 172.21.15.22:0/3085602237 learned_addr learned my addr 172.21.15.22:0/3085602237 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.078+0000 7f3ac657a640 1 -- 172.21.15.22:0/3085602237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ac015c4f0 msgr2=0x7f3ac0140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.078+0000 7f3ac657a640 1 --2- 172.21.15.22:0/3085602237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ac015c4f0 0x7f3ac0140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.078+0000 7f3ac657a640 1 -- 172.21.15.22:0/3085602237 >> v2:172.21.15.31:3300/0 conn(0x7f3ac00701d0 msgr2=0x7f3ac015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.078+0000 7f3ac657a640 1 --2- 172.21.15.22:0/3085602237 >> v2:172.21.15.31:3300/0 conn(0x7f3ac00701d0 0x7f3ac015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.078+0000 7f3ac657a640 1 -- 172.21.15.22:0/3085602237 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac015f4a0 con 0x7f3ac006fdf0 2023-11-24T06:14:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.079+0000 7f3ac657a640 1 --2- 172.21.15.22:0/3085602237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac006fdf0 0x7f3ac015ed30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00d1d40 tx=0x7f3abc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658a3cec97245243 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac5578640 1 -- 172.21.15.22:0/3085602237 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc02ca70 con 0x7f3ac006fdf0 2023-11-24T06:14:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac5578640 1 -- 172.21.15.22:0/3085602237 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc02cbd0 con 0x7f3ac006fdf0 2023-11-24T06:14:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac5578640 1 -- 172.21.15.22:0/3085602237 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc0343f0 con 0x7f3ac006fdf0 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac87de640 1 -- 172.21.15.22:0/3085602237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac006fdf0 msgr2=0x7f3ac015ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac87de640 1 --2- 172.21.15.22:0/3085602237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac006fdf0 0x7f3ac015ed30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00d1d40 tx=0x7f3abc02bed0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac87de640 1 -- 172.21.15.22:0/3085602237 shutdown_connections 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac87de640 1 --2- 172.21.15.22:0/3085602237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ac015c4f0 0x7f3ac0140840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac87de640 1 --2- 172.21.15.22:0/3085602237 >> v2:172.21.15.31:3300/0 conn(0x7f3ac00701d0 0x7f3ac015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac87de640 1 --2- 172.21.15.22:0/3085602237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac006fdf0 0x7f3ac015ed30 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac87de640 1 -- 172.21.15.22:0/3085602237 >> 172.21.15.22:0/3085602237 conn(0x7f3ac0066610 msgr2=0x7f3ac0066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac87de640 1 -- 172.21.15.22:0/3085602237 shutdown_connections 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.080+0000 7f3ac87de640 1 -- 172.21.15.22:0/3085602237 wait complete. 2023-11-24T06:14:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.082+0000 7f3ac87de640 1 Processor -- start 2023-11-24T06:14:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.082+0000 7f3ac87de640 1 -- start start 2023-11-24T06:14:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.083+0000 7f3ac87de640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ac006fdf0 0x7f3ac013dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac87de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac00701d0 0x7f3ac00b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac87de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ac0155e00 0x7f3ac00b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac87de640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac01565a0 con 0x7f3ac00701d0 2023-11-24T06:14:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac87de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac01562c0 con 0x7f3ac0155e00 2023-11-24T06:14:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac87de640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac0152900 con 0x7f3ac006fdf0 2023-11-24T06:14:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac5d79640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac00701d0 0x7f3ac00b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac5d79640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac00701d0 0x7f3ac00b5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40854/0 (socket says 172.21.15.22:40854) 2023-11-24T06:14:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac5d79640 1 -- 172.21.15.22:0/2926367416 learned_addr learned my addr 172.21.15.22:0/2926367416 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac5d79640 1 -- 172.21.15.22:0/2926367416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ac006fdf0 msgr2=0x7f3ac013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac5d79640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ac006fdf0 0x7f3ac013dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac5d79640 1 -- 172.21.15.22:0/2926367416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ac0155e00 msgr2=0x7f3ac00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac6d7b640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ac0155e00 0x7f3ac00b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac5d79640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ac0155e00 0x7f3ac00b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.084+0000 7f3ac5d79640 1 -- 172.21.15.22:0/2926367416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc009b30 con 0x7f3ac00701d0 2023-11-24T06:14:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.085+0000 7f3ac5d79640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac00701d0 0x7f3ac00b5360 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000b4a0 tx=0x7f3ab000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.085+0000 7f3ab6ffd640 1 -- 172.21.15.22:0/2926367416 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0010610 con 0x7f3ac00701d0 2023-11-24T06:14:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.085+0000 7f3ab6ffd640 1 -- 172.21.15.22:0/2926367416 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab0010770 con 0x7f3ac00701d0 2023-11-24T06:14:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.085+0000 7f3ab6ffd640 1 -- 172.21.15.22:0/2926367416 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0010b20 con 0x7f3ac00701d0 2023-11-24T06:14:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.085+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac0152be0 con 0x7f3ac00701d0 2023-11-24T06:14:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.085+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac013d8c0 con 0x7f3ac00701d0 2023-11-24T06:14:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.087+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac0153100 con 0x7f3ac00701d0 2023-11-24T06:14:34.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.087+0000 7f3ab6ffd640 1 -- 172.21.15.22:0/2926367416 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3ab0010c80 con 0x7f3ac00701d0 2023-11-24T06:14:34.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.088+0000 7f3ab6ffd640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3aa406b020 0x7f3aa406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.088+0000 7f3ab6ffd640 1 -- 172.21.15.22:0/2926367416 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ab00894a0 con 0x7f3ac00701d0 2023-11-24T06:14:34.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.089+0000 7f3ac657a640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3aa406b020 0x7f3aa406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.089+0000 7f3ac657a640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3aa406b020 0x7f3aa406d4e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3abc035000 tx=0x7f3abc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:34.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.093+0000 7f3ab6ffd640 1 -- 172.21.15.22:0/2926367416 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ac0153100 con 0x7f3ac00701d0 2023-11-24T06:14:34.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.310+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ac013e950 con 0x7f3aa406b020 2023-11-24T06:14:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.312+0000 7f3ab6ffd640 1 -- 172.21.15.22:0/2926367416 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3abc009510 con 0x7f3aa406b020 2023-11-24T06:14:34.315 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-11-24T06:14:34.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:14:34.315 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-11-24T06:14:34.315 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:14:34.315 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-11-24T06:14:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3aa406b020 msgr2=0x7f3aa406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3aa406b020 0x7f3aa406d4e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3abc035000 tx=0x7f3abc02e000 comp rx=0 tx=0).stop 2023-11-24T06:14:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac00701d0 msgr2=0x7f3ac00b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac00701d0 0x7f3ac00b5360 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000b4a0 tx=0x7f3ab000b960 comp rx=0 tx=0).stop 2023-11-24T06:14:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 shutdown_connections 2023-11-24T06:14:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3aa406b020 0x7f3aa406d4e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ac0155e00 0x7f3ac00b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac00701d0 0x7f3ac00b5360 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 --2- 172.21.15.22:0/2926367416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ac006fdf0 0x7f3ac013dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 >> 172.21.15.22:0/2926367416 conn(0x7f3ac0066610 msgr2=0x7f3ac00b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 shutdown_connections 2023-11-24T06:14:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.315+0000 7f3ac87de640 1 -- 172.21.15.22:0/2926367416 wait complete. 2023-11-24T06:14:34.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:14:34.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.550+0000 7fe9aab4c640 1 Processor -- start 2023-11-24T06:14:34.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.550+0000 7fe9aab4c640 1 -- start start 2023-11-24T06:14:34.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.552+0000 7fe9aab4c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe9a4160b10 0x7fe9a406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.552+0000 7fe9aab4c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a4071780 con 0x7fe9a406cad0 2023-11-24T06:14:34.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.553+0000 7fe9aab4c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a40711c0 con 0x7fe9a4072280 2023-11-24T06:14:34.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.553+0000 7fe9aab4c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a40b2320 con 0x7fe9a4160b10 2023-11-24T06:14:34.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.553+0000 7fe9a88e8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe9a4160b10 0x7fe9a406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.553+0000 7fe9a88e8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe9a4160b10 0x7fe9a406e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40858/0 (socket says 172.21.15.22:40858) 2023-11-24T06:14:34.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.553+0000 7fe9a88e8640 1 -- 172.21.15.22:0/2299503467 learned_addr learned my addr 172.21.15.22:0/2299503467 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:34.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.553+0000 7fe9a88e8640 1 -- 172.21.15.22:0/2299503467 >> v1:172.21.15.31:6789/0 conn(0x7fe9a4072280 legacy=0x7fe9a406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:34.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.553+0000 7fe9a88e8640 1 -- 172.21.15.22:0/2299503467 >> v1:172.21.15.22:6789/0 conn(0x7fe9a406cad0 legacy=0x7fe9a40b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.553+0000 7fe9a88e8640 1 -- 172.21.15.22:0/2299503467 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a40714a0 con 0x7fe9a4160b10 2023-11-24T06:14:34.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.555+0000 7fe9a88e8640 1 --2- 172.21.15.22:0/2299503467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4160b10 0x7fe9a406e420 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe998009870 tx=0x7fe99802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7359d73cd11e2d33 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:34.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.555+0000 7fe9a37fe640 1 -- 172.21.15.22:0/2299503467 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998031870 con 0x7fe9a4160b10 2023-11-24T06:14:34.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.555+0000 7fe9a37fe640 1 -- 172.21.15.22:0/2299503467 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9980319d0 con 0x7fe9a4160b10 2023-11-24T06:14:34.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.555+0000 7fe9a37fe640 1 -- 172.21.15.22:0/2299503467 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998031d60 con 0x7fe9a4160b10 2023-11-24T06:14:34.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.555+0000 7fe9aab4c640 1 -- 172.21.15.22:0/2299503467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4160b10 msgr2=0x7fe9a406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.556+0000 7fe9aab4c640 1 --2- 172.21.15.22:0/2299503467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4160b10 0x7fe9a406e420 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe998009870 tx=0x7fe99802b910 comp rx=0 tx=0).stop 2023-11-24T06:14:34.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.556+0000 7fe9aab4c640 1 -- 172.21.15.22:0/2299503467 shutdown_connections 2023-11-24T06:14:34.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.556+0000 7fe9aab4c640 1 --2- 172.21.15.22:0/2299503467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4160b10 0x7fe9a406e420 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.556+0000 7fe9aab4c640 1 -- 172.21.15.22:0/2299503467 >> 172.21.15.22:0/2299503467 conn(0x7fe9a40b0ba0 msgr2=0x7fe9a40b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:34.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.556+0000 7fe9aab4c640 1 -- 172.21.15.22:0/2299503467 shutdown_connections 2023-11-24T06:14:34.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.556+0000 7fe9aab4c640 1 -- 172.21.15.22:0/2299503467 wait complete. 2023-11-24T06:14:34.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.557+0000 7fe9aab4c640 1 Processor -- start 2023-11-24T06:14:34.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.558+0000 7fe9aab4c640 1 -- start start 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9aab4c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9a406cad0 0x7fe9a40b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9aab4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4072280 0x7fe9a414b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9aab4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9a4160b10 0x7fe9a414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9aab4c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40cc230 con 0x7fe9a4072280 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9aab4c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a409c8c0 con 0x7fe9a4160b10 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9aab4c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40cc480 con 0x7fe9a406cad0 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9a3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4072280 0x7fe9a414b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9a3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4072280 0x7fe9a414b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40864/0 (socket says 172.21.15.22:40864) 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9a3fff640 1 -- 172.21.15.22:0/3730288896 learned_addr learned my addr 172.21.15.22:0/3730288896 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:34.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9a3fff640 1 -- 172.21.15.22:0/3730288896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9a406cad0 msgr2=0x7fe9a40b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9a3fff640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9a406cad0 0x7fe9a40b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9a3fff640 1 -- 172.21.15.22:0/3730288896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9a4160b10 msgr2=0x7fe9a414bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9a3fff640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9a4160b10 0x7fe9a414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.559+0000 7fe9a3fff640 1 -- 172.21.15.22:0/3730288896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980094d0 con 0x7fe9a4072280 2023-11-24T06:14:34.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.560+0000 7fe9a3fff640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4072280 0x7fe9a414b6e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe99000c430 tx=0x7fe99000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:34.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.560+0000 7fe9a17fa640 1 -- 172.21.15.22:0/3730288896 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990011790 con 0x7fe9a4072280 2023-11-24T06:14:34.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.560+0000 7fe9a17fa640 1 -- 172.21.15.22:0/3730288896 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9900118f0 con 0x7fe9a4072280 2023-11-24T06:14:34.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.560+0000 7fe9a17fa640 1 -- 172.21.15.22:0/3730288896 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990011ce0 con 0x7fe9a4072280 2023-11-24T06:14:34.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.560+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a40cc760 con 0x7fe9a4072280 2023-11-24T06:14:34.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.560+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a40b07f0 con 0x7fe9a4072280 2023-11-24T06:14:34.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.561+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a40ccc80 con 0x7fe9a4072280 2023-11-24T06:14:34.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.562+0000 7fe9a17fa640 1 -- 172.21.15.22:0/3730288896 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe99001c460 con 0x7fe9a4072280 2023-11-24T06:14:34.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.563+0000 7fe9a17fa640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe98806aff0 0x7fe98806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.563+0000 7fe9a17fa640 1 -- 172.21.15.22:0/3730288896 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9900898f0 con 0x7fe9a4072280 2023-11-24T06:14:34.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.564+0000 7fe9a88e8640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe98806aff0 0x7fe98806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.564+0000 7fe9a88e8640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe98806aff0 0x7fe98806d4b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe998036000 tx=0x7fe998030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:34.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.568+0000 7fe9a17fa640 1 -- 172.21.15.22:0/3730288896 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9a40ccc80 con 0x7fe9a4072280 2023-11-24T06:14:34.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.761+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe9a40ccc80 con 0x7fe9a4072280 2023-11-24T06:14:34.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.762+0000 7fe9a17fa640 1 -- 172.21.15.22:0/3730288896 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe9a40ccc80 con 0x7fe9a4072280 2023-11-24T06:14:34.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.765+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe98806aff0 msgr2=0x7fe98806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.765+0000 7fe9aab4c640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe98806aff0 0x7fe98806d4b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe998036000 tx=0x7fe998030000 comp rx=0 tx=0).stop 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.765+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4072280 msgr2=0x7fe9a414b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.765+0000 7fe9aab4c640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4072280 0x7fe9a414b6e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe99000c430 tx=0x7fe99000c8f0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.765+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 shutdown_connections 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.765+0000 7fe9aab4c640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe98806aff0 0x7fe98806d4b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.765+0000 7fe9aab4c640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9a4160b10 0x7fe9a414bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.765+0000 7fe9aab4c640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9a4072280 0x7fe9a414b6e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.765+0000 7fe9aab4c640 1 --2- 172.21.15.22:0/3730288896 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9a406cad0 0x7fe9a40b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.766+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 >> 172.21.15.22:0/3730288896 conn(0x7fe9a40b0ba0 msgr2=0x7fe9a40cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.766+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 shutdown_connections 2023-11-24T06:14:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:34.766+0000 7fe9aab4c640 1 -- 172.21.15.22:0/3730288896 wait complete. 2023-11-24T06:14:34.789 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:14:34.789 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:34.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:35.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.068+0000 7faeeee59640 1 Processor -- start 2023-11-24T06:14:35.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.068+0000 7faeeee59640 1 -- start start 2023-11-24T06:14:35.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.069+0000 7faeeee59640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee8157770 0x7faee806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.070+0000 7faeeee59640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faee815df80 0x7faee8070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.070+0000 7faeeee59640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee8161670 con 0x7faee806d080 2023-11-24T06:14:35.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.070+0000 7faeeee59640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee815e410 con 0x7faee815df80 2023-11-24T06:14:35.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.070+0000 7faeeee59640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee806d500 con 0x7faee8157770 2023-11-24T06:14:35.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.070+0000 7faeed656640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faee806d080 0x7faee815d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37120/0 (socket says 172.21.15.22:37120) 2023-11-24T06:14:35.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.070+0000 7faeed656640 1 -- 172.21.15.22:0/4042030462 learned_addr learned my addr 172.21.15.22:0/4042030462 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:35.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.070+0000 7faeee658640 1 --2- 172.21.15.22:0/4042030462 >> v2:172.21.15.22:3300/0 conn(0x7faee815df80 0x7faee8070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.070+0000 7faeede57640 1 --2- 172.21.15.22:0/4042030462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee8157770 0x7faee806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.071+0000 7faeee658640 1 -- 172.21.15.22:0/4042030462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee8157770 msgr2=0x7faee806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:35.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.071+0000 7faeece55640 1 -- 172.21.15.22:0/4042030462 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217485682 0 0) 0x7faee8161670 con 0x7faee806d080 2023-11-24T06:14:35.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.071+0000 7faeee658640 1 --2- 172.21.15.22:0/4042030462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee8157770 0x7faee806cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.071+0000 7faeee658640 1 -- 172.21.15.22:0/4042030462 >> v1:172.21.15.22:6789/0 conn(0x7faee806d080 legacy=0x7faee815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.071+0000 7faeee658640 1 -- 172.21.15.22:0/4042030462 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee815e610 con 0x7faee815df80 2023-11-24T06:14:35.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.071+0000 7faeede57640 1 --2- 172.21.15.22:0/4042030462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee8157770 0x7faee806cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:35.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.072+0000 7faeee658640 1 --2- 172.21.15.22:0/4042030462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee815df80 0x7faee8070720 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faee0009d90 tx=0x7faee002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa263b643f7412a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.072+0000 7faeece55640 1 -- 172.21.15.22:0/4042030462 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee002cc60 con 0x7faee815df80 2023-11-24T06:14:35.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.072+0000 7faeece55640 1 -- 172.21.15.22:0/4042030462 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee002cdc0 con 0x7faee815df80 2023-11-24T06:14:35.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.072+0000 7faeece55640 1 -- 172.21.15.22:0/4042030462 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0034660 con 0x7faee815df80 2023-11-24T06:14:35.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.073+0000 7faeeee59640 1 -- 172.21.15.22:0/4042030462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee815df80 msgr2=0x7faee8070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.073+0000 7faeeee59640 1 --2- 172.21.15.22:0/4042030462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee815df80 0x7faee8070720 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faee0009d90 tx=0x7faee002beb0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.073+0000 7faeeee59640 1 -- 172.21.15.22:0/4042030462 shutdown_connections 2023-11-24T06:14:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.073+0000 7faeeee59640 1 --2- 172.21.15.22:0/4042030462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee815df80 0x7faee8070720 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.073+0000 7faeeee59640 1 --2- 172.21.15.22:0/4042030462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee8157770 0x7faee806cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.073+0000 7faeeee59640 1 -- 172.21.15.22:0/4042030462 >> 172.21.15.22:0/4042030462 conn(0x7faee806a860 msgr2=0x7faee806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.073+0000 7faeeee59640 1 -- 172.21.15.22:0/4042030462 shutdown_connections 2023-11-24T06:14:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.073+0000 7faeeee59640 1 -- 172.21.15.22:0/4042030462 wait complete. 2023-11-24T06:14:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.075+0000 7faeeee59640 1 Processor -- start 2023-11-24T06:14:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.075+0000 7faeeee59640 1 -- start start 2023-11-24T06:14:35.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.076+0000 7faeeee59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee806d080 0x7faee80cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.076+0000 7faeeee59640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faee8157770 0x7faee814e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.076+0000 7faeeee59640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee815df80 0x7faee80cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.076+0000 7faeeee59640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80cb640 con 0x7faee806d080 2023-11-24T06:14:35.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.076+0000 7faeeee59640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80cd1f0 con 0x7faee8157770 2023-11-24T06:14:35.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.076+0000 7faeeee59640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee80cad30 con 0x7faee815df80 2023-11-24T06:14:35.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.076+0000 7faeede57640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee806d080 0x7faee80cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.076+0000 7faeede57640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee806d080 0x7faee80cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40884/0 (socket says 172.21.15.22:40884) 2023-11-24T06:14:35.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.076+0000 7faeede57640 1 -- 172.21.15.22:0/3257317014 learned_addr learned my addr 172.21.15.22:0/3257317014 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:35.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faeed656640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faee8157770 0x7faee814e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faeee658640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee815df80 0x7faee80cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faeede57640 1 -- 172.21.15.22:0/3257317014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee815df80 msgr2=0x7faee80cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faeede57640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee815df80 0x7faee80cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faeede57640 1 -- 172.21.15.22:0/3257317014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faee8157770 msgr2=0x7faee814e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faeede57640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faee8157770 0x7faee814e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faeede57640 1 -- 172.21.15.22:0/3257317014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee0009a70 con 0x7faee806d080 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faeed656640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faee8157770 0x7faee814e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faeede57640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee806d080 0x7faee80cba60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7faee400c7f0 tx=0x7faee400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.077+0000 7faede7fc640 1 -- 172.21.15.22:0/3257317014 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4007a30 con 0x7faee806d080 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.078+0000 7faede7fc640 1 -- 172.21.15.22:0/3257317014 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee4007b90 con 0x7faee806d080 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.078+0000 7faede7fc640 1 -- 172.21.15.22:0/3257317014 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400ce40 con 0x7faee806d080 2023-11-24T06:14:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.078+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee80ccf70 con 0x7faee806d080 2023-11-24T06:14:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.078+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee814ea60 con 0x7faee806d080 2023-11-24T06:14:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.079+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee804e840 con 0x7faee806d080 2023-11-24T06:14:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.080+0000 7faede7fc640 1 -- 172.21.15.22:0/3257317014 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faee40113f0 con 0x7faee806d080 2023-11-24T06:14:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.081+0000 7faede7fc640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faecc06aff0 0x7faecc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.081+0000 7faede7fc640 1 -- 172.21.15.22:0/3257317014 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faee4089c80 con 0x7faee806d080 2023-11-24T06:14:35.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.081+0000 7faeed656640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faecc06aff0 0x7faecc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.082+0000 7faeed656640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faecc06aff0 0x7faecc06d4b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faee8151f20 tx=0x7faed8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.085+0000 7faede7fc640 1 -- 172.21.15.22:0/3257317014 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faee4054900 con 0x7faee806d080 2023-11-24T06:14:35.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.275+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faee80b05b0 con 0x7faee806d080 2023-11-24T06:14:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.277+0000 7faede7fc640 1 -- 172.21.15.22:0/3257317014 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16465 (secure 0 0 0) 0x7faee401f090 con 0x7faee806d080 2023-11-24T06:14:35.280 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:35.280 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":47,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:16.422982+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.279+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faecc06aff0 msgr2=0x7faecc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.279+0000 7faeeee59640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faecc06aff0 0x7faecc06d4b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faee8151f20 tx=0x7faed8009040 comp rx=0 tx=0).stop 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.279+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee806d080 msgr2=0x7faee80cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.279+0000 7faeeee59640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee806d080 0x7faee80cba60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7faee400c7f0 tx=0x7faee400cbf0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.280+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 shutdown_connections 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.280+0000 7faeeee59640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faecc06aff0 0x7faecc06d4b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.280+0000 7faeeee59640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faee815df80 0x7faee80cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.280+0000 7faeeee59640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faee8157770 0x7faee814e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.280+0000 7faeeee59640 1 --2- 172.21.15.22:0/3257317014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faee806d080 0x7faee80cba60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.280+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 >> 172.21.15.22:0/3257317014 conn(0x7faee806a860 msgr2=0x7faee8070720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.280+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 shutdown_connections 2023-11-24T06:14:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.280+0000 7faeeee59640 1 -- 172.21.15.22:0/3257317014 wait complete. 2023-11-24T06:14:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:12.796187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:13.964719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:35.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.512+0000 7fb816e52640 1 Processor -- start 2023-11-24T06:14:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.512+0000 7fb816e52640 1 -- start start 2023-11-24T06:14:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.514+0000 7fb816e52640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb81015b380 0x7fb8100cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.514+0000 7fb816e52640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8100cf420 0x7fb8100cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.514+0000 7fb816e52640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8100cfdc0 con 0x7fb8100b14d0 2023-11-24T06:14:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.514+0000 7fb816e52640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8100d1960 con 0x7fb8100cf420 2023-11-24T06:14:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.514+0000 7fb816e52640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8100b07a0 con 0x7fb81015b380 2023-11-24T06:14:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.514+0000 7fb81564f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8100cf420 0x7fb8100cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.514+0000 7fb81564f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8100cf420 0x7fb8100cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40896/0 (socket says 172.21.15.22:40896) 2023-11-24T06:14:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.514+0000 7fb81564f640 1 -- 172.21.15.22:0/2011602831 learned_addr learned my addr 172.21.15.22:0/2011602831 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.515+0000 7fb81564f640 1 -- 172.21.15.22:0/2011602831 >> v2:172.21.15.31:3300/0 conn(0x7fb81015b380 msgr2=0x7fb8100cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.515+0000 7fb81564f640 1 --2- 172.21.15.22:0/2011602831 >> v2:172.21.15.31:3300/0 conn(0x7fb81015b380 0x7fb8100cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.515+0000 7fb81564f640 1 -- 172.21.15.22:0/2011602831 >> v1:172.21.15.22:6789/0 conn(0x7fb8100b14d0 legacy=0x7fb8100b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.515+0000 7fb81564f640 1 -- 172.21.15.22:0/2011602831 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8100d1bb0 con 0x7fb8100cf420 2023-11-24T06:14:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.516+0000 7fb81564f640 1 --2- 172.21.15.22:0/2011602831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 0x7fb8100cf880 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb810070da0 tx=0x7fb80002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73bf6ae869352ac server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.516+0000 7fb814e4e640 1 -- 172.21.15.22:0/2011602831 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800031870 con 0x7fb8100cf420 2023-11-24T06:14:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.516+0000 7fb814e4e640 1 -- 172.21.15.22:0/2011602831 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8000319d0 con 0x7fb8100cf420 2023-11-24T06:14:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.516+0000 7fb814e4e640 1 -- 172.21.15.22:0/2011602831 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800031d60 con 0x7fb8100cf420 2023-11-24T06:14:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.517+0000 7fb816e52640 1 -- 172.21.15.22:0/2011602831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 msgr2=0x7fb8100cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.517+0000 7fb816e52640 1 --2- 172.21.15.22:0/2011602831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 0x7fb8100cf880 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb810070da0 tx=0x7fb80002b910 comp rx=0 tx=0).stop 2023-11-24T06:14:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.517+0000 7fb816e52640 1 -- 172.21.15.22:0/2011602831 shutdown_connections 2023-11-24T06:14:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.517+0000 7fb816e52640 1 --2- 172.21.15.22:0/2011602831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 0x7fb8100cf880 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.517+0000 7fb816e52640 1 --2- 172.21.15.22:0/2011602831 >> v2:172.21.15.31:3300/0 conn(0x7fb81015b380 0x7fb8100cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.517+0000 7fb816e52640 1 -- 172.21.15.22:0/2011602831 >> 172.21.15.22:0/2011602831 conn(0x7fb8100d0e40 msgr2=0x7fb8100d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.517+0000 7fb816e52640 1 -- 172.21.15.22:0/2011602831 shutdown_connections 2023-11-24T06:14:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.517+0000 7fb816e52640 1 -- 172.21.15.22:0/2011602831 wait complete. 2023-11-24T06:14:35.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.519+0000 7fb816e52640 1 Processor -- start 2023-11-24T06:14:35.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.519+0000 7fb816e52640 1 -- start start 2023-11-24T06:14:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb816e52640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8100b14d0 0x7fb81009e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb816e52640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 0x7fb8101e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb816e52640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb81015b380 0x7fb8101460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb816e52640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81009ed10 con 0x7fb8100cf420 2023-11-24T06:14:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb816e52640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb810144d80 con 0x7fb8100b14d0 2023-11-24T06:14:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb816e52640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb810145040 con 0x7fb81015b380 2023-11-24T06:14:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb81564f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 0x7fb8101e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb81564f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 0x7fb8101e37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40906/0 (socket says 172.21.15.22:40906) 2023-11-24T06:14:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb81564f640 1 -- 172.21.15.22:0/3629553928 learned_addr learned my addr 172.21.15.22:0/3629553928 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.520+0000 7fb815e50640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8100b14d0 0x7fb81009e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb81564f640 1 -- 172.21.15.22:0/3629553928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb81015b380 msgr2=0x7fb8101460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb81564f640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb81015b380 0x7fb8101460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb81564f640 1 -- 172.21.15.22:0/3629553928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8100b14d0 msgr2=0x7fb81009e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb81564f640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8100b14d0 0x7fb81009e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb81564f640 1 -- 172.21.15.22:0/3629553928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8000094d0 con 0x7fb8100cf420 2023-11-24T06:14:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb81564f640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 0x7fb8101e37e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb800000c00 tx=0x7fb8000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb8067fc640 1 -- 172.21.15.22:0/3629553928 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800031840 con 0x7fb8100cf420 2023-11-24T06:14:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb8067fc640 1 -- 172.21.15.22:0/3629553928 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8000443f0 con 0x7fb8100cf420 2023-11-24T06:14:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb8067fc640 1 -- 172.21.15.22:0/3629553928 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8000447a0 con 0x7fb8100cf420 2023-11-24T06:14:35.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.521+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb810145320 con 0x7fb8100cf420 2023-11-24T06:14:35.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.522+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8101458e0 con 0x7fb8100cf420 2023-11-24T06:14:35.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.523+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81006af70 con 0x7fb8100cf420 2023-11-24T06:14:35.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.523+0000 7fb8067fc640 1 -- 172.21.15.22:0/3629553928 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb80004d450 con 0x7fb8100cf420 2023-11-24T06:14:35.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.524+0000 7fb8067fc640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7f406aff0 0x7fb7f406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.524+0000 7fb8067fc640 1 -- 172.21.15.22:0/3629553928 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb80002d040 con 0x7fb8100cf420 2023-11-24T06:14:35.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.525+0000 7fb815e50640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7f406aff0 0x7fb7f406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.525+0000 7fb815e50640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7f406aff0 0x7fb7f406d4b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00b810 tx=0x7fb80c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.529+0000 7fb8067fc640 1 -- 172.21.15.22:0/3629553928 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb800076fa0 con 0x7fb8100cf420 2023-11-24T06:14:35.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.722+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb81004e840 con 0x7fb8100cf420 2023-11-24T06:14:35.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.723+0000 7fb8067fc640 1 -- 172.21.15.22:0/3629553928 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb80007a5c0 con 0x7fb8100cf420 2023-11-24T06:14:35.726 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7f406aff0 msgr2=0x7fb7f406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7f406aff0 0x7fb7f406d4b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00b810 tx=0x7fb80c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 msgr2=0x7fb8101e37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 0x7fb8101e37e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb800000c00 tx=0x7fb8000046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 shutdown_connections 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb7f406aff0 0x7fb7f406d4b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb81015b380 0x7fb8101460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8100cf420 0x7fb8101e37e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 --2- 172.21.15.22:0/3629553928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8100b14d0 0x7fb81009e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 >> 172.21.15.22:0/3629553928 conn(0x7fb8100d0e40 msgr2=0x7fb81015dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:35.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 shutdown_connections 2023-11-24T06:14:35.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.726+0000 7fb816e52640 1 -- 172.21.15.22:0/3629553928 wait complete. 2023-11-24T06:14:35.747 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:35.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.978+0000 7fea8c823640 1 Processor -- start 2023-11-24T06:14:35.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.978+0000 7fea8c823640 1 -- start start 2023-11-24T06:14:35.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.980+0000 7fea8c823640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fea8806dc30 0x7fea880ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.980+0000 7fea8c823640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 0x7fea88070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.980+0000 7fea8c823640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8806d7a0 con 0x7fea880acd70 2023-11-24T06:14:35.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.980+0000 7fea8c823640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8815a5b0 con 0x7fea8806dc30 2023-11-24T06:14:35.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.980+0000 7fea8c823640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea880ae9d0 con 0x7fea88070490 2023-11-24T06:14:35.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.981+0000 7fea85d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fea8806dc30 0x7fea880ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.981+0000 7fea86d9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 0x7fea88070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.981+0000 7fea85d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fea8806dc30 0x7fea880ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:48460/0 (socket says 172.21.15.22:48460) 2023-11-24T06:14:35.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.981+0000 7fea85d9b640 1 -- 172.21.15.22:0/3923166214 learned_addr learned my addr 172.21.15.22:0/3923166214 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:35.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.982+0000 7fea85d9b640 1 -- 172.21.15.22:0/3923166214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 msgr2=0x7fea88070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:35.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.982+0000 7fea85d9b640 1 --2- 172.21.15.22:0/3923166214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 0x7fea88070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.982+0000 7fea85d9b640 1 -- 172.21.15.22:0/3923166214 >> v1:172.21.15.31:6789/0 conn(0x7fea880acd70 legacy=0x7fea880ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.982+0000 7fea85d9b640 1 -- 172.21.15.22:0/3923166214 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8806ce70 con 0x7fea8806dc30 2023-11-24T06:14:35.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.982+0000 7fea86d9d640 1 --2- 172.21.15.22:0/3923166214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 0x7fea88070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.982+0000 7fea8559a640 1 -- 172.21.15.22:0/3923166214 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999834720 0 0) 0x7fea8806d7a0 con 0x7fea880acd70 2023-11-24T06:14:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.983+0000 7fea85d9b640 1 --2- 172.21.15.22:0/3923166214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea8806dc30 0x7fea880ae490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea70009e50 tx=0x7fea7002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef9df5f598898163 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.984+0000 7fea8559a640 1 -- 172.21.15.22:0/3923166214 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7002cb00 con 0x7fea8806dc30 2023-11-24T06:14:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.984+0000 7fea8559a640 1 -- 172.21.15.22:0/3923166214 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7002cc60 con 0x7fea8806dc30 2023-11-24T06:14:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.984+0000 7fea8559a640 1 -- 172.21.15.22:0/3923166214 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea700343f0 con 0x7fea8806dc30 2023-11-24T06:14:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.984+0000 7fea8c823640 1 -- 172.21.15.22:0/3923166214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea8806dc30 msgr2=0x7fea880ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.984+0000 7fea8c823640 1 --2- 172.21.15.22:0/3923166214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea8806dc30 0x7fea880ae490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea70009e50 tx=0x7fea7002bf60 comp rx=0 tx=0).stop 2023-11-24T06:14:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.985+0000 7fea8c823640 1 -- 172.21.15.22:0/3923166214 shutdown_connections 2023-11-24T06:14:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.985+0000 7fea8c823640 1 --2- 172.21.15.22:0/3923166214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 0x7fea88070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.985+0000 7fea8c823640 1 --2- 172.21.15.22:0/3923166214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea8806dc30 0x7fea880ae490 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.985+0000 7fea8c823640 1 -- 172.21.15.22:0/3923166214 >> 172.21.15.22:0/3923166214 conn(0x7fea880b0ba0 msgr2=0x7fea880b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.985+0000 7fea8c823640 1 -- 172.21.15.22:0/3923166214 shutdown_connections 2023-11-24T06:14:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.985+0000 7fea8c823640 1 -- 172.21.15.22:0/3923166214 wait complete. 2023-11-24T06:14:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.987+0000 7fea8c823640 1 Processor -- start 2023-11-24T06:14:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.987+0000 7fea8c823640 1 -- start start 2023-11-24T06:14:35.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.988+0000 7fea8c823640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea8806dc30 0x7fea8809b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.988+0000 7fea8c823640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 0x7fea880c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.988+0000 7fea8c823640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea880acd70 0x7fea88148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.988+0000 7fea8c823640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea880c9270 con 0x7fea8806dc30 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.988+0000 7fea8c823640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea88149100 con 0x7fea880acd70 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.988+0000 7fea8c823640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8809bd40 con 0x7fea88070490 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.988+0000 7fea8659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea8806dc30 0x7fea8809b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.988+0000 7fea8659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea8806dc30 0x7fea8809b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40908/0 (socket says 172.21.15.22:40908) 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.988+0000 7fea8659c640 1 -- 172.21.15.22:0/2334045890 learned_addr learned my addr 172.21.15.22:0/2334045890 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea86d9d640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea880acd70 0x7fea88148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea85d9b640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 0x7fea880c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea8659c640 1 -- 172.21.15.22:0/2334045890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 msgr2=0x7fea880c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea8659c640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 0x7fea880c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea8659c640 1 -- 172.21.15.22:0/2334045890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea880acd70 msgr2=0x7fea88148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea8659c640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea880acd70 0x7fea88148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea8659c640 1 -- 172.21.15.22:0/2334045890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea80009400 con 0x7fea8806dc30 2023-11-24T06:14:35.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea8659c640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea8806dc30 0x7fea8809b760 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fea7800c4b0 tx=0x7fea7800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea7effd640 1 -- 172.21.15.22:0/2334045890 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78005480 con 0x7fea8806dc30 2023-11-24T06:14:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea7effd640 1 -- 172.21.15.22:0/2334045890 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea780035f0 con 0x7fea8806dc30 2023-11-24T06:14:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea7effd640 1 -- 172.21.15.22:0/2334045890 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780039e0 con 0x7fea8806dc30 2023-11-24T06:14:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.989+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea70009b30 con 0x7fea8806dc30 2023-11-24T06:14:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.990+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8809c300 con 0x7fea8806dc30 2023-11-24T06:14:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.991+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8804e920 con 0x7fea8806dc30 2023-11-24T06:14:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.992+0000 7fea7effd640 1 -- 172.21.15.22:0/2334045890 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fea78003b40 con 0x7fea8806dc30 2023-11-24T06:14:35.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.993+0000 7fea7effd640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6806aff0 0x7fea6806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.993+0000 7fea7effd640 1 -- 172.21.15.22:0/2334045890 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea78088f20 con 0x7fea8806dc30 2023-11-24T06:14:35.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.993+0000 7fea85d9b640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6806aff0 0x7fea6806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.994+0000 7fea85d9b640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6806aff0 0x7fea6806d4b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea70035000 tx=0x7fea70030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:36.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:35.998+0000 7fea7effd640 1 -- 172.21.15.22:0/2334045890 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea78053d50 con 0x7fea8806dc30 2023-11-24T06:14:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.192+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea880b1d30 con 0x7fea8806dc30 2023-11-24T06:14:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.193+0000 7fea7effd640 1 -- 172.21.15.22:0/2334045890 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea78017020 con 0x7fea8806dc30 2023-11-24T06:14:36.196 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6806aff0 msgr2=0x7fea6806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6806aff0 0x7fea6806d4b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea70035000 tx=0x7fea70030000 comp rx=0 tx=0).stop 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea8806dc30 msgr2=0x7fea8809b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea8806dc30 0x7fea8809b760 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fea7800c4b0 tx=0x7fea7800c970 comp rx=0 tx=0).stop 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 shutdown_connections 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea6806aff0 0x7fea6806d4b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea880acd70 0x7fea88148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea88070490 0x7fea880c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 --2- 172.21.15.22:0/2334045890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea8806dc30 0x7fea8809b760 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 >> 172.21.15.22:0/2334045890 conn(0x7fea880b0ba0 msgr2=0x7fea8806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 shutdown_connections 2023-11-24T06:14:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.196+0000 7fea8c823640 1 -- 172.21.15.22:0/2334045890 wait complete. 2023-11-24T06:14:36.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:36.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.450+0000 7fbb9327e640 1 Processor -- start 2023-11-24T06:14:36.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.451+0000 7fbb9327e640 1 -- start start 2023-11-24T06:14:36.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.452+0000 7fbb9327e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb8c144770 0x7fbb8c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.452+0000 7fbb9327e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbb8c0b35a0 0x7fbb8c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.452+0000 7fbb9327e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb8c06c9d0 0x7fbb8c06ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.452+0000 7fbb9327e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c0b43b0 con 0x7fbb8c0b35a0 2023-11-24T06:14:36.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.452+0000 7fbb9327e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c15f930 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.452+0000 7fbb9327e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0b3b10 con 0x7fbb8c144770 2023-11-24T06:14:36.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb91a7b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbb8c0b35a0 0x7fbb8c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb91a7b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbb8c0b35a0 0x7fbb8c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40910/0 (socket says 172.21.15.22:40910) 2023-11-24T06:14:36.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb91a7b640 1 -- 172.21.15.22:0/3196407918 learned_addr learned my addr 172.21.15.22:0/3196407918 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:36.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb9227c640 1 --2- 172.21.15.22:0/3196407918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb8c144770 0x7fbb8c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb92a7d640 1 --2- 172.21.15.22:0/3196407918 >> v2:172.21.15.31:3300/0 conn(0x7fbb8c06c9d0 0x7fbb8c06ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb91a7b640 1 -- 172.21.15.22:0/3196407918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb8c144770 msgr2=0x7fbb8c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:36.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb91a7b640 1 --2- 172.21.15.22:0/3196407918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb8c144770 0x7fbb8c15eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb91a7b640 1 -- 172.21.15.22:0/3196407918 >> v2:172.21.15.31:3300/0 conn(0x7fbb8c06c9d0 msgr2=0x7fbb8c06ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:36.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb91a7b640 1 --2- 172.21.15.22:0/3196407918 >> v2:172.21.15.31:3300/0 conn(0x7fbb8c06c9d0 0x7fbb8c06ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.453+0000 7fbb91a7b640 1 -- 172.21.15.22:0/3196407918 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0b3df0 con 0x7fbb8c0b35a0 2023-11-24T06:14:36.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.454+0000 7fbb91a7b640 1 --2- 172.21.15.22:0/3196407918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c0b35a0 0x7fbb8c15f0a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009870 tx=0x7fbb7c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd2f5d9a6cb07e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:36.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.455+0000 7fbb9127a640 1 -- 172.21.15.22:0/3196407918 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c031640 con 0x7fbb8c0b35a0 2023-11-24T06:14:36.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.455+0000 7fbb9127a640 1 -- 172.21.15.22:0/3196407918 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c0317a0 con 0x7fbb8c0b35a0 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.455+0000 7fbb9127a640 1 -- 172.21.15.22:0/3196407918 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c031b30 con 0x7fbb8c0b35a0 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.455+0000 7fbb9327e640 1 -- 172.21.15.22:0/3196407918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c0b35a0 msgr2=0x7fbb8c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.455+0000 7fbb9327e640 1 --2- 172.21.15.22:0/3196407918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c0b35a0 0x7fbb8c15f0a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009870 tx=0x7fbb7c02b8f0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.456+0000 7fbb9327e640 1 -- 172.21.15.22:0/3196407918 shutdown_connections 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.456+0000 7fbb9327e640 1 --2- 172.21.15.22:0/3196407918 >> v2:172.21.15.31:3300/0 conn(0x7fbb8c06c9d0 0x7fbb8c06ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.456+0000 7fbb9327e640 1 --2- 172.21.15.22:0/3196407918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c0b35a0 0x7fbb8c15f0a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.456+0000 7fbb9327e640 1 --2- 172.21.15.22:0/3196407918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb8c144770 0x7fbb8c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.456+0000 7fbb9327e640 1 -- 172.21.15.22:0/3196407918 >> 172.21.15.22:0/3196407918 conn(0x7fbb8c0cec10 msgr2=0x7fbb8c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.456+0000 7fbb9327e640 1 -- 172.21.15.22:0/3196407918 shutdown_connections 2023-11-24T06:14:36.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.456+0000 7fbb9327e640 1 -- 172.21.15.22:0/3196407918 wait complete. 2023-11-24T06:14:36.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.458+0000 7fbb9327e640 1 Processor -- start 2023-11-24T06:14:36.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.458+0000 7fbb9327e640 1 -- start start 2023-11-24T06:14:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9327e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c06c9d0 0x7fbb8c0adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9327e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8c0b35a0 0x7fbb8c13d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9327e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb8c144770 0x7fbb8c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9327e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0acbc0 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9327e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0acea0 con 0x7fbb8c0b35a0 2023-11-24T06:14:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9327e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0ad180 con 0x7fbb8c144770 2023-11-24T06:14:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9227c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c06c9d0 0x7fbb8c0adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9227c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c06c9d0 0x7fbb8c0adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40922/0 (socket says 172.21.15.22:40922) 2023-11-24T06:14:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9227c640 1 -- 172.21.15.22:0/449490096 learned_addr learned my addr 172.21.15.22:0/449490096 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:36.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9227c640 1 -- 172.21.15.22:0/449490096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb8c144770 msgr2=0x7fbb8c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9227c640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb8c144770 0x7fbb8c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9227c640 1 -- 172.21.15.22:0/449490096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8c0b35a0 msgr2=0x7fbb8c13d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.459+0000 7fbb9227c640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8c0b35a0 0x7fbb8c13d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.460+0000 7fbb9227c640 1 -- 172.21.15.22:0/449490096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0094d0 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.460+0000 7fbb9227c640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c06c9d0 0x7fbb8c0adc60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800d5f0 tx=0x7fbb8800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:36.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.460+0000 7fbb82ffd640 1 -- 172.21.15.22:0/449490096 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880125f0 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.460+0000 7fbb82ffd640 1 -- 172.21.15.22:0/449490096 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88012750 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.460+0000 7fbb82ffd640 1 -- 172.21.15.22:0/449490096 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88012b00 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.460+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c0ad460 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.460+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c0ac870 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.462+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c04e840 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.463+0000 7fbb82ffd640 1 -- 172.21.15.22:0/449490096 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbb88012c60 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.464+0000 7fbb82ffd640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb7006aff0 0x7fbb7006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.464+0000 7fbb82ffd640 1 -- 172.21.15.22:0/449490096 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb88089d90 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.464+0000 7fbb91a7b640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb7006aff0 0x7fbb7006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.465+0000 7fbb91a7b640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb7006aff0 0x7fbb7006d4b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c036000 tx=0x7fbb7c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:36.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.469+0000 7fbb82ffd640 1 -- 172.21.15.22:0/449490096 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb88054bc0 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.666+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb8c0b2460 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.667+0000 7fbb82ffd640 1 -- 172.21.15.22:0/449490096 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb880581e0 con 0x7fbb8c06c9d0 2023-11-24T06:14:36.672 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:14:36.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb7006aff0 msgr2=0x7fbb7006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb7006aff0 0x7fbb7006d4b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c036000 tx=0x7fbb7c030000 comp rx=0 tx=0).stop 2023-11-24T06:14:36.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c06c9d0 msgr2=0x7fbb8c0adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c06c9d0 0x7fbb8c0adc60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800d5f0 tx=0x7fbb8800dab0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 shutdown_connections 2023-11-24T06:14:36.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb7006aff0 0x7fbb7006d4b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb8c144770 0x7fbb8c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8c0b35a0 0x7fbb8c13d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 --2- 172.21.15.22:0/449490096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb8c06c9d0 0x7fbb8c0adc60 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 >> 172.21.15.22:0/449490096 conn(0x7fbb8c0cec10 msgr2=0x7fbb8c13e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 shutdown_connections 2023-11-24T06:14:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.670+0000 7fbb9327e640 1 -- 172.21.15.22:0/449490096 wait complete. 2023-11-24T06:14:36.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.907+0000 7f1071ce7640 1 Processor -- start 2023-11-24T06:14:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.908+0000 7f1071ce7640 1 -- start start 2023-11-24T06:14:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.910+0000 7f1071ce7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c15dc50 0x7f106c15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.910+0000 7f1071ce7640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c0ce230 con 0x7f106c0ccc00 2023-11-24T06:14:36.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.910+0000 7f1071ce7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c1611c0 con 0x7f106c0cddd0 2023-11-24T06:14:36.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.910+0000 7f1071ce7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c160fe0 con 0x7f106c15dc50 2023-11-24T06:14:36.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.910+0000 7f106b7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f106c0ccc00 0x7f106c0ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37136/0 (socket says 172.21.15.22:37136) 2023-11-24T06:14:36.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.910+0000 7f106b7fe640 1 -- 172.21.15.22:0/2015541514 learned_addr learned my addr 172.21.15.22:0/2015541514 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:36.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.910+0000 7f106bfff640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c15dc50 0x7f106c15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.910+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950218435 0 0) 0x7f106c0ce230 con 0x7f106c0ccc00 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.910+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1058003520 con 0x7f106c0ccc00 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 119060617 0 0) 0x7f1058003520 con 0x7f106c0ccc00 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c15dc50 msgr2=0x7f106c15e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c15dc50 0x7f106c15e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 >> v1:172.21.15.31:6789/0 conn(0x7f106c0cddd0 legacy=0x7f106c0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c1614a0 con 0x7f106c0ccc00 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f105c0019f0 con 0x7f106c0ccc00 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 >> v1:172.21.15.22:6789/0 conn(0x7f106c0ccc00 legacy=0x7f106c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10580039a0 0x7f1058003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10580047c0 0x7f1058004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c15dc50 0x7f1058005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c160fe0 con 0x7f10580039a0 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105800bb40 con 0x7f10580047c0 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105800bd00 con 0x7f106c15dc50 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.911+0000 7f106b7fe640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10580039a0 0x7f1058003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.912+0000 7f106b7fe640 1 -- 172.21.15.22:0/2015541514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c15dc50 msgr2=0x7f1058005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.912+0000 7f106b7fe640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f106c15dc50 0x7f1058005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.912+0000 7f106b7fe640 1 -- 172.21.15.22:0/2015541514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10580047c0 msgr2=0x7f1058004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.912+0000 7f106b7fe640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10580047c0 0x7f1058004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.912+0000 7f106b7fe640 1 -- 172.21.15.22:0/2015541514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058003520 con 0x7f10580039a0 2023-11-24T06:14:36.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.913+0000 7f106b7fe640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10580039a0 0x7f1058003dc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f105c00a760 tx=0x7f10580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a40025277b29894 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:36.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.913+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c034630 con 0x7f10580039a0 2023-11-24T06:14:36.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.913+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c02f070 con 0x7f10580039a0 2023-11-24T06:14:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.913+0000 7f106a7fc640 1 -- 172.21.15.22:0/2015541514 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0349d0 con 0x7f10580039a0 2023-11-24T06:14:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.913+0000 7f1071ce7640 1 -- 172.21.15.22:0/2015541514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10580039a0 msgr2=0x7f1058003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.913+0000 7f1071ce7640 1 --2- 172.21.15.22:0/2015541514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10580039a0 0x7f1058003dc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f105c00a760 tx=0x7f10580057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.914+0000 7f106bfff640 1 -- 172.21.15.22:0/2015541514 reap_dead start 2023-11-24T06:14:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.914+0000 7f1071ce7640 1 -- 172.21.15.22:0/2015541514 shutdown_connections 2023-11-24T06:14:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.914+0000 7f1071ce7640 1 -- 172.21.15.22:0/2015541514 >> 172.21.15.22:0/2015541514 conn(0x7f106c0b23e0 msgr2=0x7f106c0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.914+0000 7f1071ce7640 1 -- 172.21.15.22:0/2015541514 shutdown_connections 2023-11-24T06:14:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.914+0000 7f1071ce7640 1 -- 172.21.15.22:0/2015541514 wait complete. 2023-11-24T06:14:36.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.915+0000 7f1071ce7640 1 Processor -- start 2023-11-24T06:14:36.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.916+0000 7f1071ce7640 1 -- start start 2023-11-24T06:14:36.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f1071ce7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10580039a0 0x7f106c14f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f1071ce7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c0c4a10 0x7f106c0c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f1071ce7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f106c06e4e0 0x7f106c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f1071ce7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c161e40 con 0x7f106c06e4e0 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f1071ce7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c06eea0 con 0x7f106c0c4a10 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f1071ce7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0c5a90 con 0x7f10580039a0 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f106bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f106c06e4e0 0x7f106c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f106bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f106c06e4e0 0x7f106c06e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40944/0 (socket says 172.21.15.22:40944) 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f106bfff640 1 -- 172.21.15.22:0/1753676186 learned_addr learned my addr 172.21.15.22:0/1753676186 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f106affd640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c0c4a10 0x7f106c0c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f106bfff640 1 -- 172.21.15.22:0/1753676186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10580039a0 msgr2=0x7f106c14f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f106b7fe640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10580039a0 0x7f106c14f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.917+0000 7f106bfff640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10580039a0 0x7f106c14f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f106bfff640 1 -- 172.21.15.22:0/1753676186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c0c4a10 msgr2=0x7f106c0c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f106bfff640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c0c4a10 0x7f106c0c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f106bfff640 1 -- 172.21.15.22:0/1753676186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c0c54d0 con 0x7f106c06e4e0 2023-11-24T06:14:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f106affd640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c0c4a10 0x7f106c0c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f106bfff640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f106c06e4e0 0x7f106c06e960 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f106c15e030 tx=0x7f106400d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f1063fff640 1 -- 172.21.15.22:0/1753676186 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064004030 con 0x7f106c06e4e0 2023-11-24T06:14:36.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f1063fff640 1 -- 172.21.15.22:0/1753676186 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10640041b0 con 0x7f106c06e4e0 2023-11-24T06:14:36.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f1063fff640 1 -- 172.21.15.22:0/1753676186 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064003610 con 0x7f106c06e4e0 2023-11-24T06:14:36.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c0c57b0 con 0x7f106c06e4e0 2023-11-24T06:14:36.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.918+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c1f39f0 con 0x7f106c06e4e0 2023-11-24T06:14:36.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.919+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c1f3570 con 0x7f106c06e4e0 2023-11-24T06:14:36.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.920+0000 7f1063fff640 1 -- 172.21.15.22:0/1753676186 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1064003770 con 0x7f106c06e4e0 2023-11-24T06:14:36.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.921+0000 7f1063fff640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f104c06aff0 0x7f104c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:36.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.921+0000 7f1063fff640 1 -- 172.21.15.22:0/1753676186 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10640890c0 con 0x7f106c06e4e0 2023-11-24T06:14:36.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.922+0000 7f106b7fe640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f104c06aff0 0x7f104c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.922+0000 7f106b7fe640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f104c06aff0 0x7f104c06d4b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f105c034000 tx=0x7f105c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:36.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:36.926+0000 7f1063fff640 1 -- 172.21.15.22:0/1753676186 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f106c1f3570 con 0x7f106c06e4e0 2023-11-24T06:14:37.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.133+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f106c1f3570 con 0x7f106c06e4e0 2023-11-24T06:14:37.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.133+0000 7f1063fff640 1 -- 172.21.15.22:0/1753676186 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f106c1f3570 con 0x7f106c06e4e0 2023-11-24T06:14:37.136 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:14:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f104c06aff0 msgr2=0x7f104c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f104c06aff0 0x7f104c06d4b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f105c034000 tx=0x7f105c02f000 comp rx=0 tx=0).stop 2023-11-24T06:14:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f106c06e4e0 msgr2=0x7f106c06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f106c06e4e0 0x7f106c06e960 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f106c15e030 tx=0x7f106400d8a0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 shutdown_connections 2023-11-24T06:14:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f104c06aff0 0x7f104c06d4b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f106c06e4e0 0x7f106c06e960 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f106c0c4a10 0x7f106c0c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 --2- 172.21.15.22:0/1753676186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10580039a0 0x7f106c14f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.136+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 >> 172.21.15.22:0/1753676186 conn(0x7f106c0b23e0 msgr2=0x7f106c0b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.137+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 shutdown_connections 2023-11-24T06:14:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.137+0000 7f1071ce7640 1 -- 172.21.15.22:0/1753676186 wait complete. 2023-11-24T06:14:37.159 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:14:37.159 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:37.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:37.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.430+0000 7f0c6d5ff640 1 Processor -- start 2023-11-24T06:14:37.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.430+0000 7f0c6d5ff640 1 -- start start 2023-11-24T06:14:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.432+0000 7f0c6d5ff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0c6813dfd0 0x7f0c6815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.432+0000 7f0c6d5ff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 0x7f0c6806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.432+0000 7f0c6d5ff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c680ce7c0 con 0x7f0c680cf050 2023-11-24T06:14:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.432+0000 7f0c6d5ff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c68140900 con 0x7f0c6813dfd0 2023-11-24T06:14:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.432+0000 7f0c6d5ff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6815fa70 con 0x7f0c680cf500 2023-11-24T06:14:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.432+0000 7f0c67fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0c6813dfd0 0x7f0c6815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.432+0000 7f0c67fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0c6813dfd0 0x7f0c6815be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40952/0 (socket says 172.21.15.22:40952) 2023-11-24T06:14:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.432+0000 7f0c67fff640 1 -- 172.21.15.22:0/2869448287 learned_addr learned my addr 172.21.15.22:0/2869448287 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:37.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.433+0000 7f0c6cdfe640 1 --2- 172.21.15.22:0/2869448287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 0x7f0c6806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.433+0000 7f0c67fff640 1 -- 172.21.15.22:0/2869448287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 msgr2=0x7f0c6806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.433+0000 7f0c67fff640 1 --2- 172.21.15.22:0/2869448287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 0x7f0c6806c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.433+0000 7f0c67fff640 1 -- 172.21.15.22:0/2869448287 >> v1:172.21.15.31:6789/0 conn(0x7f0c680cf050 legacy=0x7f0c6806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.433+0000 7f0c67fff640 1 -- 172.21.15.22:0/2869448287 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680cf950 con 0x7f0c6813dfd0 2023-11-24T06:14:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.434+0000 7f0c67fff640 1 --2- 172.21.15.22:0/2869448287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c6813dfd0 0x7f0c6815be70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0c680cfc10 tx=0x7f0c5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb27213b9f5fa6b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.434+0000 7f0c66ffd640 1 -- 172.21.15.22:0/2869448287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58031830 con 0x7f0c6813dfd0 2023-11-24T06:14:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.434+0000 7f0c66ffd640 1 -- 172.21.15.22:0/2869448287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58031990 con 0x7f0c6813dfd0 2023-11-24T06:14:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.434+0000 7f0c66ffd640 1 -- 172.21.15.22:0/2869448287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58031d20 con 0x7f0c6813dfd0 2023-11-24T06:14:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.435+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/2869448287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c6813dfd0 msgr2=0x7f0c6815be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.435+0000 7f0c6d5ff640 1 --2- 172.21.15.22:0/2869448287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c6813dfd0 0x7f0c6815be70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0c680cfc10 tx=0x7f0c5802b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.435+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/2869448287 shutdown_connections 2023-11-24T06:14:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.435+0000 7f0c6d5ff640 1 --2- 172.21.15.22:0/2869448287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 0x7f0c6806c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.435+0000 7f0c6d5ff640 1 --2- 172.21.15.22:0/2869448287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c6813dfd0 0x7f0c6815be70 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.435+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/2869448287 >> 172.21.15.22:0/2869448287 conn(0x7f0c6806a860 msgr2=0x7f0c6806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.435+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/2869448287 shutdown_connections 2023-11-24T06:14:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.435+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/2869448287 wait complete. 2023-11-24T06:14:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.437+0000 7f0c6d5ff640 1 Processor -- start 2023-11-24T06:14:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.437+0000 7f0c6d5ff640 1 -- start start 2023-11-24T06:14:37.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.438+0000 7f0c6d5ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c680cf050 0x7f0c680c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.438+0000 7f0c6d5ff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 0x7f0c6813b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.438+0000 7f0c6d5ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c6813dfd0 0x7f0c68158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.438+0000 7f0c6d5ff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680b29c0 con 0x7f0c680cf050 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.438+0000 7f0c6d5ff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6813bbf0 con 0x7f0c6813dfd0 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.438+0000 7f0c6d5ff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68156570 con 0x7f0c680cf500 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.438+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c680cf050 0x7f0c680c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.438+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c680cf050 0x7f0c680c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40962/0 (socket says 172.21.15.22:40962) 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.438+0000 7f0c67fff640 1 -- 172.21.15.22:0/3221082425 learned_addr learned my addr 172.21.15.22:0/3221082425 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c6cdfe640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c6813dfd0 0x7f0c68158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c677fe640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 0x7f0c6813b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c67fff640 1 -- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 msgr2=0x7f0c6813b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c67fff640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 0x7f0c6813b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c67fff640 1 -- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c6813dfd0 msgr2=0x7f0c68158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c67fff640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c6813dfd0 0x7f0c68158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c67fff640 1 -- 172.21.15.22:0/3221082425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580094d0 con 0x7f0c680cf050 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c6cdfe640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c6813dfd0 0x7f0c68158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c677fe640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 0x7f0c6813b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c67fff640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c680cf050 0x7f0c680c7ec0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c58000c00 tx=0x7f0c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.439+0000 7f0c64ff9640 1 -- 172.21.15.22:0/3221082425 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5803a8f0 con 0x7f0c680cf050 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.440+0000 7f0c64ff9640 1 -- 172.21.15.22:0/3221082425 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5803aa70 con 0x7f0c680cf050 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.440+0000 7f0c64ff9640 1 -- 172.21.15.22:0/3221082425 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5803ae20 con 0x7f0c680cf050 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.440+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c680b2690 con 0x7f0c680cf050 2023-11-24T06:14:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.440+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c68156af0 con 0x7f0c680cf050 2023-11-24T06:14:37.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.441+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c68156ce0 con 0x7f0c680cf050 2023-11-24T06:14:37.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.442+0000 7f0c64ff9640 1 -- 172.21.15.22:0/3221082425 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0c5804d450 con 0x7f0c680cf050 2023-11-24T06:14:37.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.443+0000 7f0c64ff9640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5406b020 0x7f0c5406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.443+0000 7f0c64ff9640 1 -- 172.21.15.22:0/3221082425 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c580abb20 con 0x7f0c680cf050 2023-11-24T06:14:37.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.443+0000 7f0c677fe640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5406b020 0x7f0c5406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.444+0000 7f0c677fe640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5406b020 0x7f0c5406d4e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0c680b06f0 tx=0x7f0c5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.448+0000 7f0c64ff9640 1 -- 172.21.15.22:0/3221082425 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c58076830 con 0x7f0c680cf050 2023-11-24T06:14:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.642+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c6804e840 con 0x7f0c680cf050 2023-11-24T06:14:37.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.645+0000 7f0c64ff9640 1 -- 172.21.15.22:0/3221082425 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16465 (secure 0 0 0) 0x7f0c58035020 con 0x7f0c680cf050 2023-11-24T06:14:37.648 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:37.649 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":47,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:16.422982+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5406b020 msgr2=0x7f0c5406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5406b020 0x7f0c5406d4e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0c680b06f0 tx=0x7f0c5c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c680cf050 msgr2=0x7f0c680c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c680cf050 0x7f0c680c7ec0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c58000c00 tx=0x7f0c580046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 shutdown_connections 2023-11-24T06:14:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0c5406b020 0x7f0c5406d4e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c6813dfd0 0x7f0c68158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c680cf500 0x7f0c6813b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 --2- 172.21.15.22:0/3221082425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c680cf050 0x7f0c680c7ec0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.648+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 >> 172.21.15.22:0/3221082425 conn(0x7f0c6806a860 msgr2=0x7f0c6813f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.649+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 shutdown_connections 2023-11-24T06:14:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.649+0000 7f0c6d5ff640 1 -- 172.21.15.22:0/3221082425 wait complete. 2023-11-24T06:14:37.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:12.796187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:13.964719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:37.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.888+0000 7f77eb59e640 1 Processor -- start 2023-11-24T06:14:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.888+0000 7f77eb59e640 1 -- start start 2023-11-24T06:14:37.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.890+0000 7f77eb59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec15d3b0 0x7f77ec0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.890+0000 7f77eb59e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f77ec0d1d90 0x7f77ec0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.890+0000 7f77eb59e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ec0c6bf0 con 0x7f77ec0d0fa0 2023-11-24T06:14:37.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.890+0000 7f77eb59e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ec0d1400 con 0x7f77ec0d1d90 2023-11-24T06:14:37.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.890+0000 7f77eb59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec0cedc0 con 0x7f77ec15d3b0 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.890+0000 7f77e3fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f77ec0d0fa0 0x7f77ec0d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37148/0 (socket says 172.21.15.22:37148) 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77e3fff640 1 -- 172.21.15.22:0/1344675322 learned_addr learned my addr 172.21.15.22:0/1344675322 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77ea59c640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec15d3b0 0x7f77ec0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77ead9d640 1 --2- 172.21.15.22:0/1344675322 >> v2:172.21.15.31:3300/0 conn(0x7f77ec0d1d90 0x7f77ec0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317190957 0 0) 0x7f77ec0c6bf0 con 0x7f77ec0d0fa0 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d8003520 con 0x7f77ec0d0fa0 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4087888092 0 0) 0x7f77d8003520 con 0x7f77ec0d0fa0 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec15d3b0 msgr2=0x7f77ec0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77e9d9b640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec15d3b0 0x7f77ec0ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 >> v2:172.21.15.31:3300/0 conn(0x7f77ec0d1d90 msgr2=0x7f77ec0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77e9d9b640 1 --2- 172.21.15.22:0/1344675322 >> v2:172.21.15.31:3300/0 conn(0x7f77ec0d1d90 0x7f77ec0b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.891+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0c6e40 con 0x7f77ec0d0fa0 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f77d4001670 con 0x7f77ec0d0fa0 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 >> v1:172.21.15.22:6789/0 conn(0x7f77ec0d0fa0 legacy=0x7f77ec0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77e9d9b640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec15d3b0 0x7f77d80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77e9d9b640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77e9d9b640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d8004d00 0x7f77d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec0d1400 con 0x7f77d8003f60 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec0cedc0 con 0x7f77d8004d00 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d800ba30 con 0x7f77ec15d3b0 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77e3fff640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77ea59c640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec15d3b0 0x7f77d80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.892+0000 7f77ead9d640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d8004d00 0x7f77d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.893+0000 7f77e3fff640 1 -- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec15d3b0 msgr2=0x7f77d80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.893+0000 7f77e3fff640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec15d3b0 0x7f77d80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.893+0000 7f77e3fff640 1 -- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d8004d00 msgr2=0x7f77d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.893+0000 7f77e3fff640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d8004d00 0x7f77d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.893+0000 7f77e3fff640 1 -- 172.21.15.22:0/1344675322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8003520 con 0x7f77d8003f60 2023-11-24T06:14:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.893+0000 7f77ea59c640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec15d3b0 0x7f77d80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.893+0000 7f77ead9d640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d8004d00 0x7f77d8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.894+0000 7f77e3fff640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77d80047c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c240 tx=0x7f77d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f684caa1386453 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.895+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d402cb00 con 0x7f77d8003f60 2023-11-24T06:14:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.895+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d402cc60 con 0x7f77d8003f60 2023-11-24T06:14:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.895+0000 7f77e9d9b640 1 -- 172.21.15.22:0/1344675322 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4005b10 con 0x7f77d8003f60 2023-11-24T06:14:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.895+0000 7f77eb59e640 1 -- 172.21.15.22:0/1344675322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 msgr2=0x7f77d80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.895+0000 7f77eb59e640 1 --2- 172.21.15.22:0/1344675322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77d80047c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c240 tx=0x7f77d80057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.895+0000 7f77ead9d640 1 -- 172.21.15.22:0/1344675322 reap_dead start 2023-11-24T06:14:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.895+0000 7f77eb59e640 1 -- 172.21.15.22:0/1344675322 shutdown_connections 2023-11-24T06:14:37.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.895+0000 7f77eb59e640 1 -- 172.21.15.22:0/1344675322 >> 172.21.15.22:0/1344675322 conn(0x7f77ec0d30a0 msgr2=0x7f77ec0d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.895+0000 7f77eb59e640 1 -- 172.21.15.22:0/1344675322 shutdown_connections 2023-11-24T06:14:37.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.896+0000 7f77eb59e640 1 -- 172.21.15.22:0/1344675322 wait complete. 2023-11-24T06:14:37.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.897+0000 7f77eb59e640 1 Processor -- start 2023-11-24T06:14:37.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.898+0000 7f77eb59e640 1 -- start start 2023-11-24T06:14:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.898+0000 7f77eb59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77ec09f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77eb59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ec0cc720 0x7f77ec1f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77eb59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec0ccba0 0x7f77ec1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77eb59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec0a0590 con 0x7f77d8003f60 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77eb59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec1f2c00 con 0x7f77ec0cc720 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77eb59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec1f6a10 con 0x7f77ec0ccba0 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77ec09f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77ec09f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40968/0 (socket says 172.21.15.22:40968) 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77ea59c640 1 -- 172.21.15.22:0/4263811304 learned_addr learned my addr 172.21.15.22:0/4263811304 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77ea59c640 1 -- 172.21.15.22:0/4263811304 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec0ccba0 msgr2=0x7f77ec1f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77ea59c640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec0ccba0 0x7f77ec1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77ea59c640 1 -- 172.21.15.22:0/4263811304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ec0cc720 msgr2=0x7f77ec1f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77ea59c640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ec0cc720 0x7f77ec1f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.899+0000 7f77ea59c640 1 -- 172.21.15.22:0/4263811304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec1f6cf0 con 0x7f77d8003f60 2023-11-24T06:14:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.900+0000 7f77ea59c640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77ec09f040 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0116d0 tx=0x7f77dc011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.900+0000 7f77e2ffd640 1 -- 172.21.15.22:0/4263811304 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00f940 con 0x7f77d8003f60 2023-11-24T06:14:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.900+0000 7f77e2ffd640 1 -- 172.21.15.22:0/4263811304 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc00faa0 con 0x7f77d8003f60 2023-11-24T06:14:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.900+0000 7f77e2ffd640 1 -- 172.21.15.22:0/4263811304 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00fe50 con 0x7f77d8003f60 2023-11-24T06:14:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.900+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ec09e560 con 0x7f77d8003f60 2023-11-24T06:14:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.900+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ec09eb20 con 0x7f77d8003f60 2023-11-24T06:14:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.901+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ec09ece0 con 0x7f77d8003f60 2023-11-24T06:14:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.902+0000 7f77e2ffd640 1 -- 172.21.15.22:0/4263811304 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f77dc015460 con 0x7f77d8003f60 2023-11-24T06:14:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.903+0000 7f77e2ffd640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77cc06aff0 0x7f77cc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.903+0000 7f77e2ffd640 1 -- 172.21.15.22:0/4263811304 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77dc08a140 con 0x7f77d8003f60 2023-11-24T06:14:37.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.903+0000 7f77e3fff640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77cc06aff0 0x7f77cc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.904+0000 7f77e3fff640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77cc06aff0 0x7f77cc06d4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f77d4034000 tx=0x7f77d402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:37.907+0000 7f77e2ffd640 1 -- 172.21.15.22:0/4263811304 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77dc054ed0 con 0x7f77d8003f60 2023-11-24T06:14:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.103+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77ec04e840 con 0x7f77d8003f60 2023-11-24T06:14:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.104+0000 7f77e2ffd640 1 -- 172.21.15.22:0/4263811304 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77dc0584f0 con 0x7f77d8003f60 2023-11-24T06:14:38.107 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:14:38.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77cc06aff0 msgr2=0x7f77cc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77cc06aff0 0x7f77cc06d4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f77d4034000 tx=0x7f77d402e000 comp rx=0 tx=0).stop 2023-11-24T06:14:38.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 msgr2=0x7f77ec09f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77ec09f040 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0116d0 tx=0x7f77dc011b90 comp rx=0 tx=0).stop 2023-11-24T06:14:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 shutdown_connections 2023-11-24T06:14:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f77cc06aff0 0x7f77cc06d4b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77ec0ccba0 0x7f77ec1f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ec0cc720 0x7f77ec1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 --2- 172.21.15.22:0/4263811304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77d8003f60 0x7f77ec09f040 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 >> 172.21.15.22:0/4263811304 conn(0x7f77ec0d30a0 msgr2=0x7f77ec06c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.107+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 shutdown_connections 2023-11-24T06:14:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.108+0000 7f77eb59e640 1 -- 172.21.15.22:0/4263811304 wait complete. 2023-11-24T06:14:38.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.360+0000 7fc6dd92c640 1 Processor -- start 2023-11-24T06:14:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.360+0000 7fc6dd92c640 1 -- start start 2023-11-24T06:14:38.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.362+0000 7fc6dd92c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d80cd150 0x7fc6d806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.362+0000 7fc6dd92c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6d80702a0 0x7fc6d806e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.362+0000 7fc6dd92c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d8142d50 con 0x7fc6d806ec60 2023-11-24T06:14:38.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.363+0000 7fc6dd92c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d80cd530 con 0x7fc6d80702a0 2023-11-24T06:14:38.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.363+0000 7fc6dd92c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80706c0 con 0x7fc6d80cd150 2023-11-24T06:14:38.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.363+0000 7fc6d77fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc6d806ec60 0x7fc6d8160fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37164/0 (socket says 172.21.15.22:37164) 2023-11-24T06:14:38.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.363+0000 7fc6d77fe640 1 -- 172.21.15.22:0/2823009871 learned_addr learned my addr 172.21.15.22:0/2823009871 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.363+0000 7fc6d6ffd640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d80cd150 0x7fc6d806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.363+0000 7fc6ce7fc640 1 --2- 172.21.15.22:0/2823009871 >> v2:172.21.15.31:3300/0 conn(0x7fc6d80702a0 0x7fc6d806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.363+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842451980 0 0) 0x7fc6d8142d50 con 0x7fc6d806ec60 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.363+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c4003520 con 0x7fc6d806ec60 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1642957051 0 0) 0x7fc6c4003520 con 0x7fc6d806ec60 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d80cd150 msgr2=0x7fc6d806fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d80cd150 0x7fc6d806fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 >> v2:172.21.15.31:3300/0 conn(0x7fc6d80702a0 msgr2=0x7fc6d806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 --2- 172.21.15.22:0/2823009871 >> v2:172.21.15.31:3300/0 conn(0x7fc6d80702a0 0x7fc6d806e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d806f430 con 0x7fc6d806ec60 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fc6d0001670 con 0x7fc6d806ec60 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 >> v1:172.21.15.22:6789/0 conn(0x7fc6d806ec60 legacy=0x7fc6d8160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c4003970 0x7fc6c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6c40047c0 0x7fc6c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d80cd150 0x7fc6c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80cd530 con 0x7fc6c40047c0 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80706c0 con 0x7fc6c4003970 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c400b9d0 con 0x7fc6d80cd150 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.364+0000 7fc6ce7fc640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6c40047c0 0x7fc6c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.365+0000 7fc6d6ffd640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c4003970 0x7fc6c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.365+0000 7fc6ce7fc640 1 -- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d80cd150 msgr2=0x7fc6c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.365+0000 7fc6d77fe640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d80cd150 0x7fc6c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.365+0000 7fc6ce7fc640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d80cd150 0x7fc6c4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.365+0000 7fc6ce7fc640 1 -- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c4003970 msgr2=0x7fc6c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:38.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.365+0000 7fc6ce7fc640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c4003970 0x7fc6c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.365+0000 7fc6ce7fc640 1 -- 172.21.15.22:0/2823009871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4003520 con 0x7fc6c40047c0 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.366+0000 7fc6ce7fc640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6c40047c0 0x7fc6c4004c40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000e170 tx=0x7fc6c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be06a366538f580 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.366+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c002cc20 con 0x7fc6c40047c0 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.366+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000f040 con 0x7fc6c40047c0 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.366+0000 7fc6d67fc640 1 -- 172.21.15.22:0/2823009871 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0034440 con 0x7fc6c40047c0 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.367+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2823009871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6c40047c0 msgr2=0x7fc6c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.367+0000 7fc6dd92c640 1 --2- 172.21.15.22:0/2823009871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6c40047c0 0x7fc6c4004c40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000e170 tx=0x7fc6c40057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.367+0000 7fc6d77fe640 1 -- 172.21.15.22:0/2823009871 reap_dead start 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.367+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2823009871 shutdown_connections 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.367+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2823009871 >> 172.21.15.22:0/2823009871 conn(0x7fc6d80cdb20 msgr2=0x7fc6d80cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.367+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2823009871 shutdown_connections 2023-11-24T06:14:38.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.367+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2823009871 wait complete. 2023-11-24T06:14:38.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.369+0000 7fc6dd92c640 1 Processor -- start 2023-11-24T06:14:38.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.369+0000 7fc6dd92c640 1 -- start start 2023-11-24T06:14:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.370+0000 7fc6dd92c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c40047c0 0x7fc6d80ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.370+0000 7fc6dd92c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d815ac40 0x7fc6d80c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.370+0000 7fc6dd92c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d80c8170 0x7fc6d80c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.370+0000 7fc6dd92c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80cae40 con 0x7fc6d80c8170 2023-11-24T06:14:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.370+0000 7fc6dd92c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80cb020 con 0x7fc6c40047c0 2023-11-24T06:14:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.370+0000 7fc6dd92c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80b6b70 con 0x7fc6d815ac40 2023-11-24T06:14:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.370+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d80c8170 0x7fc6d80c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.370+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d80c8170 0x7fc6d80c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40998/0 (socket says 172.21.15.22:40998) 2023-11-24T06:14:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.370+0000 7fc6d77fe640 1 -- 172.21.15.22:0/2248477732 learned_addr learned my addr 172.21.15.22:0/2248477732 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.371+0000 7fc6d6ffd640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c40047c0 0x7fc6d80ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.371+0000 7fc6ce7fc640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d815ac40 0x7fc6d80c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.371+0000 7fc6d77fe640 1 -- 172.21.15.22:0/2248477732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d815ac40 msgr2=0x7fc6d80c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.371+0000 7fc6d77fe640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d815ac40 0x7fc6d80c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.371+0000 7fc6d77fe640 1 -- 172.21.15.22:0/2248477732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c40047c0 msgr2=0x7fc6d80ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.371+0000 7fc6d77fe640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c40047c0 0x7fc6d80ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.371+0000 7fc6d77fe640 1 -- 172.21.15.22:0/2248477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d81461d0 con 0x7fc6d80c8170 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.371+0000 7fc6d77fe640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d80c8170 0x7fc6d80c8600 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8147310 tx=0x7fc6d000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.371+0000 7fc6d4ff9640 1 -- 172.21.15.22:0/2248477732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00074e0 con 0x7fc6d80c8170 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.372+0000 7fc6d4ff9640 1 -- 172.21.15.22:0/2248477732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d0007640 con 0x7fc6d80c8170 2023-11-24T06:14:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.372+0000 7fc6d4ff9640 1 -- 172.21.15.22:0/2248477732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0004a20 con 0x7fc6d80c8170 2023-11-24T06:14:38.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.372+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d81464b0 con 0x7fc6d80c8170 2023-11-24T06:14:38.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.372+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d8146a70 con 0x7fc6d80c8170 2023-11-24T06:14:38.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.373+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d806fb50 con 0x7fc6d80c8170 2023-11-24T06:14:38.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.374+0000 7fc6d4ff9640 1 -- 172.21.15.22:0/2248477732 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc6d0004b80 con 0x7fc6d80c8170 2023-11-24T06:14:38.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.375+0000 7fc6d4ff9640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc6b806aff0 0x7fc6b806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.375+0000 7fc6d4ff9640 1 -- 172.21.15.22:0/2248477732 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6d0089810 con 0x7fc6d80c8170 2023-11-24T06:14:38.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.375+0000 7fc6d6ffd640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc6b806aff0 0x7fc6b806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.376+0000 7fc6d6ffd640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc6b806aff0 0x7fc6b806d4b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc6d806e7f0 tx=0x7fc6c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:38.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.379+0000 7fc6d4ff9640 1 -- 172.21.15.22:0/2248477732 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6d0054520 con 0x7fc6d80c8170 2023-11-24T06:14:38.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.582+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6d804e920 con 0x7fc6d80c8170 2023-11-24T06:14:38.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.583+0000 7fc6d4ff9640 1 -- 172.21.15.22:0/2248477732 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6d0057b40 con 0x7fc6d80c8170 2023-11-24T06:14:38.586 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:14:38.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc6b806aff0 msgr2=0x7fc6b806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc6b806aff0 0x7fc6b806d4b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc6d806e7f0 tx=0x7fc6c8008040 comp rx=0 tx=0).stop 2023-11-24T06:14:38.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d80c8170 msgr2=0x7fc6d80c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d80c8170 0x7fc6d80c8600 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8147310 tx=0x7fc6d000d9d0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 shutdown_connections 2023-11-24T06:14:38.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc6b806aff0 0x7fc6b806d4b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d80c8170 0x7fc6d80c8600 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6d815ac40 0x7fc6d80c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 --2- 172.21.15.22:0/2248477732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c40047c0 0x7fc6d80ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 >> 172.21.15.22:0/2248477732 conn(0x7fc6d80cdb20 msgr2=0x7fc6d806caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:38.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.586+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 shutdown_connections 2023-11-24T06:14:38.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.587+0000 7fc6dd92c640 1 -- 172.21.15.22:0/2248477732 wait complete. 2023-11-24T06:14:38.607 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:38.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.828+0000 7fd8e6101640 1 Processor -- start 2023-11-24T06:14:38.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.828+0000 7fd8e6101640 1 -- start start 2023-11-24T06:14:38.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.830+0000 7fd8e6101640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8e015b350 0x7fd8e00abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.830+0000 7fd8e6101640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd8e009cb30 0x7fd8e00b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.830+0000 7fd8e6101640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e015b730 con 0x7fd8e00adb60 2023-11-24T06:14:38.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.830+0000 7fd8e6101640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e00ac740 con 0x7fd8e009cb30 2023-11-24T06:14:38.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.830+0000 7fd8e6101640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e00ac460 con 0x7fd8e015b350 2023-11-24T06:14:38.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.831+0000 7fd8d6ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd8e009cb30 0x7fd8e00b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.831+0000 7fd8d6ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd8e009cb30 0x7fd8e00b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41002/0 (socket says 172.21.15.22:41002) 2023-11-24T06:14:38.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.831+0000 7fd8d6ffd640 1 -- 172.21.15.22:0/1903121915 learned_addr learned my addr 172.21.15.22:0/1903121915 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:38.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.831+0000 7fd8df7fe640 1 --2- 172.21.15.22:0/1903121915 >> v2:172.21.15.31:3300/0 conn(0x7fd8e015b350 0x7fd8e00abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.831+0000 7fd8d6ffd640 1 -- 172.21.15.22:0/1903121915 >> v2:172.21.15.31:3300/0 conn(0x7fd8e015b350 msgr2=0x7fd8e00abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:38.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.831+0000 7fd8d6ffd640 1 --2- 172.21.15.22:0/1903121915 >> v2:172.21.15.31:3300/0 conn(0x7fd8e015b350 0x7fd8e00abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.831+0000 7fd8d6ffd640 1 -- 172.21.15.22:0/1903121915 >> v1:172.21.15.31:6789/0 conn(0x7fd8e00adb60 legacy=0x7fd8e00adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:38.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.831+0000 7fd8d6ffd640 1 -- 172.21.15.22:0/1903121915 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e00b2a50 con 0x7fd8e009cb30 2023-11-24T06:14:38.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.832+0000 7fd8d6ffd640 1 --2- 172.21.15.22:0/1903121915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e009cb30 0x7fd8e00b3530 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00b5100 tx=0x7fd8c802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7540cf750ee69756 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:38.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.833+0000 7fd8deffd640 1 -- 172.21.15.22:0/1903121915 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c802ca80 con 0x7fd8e009cb30 2023-11-24T06:14:38.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.833+0000 7fd8deffd640 1 -- 172.21.15.22:0/1903121915 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c802cbe0 con 0x7fd8e009cb30 2023-11-24T06:14:38.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.833+0000 7fd8deffd640 1 -- 172.21.15.22:0/1903121915 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80343f0 con 0x7fd8e009cb30 2023-11-24T06:14:38.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.833+0000 7fd8e6101640 1 -- 172.21.15.22:0/1903121915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e009cb30 msgr2=0x7fd8e00b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.833+0000 7fd8e6101640 1 --2- 172.21.15.22:0/1903121915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e009cb30 0x7fd8e00b3530 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00b5100 tx=0x7fd8c802bee0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.834+0000 7fd8e6101640 1 -- 172.21.15.22:0/1903121915 shutdown_connections 2023-11-24T06:14:38.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.834+0000 7fd8e6101640 1 --2- 172.21.15.22:0/1903121915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e009cb30 0x7fd8e00b3530 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.834+0000 7fd8e6101640 1 --2- 172.21.15.22:0/1903121915 >> v2:172.21.15.31:3300/0 conn(0x7fd8e015b350 0x7fd8e00abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.834+0000 7fd8e6101640 1 -- 172.21.15.22:0/1903121915 >> 172.21.15.22:0/1903121915 conn(0x7fd8e00b0ba0 msgr2=0x7fd8e00b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:38.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.834+0000 7fd8e6101640 1 -- 172.21.15.22:0/1903121915 shutdown_connections 2023-11-24T06:14:38.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.834+0000 7fd8e6101640 1 -- 172.21.15.22:0/1903121915 wait complete. 2023-11-24T06:14:38.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.835+0000 7fd8e6101640 1 Processor -- start 2023-11-24T06:14:38.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.836+0000 7fd8e6101640 1 -- start start 2023-11-24T06:14:38.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8e6101640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8e009cb30 0x7fd8e0146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8e6101640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e00adb60 0x7fd8e015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8e6101640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8e015b350 0x7fd8e015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8e6101640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e009a720 con 0x7fd8e00adb60 2023-11-24T06:14:38.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8e6101640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e015e960 con 0x7fd8e015b350 2023-11-24T06:14:38.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8e6101640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e014de70 con 0x7fd8e009cb30 2023-11-24T06:14:38.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e00adb60 0x7fd8e015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e00adb60 0x7fd8e015dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41010/0 (socket says 172.21.15.22:41010) 2023-11-24T06:14:38.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8d6ffd640 1 -- 172.21.15.22:0/486129546 learned_addr learned my addr 172.21.15.22:0/486129546 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8df7fe640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8e009cb30 0x7fd8e0146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8dffff640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8e015b350 0x7fd8e015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8d6ffd640 1 -- 172.21.15.22:0/486129546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8e009cb30 msgr2=0x7fd8e0146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8d6ffd640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8e009cb30 0x7fd8e0146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8d6ffd640 1 -- 172.21.15.22:0/486129546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8e015b350 msgr2=0x7fd8e015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8d6ffd640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8e015b350 0x7fd8e015e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.837+0000 7fd8d6ffd640 1 -- 172.21.15.22:0/486129546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8009b30 con 0x7fd8e00adb60 2023-11-24T06:14:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.838+0000 7fd8d6ffd640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e00adb60 0x7fd8e015dee0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8036040 tx=0x7fd8c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.838+0000 7fd8dcff9640 1 -- 172.21.15.22:0/486129546 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8009510 con 0x7fd8e00adb60 2023-11-24T06:14:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.838+0000 7fd8dcff9640 1 -- 172.21.15.22:0/486129546 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c803e450 con 0x7fd8e00adb60 2023-11-24T06:14:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.838+0000 7fd8dcff9640 1 -- 172.21.15.22:0/486129546 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c803e800 con 0x7fd8e00adb60 2023-11-24T06:14:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.838+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e0099aa0 con 0x7fd8e00adb60 2023-11-24T06:14:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.838+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e009a060 con 0x7fd8e00adb60 2023-11-24T06:14:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.839+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e009a860 con 0x7fd8e00adb60 2023-11-24T06:14:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.840+0000 7fd8dcff9640 1 -- 172.21.15.22:0/486129546 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd8c802cd50 con 0x7fd8e00adb60 2023-11-24T06:14:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.841+0000 7fd8dcff9640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8c006aff0 0x7fd8c006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.842+0000 7fd8dcff9640 1 -- 172.21.15.22:0/486129546 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8c80ac2e0 con 0x7fd8e00adb60 2023-11-24T06:14:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.842+0000 7fd8df7fe640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8c006aff0 0x7fd8c006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:38.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.843+0000 7fd8df7fe640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8c006aff0 0x7fd8c006d4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0006fd0 tx=0x7fd8d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:38.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:38.846+0000 7fd8dcff9640 1 -- 172.21.15.22:0/486129546 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8e009a860 con 0x7fd8e00adb60 2023-11-24T06:14:39.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.040+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8e015b730 con 0x7fd8e00adb60 2023-11-24T06:14:39.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.041+0000 7fd8dcff9640 1 -- 172.21.15.22:0/486129546 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8e015b730 con 0x7fd8e00adb60 2023-11-24T06:14:39.044 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:14:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8c006aff0 msgr2=0x7fd8c006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8c006aff0 0x7fd8c006d4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0006fd0 tx=0x7fd8d0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e00adb60 msgr2=0x7fd8e015dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e00adb60 0x7fd8e015dee0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8036040 tx=0x7fd8c8004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:39.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 shutdown_connections 2023-11-24T06:14:39.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd8c006aff0 0x7fd8c006d4b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8e015b350 0x7fd8e015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8e00adb60 0x7fd8e015dee0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 --2- 172.21.15.22:0/486129546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8e009cb30 0x7fd8e0146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.043+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 >> 172.21.15.22:0/486129546 conn(0x7fd8e00b0ba0 msgr2=0x7fd8e0159950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:39.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.044+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 shutdown_connections 2023-11-24T06:14:39.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.044+0000 7fd8e6101640 1 -- 172.21.15.22:0/486129546 wait complete. 2023-11-24T06:14:39.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:39.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.290+0000 7faac6d63640 1 Processor -- start 2023-11-24T06:14:39.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.291+0000 7faac6d63640 1 -- start start 2023-11-24T06:14:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.292+0000 7faac6d63640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 0x7faac00ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.292+0000 7faac6d63640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faac00d1d80 0x7faac00cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.292+0000 7faac6d63640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac00d04b0 con 0x7faac00cf710 2023-11-24T06:14:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.292+0000 7faac6d63640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac00ce4e0 con 0x7faac00d1d80 2023-11-24T06:14:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.292+0000 7faac6d63640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac00cdb80 con 0x7faac015d5d0 2023-11-24T06:14:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.293+0000 7faac6562640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faac00d1d80 0x7faac00cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.293+0000 7faac5560640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faac00cf710 0x7faac00d1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37166/0 (socket says 172.21.15.22:37166) 2023-11-24T06:14:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.293+0000 7faac5560640 1 -- 172.21.15.22:0/2748644 learned_addr learned my addr 172.21.15.22:0/2748644 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.293+0000 7faac5d61640 1 --2- 172.21.15.22:0/2748644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 0x7faac00ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.293+0000 7faac6562640 1 -- 172.21.15.22:0/2748644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 msgr2=0x7faac00ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.293+0000 7faac6562640 1 --2- 172.21.15.22:0/2748644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 0x7faac00ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.293+0000 7faac6562640 1 -- 172.21.15.22:0/2748644 >> v1:172.21.15.22:6789/0 conn(0x7faac00cf710 legacy=0x7faac00d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.293+0000 7faac6562640 1 -- 172.21.15.22:0/2748644 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00d01d0 con 0x7faac00d1d80 2023-11-24T06:14:39.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.293+0000 7faac4d5f640 1 -- 172.21.15.22:0/2748644 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446325857 0 0) 0x7faac00d04b0 con 0x7faac00cf710 2023-11-24T06:14:39.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.294+0000 7faac6562640 1 --2- 172.21.15.22:0/2748644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 0x7faac00cfb70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7faab80097a0 tx=0x7faab802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ae637c6d53da84 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:39.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.295+0000 7faac4d5f640 1 -- 172.21.15.22:0/2748644 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8031780 con 0x7faac00d1d80 2023-11-24T06:14:39.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.295+0000 7faac4d5f640 1 -- 172.21.15.22:0/2748644 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab80318e0 con 0x7faac00d1d80 2023-11-24T06:14:39.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.295+0000 7faac4d5f640 1 -- 172.21.15.22:0/2748644 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8031c70 con 0x7faac00d1d80 2023-11-24T06:14:39.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.295+0000 7faac6d63640 1 -- 172.21.15.22:0/2748644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 msgr2=0x7faac00cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.295+0000 7faac6d63640 1 --2- 172.21.15.22:0/2748644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 0x7faac00cfb70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7faab80097a0 tx=0x7faab802b820 comp rx=0 tx=0).stop 2023-11-24T06:14:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.296+0000 7faac6d63640 1 -- 172.21.15.22:0/2748644 shutdown_connections 2023-11-24T06:14:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.296+0000 7faac6d63640 1 --2- 172.21.15.22:0/2748644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 0x7faac00cfb70 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.296+0000 7faac6d63640 1 --2- 172.21.15.22:0/2748644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 0x7faac00ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.296+0000 7faac6d63640 1 -- 172.21.15.22:0/2748644 >> 172.21.15.22:0/2748644 conn(0x7faac009c3d0 msgr2=0x7faac00d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.296+0000 7faac6d63640 1 -- 172.21.15.22:0/2748644 shutdown_connections 2023-11-24T06:14:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.296+0000 7faac6d63640 1 -- 172.21.15.22:0/2748644 wait complete. 2023-11-24T06:14:39.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.297+0000 7faac6d63640 1 Processor -- start 2023-11-24T06:14:39.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.298+0000 7faac6d63640 1 -- start start 2023-11-24T06:14:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.298+0000 7faac6d63640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac00cf710 0x7faac01604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac6d63640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 0x7faac00c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac6d63640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 0x7faac00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac6d63640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac01f6f90 con 0x7faac00d1d80 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac6d63640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac015f9c0 con 0x7faac00cf710 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac6d63640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac015fca0 con 0x7faac015d5d0 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5560640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 0x7faac00c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5560640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 0x7faac00c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41038/0 (socket says 172.21.15.22:41038) 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5560640 1 -- 172.21.15.22:0/456018716 learned_addr learned my addr 172.21.15.22:0/456018716 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac6562640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 0x7faac00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5d61640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac00cf710 0x7faac01604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5560640 1 -- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 msgr2=0x7faac00c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5560640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 0x7faac00c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5560640 1 -- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac00cf710 msgr2=0x7faac01604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5560640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac00cf710 0x7faac01604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5560640 1 -- 172.21.15.22:0/456018716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8009400 con 0x7faac00d1d80 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac5d61640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac00cf710 0x7faac01604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.299+0000 7faac6562640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 0x7faac00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.300+0000 7faac5560640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 0x7faac00c8d90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7faab400c3f0 tx=0x7faab400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.300+0000 7faabe7fc640 1 -- 172.21.15.22:0/456018716 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40074e0 con 0x7faac00d1d80 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.300+0000 7faabe7fc640 1 -- 172.21.15.22:0/456018716 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4007640 con 0x7faac00d1d80 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.300+0000 7faabe7fc640 1 -- 172.21.15.22:0/456018716 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4004a00 con 0x7faac00d1d80 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.300+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac015ff80 con 0x7faac00d1d80 2023-11-24T06:14:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.300+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac015f600 con 0x7faac00d1d80 2023-11-24T06:14:39.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.301+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac004e840 con 0x7faac00d1d80 2023-11-24T06:14:39.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.302+0000 7faabe7fc640 1 -- 172.21.15.22:0/456018716 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faab4004b60 con 0x7faac00d1d80 2023-11-24T06:14:39.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.303+0000 7faabe7fc640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaac06aff0 0x7faaac06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.304+0000 7faabe7fc640 1 -- 172.21.15.22:0/456018716 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faab4089740 con 0x7faac00d1d80 2023-11-24T06:14:39.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.304+0000 7faac5d61640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaac06aff0 0x7faaac06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.305+0000 7faac5d61640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaac06aff0 0x7faaac06d4b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faab0007f50 tx=0x7faab00074a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:39.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.308+0000 7faabe7fc640 1 -- 172.21.15.22:0/456018716 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faab4054560 con 0x7faac00d1d80 2023-11-24T06:14:39.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.526+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faac00678d0 con 0x7faac00d1d80 2023-11-24T06:14:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.526+0000 7faabe7fc640 1 -- 172.21.15.22:0/456018716 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7faab4057b80 con 0x7faac00d1d80 2023-11-24T06:14:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:14:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.529+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaac06aff0 msgr2=0x7faaac06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.529+0000 7faac6d63640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaac06aff0 0x7faaac06d4b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faab0007f50 tx=0x7faab00074a0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.529+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 msgr2=0x7faac00c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.529+0000 7faac6d63640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 0x7faac00c8d90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7faab400c3f0 tx=0x7faab400c8b0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.529+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 shutdown_connections 2023-11-24T06:14:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.529+0000 7faac6d63640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faaac06aff0 0x7faaac06d4b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.529+0000 7faac6d63640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faac015d5d0 0x7faac00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.529+0000 7faac6d63640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d1d80 0x7faac00c8d90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.529+0000 7faac6d63640 1 --2- 172.21.15.22:0/456018716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faac00cf710 0x7faac01604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.530+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 >> 172.21.15.22:0/456018716 conn(0x7faac009c3d0 msgr2=0x7faac00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.530+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 shutdown_connections 2023-11-24T06:14:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:39.530+0000 7faac6d63640 1 -- 172.21.15.22:0/456018716 wait complete. 2023-11-24T06:14:39.551 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2023-11-24T06:14:39.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:39.551 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:39.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[105064]: fuse finished with error 0 and tester_r 0 2023-11-24T06:14:39.646 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:45.748 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:14:45.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:45.749 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:14:45.812 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:14:45.812 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:45.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:46.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.109+0000 7fd61deec640 1 Processor -- start 2023-11-24T06:14:46.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.110+0000 7fd61deec640 1 -- start start 2023-11-24T06:14:46.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.111+0000 7fd61deec640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6180abff0 0x7fd6180b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.111+0000 7fd61deec640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61815c360 con 0x7fd6180ad720 2023-11-24T06:14:46.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.111+0000 7fd61deec640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61815ba30 con 0x7fd61806d520 2023-11-24T06:14:46.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.112+0000 7fd61deec640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6180b41a0 con 0x7fd6180abff0 2023-11-24T06:14:46.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.112+0000 7fd617fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6180abff0 0x7fd6180b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.112+0000 7fd617fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6180abff0 0x7fd6180b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52074/0 (socket says 172.21.15.22:52074) 2023-11-24T06:14:46.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.112+0000 7fd617fff640 1 -- 172.21.15.22:0/2696083672 learned_addr learned my addr 172.21.15.22:0/2696083672 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:46.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.112+0000 7fd617fff640 1 -- 172.21.15.22:0/2696083672 >> v1:172.21.15.31:6789/0 conn(0x7fd61806d520 legacy=0x7fd61806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.112+0000 7fd617fff640 1 -- 172.21.15.22:0/2696083672 >> v1:172.21.15.22:6789/0 conn(0x7fd6180ad720 legacy=0x7fd6180b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.112+0000 7fd617fff640 1 -- 172.21.15.22:0/2696083672 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61815bd10 con 0x7fd6180abff0 2023-11-24T06:14:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.113+0000 7fd617fff640 1 --2- 172.21.15.22:0/2696083672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180abff0 0x7fd6180b2790 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd610009e50 tx=0x7fd61002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412dd25549e2186 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.114+0000 7fd616ffd640 1 -- 172.21.15.22:0/2696083672 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61002cb20 con 0x7fd6180abff0 2023-11-24T06:14:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.114+0000 7fd616ffd640 1 -- 172.21.15.22:0/2696083672 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61002cc80 con 0x7fd6180abff0 2023-11-24T06:14:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.114+0000 7fd616ffd640 1 -- 172.21.15.22:0/2696083672 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100343f0 con 0x7fd6180abff0 2023-11-24T06:14:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.115+0000 7fd61deec640 1 -- 172.21.15.22:0/2696083672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180abff0 msgr2=0x7fd6180b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.115+0000 7fd61deec640 1 --2- 172.21.15.22:0/2696083672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180abff0 0x7fd6180b2790 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd610009e50 tx=0x7fd61002bf80 comp rx=0 tx=0).stop 2023-11-24T06:14:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.115+0000 7fd61deec640 1 -- 172.21.15.22:0/2696083672 shutdown_connections 2023-11-24T06:14:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.115+0000 7fd61deec640 1 --2- 172.21.15.22:0/2696083672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180abff0 0x7fd6180b2790 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.115+0000 7fd61deec640 1 -- 172.21.15.22:0/2696083672 >> 172.21.15.22:0/2696083672 conn(0x7fd6180b0d80 msgr2=0x7fd6180b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.115+0000 7fd61deec640 1 -- 172.21.15.22:0/2696083672 shutdown_connections 2023-11-24T06:14:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.115+0000 7fd61deec640 1 -- 172.21.15.22:0/2696083672 wait complete. 2023-11-24T06:14:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.117+0000 7fd61deec640 1 Processor -- start 2023-11-24T06:14:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.117+0000 7fd61deec640 1 -- start start 2023-11-24T06:14:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd61deec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd61806d520 0x7fd6181f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd61deec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6180abff0 0x7fd61815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd61deec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180ad720 0x7fd6180c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd61deec640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6181f3c50 con 0x7fd6180ad720 2023-11-24T06:14:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd61deec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6181f2c50 con 0x7fd6180abff0 2023-11-24T06:14:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd61deec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd618159410 con 0x7fd61806d520 2023-11-24T06:14:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd617fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180ad720 0x7fd6180c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd617fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180ad720 0x7fd6180c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52080/0 (socket says 172.21.15.22:52080) 2023-11-24T06:14:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd617fff640 1 -- 172.21.15.22:0/2914330801 learned_addr learned my addr 172.21.15.22:0/2914330801 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd617fff640 1 -- 172.21.15.22:0/2914330801 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd61806d520 msgr2=0x7fd6181f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd617fff640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd61806d520 0x7fd6181f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd617fff640 1 -- 172.21.15.22:0/2914330801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6180abff0 msgr2=0x7fd61815ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.118+0000 7fd617fff640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6180abff0 0x7fd61815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.119+0000 7fd617fff640 1 -- 172.21.15.22:0/2914330801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610009b30 con 0x7fd6180ad720 2023-11-24T06:14:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.119+0000 7fd617fff640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180ad720 0x7fd6180c9940 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd610036040 tx=0x7fd610004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.119+0000 7fd614ff9640 1 -- 172.21.15.22:0/2914330801 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd610009510 con 0x7fd6180ad720 2023-11-24T06:14:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.119+0000 7fd614ff9640 1 -- 172.21.15.22:0/2914330801 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd610007e50 con 0x7fd6180ad720 2023-11-24T06:14:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.119+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6181596f0 con 0x7fd6180ad720 2023-11-24T06:14:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.119+0000 7fd614ff9640 1 -- 172.21.15.22:0/2914330801 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61003e690 con 0x7fd6180ad720 2023-11-24T06:14:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.119+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6181f31f0 con 0x7fd6180ad720 2023-11-24T06:14:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.120+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd618159930 con 0x7fd6180ad720 2023-11-24T06:14:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.121+0000 7fd614ff9640 1 -- 172.21.15.22:0/2914330801 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd61003e7f0 con 0x7fd6180ad720 2023-11-24T06:14:46.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.122+0000 7fd614ff9640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5f806aff0 0x7fd5f806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.122+0000 7fd614ff9640 1 -- 172.21.15.22:0/2914330801 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd6100ac640 con 0x7fd6180ad720 2023-11-24T06:14:46.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.123+0000 7fd6177fe640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5f806aff0 0x7fd5f806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.123+0000 7fd6177fe640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5f806aff0 0x7fd5f806d4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd61815fd40 tx=0x7fd6080079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.128+0000 7fd614ff9640 1 -- 172.21.15.22:0/2914330801 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd610077420 con 0x7fd6180ad720 2023-11-24T06:14:46.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.325+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6181f33e0 con 0x7fd6180ad720 2023-11-24T06:14:46.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.328+0000 7fd614ff9640 1 -- 172.21.15.22:0/2914330801 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16560 (secure 0 0 0) 0x7fd61007aa40 con 0x7fd6180ad720 2023-11-24T06:14:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:46.331 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":49,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:42.443698+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5f806aff0 msgr2=0x7fd5f806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5f806aff0 0x7fd5f806d4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd61815fd40 tx=0x7fd6080079b0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180ad720 msgr2=0x7fd6180c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180ad720 0x7fd6180c9940 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd610036040 tx=0x7fd610004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 shutdown_connections 2023-11-24T06:14:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5f806aff0 0x7fd5f806d4b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6180ad720 0x7fd6180c9940 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6180abff0 0x7fd61815ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 --2- 172.21.15.22:0/2914330801 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd61806d520 0x7fd6181f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.330+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 >> 172.21.15.22:0/2914330801 conn(0x7fd6180b0d80 msgr2=0x7fd6180af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.331+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 shutdown_connections 2023-11-24T06:14:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.331+0000 7fd61deec640 1 -- 172.21.15.22:0/2914330801 wait complete. 2023-11-24T06:14:46.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:12.796187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:13.964719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:46.353 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:46.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.579+0000 7fc32c87b640 1 Processor -- start 2023-11-24T06:14:46.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.580+0000 7fc32c87b640 1 -- start start 2023-11-24T06:14:46.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.581+0000 7fc32c87b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc32815d3b0 0x7fc3280ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.581+0000 7fc32c87b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc3280d0fa0 0x7fc3280d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.581+0000 7fc32c87b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280c6bf0 con 0x7fc3280d1bc0 2023-11-24T06:14:46.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.581+0000 7fc32c87b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280d1430 con 0x7fc3280d0fa0 2023-11-24T06:14:46.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.581+0000 7fc32c87b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280d1fa0 con 0x7fc32815d3b0 2023-11-24T06:14:46.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.582+0000 7fc32659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc3280d0fa0 0x7fc3280d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.582+0000 7fc32659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc3280d0fa0 0x7fc3280d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52088/0 (socket says 172.21.15.22:52088) 2023-11-24T06:14:46.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.582+0000 7fc32659c640 1 -- 172.21.15.22:0/2487536653 learned_addr learned my addr 172.21.15.22:0/2487536653 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:46.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.582+0000 7fc326d9d640 1 --2- 172.21.15.22:0/2487536653 >> v2:172.21.15.31:3300/0 conn(0x7fc32815d3b0 0x7fc3280ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.582+0000 7fc32659c640 1 -- 172.21.15.22:0/2487536653 >> v2:172.21.15.31:3300/0 conn(0x7fc32815d3b0 msgr2=0x7fc3280ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.582+0000 7fc32659c640 1 --2- 172.21.15.22:0/2487536653 >> v2:172.21.15.31:3300/0 conn(0x7fc32815d3b0 0x7fc3280ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.582+0000 7fc32659c640 1 -- 172.21.15.22:0/2487536653 >> v1:172.21.15.31:6789/0 conn(0x7fc3280d1bc0 legacy=0x7fc3280b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.582+0000 7fc32659c640 1 -- 172.21.15.22:0/2487536653 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280cedc0 con 0x7fc3280d0fa0 2023-11-24T06:14:46.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.583+0000 7fc32659c640 1 --2- 172.21.15.22:0/2487536653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3280d0fa0 0x7fc3280d1680 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc32808b2a0 tx=0x7fc31c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cef535454d4c072 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.584+0000 7fc325d9b640 1 -- 172.21.15.22:0/2487536653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0317e0 con 0x7fc3280d0fa0 2023-11-24T06:14:46.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.584+0000 7fc325d9b640 1 -- 172.21.15.22:0/2487536653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c031940 con 0x7fc3280d0fa0 2023-11-24T06:14:46.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.584+0000 7fc325d9b640 1 -- 172.21.15.22:0/2487536653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c031cd0 con 0x7fc3280d0fa0 2023-11-24T06:14:46.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.584+0000 7fc32c87b640 1 -- 172.21.15.22:0/2487536653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3280d0fa0 msgr2=0x7fc3280d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.584+0000 7fc32c87b640 1 --2- 172.21.15.22:0/2487536653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3280d0fa0 0x7fc3280d1680 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc32808b2a0 tx=0x7fc31c02b880 comp rx=0 tx=0).stop 2023-11-24T06:14:46.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.585+0000 7fc32c87b640 1 -- 172.21.15.22:0/2487536653 shutdown_connections 2023-11-24T06:14:46.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.585+0000 7fc32c87b640 1 --2- 172.21.15.22:0/2487536653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3280d0fa0 0x7fc3280d1680 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.585+0000 7fc32c87b640 1 --2- 172.21.15.22:0/2487536653 >> v2:172.21.15.31:3300/0 conn(0x7fc32815d3b0 0x7fc3280ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.585+0000 7fc32c87b640 1 -- 172.21.15.22:0/2487536653 >> 172.21.15.22:0/2487536653 conn(0x7fc3280d30a0 msgr2=0x7fc3280d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.585+0000 7fc32c87b640 1 -- 172.21.15.22:0/2487536653 shutdown_connections 2023-11-24T06:14:46.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.585+0000 7fc32c87b640 1 -- 172.21.15.22:0/2487536653 wait complete. 2023-11-24T06:14:46.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.587+0000 7fc32c87b640 1 Processor -- start 2023-11-24T06:14:46.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.587+0000 7fc32c87b640 1 -- start start 2023-11-24T06:14:46.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc32c87b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3280d0fa0 0x7fc3281574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc32c87b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280d1bc0 0x7fc3280cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc32c87b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc32815d3b0 0x7fc3280cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc32c87b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280b7400 con 0x7fc32815d3b0 2023-11-24T06:14:46.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc32c87b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280b6ad0 con 0x7fc3280d1bc0 2023-11-24T06:14:46.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc32c87b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280b6db0 con 0x7fc3280d0fa0 2023-11-24T06:14:46.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc32759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc32815d3b0 0x7fc3280cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc32759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc32815d3b0 0x7fc3280cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52092/0 (socket says 172.21.15.22:52092) 2023-11-24T06:14:46.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc32759e640 1 -- 172.21.15.22:0/1777987047 learned_addr learned my addr 172.21.15.22:0/1777987047 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:46.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.588+0000 7fc326d9d640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3280d0fa0 0x7fc3281574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc32659c640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280d1bc0 0x7fc3280cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc32759e640 1 -- 172.21.15.22:0/1777987047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3280d0fa0 msgr2=0x7fc3281574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc32759e640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3280d0fa0 0x7fc3281574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc32759e640 1 -- 172.21.15.22:0/1777987047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280d1bc0 msgr2=0x7fc3280cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc32759e640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280d1bc0 0x7fc3280cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc32759e640 1 -- 172.21.15.22:0/1777987047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c0094d0 con 0x7fc32815d3b0 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc32659c640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280d1bc0 0x7fc3280cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc32759e640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc32815d3b0 0x7fc3280cc5f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc32000b410 tx=0x7fc32000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc30f7fe640 1 -- 172.21.15.22:0/1777987047 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320004020 con 0x7fc32815d3b0 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc30f7fe640 1 -- 172.21.15.22:0/1777987047 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320004180 con 0x7fc32815d3b0 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3280b7090 con 0x7fc32815d3b0 2023-11-24T06:14:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.589+0000 7fc30f7fe640 1 -- 172.21.15.22:0/1777987047 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320011630 con 0x7fc32815d3b0 2023-11-24T06:14:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.590+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc328157a30 con 0x7fc32815d3b0 2023-11-24T06:14:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.591+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3280b7570 con 0x7fc32815d3b0 2023-11-24T06:14:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.592+0000 7fc30f7fe640 1 -- 172.21.15.22:0/1777987047 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc320011790 con 0x7fc32815d3b0 2023-11-24T06:14:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.593+0000 7fc30f7fe640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc31406b020 0x7fc31406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.593+0000 7fc30f7fe640 1 -- 172.21.15.22:0/1777987047 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc3200896e0 con 0x7fc32815d3b0 2023-11-24T06:14:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.593+0000 7fc326d9d640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc31406b020 0x7fc31406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.594+0000 7fc326d9d640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc31406b020 0x7fc31406d4e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc318009a60 tx=0x7fc318003990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.597+0000 7fc30f7fe640 1 -- 172.21.15.22:0/1777987047 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc320054440 con 0x7fc32815d3b0 2023-11-24T06:14:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.792+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3280b7220 con 0x7fc32815d3b0 2023-11-24T06:14:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.793+0000 7fc30f7fe640 1 -- 172.21.15.22:0/1777987047 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc320015020 con 0x7fc32815d3b0 2023-11-24T06:14:46.795 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:14:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.795+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc31406b020 msgr2=0x7fc31406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.795+0000 7fc32c87b640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc31406b020 0x7fc31406d4e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc318009a60 tx=0x7fc318003990 comp rx=0 tx=0).stop 2023-11-24T06:14:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.795+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc32815d3b0 msgr2=0x7fc3280cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.795+0000 7fc32c87b640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc32815d3b0 0x7fc3280cc5f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc32000b410 tx=0x7fc32000b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.796+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 shutdown_connections 2023-11-24T06:14:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.796+0000 7fc32c87b640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc31406b020 0x7fc31406d4e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.796+0000 7fc32c87b640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc32815d3b0 0x7fc3280cc5f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.796+0000 7fc32c87b640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280d1bc0 0x7fc3280cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.796+0000 7fc32c87b640 1 --2- 172.21.15.22:0/1777987047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3280d0fa0 0x7fc3281574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.796+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 >> 172.21.15.22:0/1777987047 conn(0x7fc3280d30a0 msgr2=0x7fc32806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.796+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 shutdown_connections 2023-11-24T06:14:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:46.796+0000 7fc32c87b640 1 -- 172.21.15.22:0/1777987047 wait complete. 2023-11-24T06:14:46.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:47.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.033+0000 7fd3e73cb640 1 Processor -- start 2023-11-24T06:14:47.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.033+0000 7fd3e73cb640 1 -- start start 2023-11-24T06:14:47.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.034+0000 7fd3e73cb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e015d3b0 0x7fd3e00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.034+0000 7fd3e73cb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3e00d0fa0 0x7fd3e00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.034+0000 7fd3e73cb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e00d2010 con 0x7fd3e00d1bc0 2023-11-24T06:14:47.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.034+0000 7fd3e73cb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e00c6bf0 con 0x7fd3e00d0fa0 2023-11-24T06:14:47.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.034+0000 7fd3e73cb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e00d1400 con 0x7fd3e015d3b0 2023-11-24T06:14:47.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.035+0000 7fd3e5bc8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3e00d0fa0 0x7fd3e00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.035+0000 7fd3e5bc8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3e00d0fa0 0x7fd3e00d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52094/0 (socket says 172.21.15.22:52094) 2023-11-24T06:14:47.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.035+0000 7fd3e5bc8640 1 -- 172.21.15.22:0/1688458560 learned_addr learned my addr 172.21.15.22:0/1688458560 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:47.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.035+0000 7fd3e63c9640 1 --2- 172.21.15.22:0/1688458560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e015d3b0 0x7fd3e00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.035+0000 7fd3e5bc8640 1 -- 172.21.15.22:0/1688458560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e015d3b0 msgr2=0x7fd3e00ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.035+0000 7fd3e5bc8640 1 --2- 172.21.15.22:0/1688458560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e015d3b0 0x7fd3e00ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.035+0000 7fd3e5bc8640 1 -- 172.21.15.22:0/1688458560 >> v1:172.21.15.31:6789/0 conn(0x7fd3e00d1bc0 legacy=0x7fd3e00b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.035+0000 7fd3e5bc8640 1 -- 172.21.15.22:0/1688458560 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e00cedc0 con 0x7fd3e00d0fa0 2023-11-24T06:14:47.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.035+0000 7fd3e63c9640 1 --2- 172.21.15.22:0/1688458560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e015d3b0 0x7fd3e00ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:47.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.036+0000 7fd3e5bc8640 1 --2- 172.21.15.22:0/1688458560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e00d0fa0 0x7fd3e00d1680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009870 tx=0x7fd3d002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4064c7c72f5ddd2c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.037+0000 7fd3e53c7640 1 -- 172.21.15.22:0/1688458560 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00317c0 con 0x7fd3e00d0fa0 2023-11-24T06:14:47.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.037+0000 7fd3e53c7640 1 -- 172.21.15.22:0/1688458560 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d0031920 con 0x7fd3e00d0fa0 2023-11-24T06:14:47.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.037+0000 7fd3e53c7640 1 -- 172.21.15.22:0/1688458560 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0031cb0 con 0x7fd3e00d0fa0 2023-11-24T06:14:47.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.037+0000 7fd3e73cb640 1 -- 172.21.15.22:0/1688458560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e00d0fa0 msgr2=0x7fd3e00d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.037+0000 7fd3e73cb640 1 --2- 172.21.15.22:0/1688458560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e00d0fa0 0x7fd3e00d1680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009870 tx=0x7fd3d002b860 comp rx=0 tx=0).stop 2023-11-24T06:14:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.037+0000 7fd3e73cb640 1 -- 172.21.15.22:0/1688458560 shutdown_connections 2023-11-24T06:14:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.037+0000 7fd3e73cb640 1 --2- 172.21.15.22:0/1688458560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e00d0fa0 0x7fd3e00d1680 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.037+0000 7fd3e73cb640 1 --2- 172.21.15.22:0/1688458560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e015d3b0 0x7fd3e00ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.037+0000 7fd3e73cb640 1 -- 172.21.15.22:0/1688458560 >> 172.21.15.22:0/1688458560 conn(0x7fd3e00d30a0 msgr2=0x7fd3e00d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.038+0000 7fd3e73cb640 1 -- 172.21.15.22:0/1688458560 shutdown_connections 2023-11-24T06:14:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.038+0000 7fd3e73cb640 1 -- 172.21.15.22:0/1688458560 wait complete. 2023-11-24T06:14:47.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.039+0000 7fd3e73cb640 1 Processor -- start 2023-11-24T06:14:47.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.040+0000 7fd3e73cb640 1 -- start start 2023-11-24T06:14:47.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.040+0000 7fd3e73cb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3e00d0fa0 0x7fd3e014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e73cb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e00d1bc0 0x7fd3e00b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e73cb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e015d3b0 0x7fd3e009d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e73cb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e014fa20 con 0x7fd3e015d3b0 2023-11-24T06:14:47.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e73cb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e00a0d20 con 0x7fd3e00d0fa0 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e73cb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e009fc80 con 0x7fd3e00d1bc0 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e6bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e015d3b0 0x7fd3e009d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e6bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e015d3b0 0x7fd3e009d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52096/0 (socket says 172.21.15.22:52096) 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e6bca640 1 -- 172.21.15.22:0/3191496829 learned_addr learned my addr 172.21.15.22:0/3191496829 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e63c9640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3e00d0fa0 0x7fd3e014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e5bc8640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e00d1bc0 0x7fd3e00b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e6bca640 1 -- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e00d1bc0 msgr2=0x7fd3e00b86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e6bca640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e00d1bc0 0x7fd3e00b86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e6bca640 1 -- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3e00d0fa0 msgr2=0x7fd3e014f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e6bca640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3e00d0fa0 0x7fd3e014f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e6bca640 1 -- 172.21.15.22:0/3191496829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00094d0 con 0x7fd3e015d3b0 2023-11-24T06:14:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e63c9640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3e00d0fa0 0x7fd3e014f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:47.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.041+0000 7fd3e5bc8640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e00d1bc0 0x7fd3e00b86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:47.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.042+0000 7fd3e6bca640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e015d3b0 0x7fd3e009d840 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800b410 tx=0x7fd3d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.042+0000 7fd3d6ffd640 1 -- 172.21.15.22:0/3191496829 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8004020 con 0x7fd3e015d3b0 2023-11-24T06:14:47.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.042+0000 7fd3d6ffd640 1 -- 172.21.15.22:0/3191496829 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d8004180 con 0x7fd3e015d3b0 2023-11-24T06:14:47.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.042+0000 7fd3d6ffd640 1 -- 172.21.15.22:0/3191496829 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8011630 con 0x7fd3e015d3b0 2023-11-24T06:14:47.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.042+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e009ff60 con 0x7fd3e015d3b0 2023-11-24T06:14:47.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.042+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e00a0520 con 0x7fd3e015d3b0 2023-11-24T06:14:47.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.044+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e004e840 con 0x7fd3e015d3b0 2023-11-24T06:14:47.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.044+0000 7fd3d6ffd640 1 -- 172.21.15.22:0/3191496829 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd3d8011790 con 0x7fd3e015d3b0 2023-11-24T06:14:47.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.045+0000 7fd3d6ffd640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3c406aff0 0x7fd3c406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.045+0000 7fd3d6ffd640 1 -- 172.21.15.22:0/3191496829 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd3d80896c0 con 0x7fd3e015d3b0 2023-11-24T06:14:47.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.046+0000 7fd3e63c9640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3c406aff0 0x7fd3c406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.047+0000 7fd3e63c9640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3c406aff0 0x7fd3c406d4b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00d430 tx=0x7fd3dc007530 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.050+0000 7fd3d6ffd640 1 -- 172.21.15.22:0/3191496829 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3d8054410 con 0x7fd3e015d3b0 2023-11-24T06:14:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.243+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3e00b7ab0 con 0x7fd3e015d3b0 2023-11-24T06:14:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.245+0000 7fd3d6ffd640 1 -- 172.21.15.22:0/3191496829 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3d8057a30 con 0x7fd3e015d3b0 2023-11-24T06:14:47.247 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:14:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.247+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3c406aff0 msgr2=0x7fd3c406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.247+0000 7fd3e73cb640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3c406aff0 0x7fd3c406d4b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00d430 tx=0x7fd3dc007530 comp rx=0 tx=0).stop 2023-11-24T06:14:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.247+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e015d3b0 msgr2=0x7fd3e009d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.247+0000 7fd3e73cb640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e015d3b0 0x7fd3e009d840 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800b410 tx=0x7fd3d800b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.248+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 shutdown_connections 2023-11-24T06:14:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.248+0000 7fd3e73cb640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3c406aff0 0x7fd3c406d4b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.248+0000 7fd3e73cb640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3e015d3b0 0x7fd3e009d840 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.248+0000 7fd3e73cb640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3e00d1bc0 0x7fd3e00b86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.248+0000 7fd3e73cb640 1 --2- 172.21.15.22:0/3191496829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3e00d0fa0 0x7fd3e014f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.248+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 >> 172.21.15.22:0/3191496829 conn(0x7fd3e00d30a0 msgr2=0x7fd3e006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.248+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 shutdown_connections 2023-11-24T06:14:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.248+0000 7fd3e73cb640 1 -- 172.21.15.22:0/3191496829 wait complete. 2023-11-24T06:14:47.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:47.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.507+0000 7fc2b2d5a640 1 Processor -- start 2023-11-24T06:14:47.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.507+0000 7fc2b2d5a640 1 -- start start 2023-11-24T06:14:47.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.509+0000 7fc2b2d5a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc2ac0cd640 0x7fc2ac066490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.509+0000 7fc2b2d5a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0b35e0 0x7fc2ac06a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.509+0000 7fc2b2d5a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac0cba40 con 0x7fc2ac06e240 2023-11-24T06:14:47.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.509+0000 7fc2b2d5a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac0cbce0 con 0x7fc2ac0cd640 2023-11-24T06:14:47.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.509+0000 7fc2b2d5a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0b45a0 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.509+0000 7fc2abfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc2ac06e240 0x7fc2ac0cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52776/0 (socket says 172.21.15.22:52776) 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.509+0000 7fc2abfff640 1 -- 172.21.15.22:0/105097019 learned_addr learned my addr 172.21.15.22:0/105097019 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.509+0000 7fc2b0af6640 1 --2- 172.21.15.22:0/105097019 >> v2:172.21.15.31:3300/0 conn(0x7fc2ac0cd640 0x7fc2ac066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.509+0000 7fc2b12f7640 1 --2- 172.21.15.22:0/105097019 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0b35e0 0x7fc2ac06a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.510+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/105097019 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293576095 0 0) 0x7fc2ac0cba40 con 0x7fc2ac06e240 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.510+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/105097019 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc29c003520 con 0x7fc2ac06e240 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.510+0000 7fc2b12f7640 1 -- 172.21.15.22:0/105097019 >> v2:172.21.15.31:3300/0 conn(0x7fc2ac0cd640 msgr2=0x7fc2ac066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.510+0000 7fc2b12f7640 1 --2- 172.21.15.22:0/105097019 >> v2:172.21.15.31:3300/0 conn(0x7fc2ac0cd640 0x7fc2ac066490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.510+0000 7fc2b12f7640 1 -- 172.21.15.22:0/105097019 >> v1:172.21.15.22:6789/0 conn(0x7fc2ac06e240 legacy=0x7fc2ac0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.510+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/105097019 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3753172684 0 0) 0x7fc29c003520 con 0x7fc2ac06e240 2023-11-24T06:14:47.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.510+0000 7fc2b12f7640 1 -- 172.21.15.22:0/105097019 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac0b4880 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.512+0000 7fc2b12f7640 1 --2- 172.21.15.22:0/105097019 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0b35e0 0x7fc2ac06a440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009d90 tx=0x7fc2a402bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7758d0b0f2b25bc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.512+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/105097019 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298001670 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.512+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/105097019 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a402c810 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.513+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/105097019 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a402cba0 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.513+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/105097019 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0b35e0 msgr2=0x7fc2ac06a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.513+0000 7fc2b2d5a640 1 --2- 172.21.15.22:0/105097019 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0b35e0 0x7fc2ac06a440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009d90 tx=0x7fc2a402bce0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.513+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/105097019 shutdown_connections 2023-11-24T06:14:47.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.513+0000 7fc2b2d5a640 1 --2- 172.21.15.22:0/105097019 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0b35e0 0x7fc2ac06a440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.513+0000 7fc2b2d5a640 1 --2- 172.21.15.22:0/105097019 >> v2:172.21.15.31:3300/0 conn(0x7fc2ac0cd640 0x7fc2ac066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.513+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/105097019 >> 172.21.15.22:0/105097019 conn(0x7fc2ac0cf740 msgr2=0x7fc2ac0cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.513+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/105097019 shutdown_connections 2023-11-24T06:14:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.513+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/105097019 wait complete. 2023-11-24T06:14:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.515+0000 7fc2b2d5a640 1 Processor -- start 2023-11-24T06:14:47.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.515+0000 7fc2b2d5a640 1 -- start start 2023-11-24T06:14:47.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.516+0000 7fc2b2d5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2ac06e240 0x7fc2ac14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.516+0000 7fc2b2d5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2ac0b35e0 0x7fc2ac14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.516+0000 7fc2b2d5a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0cd640 0x7fc2ac1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.516+0000 7fc2b2d5a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac1530c0 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.516+0000 7fc2b2d5a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac14e870 con 0x7fc2ac06e240 2023-11-24T06:14:47.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.516+0000 7fc2b2d5a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac1524b0 con 0x7fc2ac0cd640 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2abfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2ac0b35e0 0x7fc2ac14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2abfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2ac0b35e0 0x7fc2ac14e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52108/0 (socket says 172.21.15.22:52108) 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2abfff640 1 -- 172.21.15.22:0/2941194888 learned_addr learned my addr 172.21.15.22:0/2941194888 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2b0af6640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2ac06e240 0x7fc2ac14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2b12f7640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0cd640 0x7fc2ac1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2abfff640 1 -- 172.21.15.22:0/2941194888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0cd640 msgr2=0x7fc2ac1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2abfff640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0cd640 0x7fc2ac1516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2abfff640 1 -- 172.21.15.22:0/2941194888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2ac06e240 msgr2=0x7fc2ac14ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2abfff640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2ac06e240 0x7fc2ac14ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2abfff640 1 -- 172.21.15.22:0/2941194888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4009a70 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2b0af6640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2ac06e240 0x7fc2ac14ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.517+0000 7fc2abfff640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2ac0b35e0 0x7fc2ac14e330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c780 tx=0x7fc29800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.518+0000 7fc2a97fa640 1 -- 172.21.15.22:0/2941194888 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298005ad0 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.518+0000 7fc2a97fa640 1 -- 172.21.15.22:0/2941194888 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298005c50 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.518+0000 7fc2a97fa640 1 -- 172.21.15.22:0/2941194888 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298007070 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.518+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac152790 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.518+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac152d50 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.519+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac072510 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.520+0000 7fc2a97fa640 1 -- 172.21.15.22:0/2941194888 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc2980071d0 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.521+0000 7fc2a97fa640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc29006aff0 0x7fc29006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.522+0000 7fc2a97fa640 1 -- 172.21.15.22:0/2941194888 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc298089700 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.522+0000 7fc2b0af6640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc29006aff0 0x7fc29006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.522+0000 7fc2b0af6640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc29006aff0 0x7fc29006d4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009a20 tx=0x7fc2a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.526+0000 7fc2a97fa640 1 -- 172.21.15.22:0/2941194888 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2980544e0 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.722+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2ac06def0 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.723+0000 7fc2a97fa640 1 -- 172.21.15.22:0/2941194888 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc298057b00 con 0x7fc2ac0b35e0 2023-11-24T06:14:47.726 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:14:47.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.725+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc29006aff0 msgr2=0x7fc29006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.725+0000 7fc2b2d5a640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc29006aff0 0x7fc29006d4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009a20 tx=0x7fc2a0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.725+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2ac0b35e0 msgr2=0x7fc2ac14e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.725+0000 7fc2b2d5a640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2ac0b35e0 0x7fc2ac14e330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c780 tx=0x7fc29800cc40 comp rx=0 tx=0).stop 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.726+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 shutdown_connections 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.726+0000 7fc2b2d5a640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc29006aff0 0x7fc29006d4b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.726+0000 7fc2b2d5a640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2ac0cd640 0x7fc2ac1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.726+0000 7fc2b2d5a640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2ac0b35e0 0x7fc2ac14e330 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.726+0000 7fc2b2d5a640 1 --2- 172.21.15.22:0/2941194888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2ac06e240 0x7fc2ac14ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.726+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 >> 172.21.15.22:0/2941194888 conn(0x7fc2ac0cf740 msgr2=0x7fc2ac06b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.726+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 shutdown_connections 2023-11-24T06:14:47.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.726+0000 7fc2b2d5a640 1 -- 172.21.15.22:0/2941194888 wait complete. 2023-11-24T06:14:47.749 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.973+0000 7fc78a143640 1 Processor -- start 2023-11-24T06:14:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.973+0000 7fc78a143640 1 -- start start 2023-11-24T06:14:47.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.975+0000 7fc78a143640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc7840b2510 0x7fc78406abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.975+0000 7fc78a143640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc78406b0f0 0x7fc78406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.975+0000 7fc78a143640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78406a440 con 0x7fc78415ac70 2023-11-24T06:14:47.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.975+0000 7fc78a143640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7840b3300 con 0x7fc7840b2510 2023-11-24T06:14:47.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.975+0000 7fc78a143640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78415df60 con 0x7fc78406b0f0 2023-11-24T06:14:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.975+0000 7fc789141640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc78415ac70 0x7fc78415d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52780/0 (socket says 172.21.15.22:52780) 2023-11-24T06:14:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.975+0000 7fc789141640 1 -- 172.21.15.22:0/2209387216 learned_addr learned my addr 172.21.15.22:0/2209387216 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.975+0000 7fc788940640 1 --2- 172.21.15.22:0/2209387216 >> v2:172.21.15.22:3300/0 conn(0x7fc7840b2510 0x7fc78406abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.975+0000 7fc789942640 1 --2- 172.21.15.22:0/2209387216 >> v2:172.21.15.31:3300/0 conn(0x7fc78406b0f0 0x7fc78406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.976+0000 7fc788940640 1 -- 172.21.15.22:0/2209387216 >> v2:172.21.15.31:3300/0 conn(0x7fc78406b0f0 msgr2=0x7fc78406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.976+0000 7fc788940640 1 --2- 172.21.15.22:0/2209387216 >> v2:172.21.15.31:3300/0 conn(0x7fc78406b0f0 0x7fc78406cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.976+0000 7fc788940640 1 -- 172.21.15.22:0/2209387216 >> v1:172.21.15.22:6789/0 conn(0x7fc78415ac70 legacy=0x7fc78415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.976+0000 7fc783fff640 1 -- 172.21.15.22:0/2209387216 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232180632 0 0) 0x7fc78406a440 con 0x7fc78415ac70 2023-11-24T06:14:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.976+0000 7fc788940640 1 -- 172.21.15.22:0/2209387216 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78415e240 con 0x7fc7840b2510 2023-11-24T06:14:47.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.977+0000 7fc788940640 1 --2- 172.21.15.22:0/2209387216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7840b2510 0x7fc78406abb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc78406ba70 tx=0x7fc77802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be7d14b711de9aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.977+0000 7fc783fff640 1 -- 172.21.15.22:0/2209387216 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778031830 con 0x7fc7840b2510 2023-11-24T06:14:47.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.977+0000 7fc783fff640 1 -- 172.21.15.22:0/2209387216 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778031990 con 0x7fc7840b2510 2023-11-24T06:14:47.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.977+0000 7fc783fff640 1 -- 172.21.15.22:0/2209387216 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778031d20 con 0x7fc7840b2510 2023-11-24T06:14:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.978+0000 7fc78a143640 1 -- 172.21.15.22:0/2209387216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7840b2510 msgr2=0x7fc78406abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.978+0000 7fc78a143640 1 --2- 172.21.15.22:0/2209387216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7840b2510 0x7fc78406abb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc78406ba70 tx=0x7fc77802b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.978+0000 7fc78a143640 1 -- 172.21.15.22:0/2209387216 shutdown_connections 2023-11-24T06:14:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.978+0000 7fc78a143640 1 --2- 172.21.15.22:0/2209387216 >> v2:172.21.15.31:3300/0 conn(0x7fc78406b0f0 0x7fc78406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.978+0000 7fc78a143640 1 --2- 172.21.15.22:0/2209387216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7840b2510 0x7fc78406abb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.978+0000 7fc78a143640 1 -- 172.21.15.22:0/2209387216 >> 172.21.15.22:0/2209387216 conn(0x7fc7840b1630 msgr2=0x7fc7840b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.978+0000 7fc78a143640 1 -- 172.21.15.22:0/2209387216 shutdown_connections 2023-11-24T06:14:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.978+0000 7fc78a143640 1 -- 172.21.15.22:0/2209387216 wait complete. 2023-11-24T06:14:47.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.980+0000 7fc78a143640 1 Processor -- start 2023-11-24T06:14:47.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.980+0000 7fc78a143640 1 -- start start 2023-11-24T06:14:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.981+0000 7fc78a143640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc78406b0f0 0x7fc7840ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.981+0000 7fc78a143640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b2510 0x7fc7840b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.981+0000 7fc78a143640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78415ac70 0x7fc784151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.981+0000 7fc78a143640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840ce9a0 con 0x7fc78406b0f0 2023-11-24T06:14:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.981+0000 7fc78a143640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840b0c40 con 0x7fc7840b2510 2023-11-24T06:14:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.981+0000 7fc78a143640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840b0f20 con 0x7fc78415ac70 2023-11-24T06:14:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.981+0000 7fc789141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc78406b0f0 0x7fc7840ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.981+0000 7fc789141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc78406b0f0 0x7fc7840ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52114/0 (socket says 172.21.15.22:52114) 2023-11-24T06:14:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.981+0000 7fc789141640 1 -- 172.21.15.22:0/1954275012 learned_addr learned my addr 172.21.15.22:0/1954275012 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:47.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc788940640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b2510 0x7fc7840b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc789942640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78415ac70 0x7fc784151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc789141640 1 -- 172.21.15.22:0/1954275012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78415ac70 msgr2=0x7fc784151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc789141640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78415ac70 0x7fc784151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc789141640 1 -- 172.21.15.22:0/1954275012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b2510 msgr2=0x7fc7840b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc789141640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b2510 0x7fc7840b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc789141640 1 -- 172.21.15.22:0/1954275012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009400 con 0x7fc78406b0f0 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc789141640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc78406b0f0 0x7fc7840ad550 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc77400c7c0 tx=0x7fc77400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc781ffb640 1 -- 172.21.15.22:0/1954275012 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77400a640 con 0x7fc78406b0f0 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc781ffb640 1 -- 172.21.15.22:0/1954275012 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77400a7c0 con 0x7fc78406b0f0 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc781ffb640 1 -- 172.21.15.22:0/1954275012 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77400ab70 con 0x7fc78406b0f0 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.982+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7840ce350 con 0x7fc78406b0f0 2023-11-24T06:14:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.983+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc784155810 con 0x7fc78406b0f0 2023-11-24T06:14:47.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.984+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78404e840 con 0x7fc78406b0f0 2023-11-24T06:14:47.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.985+0000 7fc781ffb640 1 -- 172.21.15.22:0/1954275012 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc77400acd0 con 0x7fc78406b0f0 2023-11-24T06:14:47.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.985+0000 7fc781ffb640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc77006aff0 0x7fc77006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.986+0000 7fc781ffb640 1 -- 172.21.15.22:0/1954275012 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc774088ec0 con 0x7fc78406b0f0 2023-11-24T06:14:47.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.986+0000 7fc788940640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc77006aff0 0x7fc77006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.987+0000 7fc788940640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc77006aff0 0x7fc77006d4b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc778036000 tx=0x7fc778008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:47.990+0000 7fc781ffb640 1 -- 172.21.15.22:0/1954275012 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc774053d40 con 0x7fc78406b0f0 2023-11-24T06:14:48.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.206+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc78415cd90 con 0x7fc78406b0f0 2023-11-24T06:14:48.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.206+0000 7fc781ffb640 1 -- 172.21.15.22:0/1954275012 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc774018070 con 0x7fc78406b0f0 2023-11-24T06:14:48.209 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc77006aff0 msgr2=0x7fc77006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc77006aff0 0x7fc77006d4b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc778036000 tx=0x7fc778008030 comp rx=0 tx=0).stop 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc78406b0f0 msgr2=0x7fc7840ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc78406b0f0 0x7fc7840ad550 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc77400c7c0 tx=0x7fc77400cc80 comp rx=0 tx=0).stop 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 shutdown_connections 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc77006aff0 0x7fc77006d4b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78415ac70 0x7fc784151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b2510 0x7fc7840b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 --2- 172.21.15.22:0/1954275012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc78406b0f0 0x7fc7840ad550 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.209+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 >> 172.21.15.22:0/1954275012 conn(0x7fc7840b1630 msgr2=0x7fc784073310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.210+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 shutdown_connections 2023-11-24T06:14:48.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.210+0000 7fc78a143640 1 -- 172.21.15.22:0/1954275012 wait complete. 2023-11-24T06:14:48.232 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:14:48.232 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:48.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:48.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.530+0000 7f627aa9b640 1 Processor -- start 2023-11-24T06:14:48.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.530+0000 7f627aa9b640 1 -- start start 2023-11-24T06:14:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.531+0000 7f627aa9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f627406d520 0x7f627406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.531+0000 7f627aa9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62740ad720 0x7f627415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.531+0000 7f627aa9b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627415c360 con 0x7f62740abff0 2023-11-24T06:14:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.531+0000 7f627aa9b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740b41a0 con 0x7f627406d520 2023-11-24T06:14:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.531+0000 7f627aa9b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627406de40 con 0x7f62740ad720 2023-11-24T06:14:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.531+0000 7f6278837640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f627406d520 0x7f627406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.532+0000 7f6278837640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f627406d520 0x7f627406d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52128/0 (socket says 172.21.15.22:52128) 2023-11-24T06:14:48.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.532+0000 7f6278837640 1 -- 172.21.15.22:0/2680587151 learned_addr learned my addr 172.21.15.22:0/2680587151 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:48.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.532+0000 7f6273fff640 1 --2- 172.21.15.22:0/2680587151 >> v2:172.21.15.31:3300/0 conn(0x7f62740ad720 0x7f627415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.532+0000 7f6278837640 1 -- 172.21.15.22:0/2680587151 >> v2:172.21.15.31:3300/0 conn(0x7f62740ad720 msgr2=0x7f627415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.532+0000 7f6278837640 1 --2- 172.21.15.22:0/2680587151 >> v2:172.21.15.31:3300/0 conn(0x7f62740ad720 0x7f627415ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.532+0000 7f6278837640 1 -- 172.21.15.22:0/2680587151 >> v1:172.21.15.31:6789/0 conn(0x7f62740abff0 legacy=0x7f627415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.532+0000 7f6278837640 1 -- 172.21.15.22:0/2680587151 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627415ba30 con 0x7f627406d520 2023-11-24T06:14:48.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.533+0000 7f6278837640 1 --2- 172.21.15.22:0/2680587151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f627406d520 0x7f627406d900 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f62740adb00 tx=0x7f626802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17940aa5923e1e2d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f62737fe640 1 -- 172.21.15.22:0/2680587151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268031870 con 0x7f627406d520 2023-11-24T06:14:48.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f62737fe640 1 -- 172.21.15.22:0/2680587151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62680319d0 con 0x7f627406d520 2023-11-24T06:14:48.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f62737fe640 1 -- 172.21.15.22:0/2680587151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268031d60 con 0x7f627406d520 2023-11-24T06:14:48.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f627aa9b640 1 -- 172.21.15.22:0/2680587151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f627406d520 msgr2=0x7f627406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f627aa9b640 1 --2- 172.21.15.22:0/2680587151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f627406d520 0x7f627406d900 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f62740adb00 tx=0x7f626802b910 comp rx=0 tx=0).stop 2023-11-24T06:14:48.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f627aa9b640 1 -- 172.21.15.22:0/2680587151 shutdown_connections 2023-11-24T06:14:48.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f627aa9b640 1 --2- 172.21.15.22:0/2680587151 >> v2:172.21.15.31:3300/0 conn(0x7f62740ad720 0x7f627415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f627aa9b640 1 --2- 172.21.15.22:0/2680587151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f627406d520 0x7f627406d900 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f627aa9b640 1 -- 172.21.15.22:0/2680587151 >> 172.21.15.22:0/2680587151 conn(0x7f62740b0d80 msgr2=0x7f62740b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.534+0000 7f627aa9b640 1 -- 172.21.15.22:0/2680587151 shutdown_connections 2023-11-24T06:14:48.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.535+0000 7f627aa9b640 1 -- 172.21.15.22:0/2680587151 wait complete. 2023-11-24T06:14:48.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.536+0000 7f627aa9b640 1 Processor -- start 2023-11-24T06:14:48.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.536+0000 7f627aa9b640 1 -- start start 2023-11-24T06:14:48.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.537+0000 7f627aa9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627406d520 0x7f6274071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.537+0000 7f627aa9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62740abff0 0x7f627414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.537+0000 7f627aa9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62740ad720 0x7f62740cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.537+0000 7f627aa9b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740cbc70 con 0x7f62740ad720 2023-11-24T06:14:48.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.537+0000 7f627aa9b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740cb1c0 con 0x7f627406d520 2023-11-24T06:14:48.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.537+0000 7f627aa9b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62740cbec0 con 0x7f62740abff0 2023-11-24T06:14:48.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6279038640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62740ad720 0x7f62740cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6279038640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62740ad720 0x7f62740cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52138/0 (socket says 172.21.15.22:52138) 2023-11-24T06:14:48.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6279038640 1 -- 172.21.15.22:0/1318520457 learned_addr learned my addr 172.21.15.22:0/1318520457 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:48.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6278837640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627406d520 0x7f6274071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6273fff640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62740abff0 0x7f627414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6279038640 1 -- 172.21.15.22:0/1318520457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62740abff0 msgr2=0x7f627414ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6279038640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62740abff0 0x7f627414ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6279038640 1 -- 172.21.15.22:0/1318520457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627406d520 msgr2=0x7f6274071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6279038640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627406d520 0x7f6274071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6279038640 1 -- 172.21.15.22:0/1318520457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680094d0 con 0x7f62740ad720 2023-11-24T06:14:48.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.538+0000 7f6273fff640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62740abff0 0x7f627414ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:48.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.539+0000 7f6279038640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62740ad720 0x7f62740cc9a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c700 tx=0x7f626c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.539+0000 7f62717fa640 1 -- 172.21.15.22:0/1318520457 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00aa50 con 0x7f62740ad720 2023-11-24T06:14:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.539+0000 7f62717fa640 1 -- 172.21.15.22:0/1318520457 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00abb0 con 0x7f62740ad720 2023-11-24T06:14:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.539+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62740cc1a0 con 0x7f62740ad720 2023-11-24T06:14:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.539+0000 7f62717fa640 1 -- 172.21.15.22:0/1318520457 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00ce10 con 0x7f62740ad720 2023-11-24T06:14:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.539+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6274072130 con 0x7f62740ad720 2023-11-24T06:14:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.540+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62740cc6c0 con 0x7f62740ad720 2023-11-24T06:14:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.542+0000 7f62717fa640 1 -- 172.21.15.22:0/1318520457 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f626c012420 con 0x7f62740ad720 2023-11-24T06:14:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.543+0000 7f62717fa640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f625806aff0 0x7f625806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.543+0000 7f62717fa640 1 -- 172.21.15.22:0/1318520457 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f626c089ec0 con 0x7f62740ad720 2023-11-24T06:14:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.543+0000 7f6278837640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f625806aff0 0x7f625806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.544+0000 7f6278837640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f625806aff0 0x7f625806d4b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6268036000 tx=0x7f626803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.547+0000 7f62717fa640 1 -- 172.21.15.22:0/1318520457 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f626c054c10 con 0x7f62740ad720 2023-11-24T06:14:48.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.747+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6274074770 con 0x7f62740ad720 2023-11-24T06:14:48.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.750+0000 7f62717fa640 1 -- 172.21.15.22:0/1318520457 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16560 (secure 0 0 0) 0x7f626c016020 con 0x7f62740ad720 2023-11-24T06:14:48.753 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":49,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:42.443698+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.752+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f625806aff0 msgr2=0x7f625806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.752+0000 7f627aa9b640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f625806aff0 0x7f625806d4b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6268036000 tx=0x7f626803c040 comp rx=0 tx=0).stop 2023-11-24T06:14:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.752+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62740ad720 msgr2=0x7f62740cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.752+0000 7f627aa9b640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62740ad720 0x7f62740cc9a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c700 tx=0x7f626c00cbc0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.753+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 shutdown_connections 2023-11-24T06:14:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.753+0000 7f627aa9b640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f625806aff0 0x7f625806d4b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.753+0000 7f627aa9b640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62740ad720 0x7f62740cc9a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.753+0000 7f627aa9b640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62740abff0 0x7f627414ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.753+0000 7f627aa9b640 1 --2- 172.21.15.22:0/1318520457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627406d520 0x7f6274071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.753+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 >> 172.21.15.22:0/1318520457 conn(0x7f62740b0d80 msgr2=0x7f627415ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.753+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 shutdown_connections 2023-11-24T06:14:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.753+0000 7f627aa9b640 1 -- 172.21.15.22:0/1318520457 wait complete. 2023-11-24T06:14:48.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:12.796187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:13.964719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:48.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:48.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.996+0000 7efe44c50640 1 Processor -- start 2023-11-24T06:14:48.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.997+0000 7efe44c50640 1 -- start start 2023-11-24T06:14:49.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.998+0000 7efe44c50640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe400d1d90 0x7efe400ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.998+0000 7efe44c50640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe400d0fa0 0x7efe400b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.998+0000 7efe44c50640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe400c6bf0 con 0x7efe4015d3b0 2023-11-24T06:14:49.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.998+0000 7efe44c50640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe400d13f0 con 0x7efe400d1d90 2023-11-24T06:14:49.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.998+0000 7efe44c50640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe400cedc0 con 0x7efe400d0fa0 2023-11-24T06:14:49.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.998+0000 7efe3f7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efe4015d3b0 0x7efe400d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52788/0 (socket says 172.21.15.22:52788) 2023-11-24T06:14:49.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.998+0000 7efe3f7fe640 1 -- 172.21.15.22:0/2469526987 learned_addr learned my addr 172.21.15.22:0/2469526987 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:49.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.999+0000 7efe37fff640 1 --2- 172.21.15.22:0/2469526987 >> v2:172.21.15.22:3300/0 conn(0x7efe400d1d90 0x7efe400ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.999+0000 7efe3ffff640 1 --2- 172.21.15.22:0/2469526987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe400d0fa0 0x7efe400b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.999+0000 7efe3effd640 1 -- 172.21.15.22:0/2469526987 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112506672 0 0) 0x7efe400c6bf0 con 0x7efe4015d3b0 2023-11-24T06:14:49.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.999+0000 7efe3effd640 1 -- 172.21.15.22:0/2469526987 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe2c003520 con 0x7efe4015d3b0 2023-11-24T06:14:49.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.999+0000 7efe37fff640 1 -- 172.21.15.22:0/2469526987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe400d0fa0 msgr2=0x7efe400b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.999+0000 7efe37fff640 1 --2- 172.21.15.22:0/2469526987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe400d0fa0 0x7efe400b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.999+0000 7efe37fff640 1 -- 172.21.15.22:0/2469526987 >> v1:172.21.15.22:6789/0 conn(0x7efe4015d3b0 legacy=0x7efe400d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:48.999+0000 7efe37fff640 1 -- 172.21.15.22:0/2469526987 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe400c6e40 con 0x7efe400d1d90 2023-11-24T06:14:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.000+0000 7efe37fff640 1 --2- 172.21.15.22:0/2469526987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 0x7efe400ce6c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7efe280097a0 tx=0x7efe2802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa7c189fe8b05cb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe3effd640 1 -- 172.21.15.22:0/2469526987 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2802e070 con 0x7efe400d1d90 2023-11-24T06:14:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe3effd640 1 -- 172.21.15.22:0/2469526987 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe280315a0 con 0x7efe400d1d90 2023-11-24T06:14:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe3effd640 1 -- 172.21.15.22:0/2469526987 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe28031910 con 0x7efe400d1d90 2023-11-24T06:14:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe44c50640 1 -- 172.21.15.22:0/2469526987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 msgr2=0x7efe400ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe44c50640 1 --2- 172.21.15.22:0/2469526987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 0x7efe400ce6c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7efe280097a0 tx=0x7efe2802b840 comp rx=0 tx=0).stop 2023-11-24T06:14:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe44c50640 1 -- 172.21.15.22:0/2469526987 shutdown_connections 2023-11-24T06:14:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe44c50640 1 --2- 172.21.15.22:0/2469526987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 0x7efe400ce6c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe44c50640 1 --2- 172.21.15.22:0/2469526987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe400d0fa0 0x7efe400b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe44c50640 1 -- 172.21.15.22:0/2469526987 >> 172.21.15.22:0/2469526987 conn(0x7efe400d30a0 msgr2=0x7efe400d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.001+0000 7efe44c50640 1 -- 172.21.15.22:0/2469526987 shutdown_connections 2023-11-24T06:14:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.002+0000 7efe44c50640 1 -- 172.21.15.22:0/2469526987 wait complete. 2023-11-24T06:14:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.003+0000 7efe44c50640 1 Processor -- start 2023-11-24T06:14:49.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.003+0000 7efe44c50640 1 -- start start 2023-11-24T06:14:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.004+0000 7efe44c50640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe400d0fa0 0x7efe4014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.004+0000 7efe44c50640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 0x7efe400cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.004+0000 7efe44c50640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe4015d3b0 0x7efe4006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.004+0000 7efe44c50640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe400cb7d0 con 0x7efe400d1d90 2023-11-24T06:14:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.004+0000 7efe44c50640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe400cb4f0 con 0x7efe400d0fa0 2023-11-24T06:14:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.004+0000 7efe44c50640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4015ea00 con 0x7efe4015d3b0 2023-11-24T06:14:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe37fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 0x7efe400cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe37fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 0x7efe400cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52150/0 (socket says 172.21.15.22:52150) 2023-11-24T06:14:49.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe37fff640 1 -- 172.21.15.22:0/794152532 learned_addr learned my addr 172.21.15.22:0/794152532 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe3f7fe640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe400d0fa0 0x7efe4014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe37fff640 1 -- 172.21.15.22:0/794152532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe4015d3b0 msgr2=0x7efe4006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe37fff640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe4015d3b0 0x7efe4006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe37fff640 1 -- 172.21.15.22:0/794152532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe400d0fa0 msgr2=0x7efe4014e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe37fff640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe400d0fa0 0x7efe4014e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe37fff640 1 -- 172.21.15.22:0/794152532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28009400 con 0x7efe400d1d90 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe3f7fe640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe400d0fa0 0x7efe4014e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.005+0000 7efe37fff640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 0x7efe400cab80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7efe28034040 tx=0x7efe280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.006+0000 7efe3cff9640 1 -- 172.21.15.22:0/794152532 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe28032630 con 0x7efe400d1d90 2023-11-24T06:14:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.006+0000 7efe3cff9640 1 -- 172.21.15.22:0/794152532 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe28032790 con 0x7efe400d1d90 2023-11-24T06:14:49.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.006+0000 7efe3cff9640 1 -- 172.21.15.22:0/794152532 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe28032b00 con 0x7efe400d1d90 2023-11-24T06:14:49.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.006+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4015ece0 con 0x7efe400d1d90 2023-11-24T06:14:49.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.006+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4014e8e0 con 0x7efe400d1d90 2023-11-24T06:14:49.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.007+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4015f200 con 0x7efe400d1d90 2023-11-24T06:14:49.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.008+0000 7efe3cff9640 1 -- 172.21.15.22:0/794152532 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7efe28032c60 con 0x7efe400d1d90 2023-11-24T06:14:49.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.009+0000 7efe3cff9640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe2006aff0 0x7efe2006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.009+0000 7efe3cff9640 1 -- 172.21.15.22:0/794152532 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efe280aba00 con 0x7efe400d1d90 2023-11-24T06:14:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.009+0000 7efe3f7fe640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe2006aff0 0x7efe2006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.010+0000 7efe3f7fe640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe2006aff0 0x7efe2006d4b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efe30005880 tx=0x7efe30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.016+0000 7efe3cff9640 1 -- 172.21.15.22:0/794152532 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe4015f200 con 0x7efe400d1d90 2023-11-24T06:14:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.210+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe4015f200 con 0x7efe400d1d90 2023-11-24T06:14:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.211+0000 7efe3cff9640 1 -- 172.21.15.22:0/794152532 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe4015f200 con 0x7efe400d1d90 2023-11-24T06:14:49.214 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:14:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe2006aff0 msgr2=0x7efe2006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe2006aff0 0x7efe2006d4b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efe30005880 tx=0x7efe30009040 comp rx=0 tx=0).stop 2023-11-24T06:14:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 msgr2=0x7efe400cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 0x7efe400cab80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7efe28034040 tx=0x7efe280046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 shutdown_connections 2023-11-24T06:14:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efe2006aff0 0x7efe2006d4b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efe4015d3b0 0x7efe4006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe400d1d90 0x7efe400cab80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 --2- 172.21.15.22:0/794152532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe400d0fa0 0x7efe4014e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.213+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 >> 172.21.15.22:0/794152532 conn(0x7efe400d30a0 msgr2=0x7efe400c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.214+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 shutdown_connections 2023-11-24T06:14:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.214+0000 7efe44c50640 1 -- 172.21.15.22:0/794152532 wait complete. 2023-11-24T06:14:49.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.461+0000 7f9b2a37c640 1 Processor -- start 2023-11-24T06:14:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.461+0000 7f9b2a37c640 1 -- start start 2023-11-24T06:14:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.462+0000 7f9b2a37c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9b24144770 0x7f9b2415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.462+0000 7f9b2a37c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b2415f0a0 0x7f9b240ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.462+0000 7f9b2a37c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2415f930 con 0x7f9b240b35a0 2023-11-24T06:14:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b2a37c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b240b43b0 con 0x7f9b24144770 2023-11-24T06:14:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b2a37c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2415f530 con 0x7f9b2415f0a0 2023-11-24T06:14:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b2937a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9b24144770 0x7f9b2415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b2937a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9b24144770 0x7f9b2415eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52152/0 (socket says 172.21.15.22:52152) 2023-11-24T06:14:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b2937a640 1 -- 172.21.15.22:0/2611705887 learned_addr learned my addr 172.21.15.22:0/2611705887 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b29b7b640 1 --2- 172.21.15.22:0/2611705887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b2415f0a0 0x7f9b240ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b2937a640 1 -- 172.21.15.22:0/2611705887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b2415f0a0 msgr2=0x7f9b240ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b2937a640 1 --2- 172.21.15.22:0/2611705887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b2415f0a0 0x7f9b240ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b2937a640 1 -- 172.21.15.22:0/2611705887 >> v1:172.21.15.22:6789/0 conn(0x7f9b240b35a0 legacy=0x7f9b2406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.463+0000 7f9b2937a640 1 -- 172.21.15.22:0/2611705887 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b240ce9f0 con 0x7f9b24144770 2023-11-24T06:14:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.464+0000 7f9b2937a640 1 --2- 172.21.15.22:0/2611705887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 0x7f9b2415eb60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009870 tx=0x7f9b2002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79335db452061fa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.465+0000 7f9b1bfff640 1 -- 172.21.15.22:0/2611705887 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20030840 con 0x7f9b24144770 2023-11-24T06:14:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.465+0000 7f9b1bfff640 1 -- 172.21.15.22:0/2611705887 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b200309a0 con 0x7f9b24144770 2023-11-24T06:14:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.465+0000 7f9b1bfff640 1 -- 172.21.15.22:0/2611705887 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20030d30 con 0x7f9b24144770 2023-11-24T06:14:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.465+0000 7f9b2a37c640 1 -- 172.21.15.22:0/2611705887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 msgr2=0x7f9b2415eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.465+0000 7f9b2a37c640 1 --2- 172.21.15.22:0/2611705887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 0x7f9b2415eb60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009870 tx=0x7f9b2002b980 comp rx=0 tx=0).stop 2023-11-24T06:14:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.465+0000 7f9b2a37c640 1 -- 172.21.15.22:0/2611705887 shutdown_connections 2023-11-24T06:14:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.466+0000 7f9b2a37c640 1 --2- 172.21.15.22:0/2611705887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b2415f0a0 0x7f9b240ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.466+0000 7f9b2a37c640 1 --2- 172.21.15.22:0/2611705887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 0x7f9b2415eb60 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.466+0000 7f9b2a37c640 1 -- 172.21.15.22:0/2611705887 >> 172.21.15.22:0/2611705887 conn(0x7f9b240cec10 msgr2=0x7f9b240cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.466+0000 7f9b2a37c640 1 -- 172.21.15.22:0/2611705887 shutdown_connections 2023-11-24T06:14:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.466+0000 7f9b2a37c640 1 -- 172.21.15.22:0/2611705887 wait complete. 2023-11-24T06:14:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.467+0000 7f9b2a37c640 1 Processor -- start 2023-11-24T06:14:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.468+0000 7f9b2a37c640 1 -- start start 2023-11-24T06:14:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.468+0000 7f9b2a37c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b240b35a0 0x7f9b24140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.468+0000 7f9b2a37c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 0x7f9b2415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b2a37c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2415f0a0 0x7f9b24143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b2a37c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b24143bd0 con 0x7f9b24144770 2023-11-24T06:14:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b2a37c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b24141580 con 0x7f9b2415f0a0 2023-11-24T06:14:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b2a37c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b24141860 con 0x7f9b240b35a0 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b28b79640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 0x7f9b2415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b28b79640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 0x7f9b2415aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52164/0 (socket says 172.21.15.22:52164) 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b28b79640 1 -- 172.21.15.22:0/1913880830 learned_addr learned my addr 172.21.15.22:0/1913880830 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b2937a640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b240b35a0 0x7f9b24140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b28b79640 1 -- 172.21.15.22:0/1913880830 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b240b35a0 msgr2=0x7f9b24140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b28b79640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b240b35a0 0x7f9b24140ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b28b79640 1 -- 172.21.15.22:0/1913880830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2415f0a0 msgr2=0x7f9b24143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b28b79640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2415f0a0 0x7f9b24143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.469+0000 7f9b28b79640 1 -- 172.21.15.22:0/1913880830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b200094d0 con 0x7f9b24144770 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.470+0000 7f9b28b79640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 0x7f9b2415aa90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400c400 tx=0x7f9b1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.470+0000 7f9b19ffb640 1 -- 172.21.15.22:0/1913880830 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b140052d0 con 0x7f9b24144770 2023-11-24T06:14:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.470+0000 7f9b19ffb640 1 -- 172.21.15.22:0/1913880830 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b14005430 con 0x7f9b24144770 2023-11-24T06:14:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.470+0000 7f9b19ffb640 1 -- 172.21.15.22:0/1913880830 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14003830 con 0x7f9b24144770 2023-11-24T06:14:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.470+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b24141b40 con 0x7f9b24144770 2023-11-24T06:14:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.470+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b240ab370 con 0x7f9b24144770 2023-11-24T06:14:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.471+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2404e840 con 0x7f9b24144770 2023-11-24T06:14:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.472+0000 7f9b19ffb640 1 -- 172.21.15.22:0/1913880830 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9b14003990 con 0x7f9b24144770 2023-11-24T06:14:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.473+0000 7f9b19ffb640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9b0806b040 0x7f9b0806d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.473+0000 7f9b19ffb640 1 -- 172.21.15.22:0/1913880830 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9b14088fd0 con 0x7f9b24144770 2023-11-24T06:14:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.473+0000 7f9b2937a640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9b0806b040 0x7f9b0806d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.474+0000 7f9b2937a640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9b0806b040 0x7f9b0806d500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b20036000 tx=0x7f9b2003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.477+0000 7f9b19ffb640 1 -- 172.21.15.22:0/1913880830 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b14053d10 con 0x7f9b24144770 2023-11-24T06:14:49.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.669+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b240b2460 con 0x7f9b24144770 2023-11-24T06:14:49.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.670+0000 7f9b19ffb640 1 -- 172.21.15.22:0/1913880830 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b140170a0 con 0x7f9b24144770 2023-11-24T06:14:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:14:49.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9b0806b040 msgr2=0x7f9b0806d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9b0806b040 0x7f9b0806d500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b20036000 tx=0x7f9b2003b040 comp rx=0 tx=0).stop 2023-11-24T06:14:49.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 msgr2=0x7f9b2415aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 0x7f9b2415aa90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400c400 tx=0x7f9b1400c8c0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 shutdown_connections 2023-11-24T06:14:49.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9b0806b040 0x7f9b0806d500 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2415f0a0 0x7f9b24143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b24144770 0x7f9b2415aa90 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 --2- 172.21.15.22:0/1913880830 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b240b35a0 0x7f9b24140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 >> 172.21.15.22:0/1913880830 conn(0x7f9b240cec10 msgr2=0x7f9b240ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 shutdown_connections 2023-11-24T06:14:49.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.673+0000 7f9b2a37c640 1 -- 172.21.15.22:0/1913880830 wait complete. 2023-11-24T06:14:49.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.922+0000 7f805d9a7640 1 Processor -- start 2023-11-24T06:14:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.923+0000 7f805d9a7640 1 -- start start 2023-11-24T06:14:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.924+0000 7f805d9a7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80580c8930 0x7f80580ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.924+0000 7f805d9a7640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80580c6bf0 con 0x7f80580d1d90 2023-11-24T06:14:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.924+0000 7f805d9a7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80580cedc0 con 0x7f805815d3b0 2023-11-24T06:14:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.924+0000 7f805d9a7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80580c6e40 con 0x7f80580c8930 2023-11-24T06:14:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.924+0000 7f805d1a6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80580c8930 0x7f80580ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.925+0000 7f805d1a6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80580c8930 0x7f80580ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52176/0 (socket says 172.21.15.22:52176) 2023-11-24T06:14:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.925+0000 7f805d1a6640 1 -- 172.21.15.22:0/3266877874 learned_addr learned my addr 172.21.15.22:0/3266877874 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.925+0000 7f8057fff640 1 --1- 172.21.15.22:0/3266877874 >> v1:172.21.15.22:6789/0 conn(0x7f80580d1d90 0x7f80580b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52804/0 (socket says 172.21.15.22:52804) 2023-11-24T06:14:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.925+0000 7f805d1a6640 1 -- 172.21.15.22:0/3266877874 >> v1:172.21.15.31:6789/0 conn(0x7f805815d3b0 legacy=0x7f80580d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.925+0000 7f805d1a6640 1 -- 172.21.15.22:0/3266877874 >> v1:172.21.15.22:6789/0 conn(0x7f80580d1d90 legacy=0x7f80580b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.925+0000 7f805d1a6640 1 -- 172.21.15.22:0/3266877874 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80580c7120 con 0x7f80580c8930 2023-11-24T06:14:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.926+0000 7f805d1a6640 1 --2- 172.21.15.22:0/3266877874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80580c8930 0x7f80580ce6c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8050009870 tx=0x7f805002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f4ad09a1488a4e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.926+0000 7f80577fe640 1 -- 172.21.15.22:0/3266877874 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050031870 con 0x7f80580c8930 2023-11-24T06:14:49.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.926+0000 7f80577fe640 1 -- 172.21.15.22:0/3266877874 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80500319d0 con 0x7f80580c8930 2023-11-24T06:14:49.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.927+0000 7f80577fe640 1 -- 172.21.15.22:0/3266877874 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050031d60 con 0x7f80580c8930 2023-11-24T06:14:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.927+0000 7f805d9a7640 1 -- 172.21.15.22:0/3266877874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80580c8930 msgr2=0x7f80580ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.927+0000 7f805d9a7640 1 --2- 172.21.15.22:0/3266877874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80580c8930 0x7f80580ce6c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8050009870 tx=0x7f805002b910 comp rx=0 tx=0).stop 2023-11-24T06:14:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.927+0000 7f805d9a7640 1 -- 172.21.15.22:0/3266877874 shutdown_connections 2023-11-24T06:14:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.927+0000 7f805d9a7640 1 --2- 172.21.15.22:0/3266877874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80580c8930 0x7f80580ce6c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.927+0000 7f805d9a7640 1 -- 172.21.15.22:0/3266877874 >> 172.21.15.22:0/3266877874 conn(0x7f80580d30a0 msgr2=0x7f80580d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.927+0000 7f805d9a7640 1 -- 172.21.15.22:0/3266877874 shutdown_connections 2023-11-24T06:14:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.927+0000 7f805d9a7640 1 -- 172.21.15.22:0/3266877874 wait complete. 2023-11-24T06:14:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.929+0000 7f805d9a7640 1 Processor -- start 2023-11-24T06:14:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.929+0000 7f805d9a7640 1 -- start start 2023-11-24T06:14:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.930+0000 7f805d9a7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80580c8930 0x7f805815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.930+0000 7f805d9a7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80580d1d90 0x7f80580b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.930+0000 7f805d9a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f805815d3b0 0x7f80580cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.930+0000 7f805d9a7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80580b80d0 con 0x7f805815d3b0 2023-11-24T06:14:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.930+0000 7f805d9a7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80580a0240 con 0x7f80580d1d90 2023-11-24T06:14:49.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.930+0000 7f805d9a7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80580a04e0 con 0x7f80580c8930 2023-11-24T06:14:49.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f805d1a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f805815d3b0 0x7f80580cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f805d1a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f805815d3b0 0x7f80580cc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52186/0 (socket says 172.21.15.22:52186) 2023-11-24T06:14:49.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f805d1a6640 1 -- 172.21.15.22:0/2623184206 learned_addr learned my addr 172.21.15.22:0/2623184206 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f8057fff640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80580d1d90 0x7f80580b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f805c9a5640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80580c8930 0x7f805815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f805d1a6640 1 -- 172.21.15.22:0/2623184206 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80580c8930 msgr2=0x7f805815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f805d1a6640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80580c8930 0x7f805815ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f805d1a6640 1 -- 172.21.15.22:0/2623184206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80580d1d90 msgr2=0x7f80580b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f805d1a6640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80580d1d90 0x7f80580b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f805d1a6640 1 -- 172.21.15.22:0/2623184206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80500094d0 con 0x7f805815d3b0 2023-11-24T06:14:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.931+0000 7f8057fff640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80580d1d90 0x7f80580b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.932+0000 7f805d1a6640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f805815d3b0 0x7f80580cc280 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f805002b950 tx=0x7f80500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.932+0000 7f80557fa640 1 -- 172.21.15.22:0/2623184206 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500443f0 con 0x7f805815d3b0 2023-11-24T06:14:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.932+0000 7f80557fa640 1 -- 172.21.15.22:0/2623184206 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8050044570 con 0x7f805815d3b0 2023-11-24T06:14:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.932+0000 7f80557fa640 1 -- 172.21.15.22:0/2623184206 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050044920 con 0x7f805815d3b0 2023-11-24T06:14:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.932+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80580a0780 con 0x7f805815d3b0 2023-11-24T06:14:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.932+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80580b7dc0 con 0x7f805815d3b0 2023-11-24T06:14:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.933+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80580a0e40 con 0x7f805815d3b0 2023-11-24T06:14:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.934+0000 7f80557fa640 1 -- 172.21.15.22:0/2623184206 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8050044a80 con 0x7f805815d3b0 2023-11-24T06:14:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.935+0000 7f80557fa640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f803806b070 0x7f803806d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.935+0000 7f80557fa640 1 -- 172.21.15.22:0/2623184206 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f805002d040 con 0x7f805815d3b0 2023-11-24T06:14:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.935+0000 7f805c9a5640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f803806b070 0x7f803806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.936+0000 7f805c9a5640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f803806b070 0x7f803806d530 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f80580b7810 tx=0x7f80480072f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:49.940+0000 7f80557fa640 1 -- 172.21.15.22:0/2623184206 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80580a0e40 con 0x7f805815d3b0 2023-11-24T06:14:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.131+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80580a0e40 con 0x7f805815d3b0 2023-11-24T06:14:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.133+0000 7f80557fa640 1 -- 172.21.15.22:0/2623184206 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80580a0e40 con 0x7f805815d3b0 2023-11-24T06:14:50.136 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:14:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f803806b070 msgr2=0x7f803806d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f803806b070 0x7f803806d530 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f80580b7810 tx=0x7f80480072f0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f805815d3b0 msgr2=0x7f80580cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f805815d3b0 0x7f80580cc280 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f805002b950 tx=0x7f80500046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 shutdown_connections 2023-11-24T06:14:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f803806b070 0x7f803806d530 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f805815d3b0 0x7f80580cc280 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80580d1d90 0x7f80580b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 --2- 172.21.15.22:0/2623184206 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80580c8930 0x7f805815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 >> 172.21.15.22:0/2623184206 conn(0x7f80580d30a0 msgr2=0x7f80580d1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 shutdown_connections 2023-11-24T06:14:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.135+0000 7f805d9a7640 1 -- 172.21.15.22:0/2623184206 wait complete. 2023-11-24T06:14:50.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:50.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.379+0000 7f5c614e7640 1 Processor -- start 2023-11-24T06:14:50.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.379+0000 7f5c614e7640 1 -- start start 2023-11-24T06:14:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.380+0000 7f5c614e7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c5c15b340 0x7f5c5c0abff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.380+0000 7f5c614e7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5c5c0cbcb0 0x7f5c5c06d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c614e7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c0b4130 con 0x7f5c5c0ce880 2023-11-24T06:14:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c614e7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5c0ac530 con 0x7f5c5c0cbcb0 2023-11-24T06:14:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c614e7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5c0b2080 con 0x7f5c5c15b340 2023-11-24T06:14:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c527fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5c5c0cbcb0 0x7f5c5c06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c527fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5c5c0cbcb0 0x7f5c5c06d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52188/0 (socket says 172.21.15.22:52188) 2023-11-24T06:14:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c527fc640 1 -- 172.21.15.22:0/1328028814 learned_addr learned my addr 172.21.15.22:0/1328028814 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c527fc640 1 -- 172.21.15.22:0/1328028814 >> v2:172.21.15.31:3300/0 conn(0x7f5c5c15b340 msgr2=0x7f5c5c0abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c5affd640 1 --2- 172.21.15.22:0/1328028814 >> v2:172.21.15.31:3300/0 conn(0x7f5c5c15b340 0x7f5c5c0abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c527fc640 1 --2- 172.21.15.22:0/1328028814 >> v2:172.21.15.31:3300/0 conn(0x7f5c5c15b340 0x7f5c5c0abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c527fc640 1 -- 172.21.15.22:0/1328028814 >> v1:172.21.15.31:6789/0 conn(0x7f5c5c0ce880 legacy=0x7f5c5c15ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.381+0000 7f5c527fc640 1 -- 172.21.15.22:0/1328028814 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c0b2360 con 0x7f5c5c0cbcb0 2023-11-24T06:14:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.383+0000 7f5c527fc640 1 --2- 172.21.15.22:0/1328028814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c0cbcb0 0x7f5c5c06d520 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0b1e40 tx=0x7f5c4402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791b4a9bf9452c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.383+0000 7f5c5a7fc640 1 -- 172.21.15.22:0/1328028814 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44031890 con 0x7f5c5c0cbcb0 2023-11-24T06:14:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.383+0000 7f5c5a7fc640 1 -- 172.21.15.22:0/1328028814 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c440319f0 con 0x7f5c5c0cbcb0 2023-11-24T06:14:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.383+0000 7f5c5a7fc640 1 -- 172.21.15.22:0/1328028814 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44031d80 con 0x7f5c5c0cbcb0 2023-11-24T06:14:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.383+0000 7f5c614e7640 1 -- 172.21.15.22:0/1328028814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c0cbcb0 msgr2=0x7f5c5c06d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.383+0000 7f5c614e7640 1 --2- 172.21.15.22:0/1328028814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c0cbcb0 0x7f5c5c06d520 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0b1e40 tx=0x7f5c4402b930 comp rx=0 tx=0).stop 2023-11-24T06:14:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.384+0000 7f5c614e7640 1 -- 172.21.15.22:0/1328028814 shutdown_connections 2023-11-24T06:14:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.384+0000 7f5c614e7640 1 --2- 172.21.15.22:0/1328028814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c0cbcb0 0x7f5c5c06d520 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.384+0000 7f5c614e7640 1 --2- 172.21.15.22:0/1328028814 >> v2:172.21.15.31:3300/0 conn(0x7f5c5c15b340 0x7f5c5c0abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.384+0000 7f5c614e7640 1 -- 172.21.15.22:0/1328028814 >> 172.21.15.22:0/1328028814 conn(0x7f5c5c0b0d80 msgr2=0x7f5c5c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.384+0000 7f5c614e7640 1 -- 172.21.15.22:0/1328028814 shutdown_connections 2023-11-24T06:14:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.384+0000 7f5c614e7640 1 -- 172.21.15.22:0/1328028814 wait complete. 2023-11-24T06:14:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.386+0000 7f5c614e7640 1 Processor -- start 2023-11-24T06:14:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.386+0000 7f5c614e7640 1 -- start start 2023-11-24T06:14:50.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c614e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c5c0cbcb0 0x7f5c5c071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c614e7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c5c0ce880 0x7f5c5c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c614e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c15b340 0x7f5c5c0cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c614e7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c0cb160 con 0x7f5c5c15b340 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c614e7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c0cdc50 con 0x7f5c5c0cbcb0 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c614e7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c0cdf30 con 0x7f5c5c0ce880 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c15b340 0x7f5c5c0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c15b340 0x7f5c5c0cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52194/0 (socket says 172.21.15.22:52194) 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c5b7fe640 1 -- 172.21.15.22:0/1235016367 learned_addr learned my addr 172.21.15.22:0/1235016367 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c5affd640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c5c0cbcb0 0x7f5c5c071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.387+0000 7f5c527fc640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c5c0ce880 0x7f5c5c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c5b7fe640 1 -- 172.21.15.22:0/1235016367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c5c0ce880 msgr2=0x7f5c5c0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c5b7fe640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c5c0ce880 0x7f5c5c0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c5b7fe640 1 -- 172.21.15.22:0/1235016367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c5c0cbcb0 msgr2=0x7f5c5c071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c5b7fe640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c5c0cbcb0 0x7f5c5c071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c5b7fe640 1 -- 172.21.15.22:0/1235016367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c440094d0 con 0x7f5c5c15b340 2023-11-24T06:14:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c5affd640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c5c0cbcb0 0x7f5c5c071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c5b7fe640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c15b340 0x7f5c5c0cc090 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c780 tx=0x7f5c5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c53fff640 1 -- 172.21.15.22:0/1235016367 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54003d80 con 0x7f5c5c15b340 2023-11-24T06:14:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c53fff640 1 -- 172.21.15.22:0/1235016367 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5400ce90 con 0x7f5c5c15b340 2023-11-24T06:14:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c53fff640 1 -- 172.21.15.22:0/1235016367 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c540052b0 con 0x7f5c5c15b340 2023-11-24T06:14:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5c0cab10 con 0x7f5c5c15b340 2023-11-24T06:14:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.388+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5c0cd890 con 0x7f5c5c15b340 2023-11-24T06:14:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.390+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5c0cb2d0 con 0x7f5c5c15b340 2023-11-24T06:14:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.391+0000 7f5c53fff640 1 -- 172.21.15.22:0/1235016367 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5c54005410 con 0x7f5c5c15b340 2023-11-24T06:14:50.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.392+0000 7f5c53fff640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c3c06aff0 0x7f5c3c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.392+0000 7f5c53fff640 1 -- 172.21.15.22:0/1235016367 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5c54088e70 con 0x7f5c5c15b340 2023-11-24T06:14:50.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.392+0000 7f5c5affd640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c3c06aff0 0x7f5c3c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.393+0000 7f5c5affd640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c3c06aff0 0x7f5c3c06d4b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00b820 tx=0x7f5c4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.396+0000 7f5c53fff640 1 -- 172.21.15.22:0/1235016367 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c54053bc0 con 0x7f5c5c15b340 2023-11-24T06:14:50.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.605+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5c5c074770 con 0x7f5c5c15b340 2023-11-24T06:14:50.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.605+0000 7f5c53fff640 1 -- 172.21.15.22:0/1235016367 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5c540571e0 con 0x7f5c5c15b340 2023-11-24T06:14:50.609 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:14:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c3c06aff0 msgr2=0x7f5c3c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c3c06aff0 0x7f5c3c06d4b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00b820 tx=0x7f5c4c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c15b340 msgr2=0x7f5c5c0cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c15b340 0x7f5c5c0cc090 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c780 tx=0x7f5c5400cc40 comp rx=0 tx=0).stop 2023-11-24T06:14:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 shutdown_connections 2023-11-24T06:14:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c3c06aff0 0x7f5c3c06d4b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c5c15b340 0x7f5c5c0cc090 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c5c0ce880 0x7f5c5c0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 --2- 172.21.15.22:0/1235016367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c5c0cbcb0 0x7f5c5c071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 >> 172.21.15.22:0/1235016367 conn(0x7f5c5c0b0d80 msgr2=0x7f5c5c0aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 shutdown_connections 2023-11-24T06:14:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:50.608+0000 7f5c614e7640 1 -- 172.21.15.22:0/1235016367 wait complete. 2023-11-24T06:14:50.631 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2023-11-24T06:14:50.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:50.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:50.736 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[95933]: fuse finished with error 0 and tester_r 0 2023-11-24T06:14:50.744 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:51.166 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:51.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:56.845 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:14:56.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:56.845 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:14:56.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.143+0000 7f77a359e640 1 Processor -- start 2023-11-24T06:14:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.143+0000 7f77a359e640 1 -- start start 2023-11-24T06:14:57.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.144+0000 7f77a359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f77a40cf760 0x7f77a415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.144+0000 7f77a359e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a4071700 con 0x7f77a4143950 2023-11-24T06:14:57.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.144+0000 7f77a359e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a415b410 con 0x7f77a4143570 2023-11-24T06:14:57.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.144+0000 7f77a359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a415b130 con 0x7f77a40cf760 2023-11-24T06:14:57.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.144+0000 7f77a2d9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f77a4143950 0x7f77a40b1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42764/0 (socket says 172.21.15.22:42764) 2023-11-24T06:14:57.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.144+0000 7f77a2d9d640 1 -- 172.21.15.22:0/3787898764 learned_addr learned my addr 172.21.15.22:0/3787898764 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:57.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.145+0000 7f77a1d9b640 1 --2- 172.21.15.22:0/3787898764 >> v2:172.21.15.31:3300/0 conn(0x7f77a40cf760 0x7f77a415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.145+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404146973 0 0) 0x7f779c001490 con 0x7f77a4143950 2023-11-24T06:14:57.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.145+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f778c003520 con 0x7f77a4143950 2023-11-24T06:14:57.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.145+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4211965229 0 0) 0x7f778c003520 con 0x7f77a4143950 2023-11-24T06:14:57.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.145+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 >> v2:172.21.15.31:3300/0 conn(0x7f77a40cf760 msgr2=0x7f77a415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.145+0000 7f77a159a640 1 --2- 172.21.15.22:0/3787898764 >> v2:172.21.15.31:3300/0 conn(0x7f77a40cf760 0x7f77a415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.145+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 >> v1:172.21.15.31:6789/0 conn(0x7f77a4143570 legacy=0x7f77a40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.145+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a415dbd0 con 0x7f77a4143950 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.145+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f779c001b80 con 0x7f77a4143950 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 >> v1:172.21.15.22:6789/0 conn(0x7f77a4143950 legacy=0x7f77a40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a159a640 1 --2- 172.21.15.22:0/3787898764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f778c003a30 0x7f778c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a159a640 1 --2- 172.21.15.22:0/3787898764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f778c0047c0 0x7f778c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a159a640 1 --2- 172.21.15.22:0/3787898764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f778c0052a0 0x7f778c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a415b130 con 0x7f778c003a30 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c00c170 con 0x7f778c0052a0 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c00e540 con 0x7f778c0047c0 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a259c640 1 --2- 172.21.15.22:0/3787898764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f778c003a30 0x7f778c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a259c640 1 -- 172.21.15.22:0/3787898764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f778c0047c0 msgr2=0x7f778c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a259c640 1 --2- 172.21.15.22:0/3787898764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f778c0047c0 0x7f778c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a259c640 1 -- 172.21.15.22:0/3787898764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f778c0052a0 msgr2=0x7f778c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a259c640 1 --2- 172.21.15.22:0/3787898764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f778c0052a0 0x7f778c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a259c640 1 -- 172.21.15.22:0/3787898764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c003520 con 0x7f778c003a30 2023-11-24T06:14:57.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.146+0000 7f77a2d9d640 1 -- 172.21.15.22:0/3787898764 reap_dead start 2023-11-24T06:14:57.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.147+0000 7f77a259c640 1 --2- 172.21.15.22:0/3787898764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f778c003a30 0x7f778c003e50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7794001750 tx=0x7f778c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463bc495e2e0a25a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.148+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940052d0 con 0x7f778c003a30 2023-11-24T06:14:57.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.148+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779402e050 con 0x7f778c003a30 2023-11-24T06:14:57.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.148+0000 7f77a159a640 1 -- 172.21.15.22:0/3787898764 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794003830 con 0x7f778c003a30 2023-11-24T06:14:57.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.148+0000 7f77a359e640 1 -- 172.21.15.22:0/3787898764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f778c003a30 msgr2=0x7f778c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.148+0000 7f77a359e640 1 --2- 172.21.15.22:0/3787898764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f778c003a30 0x7f778c003e50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7794001750 tx=0x7f778c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.148+0000 7f77a359e640 1 -- 172.21.15.22:0/3787898764 shutdown_connections 2023-11-24T06:14:57.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.148+0000 7f77a359e640 1 --2- 172.21.15.22:0/3787898764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f778c003a30 0x7f778c003e50 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.148+0000 7f77a359e640 1 -- 172.21.15.22:0/3787898764 >> 172.21.15.22:0/3787898764 conn(0x7f77a406a860 msgr2=0x7f77a406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.148+0000 7f77a359e640 1 -- 172.21.15.22:0/3787898764 shutdown_connections 2023-11-24T06:14:57.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.149+0000 7f77a359e640 1 -- 172.21.15.22:0/3787898764 wait complete. 2023-11-24T06:14:57.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.150+0000 7f77a359e640 1 Processor -- start 2023-11-24T06:14:57.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.150+0000 7f77a359e640 1 -- start start 2023-11-24T06:14:57.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.151+0000 7f77a359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f778c003a30 0x7f77a4159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.151+0000 7f77a359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77a413af00 0x7f77a40cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.151+0000 7f77a359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77a413b360 0x7f77a40cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.151+0000 7f77a359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a41f3720 con 0x7f77a413af00 2023-11-24T06:14:57.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.151+0000 7f77a359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a41f3f80 con 0x7f77a413b360 2023-11-24T06:14:57.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.151+0000 7f77a359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a413bbf0 con 0x7f778c003a30 2023-11-24T06:14:57.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.152+0000 7f77a1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77a413af00 0x7f77a40cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.152+0000 7f77a1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77a413af00 0x7f77a40cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55914/0 (socket says 172.21.15.22:55914) 2023-11-24T06:14:57.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.152+0000 7f77a1d9b640 1 -- 172.21.15.22:0/3656583944 learned_addr learned my addr 172.21.15.22:0/3656583944 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:57.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.152+0000 7f77a1d9b640 1 -- 172.21.15.22:0/3656583944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f778c003a30 msgr2=0x7f77a4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.152+0000 7f77a1d9b640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f778c003a30 0x7f77a4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.152+0000 7f77a1d9b640 1 -- 172.21.15.22:0/3656583944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77a413b360 msgr2=0x7f77a40cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.152+0000 7f77a1d9b640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77a413b360 0x7f77a40cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.152+0000 7f77a1d9b640 1 -- 172.21.15.22:0/3656583944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a413b910 con 0x7f77a413af00 2023-11-24T06:14:57.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.152+0000 7f77a1d9b640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77a413af00 0x7f77a40cd350 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f779800e7a0 tx=0x7f779800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.153+0000 7f7792ffd640 1 -- 172.21.15.22:0/3656583944 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779800ee50 con 0x7f77a413af00 2023-11-24T06:14:57.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.153+0000 7f7792ffd640 1 -- 172.21.15.22:0/3656583944 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779800c940 con 0x7f77a413af00 2023-11-24T06:14:57.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.153+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a41f3930 con 0x7f77a413af00 2023-11-24T06:14:57.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.153+0000 7f7792ffd640 1 -- 172.21.15.22:0/3656583944 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779800ccf0 con 0x7f77a413af00 2023-11-24T06:14:57.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.153+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a4159a80 con 0x7f77a413af00 2023-11-24T06:14:57.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.154+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a404e840 con 0x7f77a413af00 2023-11-24T06:14:57.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.155+0000 7f7792ffd640 1 -- 172.21.15.22:0/3656583944 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7798013470 con 0x7f77a413af00 2023-11-24T06:14:57.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.156+0000 7f7792ffd640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f778406aff0 0x7f778406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.156+0000 7f7792ffd640 1 -- 172.21.15.22:0/3656583944 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7798089810 con 0x7f77a413af00 2023-11-24T06:14:57.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.156+0000 7f77a259c640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f778406aff0 0x7f778406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.157+0000 7f77a259c640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f778406aff0 0x7f778406d4b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7794033000 tx=0x7f779402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.162+0000 7f7792ffd640 1 -- 172.21.15.22:0/3656583944 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7798054690 con 0x7f77a413af00 2023-11-24T06:14:57.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.391+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77a4071ad0 con 0x7f77a413af00 2023-11-24T06:14:57.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.393+0000 7f7792ffd640 1 -- 172.21.15.22:0/3656583944 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f7798017090 con 0x7f77a413af00 2023-11-24T06:14:57.396 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:57.396 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:14:57.396 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f778406aff0 msgr2=0x7f778406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f778406aff0 0x7f778406d4b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7794033000 tx=0x7f779402f000 comp rx=0 tx=0).stop 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77a413af00 msgr2=0x7f77a40cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77a413af00 0x7f77a40cd350 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f779800e7a0 tx=0x7f779800ec60 comp rx=0 tx=0).stop 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 shutdown_connections 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f778406aff0 0x7f778406d4b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77a413b360 0x7f77a40cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77a413af00 0x7f77a40cd350 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 --2- 172.21.15.22:0/3656583944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f778c003a30 0x7f77a4159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 >> 172.21.15.22:0/3656583944 conn(0x7f77a406a860 msgr2=0x7f77a406c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 shutdown_connections 2023-11-24T06:14:57.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.395+0000 7f77a359e640 1 -- 172.21.15.22:0/3656583944 wait complete. 2023-11-24T06:14:57.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:14:57.667 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2023-11-24T06:14:57.667 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-11-24T06:14:57.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol762 2023-11-24T06:14:57.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.896+0000 7fbf43fff640 1 Processor -- start 2023-11-24T06:14:57.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.896+0000 7fbf43fff640 1 -- start start 2023-11-24T06:14:57.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.898+0000 7fbf43fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf44144770 0x7fbf4415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.898+0000 7fbf43fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf4415f0a0 0x7fbf440ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.898+0000 7fbf43fff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4415f930 con 0x7fbf440b35a0 2023-11-24T06:14:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.898+0000 7fbf43fff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440b43b0 con 0x7fbf44144770 2023-11-24T06:14:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.898+0000 7fbf43fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4415f530 con 0x7fbf4415f0a0 2023-11-24T06:14:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.898+0000 7fbf427fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbf440b35a0 0x7fbf4406c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42770/0 (socket says 172.21.15.22:42770) 2023-11-24T06:14:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.898+0000 7fbf427fc640 1 -- 172.21.15.22:0/1545316861 learned_addr learned my addr 172.21.15.22:0/1545316861 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.899+0000 7fbf437fe640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf4415f0a0 0x7fbf440ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.899+0000 7fbf42ffd640 1 --2- 172.21.15.22:0/1545316861 >> v2:172.21.15.31:3300/0 conn(0x7fbf44144770 0x7fbf4415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.899+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312773692 0 0) 0x7fbf4415f930 con 0x7fbf440b35a0 2023-11-24T06:14:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.899+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf2c003520 con 0x7fbf440b35a0 2023-11-24T06:14:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2602175747 0 0) 0x7fbf2c003520 con 0x7fbf440b35a0 2023-11-24T06:14:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf4415f0a0 msgr2=0x7fbf440ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf4415f0a0 0x7fbf440ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 >> v2:172.21.15.31:3300/0 conn(0x7fbf44144770 msgr2=0x7fbf4415eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 --2- 172.21.15.22:0/1545316861 >> v2:172.21.15.31:3300/0 conn(0x7fbf44144770 0x7fbf4415eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440ce9f0 con 0x7fbf440b35a0 2023-11-24T06:14:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fbf38001670 con 0x7fbf440b35a0 2023-11-24T06:14:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 >> v1:172.21.15.22:6789/0 conn(0x7fbf440b35a0 legacy=0x7fbf4406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2c0039e0 0x7fbf2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf4415f0a0 0x7fbf2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440b43b0 con 0x7fbf2c004d00 2023-11-24T06:14:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4415f530 con 0x7fbf2c0039e0 2023-11-24T06:14:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c00b980 con 0x7fbf4415f0a0 2023-11-24T06:14:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf42ffd640 1 --2- 172.21.15.22:0/1545316861 >> v2:172.21.15.31:3300/0 conn(0x7fbf44144770 0x7fbf4415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.900+0000 7fbf437fe640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.901+0000 7fbf437fe640 1 -- 172.21.15.22:0/1545316861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf4415f0a0 msgr2=0x7fbf2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.901+0000 7fbf437fe640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf4415f0a0 0x7fbf2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.901+0000 7fbf437fe640 1 -- 172.21.15.22:0/1545316861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2c0039e0 msgr2=0x7fbf2c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.901+0000 7fbf437fe640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf2c0039e0 0x7fbf2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.901+0000 7fbf437fe640 1 -- 172.21.15.22:0/1545316861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c003520 con 0x7fbf2c004d00 2023-11-24T06:14:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.902+0000 7fbf437fe640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf2c005180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009fc0 tx=0x7fbf2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebd36cb55bcac91 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.902+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c037600 con 0x7fbf2c004d00 2023-11-24T06:14:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.902+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c033050 con 0x7fbf2c004d00 2023-11-24T06:14:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.902+0000 7fbf41ffb640 1 -- 172.21.15.22:0/1545316861 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0379a0 con 0x7fbf2c004d00 2023-11-24T06:14:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.903+0000 7fbf43fff640 1 -- 172.21.15.22:0/1545316861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 msgr2=0x7fbf2c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.903+0000 7fbf43fff640 1 --2- 172.21.15.22:0/1545316861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf2c005180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009fc0 tx=0x7fbf2c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.903+0000 7fbf437fe640 1 -- 172.21.15.22:0/1545316861 reap_dead start 2023-11-24T06:14:57.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.903+0000 7fbf43fff640 1 -- 172.21.15.22:0/1545316861 shutdown_connections 2023-11-24T06:14:57.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.903+0000 7fbf43fff640 1 -- 172.21.15.22:0/1545316861 >> 172.21.15.22:0/1545316861 conn(0x7fbf440cec10 msgr2=0x7fbf440cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.903+0000 7fbf43fff640 1 -- 172.21.15.22:0/1545316861 shutdown_connections 2023-11-24T06:14:57.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.903+0000 7fbf43fff640 1 -- 172.21.15.22:0/1545316861 wait complete. 2023-11-24T06:14:57.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.905+0000 7fbf43fff640 1 Processor -- start 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.905+0000 7fbf43fff640 1 -- start start 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.906+0000 7fbf43fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf4413d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.906+0000 7fbf43fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf4415b6a0 0x7fbf44142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.906+0000 7fbf43fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf44157d70 0x7fbf441581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.906+0000 7fbf43fff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44158730 con 0x7fbf2c004d00 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.906+0000 7fbf43fff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4415cda0 con 0x7fbf4415b6a0 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.906+0000 7fbf43fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4413dc60 con 0x7fbf44157d70 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.906+0000 7fbf42ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf4413d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.906+0000 7fbf42ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf4413d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55936/0 (socket says 172.21.15.22:55936) 2023-11-24T06:14:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.906+0000 7fbf42ffd640 1 -- 172.21.15.22:0/248443341 learned_addr learned my addr 172.21.15.22:0/248443341 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:57.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.907+0000 7fbf437fe640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf44157d70 0x7fbf441581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.907+0000 7fbf42ffd640 1 -- 172.21.15.22:0/248443341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf44157d70 msgr2=0x7fbf441581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.907+0000 7fbf427fc640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf4415b6a0 0x7fbf44142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.907+0000 7fbf42ffd640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf44157d70 0x7fbf441581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.907+0000 7fbf42ffd640 1 -- 172.21.15.22:0/248443341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf4415b6a0 msgr2=0x7fbf44142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.907+0000 7fbf42ffd640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf4415b6a0 0x7fbf44142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.907+0000 7fbf42ffd640 1 -- 172.21.15.22:0/248443341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4415c190 con 0x7fbf2c004d00 2023-11-24T06:14:57.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.907+0000 7fbf427fc640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf4415b6a0 0x7fbf44142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:57.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.907+0000 7fbf42ffd640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf4413d720 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400eb30 tx=0x7fbf34009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.908+0000 7fbf2b7fe640 1 -- 172.21.15.22:0/248443341 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34009750 con 0x7fbf2c004d00 2023-11-24T06:14:57.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.908+0000 7fbf2b7fe640 1 -- 172.21.15.22:0/248443341 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3400ca00 con 0x7fbf2c004d00 2023-11-24T06:14:57.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.908+0000 7fbf2b7fe640 1 -- 172.21.15.22:0/248443341 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3400cd90 con 0x7fbf2c004d00 2023-11-24T06:14:57.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.908+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4415c470 con 0x7fbf2c004d00 2023-11-24T06:14:57.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.908+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4415ca30 con 0x7fbf2c004d00 2023-11-24T06:14:57.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.909+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf440b2b10 con 0x7fbf2c004d00 2023-11-24T06:14:57.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.910+0000 7fbf2b7fe640 1 -- 172.21.15.22:0/248443341 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbf34004030 con 0x7fbf2c004d00 2023-11-24T06:14:57.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.911+0000 7fbf2b7fe640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf3006b020 0x7fbf3006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.911+0000 7fbf2b7fe640 1 -- 172.21.15.22:0/248443341 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbf34089b00 con 0x7fbf2c004d00 2023-11-24T06:14:57.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.911+0000 7fbf427fc640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf3006b020 0x7fbf3006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.912+0000 7fbf427fc640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf3006b020 0x7fbf3006d4e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbf38001eb0 tx=0x7fbf38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:57.915+0000 7fbf2b7fe640 1 -- 172.21.15.22:0/248443341 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf3408be60 con 0x7fbf2c004d00 2023-11-24T06:14:58.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.141+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol762", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf440b1de0 con 0x7fbf3006b020 2023-11-24T06:14:58.156 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:14:58.153+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:14:58.156 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:14:58.153+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:14:58.157 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:14:58.153+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:14:58.157 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:14:58.153+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:14:58.157 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-11-24T06:14:58.153+0000 7fed0bbf8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:14:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.215+0000 7fbf2b7fe640 1 -- 172.21.15.22:0/248443341 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbf440b1de0 con 0x7fbf3006b020 2023-11-24T06:14:58.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.218+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf3006b020 msgr2=0x7fbf3006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.218+0000 7fbf43fff640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf3006b020 0x7fbf3006d4e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbf38001eb0 tx=0x7fbf38009040 comp rx=0 tx=0).stop 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 msgr2=0x7fbf4413d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf4413d720 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400eb30 tx=0x7fbf34009e10 comp rx=0 tx=0).stop 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 shutdown_connections 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbf3006b020 0x7fbf3006d4e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf44157d70 0x7fbf441581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf4415b6a0 0x7fbf44142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 --2- 172.21.15.22:0/248443341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf2c004d00 0x7fbf4413d720 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 >> 172.21.15.22:0/248443341 conn(0x7fbf440cec10 msgr2=0x7fbf44070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 shutdown_connections 2023-11-24T06:14:58.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.219+0000 7fbf43fff640 1 -- 172.21.15.22:0/248443341 wait complete. 2023-11-24T06:14:58.243 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.451+0000 7f3c59b67640 1 Processor -- start 2023-11-24T06:14:58.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.451+0000 7f3c59b67640 1 -- start start 2023-11-24T06:14:58.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.453+0000 7f3c59b67640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c5413dfd0 0x7f3c5415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.453+0000 7f3c59b67640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3c540cf050 0x7f3c540cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.453+0000 7f3c59b67640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540ce7c0 con 0x7f3c5406c130 2023-11-24T06:14:58.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.453+0000 7f3c59b67640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540cfa40 con 0x7f3c5413dfd0 2023-11-24T06:14:58.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.453+0000 7f3c59b67640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c54140900 con 0x7f3c540cf050 2023-11-24T06:14:58.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.453+0000 7f3c58b65640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c5413dfd0 0x7f3c5415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.453+0000 7f3c58b65640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c5413dfd0 0x7f3c5415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55970/0 (socket says 172.21.15.22:55970) 2023-11-24T06:14:58.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.453+0000 7f3c58b65640 1 -- 172.21.15.22:0/3934944114 learned_addr learned my addr 172.21.15.22:0/3934944114 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:58.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.454+0000 7f3c58b65640 1 -- 172.21.15.22:0/3934944114 >> v2:172.21.15.31:3300/0 conn(0x7f3c540cf050 msgr2=0x7f3c540cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.454+0000 7f3c58b65640 1 --2- 172.21.15.22:0/3934944114 >> v2:172.21.15.31:3300/0 conn(0x7f3c540cf050 0x7f3c540cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.454+0000 7f3c58b65640 1 -- 172.21.15.22:0/3934944114 >> v1:172.21.15.31:6789/0 conn(0x7f3c5406c130 legacy=0x7f3c5406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.454+0000 7f3c58b65640 1 -- 172.21.15.22:0/3934944114 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5415fa70 con 0x7f3c5413dfd0 2023-11-24T06:14:58.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.455+0000 7f3c58b65640 1 --2- 172.21.15.22:0/3934944114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5413dfd0 0x7f3c5415be70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3c5406e070 tx=0x7f3c4802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb527e74dc9240c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.455+0000 7f3c537fe640 1 -- 172.21.15.22:0/3934944114 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48031870 con 0x7f3c5413dfd0 2023-11-24T06:14:58.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.455+0000 7f3c537fe640 1 -- 172.21.15.22:0/3934944114 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c480319d0 con 0x7f3c5413dfd0 2023-11-24T06:14:58.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.455+0000 7f3c537fe640 1 -- 172.21.15.22:0/3934944114 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48031d60 con 0x7f3c5413dfd0 2023-11-24T06:14:58.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.456+0000 7f3c59b67640 1 -- 172.21.15.22:0/3934944114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5413dfd0 msgr2=0x7f3c5415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.456+0000 7f3c59b67640 1 --2- 172.21.15.22:0/3934944114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5413dfd0 0x7f3c5415be70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3c5406e070 tx=0x7f3c4802b910 comp rx=0 tx=0).stop 2023-11-24T06:14:58.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.456+0000 7f3c59b67640 1 -- 172.21.15.22:0/3934944114 shutdown_connections 2023-11-24T06:14:58.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.456+0000 7f3c59b67640 1 --2- 172.21.15.22:0/3934944114 >> v2:172.21.15.31:3300/0 conn(0x7f3c540cf050 0x7f3c540cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.456+0000 7f3c59b67640 1 --2- 172.21.15.22:0/3934944114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5413dfd0 0x7f3c5415be70 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.456+0000 7f3c59b67640 1 -- 172.21.15.22:0/3934944114 >> 172.21.15.22:0/3934944114 conn(0x7f3c5406a860 msgr2=0x7f3c5406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.456+0000 7f3c59b67640 1 -- 172.21.15.22:0/3934944114 shutdown_connections 2023-11-24T06:14:58.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.456+0000 7f3c59b67640 1 -- 172.21.15.22:0/3934944114 wait complete. 2023-11-24T06:14:58.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.458+0000 7f3c59b67640 1 Processor -- start 2023-11-24T06:14:58.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.458+0000 7f3c59b67640 1 -- start start 2023-11-24T06:14:58.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.459+0000 7f3c59b67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5406c130 0x7f3c54134970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.459+0000 7f3c59b67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c540cf050 0x7f3c54157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.459+0000 7f3c59b67640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c5413dfd0 0x7f3c540cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.459+0000 7f3c59b67640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54134eb0 con 0x7f3c540cf050 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.459+0000 7f3c59b67640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54135cf0 con 0x7f3c5406c130 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.459+0000 7f3c59b67640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54157fd0 con 0x7f3c5413dfd0 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.459+0000 7f3c53fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c540cf050 0x7f3c54157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c53fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c540cf050 0x7f3c54157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55978/0 (socket says 172.21.15.22:55978) 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c53fff640 1 -- 172.21.15.22:0/1694756098 learned_addr learned my addr 172.21.15.22:0/1694756098 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c59366640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c5413dfd0 0x7f3c540cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c58b65640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5406c130 0x7f3c54134970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c53fff640 1 -- 172.21.15.22:0/1694756098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c5413dfd0 msgr2=0x7f3c540cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c53fff640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c5413dfd0 0x7f3c540cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c53fff640 1 -- 172.21.15.22:0/1694756098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5406c130 msgr2=0x7f3c54134970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c53fff640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5406c130 0x7f3c54134970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c53fff640 1 -- 172.21.15.22:0/1694756098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480094d0 con 0x7f3c540cf050 2023-11-24T06:14:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c58b65640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5406c130 0x7f3c54134970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:58.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.460+0000 7f3c53fff640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c540cf050 0x7f3c54157a90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000b4d0 tx=0x7f3c4000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.461+0000 7f3c517fa640 1 -- 172.21.15.22:0/1694756098 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40010870 con 0x7f3c540cf050 2023-11-24T06:14:58.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.461+0000 7f3c517fa640 1 -- 172.21.15.22:0/1694756098 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400109d0 con 0x7f3c540cf050 2023-11-24T06:14:58.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.461+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c541350e0 con 0x7f3c540cf050 2023-11-24T06:14:58.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.461+0000 7f3c517fa640 1 -- 172.21.15.22:0/1694756098 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40010d80 con 0x7f3c540cf050 2023-11-24T06:14:58.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.461+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c541356a0 con 0x7f3c540cf050 2023-11-24T06:14:58.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.462+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c54155ba0 con 0x7f3c540cf050 2023-11-24T06:14:58.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.463+0000 7f3c517fa640 1 -- 172.21.15.22:0/1694756098 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3c4000f3c0 con 0x7f3c540cf050 2023-11-24T06:14:58.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.465+0000 7f3c517fa640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c3806aff0 0x7f3c3806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.465+0000 7f3c517fa640 1 -- 172.21.15.22:0/1694756098 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c400899d0 con 0x7f3c540cf050 2023-11-24T06:14:58.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.465+0000 7f3c58b65640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c3806aff0 0x7f3c3806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.466+0000 7f3c58b65640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c3806aff0 0x7f3c3806d4b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c48036000 tx=0x7f3c4803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.469+0000 7f3c517fa640 1 -- 172.21.15.22:0/1694756098 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c40054720 con 0x7f3c540cf050 2023-11-24T06:14:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.704+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c5404e840 con 0x7f3c540cf050 2023-11-24T06:14:58.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.706+0000 7f3c517fa640 1 -- 172.21.15.22:0/1694756098 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f3c40014090 con 0x7f3c540cf050 2023-11-24T06:14:58.708 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:58.709 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:14:58.709 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:14:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c3806aff0 msgr2=0x7f3c3806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c3806aff0 0x7f3c3806d4b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c48036000 tx=0x7f3c4803c040 comp rx=0 tx=0).stop 2023-11-24T06:14:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c540cf050 msgr2=0x7f3c54157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c540cf050 0x7f3c54157a90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000b4d0 tx=0x7f3c4000b990 comp rx=0 tx=0).stop 2023-11-24T06:14:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 shutdown_connections 2023-11-24T06:14:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3c3806aff0 0x7f3c3806d4b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c5413dfd0 0x7f3c540cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c540cf050 0x7f3c54157a90 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 --2- 172.21.15.22:0/1694756098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c5406c130 0x7f3c54134970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.708+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 >> 172.21.15.22:0/1694756098 conn(0x7f3c5406a860 msgr2=0x7f3c5406c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.709+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 shutdown_connections 2023-11-24T06:14:58.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:58.709+0000 7f3c59b67640 1 -- 172.21.15.22:0/1694756098 wait complete. 2023-11-24T06:14:58.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:14:58.969 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.79298961499999998,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.960840258100525,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:14:58.969 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.960840258100525 }, "state": "open", "uptime": 0.792989615 } ] 2023-11-24T06:14:58.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.190+0000 7f2afec6b640 1 Processor -- start 2023-11-24T06:14:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.190+0000 7f2afec6b640 1 -- start start 2023-11-24T06:14:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.191+0000 7f2afec6b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af80ce260 0x7f2af80d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.191+0000 7f2afec6b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2af80ce6a0 0x7f2af80d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.191+0000 7f2afec6b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af815d8b0 con 0x7f2af815d4d0 2023-11-24T06:14:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.191+0000 7f2afec6b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af80b91b0 con 0x7f2af80ce6a0 2023-11-24T06:14:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.191+0000 7f2afec6b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80b2400 con 0x7f2af80ce260 2023-11-24T06:14:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.192+0000 7f2af7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af80ce260 0x7f2af80d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.192+0000 7f2afca07640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2af815d4d0 0x7f2af80cda70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:34810/0 (socket says 172.21.15.22:34810) 2023-11-24T06:14:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.192+0000 7f2afca07640 1 -- 172.21.15.22:0/1194104334 learned_addr learned my addr 172.21.15.22:0/1194104334 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:14:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.192+0000 7f2afd208640 1 --2- 172.21.15.22:0/1194104334 >> v2:172.21.15.31:3300/0 conn(0x7f2af80ce6a0 0x7f2af80d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.193+0000 7f2af7fff640 1 -- 172.21.15.22:0/1194104334 >> v2:172.21.15.31:3300/0 conn(0x7f2af80ce6a0 msgr2=0x7f2af80d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.193+0000 7f2af7fff640 1 --2- 172.21.15.22:0/1194104334 >> v2:172.21.15.31:3300/0 conn(0x7f2af80ce6a0 0x7f2af80d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.193+0000 7f2af7fff640 1 -- 172.21.15.22:0/1194104334 >> v1:172.21.15.31:6789/0 conn(0x7f2af815d4d0 legacy=0x7f2af80cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.193+0000 7f2af7fff640 1 -- 172.21.15.22:0/1194104334 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af80b26e0 con 0x7f2af80ce260 2023-11-24T06:14:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.193+0000 7f2af77fe640 1 -- 172.21.15.22:0/1194104334 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131376232 0 0) 0x7f2af815d8b0 con 0x7f2af815d4d0 2023-11-24T06:14:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.195+0000 7f2af7fff640 1 --2- 172.21.15.22:0/1194104334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af80ce260 0x7f2af80d1850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009d90 tx=0x7f2ae002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b51e7506f0b32fff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.195+0000 7f2af77fe640 1 -- 172.21.15.22:0/1194104334 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae002cc50 con 0x7f2af80ce260 2023-11-24T06:14:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.195+0000 7f2af77fe640 1 -- 172.21.15.22:0/1194104334 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae002cdb0 con 0x7f2af80ce260 2023-11-24T06:14:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.195+0000 7f2af77fe640 1 -- 172.21.15.22:0/1194104334 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0034660 con 0x7f2af80ce260 2023-11-24T06:14:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.196+0000 7f2afec6b640 1 -- 172.21.15.22:0/1194104334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af80ce260 msgr2=0x7f2af80d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.196+0000 7f2afec6b640 1 --2- 172.21.15.22:0/1194104334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af80ce260 0x7f2af80d1850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009d90 tx=0x7f2ae002bea0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.196+0000 7f2afec6b640 1 -- 172.21.15.22:0/1194104334 shutdown_connections 2023-11-24T06:14:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.196+0000 7f2afec6b640 1 --2- 172.21.15.22:0/1194104334 >> v2:172.21.15.31:3300/0 conn(0x7f2af80ce6a0 0x7f2af80d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.196+0000 7f2afec6b640 1 --2- 172.21.15.22:0/1194104334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af80ce260 0x7f2af80d1850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.196+0000 7f2afec6b640 1 -- 172.21.15.22:0/1194104334 >> 172.21.15.22:0/1194104334 conn(0x7f2af8071f90 msgr2=0x7f2af80723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.196+0000 7f2afec6b640 1 -- 172.21.15.22:0/1194104334 shutdown_connections 2023-11-24T06:14:59.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.197+0000 7f2afec6b640 1 -- 172.21.15.22:0/1194104334 wait complete. 2023-11-24T06:14:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.199+0000 7f2afec6b640 1 Processor -- start 2023-11-24T06:14:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.199+0000 7f2afec6b640 1 -- start start 2023-11-24T06:14:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.200+0000 7f2afec6b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2af80ce260 0x7f2af80b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.200+0000 7f2afec6b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af80ce6a0 0x7f2af80ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afec6b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af815d4d0 0x7f2af815fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afec6b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af814fd50 con 0x7f2af80ce260 2023-11-24T06:14:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afec6b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80b4590 con 0x7f2af80ce6a0 2023-11-24T06:14:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afec6b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80cae40 con 0x7f2af815d4d0 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afca07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2af80ce260 0x7f2af80b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afca07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2af80ce260 0x7f2af80b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55988/0 (socket says 172.21.15.22:55988) 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afca07640 1 -- 172.21.15.22:0/4035993312 learned_addr learned my addr 172.21.15.22:0/4035993312 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2af7fff640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af80ce6a0 0x7f2af80ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afd208640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af815d4d0 0x7f2af815fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afca07640 1 -- 172.21.15.22:0/4035993312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af815d4d0 msgr2=0x7f2af815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afca07640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af815d4d0 0x7f2af815fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afca07640 1 -- 172.21.15.22:0/4035993312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af80ce6a0 msgr2=0x7f2af80ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afca07640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af80ce6a0 0x7f2af80ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.201+0000 7f2afca07640 1 -- 172.21.15.22:0/4035993312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0009a70 con 0x7f2af80ce260 2023-11-24T06:14:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.202+0000 7f2afca07640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2af80ce260 0x7f2af80b3610 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800c500 tx=0x7f2ae800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.202+0000 7f2af57fa640 1 -- 172.21.15.22:0/4035993312 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8007560 con 0x7f2af80ce260 2023-11-24T06:14:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.202+0000 7f2af57fa640 1 -- 172.21.15.22:0/4035993312 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae80047e0 con 0x7f2af80ce260 2023-11-24T06:14:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.202+0000 7f2af57fa640 1 -- 172.21.15.22:0/4035993312 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8004b90 con 0x7f2af80ce260 2023-11-24T06:14:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.202+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af80b3cf0 con 0x7f2af80ce260 2023-11-24T06:14:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.202+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af80b42b0 con 0x7f2af80ce260 2023-11-24T06:14:59.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.204+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af8074770 con 0x7f2af80ce260 2023-11-24T06:14:59.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.204+0000 7f2af57fa640 1 -- 172.21.15.22:0/4035993312 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2ae8004cf0 con 0x7f2af80ce260 2023-11-24T06:14:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.205+0000 7f2af57fa640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ad806aff0 0x7f2ad806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.206+0000 7f2af57fa640 1 -- 172.21.15.22:0/4035993312 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2ae8088b40 con 0x7f2af80ce260 2023-11-24T06:14:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.206+0000 7f2af7fff640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ad806aff0 0x7f2ad806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.207+0000 7f2af7fff640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ad806aff0 0x7f2ad806d4b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0036000 tx=0x7f2ae0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.210+0000 7f2af57fa640 1 -- 172.21.15.22:0/4035993312 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ae8053920 con 0x7f2af80ce260 2023-11-24T06:14:59.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.442+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2af80b21e0 con 0x7f2af80ce260 2023-11-24T06:14:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.443+0000 7f2af57fa640 1 -- 172.21.15.22:0/4035993312 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f2ae8018020 con 0x7f2af80ce260 2023-11-24T06:14:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:14:59.446 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:14:59.446 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ad806aff0 msgr2=0x7f2ad806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ad806aff0 0x7f2ad806d4b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0036000 tx=0x7f2ae0030000 comp rx=0 tx=0).stop 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2af80ce260 msgr2=0x7f2af80b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2af80ce260 0x7f2af80b3610 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800c500 tx=0x7f2ae800c9c0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 shutdown_connections 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2ad806aff0 0x7f2ad806d4b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2af815d4d0 0x7f2af815fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af80ce6a0 0x7f2af80ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 --2- 172.21.15.22:0/4035993312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2af80ce260 0x7f2af80b3610 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 >> 172.21.15.22:0/4035993312 conn(0x7f2af8071f90 msgr2=0x7f2af815bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 shutdown_connections 2023-11-24T06:14:59.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:14:59.446+0000 7f2afec6b640 1 -- 172.21.15.22:0/4035993312 wait complete. 2023-11-24T06:14:59.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:14:59.701 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":1.525980015,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.923679570241166,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:14:59.701 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.923679570241166 }, "state": "open", "uptime": 1.525980015 } ] 2023-11-24T06:14:59.702 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:04.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.940+0000 7fd45975c640 1 Processor -- start 2023-11-24T06:15:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.941+0000 7fd45975c640 1 -- start start 2023-11-24T06:15:04.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.942+0000 7fd45975c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd4540cf050 0x7fd4540cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.942+0000 7fd45975c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd454140900 con 0x7fd4540cd7b0 2023-11-24T06:15:04.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.942+0000 7fd45975c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45415fa70 con 0x7fd45413dfd0 2023-11-24T06:15:04.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.942+0000 7fd45975c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4540cfa40 con 0x7fd4540cf050 2023-11-24T06:15:04.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.943+0000 7fd458f5b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd4540cd7b0 0x7fd4540cdbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39876/0 (socket says 172.21.15.22:39876) 2023-11-24T06:15:04.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.943+0000 7fd458f5b640 1 -- 172.21.15.22:0/407721509 learned_addr learned my addr 172.21.15.22:0/407721509 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:15:04.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.943+0000 7fd44bfff640 1 --2- 172.21.15.22:0/407721509 >> v2:172.21.15.31:3300/0 conn(0x7fd4540cf050 0x7fd4540cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.943+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330966245 0 0) 0x7fd454140900 con 0x7fd4540cd7b0 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.943+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd440003520 con 0x7fd4540cd7b0 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755666357 0 0) 0x7fd440003520 con 0x7fd4540cd7b0 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 >> v2:172.21.15.31:3300/0 conn(0x7fd4540cf050 msgr2=0x7fd4540cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 --2- 172.21.15.22:0/407721509 >> v2:172.21.15.31:3300/0 conn(0x7fd4540cf050 0x7fd4540cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 >> v1:172.21.15.31:6789/0 conn(0x7fd45413dfd0 legacy=0x7fd45415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45415ee60 con 0x7fd4540cd7b0 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fd44c0019f0 con 0x7fd4540cd7b0 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 >> v1:172.21.15.22:6789/0 conn(0x7fd4540cd7b0 legacy=0x7fd4540cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd440003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4400047c0 0x7fd440004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4400052a0 0x7fd44000fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540cfa40 con 0x7fd440003a30 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4400105b0 con 0x7fd4400047c0 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd440010770 con 0x7fd4400052a0 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd453fff640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd440003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.944+0000 7fd44bfff640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4400047c0 0x7fd440004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.945+0000 7fd453fff640 1 -- 172.21.15.22:0/407721509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4400052a0 msgr2=0x7fd44000fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.945+0000 7fd458f5b640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4400052a0 0x7fd44000fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.945+0000 7fd453fff640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4400052a0 0x7fd44000fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.945+0000 7fd453fff640 1 -- 172.21.15.22:0/407721509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4400047c0 msgr2=0x7fd440004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.945+0000 7fd453fff640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4400047c0 0x7fd440004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.945+0000 7fd453fff640 1 -- 172.21.15.22:0/407721509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440003520 con 0x7fd440003a30 2023-11-24T06:15:04.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.945+0000 7fd458f5b640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4400052a0 0x7fd44000fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:04.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.945+0000 7fd458f5b640 1 -- 172.21.15.22:0/407721509 reap_dead start 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.946+0000 7fd453fff640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd440003e50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd444001720 tx=0x7fd4400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dab8f40fde65def server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.946+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440052d0 con 0x7fd440003a30 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.946+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44402e050 con 0x7fd440003a30 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.946+0000 7fd4537fe640 1 -- 172.21.15.22:0/407721509 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444003830 con 0x7fd440003a30 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.947+0000 7fd45975c640 1 -- 172.21.15.22:0/407721509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 msgr2=0x7fd440003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.947+0000 7fd45975c640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd440003e50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd444001720 tx=0x7fd4400057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.947+0000 7fd45975c640 1 -- 172.21.15.22:0/407721509 shutdown_connections 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.947+0000 7fd45975c640 1 --2- 172.21.15.22:0/407721509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd440003e50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.947+0000 7fd45975c640 1 -- 172.21.15.22:0/407721509 >> 172.21.15.22:0/407721509 conn(0x7fd45406a860 msgr2=0x7fd45406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:04.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.947+0000 7fd45975c640 1 -- 172.21.15.22:0/407721509 shutdown_connections 2023-11-24T06:15:04.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.947+0000 7fd45975c640 1 -- 172.21.15.22:0/407721509 wait complete. 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.949+0000 7fd45975c640 1 Processor -- start 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.949+0000 7fd45975c640 1 -- start start 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.950+0000 7fd45975c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd454152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.950+0000 7fd45975c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd45415bc40 0x7fd4540b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.950+0000 7fd45975c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd45415c0c0 0x7fd4540b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.950+0000 7fd45975c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd454070200 con 0x7fd440003a30 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.950+0000 7fd45975c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540704e0 con 0x7fd45415c0c0 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.950+0000 7fd45975c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540707c0 con 0x7fd45415bc40 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.950+0000 7fd453fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd454152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.950+0000 7fd453fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd454152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40036/0 (socket says 172.21.15.22:40036) 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.950+0000 7fd453fff640 1 -- 172.21.15.22:0/849895717 learned_addr learned my addr 172.21.15.22:0/849895717 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd458f5b640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd45415c0c0 0x7fd4540b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd44bfff640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd45415bc40 0x7fd4540b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd453fff640 1 -- 172.21.15.22:0/849895717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd45415bc40 msgr2=0x7fd4540b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd453fff640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd45415bc40 0x7fd4540b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd453fff640 1 -- 172.21.15.22:0/849895717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd45415c0c0 msgr2=0x7fd4540b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd453fff640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd45415c0c0 0x7fd4540b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd453fff640 1 -- 172.21.15.22:0/849895717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454070aa0 con 0x7fd440003a30 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd44bfff640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd45415bc40 0x7fd4540b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd453fff640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd454152240 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd444000c00 tx=0x7fd444001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd4517fa640 1 -- 172.21.15.22:0/849895717 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440076c0 con 0x7fd440003a30 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd4517fa640 1 -- 172.21.15.22:0/849895717 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd444007a30 con 0x7fd440003a30 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.951+0000 7fd4517fa640 1 -- 172.21.15.22:0/849895717 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444006be0 con 0x7fd440003a30 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.952+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd454070d80 con 0x7fd440003a30 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.952+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45413d6c0 con 0x7fd440003a30 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.953+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd454070900 con 0x7fd440003a30 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.954+0000 7fd4517fa640 1 -- 172.21.15.22:0/849895717 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fd444006d40 con 0x7fd440003a30 2023-11-24T06:15:04.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.955+0000 7fd4517fa640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd43406b0b0 0x7fd43406d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.955+0000 7fd4517fa640 1 -- 172.21.15.22:0/849895717 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd4440ab5f0 con 0x7fd440003a30 2023-11-24T06:15:04.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.955+0000 7fd44bfff640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd43406b0b0 0x7fd43406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.956+0000 7fd44bfff640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd43406b0b0 0x7fd43406d570 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd45413dd30 tx=0x7fd43c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:04.960+0000 7fd4517fa640 1 -- 172.21.15.22:0/849895717 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd454070900 con 0x7fd440003a30 2023-11-24T06:15:05.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.189+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd454070900 con 0x7fd440003a30 2023-11-24T06:15:05.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.190+0000 7fd4517fa640 1 -- 172.21.15.22:0/849895717 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fd454070900 con 0x7fd440003a30 2023-11-24T06:15:05.193 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:05.193 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:05.193 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:05.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd43406b0b0 msgr2=0x7fd43406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd43406b0b0 0x7fd43406d570 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd45413dd30 tx=0x7fd43c008040 comp rx=0 tx=0).stop 2023-11-24T06:15:05.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 msgr2=0x7fd454152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd454152240 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd444000c00 tx=0x7fd444001120 comp rx=0 tx=0).stop 2023-11-24T06:15:05.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 shutdown_connections 2023-11-24T06:15:05.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd43406b0b0 0x7fd43406d570 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd45415c0c0 0x7fd4540b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd45415bc40 0x7fd4540b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 --2- 172.21.15.22:0/849895717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd440003a30 0x7fd454152240 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 >> 172.21.15.22:0/849895717 conn(0x7fd45406a860 msgr2=0x7fd454155800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:05.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 shutdown_connections 2023-11-24T06:15:05.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:05.193+0000 7fd45975c640 1 -- 172.21.15.22:0/849895717 wait complete. 2023-11-24T06:15:05.214 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:05.457 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":7.2799046580000004,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.634096512042653,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:05.457 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.634096512042653 }, "state": "open", "uptime": 7.279904658 } ] 2023-11-24T06:15:05.458 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:10.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:10.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.692+0000 7f9c0c82e640 1 Processor -- start 2023-11-24T06:15:10.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.692+0000 7f9c0c82e640 1 -- start start 2023-11-24T06:15:10.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.694+0000 7f9c0c82e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c0815e890 0x7f9c080cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:10.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.694+0000 7f9c0c82e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c080cfb50 0x7f9c080cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:10.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.694+0000 7f9c0c82e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c080d1e80 con 0x7f9c080d19f0 2023-11-24T06:15:10.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.694+0000 7f9c0c82e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c080ccef0 con 0x7f9c080cfb50 2023-11-24T06:15:10.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.694+0000 7f9c0c82e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c080cc650 con 0x7f9c0815e890 2023-11-24T06:15:10.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.695+0000 7f9c07fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c080cfb50 0x7f9c080cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:10.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.695+0000 7f9c07fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c080cfb50 0x7f9c080cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40046/0 (socket says 172.21.15.22:40046) 2023-11-24T06:15:10.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.695+0000 7f9c06ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9c080d19f0 0x7f9c080cead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39890/0 (socket says 172.21.15.22:39890) 2023-11-24T06:15:10.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.695+0000 7f9c07fff640 1 -- 172.21.15.22:0/3800189719 learned_addr learned my addr 172.21.15.22:0/3800189719 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:10.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.695+0000 7f9c077fe640 1 --2- 172.21.15.22:0/3800189719 >> v2:172.21.15.31:3300/0 conn(0x7f9c0815e890 0x7f9c080cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:10.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.695+0000 7f9c07fff640 1 -- 172.21.15.22:0/3800189719 >> v2:172.21.15.31:3300/0 conn(0x7f9c0815e890 msgr2=0x7f9c080cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:10.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.695+0000 7f9c07fff640 1 --2- 172.21.15.22:0/3800189719 >> v2:172.21.15.31:3300/0 conn(0x7f9c0815e890 0x7f9c080cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.695+0000 7f9c07fff640 1 -- 172.21.15.22:0/3800189719 >> v1:172.21.15.22:6789/0 conn(0x7f9c080d19f0 legacy=0x7f9c080cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:10.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.695+0000 7f9c07fff640 1 -- 172.21.15.22:0/3800189719 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c080cc930 con 0x7f9c080cfb50 2023-11-24T06:15:10.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.696+0000 7f9c07fff640 1 --2- 172.21.15.22:0/3800189719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 0x7f9c080cdda0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9c080719c0 tx=0x7f9c0002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cda3147fe75496 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:10.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.697+0000 7f9c067fc640 1 -- 172.21.15.22:0/3800189719 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000317e0 con 0x7f9c080cfb50 2023-11-24T06:15:10.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.697+0000 7f9c067fc640 1 -- 172.21.15.22:0/3800189719 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00031940 con 0x7f9c080cfb50 2023-11-24T06:15:10.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.697+0000 7f9c067fc640 1 -- 172.21.15.22:0/3800189719 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00031cd0 con 0x7f9c080cfb50 2023-11-24T06:15:10.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.697+0000 7f9c0c82e640 1 -- 172.21.15.22:0/3800189719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 msgr2=0x7f9c080cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:10.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.697+0000 7f9c0c82e640 1 --2- 172.21.15.22:0/3800189719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 0x7f9c080cdda0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9c080719c0 tx=0x7f9c0002b880 comp rx=0 tx=0).stop 2023-11-24T06:15:10.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.698+0000 7f9c0c82e640 1 -- 172.21.15.22:0/3800189719 shutdown_connections 2023-11-24T06:15:10.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.698+0000 7f9c0c82e640 1 --2- 172.21.15.22:0/3800189719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 0x7f9c080cdda0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.698+0000 7f9c0c82e640 1 --2- 172.21.15.22:0/3800189719 >> v2:172.21.15.31:3300/0 conn(0x7f9c0815e890 0x7f9c080cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.698+0000 7f9c0c82e640 1 -- 172.21.15.22:0/3800189719 >> 172.21.15.22:0/3800189719 conn(0x7f9c080d0f00 msgr2=0x7f9c080d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:10.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.698+0000 7f9c0c82e640 1 -- 172.21.15.22:0/3800189719 shutdown_connections 2023-11-24T06:15:10.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.698+0000 7f9c0c82e640 1 -- 172.21.15.22:0/3800189719 wait complete. 2023-11-24T06:15:10.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.700+0000 7f9c0c82e640 1 Processor -- start 2023-11-24T06:15:10.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.700+0000 7f9c0c82e640 1 -- start start 2023-11-24T06:15:10.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.701+0000 7f9c0c82e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 0x7f9c0815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:10.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.701+0000 7f9c0c82e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0815e890 0x7f9c0815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:10.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.701+0000 7f9c0c82e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c080adc70 0x7f9c080b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:10.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.701+0000 7f9c0c82e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c5e20 con 0x7f9c080cfb50 2023-11-24T06:15:10.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.701+0000 7f9c0c82e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c6100 con 0x7f9c080adc70 2023-11-24T06:15:10.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.701+0000 7f9c0c82e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c63e0 con 0x7f9c0815e890 2023-11-24T06:15:10.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.701+0000 7f9c077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 0x7f9c0815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:10.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.701+0000 7f9c077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 0x7f9c0815a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40052/0 (socket says 172.21.15.22:40052) 2023-11-24T06:15:10.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.701+0000 7f9c077fe640 1 -- 172.21.15.22:0/10364822 learned_addr learned my addr 172.21.15.22:0/10364822 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:10.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.702+0000 7f9c06ffd640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0815e890 0x7f9c0815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:10.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.702+0000 7f9c07fff640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c080adc70 0x7f9c080b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:10.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.702+0000 7f9c077fe640 1 -- 172.21.15.22:0/10364822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0815e890 msgr2=0x7f9c0815bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:10.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.702+0000 7f9c077fe640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0815e890 0x7f9c0815bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.702+0000 7f9c077fe640 1 -- 172.21.15.22:0/10364822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c080adc70 msgr2=0x7f9c080b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:10.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.702+0000 7f9c077fe640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c080adc70 0x7f9c080b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.702+0000 7f9c077fe640 1 -- 172.21.15.22:0/10364822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000094d0 con 0x7f9c080cfb50 2023-11-24T06:15:10.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.702+0000 7f9c077fe640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 0x7f9c0815a530 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800d5f0 tx=0x7f9bf800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:10.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.703+0000 7f9bfffff640 1 -- 172.21.15.22:0/10364822 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80125f0 con 0x7f9c080cfb50 2023-11-24T06:15:10.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.703+0000 7f9bfffff640 1 -- 172.21.15.22:0/10364822 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8012750 con 0x7f9c080cfb50 2023-11-24T06:15:10.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.703+0000 7f9bfffff640 1 -- 172.21.15.22:0/10364822 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8012b00 con 0x7f9c080cfb50 2023-11-24T06:15:10.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.703+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0815edf0 con 0x7f9c080cfb50 2023-11-24T06:15:10.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.703+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c080c69a0 con 0x7f9c080cfb50 2023-11-24T06:15:10.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.704+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0804e840 con 0x7f9c080cfb50 2023-11-24T06:15:10.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.705+0000 7f9bfffff640 1 -- 172.21.15.22:0/10364822 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f9bf8012c60 con 0x7f9c080cfb50 2023-11-24T06:15:10.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.706+0000 7f9bfffff640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9be806b080 0x7f9be806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:10.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.707+0000 7f9bfffff640 1 -- 172.21.15.22:0/10364822 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9bf8089ee0 con 0x7f9c080cfb50 2023-11-24T06:15:10.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.707+0000 7f9c06ffd640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9be806b080 0x7f9be806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:10.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.707+0000 7f9c06ffd640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9be806b080 0x7f9be806d540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9c080cb020 tx=0x7f9bf0005b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:10.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.711+0000 7f9bfffff640 1 -- 172.21.15.22:0/10364822 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9bf8054c80 con 0x7f9c080cfb50 2023-11-24T06:15:10.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.944+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c080cd820 con 0x7f9c080cfb50 2023-11-24T06:15:10.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.945+0000 7f9bfffff640 1 -- 172.21.15.22:0/10364822 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f9bf80582a0 con 0x7f9c080cfb50 2023-11-24T06:15:10.948 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:10.948 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:10.948 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9be806b080 msgr2=0x7f9be806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9be806b080 0x7f9be806d540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9c080cb020 tx=0x7f9bf0005b70 comp rx=0 tx=0).stop 2023-11-24T06:15:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 msgr2=0x7f9c0815a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 0x7f9c0815a530 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800d5f0 tx=0x7f9bf800dab0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 shutdown_connections 2023-11-24T06:15:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9be806b080 0x7f9be806d540 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c080adc70 0x7f9c080b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0815e890 0x7f9c0815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 --2- 172.21.15.22:0/10364822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c080cfb50 0x7f9c0815a530 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:10.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 >> 172.21.15.22:0/10364822 conn(0x7f9c080d0f00 msgr2=0x7f9c080cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:10.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 shutdown_connections 2023-11-24T06:15:10.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:10.948+0000 7f9c0c82e640 1 -- 172.21.15.22:0/10364822 wait complete. 2023-11-24T06:15:10.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:11.208 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":13.031829327000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.34853576519571,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:11.209 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.34853576519571 }, "state": "open", "uptime": 13.031829327 } ] 2023-11-24T06:15:11.209 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:16.213 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:16.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.447+0000 7f923e8ad640 1 Processor -- start 2023-11-24T06:15:16.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.448+0000 7f923e8ad640 1 -- start start 2023-11-24T06:15:16.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.449+0000 7f923e8ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92380d14a0 0x7f92380d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:16.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.449+0000 7f923e8ad640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92380b0640 0x7f92380b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:16.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.449+0000 7f923e8ad640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92380cf0c0 con 0x7f923815d5b0 2023-11-24T06:15:16.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.449+0000 7f923e8ad640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92380b01b0 con 0x7f92380b0640 2023-11-24T06:15:16.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.449+0000 7f923e8ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923815d990 con 0x7f92380d14a0 2023-11-24T06:15:16.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.450+0000 7f923e0ac640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92380b0640 0x7f92380b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:16.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.450+0000 7f923e0ac640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92380b0640 0x7f92380b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35470/0 (socket says 172.21.15.22:35470) 2023-11-24T06:15:16.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.450+0000 7f923e0ac640 1 -- 172.21.15.22:0/2884091997 learned_addr learned my addr 172.21.15.22:0/2884091997 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:16.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.450+0000 7f923d8ab640 1 --1- 172.21.15.22:0/2884091997 >> v1:172.21.15.22:6789/0 conn(0x7f923815d5b0 0x7f92380d3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52904/0 (socket says 172.21.15.22:52904) 2023-11-24T06:15:16.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.450+0000 7f923d0aa640 1 --2- 172.21.15.22:0/2884091997 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92380d14a0 0x7f92380d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:16.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.450+0000 7f923e0ac640 1 -- 172.21.15.22:0/2884091997 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92380d14a0 msgr2=0x7f92380d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:16.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.450+0000 7f923e0ac640 1 --2- 172.21.15.22:0/2884091997 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92380d14a0 0x7f92380d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.450+0000 7f923e0ac640 1 -- 172.21.15.22:0/2884091997 >> v1:172.21.15.22:6789/0 conn(0x7f923815d5b0 legacy=0x7f92380d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:16.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.450+0000 7f923e0ac640 1 -- 172.21.15.22:0/2884091997 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92380d1e40 con 0x7f92380b0640 2023-11-24T06:15:16.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.451+0000 7f923e0ac640 1 --2- 172.21.15.22:0/2884091997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 0x7f92380b0aa0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f923002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751be1df1ea627d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:16.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.452+0000 7f923c8a9640 1 -- 172.21.15.22:0/2884091997 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230030840 con 0x7f92380b0640 2023-11-24T06:15:16.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.452+0000 7f923c8a9640 1 -- 172.21.15.22:0/2884091997 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92300309a0 con 0x7f92380b0640 2023-11-24T06:15:16.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.452+0000 7f923c8a9640 1 -- 172.21.15.22:0/2884091997 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230030d30 con 0x7f92380b0640 2023-11-24T06:15:16.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.452+0000 7f923e8ad640 1 -- 172.21.15.22:0/2884091997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 msgr2=0x7f92380b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:16.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.452+0000 7f923e8ad640 1 --2- 172.21.15.22:0/2884091997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 0x7f92380b0aa0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f923002b980 comp rx=0 tx=0).stop 2023-11-24T06:15:16.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.452+0000 7f923e8ad640 1 -- 172.21.15.22:0/2884091997 shutdown_connections 2023-11-24T06:15:16.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.452+0000 7f923e8ad640 1 --2- 172.21.15.22:0/2884091997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 0x7f92380b0aa0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.452+0000 7f923e8ad640 1 --2- 172.21.15.22:0/2884091997 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92380d14a0 0x7f92380d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.452+0000 7f923e8ad640 1 -- 172.21.15.22:0/2884091997 >> 172.21.15.22:0/2884091997 conn(0x7f923809c3b0 msgr2=0x7f92380d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:16.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.453+0000 7f923e8ad640 1 -- 172.21.15.22:0/2884091997 shutdown_connections 2023-11-24T06:15:16.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.453+0000 7f923e8ad640 1 -- 172.21.15.22:0/2884091997 wait complete. 2023-11-24T06:15:16.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.454+0000 7f923e8ad640 1 Processor -- start 2023-11-24T06:15:16.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.455+0000 7f923e8ad640 1 -- start start 2023-11-24T06:15:16.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.455+0000 7f923e8ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 0x7f9238152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:16.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.455+0000 7f923e8ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92380d14a0 0x7f92380b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:16.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.455+0000 7f923e8ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923815d5b0 0x7f92380d3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:16.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923e8ad640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92380b7ca0 con 0x7f92380b0640 2023-11-24T06:15:16.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923e8ad640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92380b6c90 con 0x7f92380d14a0 2023-11-24T06:15:16.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923e8ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92380b6ee0 con 0x7f923815d5b0 2023-11-24T06:15:16.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d8ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 0x7f9238152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:16.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d8ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 0x7f9238152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35478/0 (socket says 172.21.15.22:35478) 2023-11-24T06:15:16.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d8ab640 1 -- 172.21.15.22:0/214039426 learned_addr learned my addr 172.21.15.22:0/214039426 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:16.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d8ab640 1 -- 172.21.15.22:0/214039426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923815d5b0 msgr2=0x7f92380d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:16.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d8ab640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923815d5b0 0x7f92380d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d8ab640 1 -- 172.21.15.22:0/214039426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92380d14a0 msgr2=0x7f92380b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:16.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d0aa640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92380d14a0 0x7f92380b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:16.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d8ab640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92380d14a0 0x7f92380b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d8ab640 1 -- 172.21.15.22:0/214039426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300094d0 con 0x7f92380b0640 2023-11-24T06:15:16.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.456+0000 7f923d0aa640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92380d14a0 0x7f92380b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:16.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.457+0000 7f923d8ab640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 0x7f9238152720 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f922800c800 tx=0x7f922800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:16.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.457+0000 7f92367fc640 1 -- 172.21.15.22:0/214039426 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800a640 con 0x7f92380b0640 2023-11-24T06:15:16.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.457+0000 7f92367fc640 1 -- 172.21.15.22:0/214039426 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922800a7a0 con 0x7f92380b0640 2023-11-24T06:15:16.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.457+0000 7f92367fc640 1 -- 172.21.15.22:0/214039426 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800ab50 con 0x7f92380b0640 2023-11-24T06:15:16.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.457+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92380b71c0 con 0x7f92380b0640 2023-11-24T06:15:16.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.457+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92380b7780 con 0x7f92380b0640 2023-11-24T06:15:16.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.459+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92380b7970 con 0x7f92380b0640 2023-11-24T06:15:16.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.459+0000 7f92367fc640 1 -- 172.21.15.22:0/214039426 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f922800acb0 con 0x7f92380b0640 2023-11-24T06:15:16.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.460+0000 7f92367fc640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922406b080 0x7f922406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:16.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.460+0000 7f92367fc640 1 -- 172.21.15.22:0/214039426 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9228089160 con 0x7f92380b0640 2023-11-24T06:15:16.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.461+0000 7f923d0aa640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922406b080 0x7f922406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:16.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.461+0000 7f923d0aa640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922406b080 0x7f922406d540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f923806cbe0 tx=0x7f922c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.465+0000 7f92367fc640 1 -- 172.21.15.22:0/214039426 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9228057a40 con 0x7f92380b0640 2023-11-24T06:15:16.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.698+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f923804e840 con 0x7f92380b0640 2023-11-24T06:15:16.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.698+0000 7f92367fc640 1 -- 172.21.15.22:0/214039426 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f92280018c0 con 0x7f92380b0640 2023-11-24T06:15:16.702 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:16.702 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:16.702 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:16.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922406b080 msgr2=0x7f922406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922406b080 0x7f922406d540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f923806cbe0 tx=0x7f922c008040 comp rx=0 tx=0).stop 2023-11-24T06:15:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 msgr2=0x7f9238152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 0x7f9238152720 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f922800c800 tx=0x7f922800ccc0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 shutdown_connections 2023-11-24T06:15:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f922406b080 0x7f922406d540 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f923815d5b0 0x7f92380d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92380d14a0 0x7f92380b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 --2- 172.21.15.22:0/214039426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92380b0640 0x7f9238152720 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 >> 172.21.15.22:0/214039426 conn(0x7f923809c3b0 msgr2=0x7f92380cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 shutdown_connections 2023-11-24T06:15:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:16.701+0000 7f923e8ad640 1 -- 172.21.15.22:0/214039426 wait complete. 2023-11-24T06:15:16.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:16.959 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":18.782754010000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.066744297044611,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:16.960 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.06674429704461 }, "state": "open", "uptime": 18.78275401 } ] 2023-11-24T06:15:16.960 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:21.424 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:21.433 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:21.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:22.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.197+0000 7f8f968ca640 1 Processor -- start 2023-11-24T06:15:22.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.197+0000 7f8f968ca640 1 -- start start 2023-11-24T06:15:22.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.198+0000 7f8f968ca640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f900cdc30 0x7f8f9015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.198+0000 7f8f968ca640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8f900ce010 0x7f8f9015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.198+0000 7f8f968ca640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f900cfbc0 con 0x7f8f9015d560 2023-11-24T06:15:22.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.198+0000 7f8f968ca640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f900b0450 con 0x7f8f900ce010 2023-11-24T06:15:22.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.198+0000 7f8f968ca640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f900cfe10 con 0x7f8f900cdc30 2023-11-24T06:15:22.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.199+0000 7f8f950c7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8f900ce010 0x7f8f9015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.199+0000 7f8f950c7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8f900ce010 0x7f8f9015d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40068/0 (socket says 172.21.15.22:40068) 2023-11-24T06:15:22.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.199+0000 7f8f950c7640 1 -- 172.21.15.22:0/1654711557 learned_addr learned my addr 172.21.15.22:0/1654711557 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:22.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.199+0000 7f8f950c7640 1 -- 172.21.15.22:0/1654711557 >> v2:172.21.15.31:3300/0 conn(0x7f8f900cdc30 msgr2=0x7f8f9015cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:22.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.199+0000 7f8f950c7640 1 --2- 172.21.15.22:0/1654711557 >> v2:172.21.15.31:3300/0 conn(0x7f8f900cdc30 0x7f8f9015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.199+0000 7f8f950c7640 1 -- 172.21.15.22:0/1654711557 >> v1:172.21.15.31:6789/0 conn(0x7f8f9015d560 legacy=0x7f8f90160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:22.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.199+0000 7f8f950c7640 1 -- 172.21.15.22:0/1654711557 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f900d00f0 con 0x7f8f900ce010 2023-11-24T06:15:22.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.200+0000 7f8f950c7640 1 --2- 172.21.15.22:0/1654711557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900ce010 0x7f8f9015d020 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8f90071840 tx=0x7f8f7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c685d21fde75f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:22.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.201+0000 7f8f948c6640 1 -- 172.21.15.22:0/1654711557 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c031870 con 0x7f8f900ce010 2023-11-24T06:15:22.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.201+0000 7f8f948c6640 1 -- 172.21.15.22:0/1654711557 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0319d0 con 0x7f8f900ce010 2023-11-24T06:15:22.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.201+0000 7f8f948c6640 1 -- 172.21.15.22:0/1654711557 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c031d60 con 0x7f8f900ce010 2023-11-24T06:15:22.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.201+0000 7f8f968ca640 1 -- 172.21.15.22:0/1654711557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900ce010 msgr2=0x7f8f9015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.201+0000 7f8f968ca640 1 --2- 172.21.15.22:0/1654711557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900ce010 0x7f8f9015d020 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8f90071840 tx=0x7f8f7c02b910 comp rx=0 tx=0).stop 2023-11-24T06:15:22.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.201+0000 7f8f968ca640 1 -- 172.21.15.22:0/1654711557 shutdown_connections 2023-11-24T06:15:22.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.202+0000 7f8f968ca640 1 --2- 172.21.15.22:0/1654711557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900ce010 0x7f8f9015d020 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.202+0000 7f8f968ca640 1 --2- 172.21.15.22:0/1654711557 >> v2:172.21.15.31:3300/0 conn(0x7f8f900cdc30 0x7f8f9015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.202+0000 7f8f968ca640 1 -- 172.21.15.22:0/1654711557 >> 172.21.15.22:0/1654711557 conn(0x7f8f900d0e70 msgr2=0x7f8f900d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:22.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.202+0000 7f8f968ca640 1 -- 172.21.15.22:0/1654711557 shutdown_connections 2023-11-24T06:15:22.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.202+0000 7f8f968ca640 1 -- 172.21.15.22:0/1654711557 wait complete. 2023-11-24T06:15:22.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.203+0000 7f8f968ca640 1 Processor -- start 2023-11-24T06:15:22.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.204+0000 7f8f968ca640 1 -- start start 2023-11-24T06:15:22.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.204+0000 7f8f968ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900cdc30 0x7f8f900c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.204+0000 7f8f968ca640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f900ce010 0x7f8f90159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.204+0000 7f8f968ca640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f9015d560 0x7f8f901e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.204+0000 7f8f968ca640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f90159fb0 con 0x7f8f900cdc30 2023-11-24T06:15:22.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.204+0000 7f8f968ca640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c8f30 con 0x7f8f9015d560 2023-11-24T06:15:22.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.204+0000 7f8f968ca640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c9210 con 0x7f8f900ce010 2023-11-24T06:15:22.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f958c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900cdc30 0x7f8f900c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f958c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900cdc30 0x7f8f900c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40076/0 (socket says 172.21.15.22:40076) 2023-11-24T06:15:22.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f958c8640 1 -- 172.21.15.22:0/2982432764 learned_addr learned my addr 172.21.15.22:0/2982432764 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:22.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f960c9640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f9015d560 0x7f8f901e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f950c7640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f900ce010 0x7f8f90159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f958c8640 1 -- 172.21.15.22:0/2982432764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f900ce010 msgr2=0x7f8f90159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f958c8640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f900ce010 0x7f8f90159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f958c8640 1 -- 172.21.15.22:0/2982432764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f9015d560 msgr2=0x7f8f901e6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f958c8640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f9015d560 0x7f8f901e6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.205+0000 7f8f958c8640 1 -- 172.21.15.22:0/2982432764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0094d0 con 0x7f8f900cdc30 2023-11-24T06:15:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.206+0000 7f8f958c8640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900cdc30 0x7f8f900c8950 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400ba50 tx=0x7f8f8400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.206+0000 7f8f8e7fc640 1 -- 172.21.15.22:0/2982432764 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400cbe0 con 0x7f8f900cdc30 2023-11-24T06:15:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.206+0000 7f8f8e7fc640 1 -- 172.21.15.22:0/2982432764 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8400cd60 con 0x7f8f900cdc30 2023-11-24T06:15:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.206+0000 7f8f8e7fc640 1 -- 172.21.15.22:0/2982432764 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84014680 con 0x7f8f900cdc30 2023-11-24T06:15:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.206+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f900c94f0 con 0x7f8f900cdc30 2023-11-24T06:15:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.206+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f900c9ab0 con 0x7f8f900cdc30 2023-11-24T06:15:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.207+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9004e840 con 0x7f8f900cdc30 2023-11-24T06:15:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.208+0000 7f8f8e7fc640 1 -- 172.21.15.22:0/2982432764 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f8f8401d3b0 con 0x7f8f900cdc30 2023-11-24T06:15:22.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.209+0000 7f8f8e7fc640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8f7406b080 0x7f8f7406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.209+0000 7f8f8e7fc640 1 -- 172.21.15.22:0/2982432764 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8f84089b10 con 0x7f8f900cdc30 2023-11-24T06:15:22.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.210+0000 7f8f950c7640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8f7406b080 0x7f8f7406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.210+0000 7f8f950c7640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8f7406b080 0x7f8f7406d540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c036000 tx=0x7f8f7c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:22.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.214+0000 7f8f8e7fc640 1 -- 172.21.15.22:0/2982432764 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f84054780 con 0x7f8f900cdc30 2023-11-24T06:15:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.445+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f900b0120 con 0x7f8f900cdc30 2023-11-24T06:15:22.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.446+0000 7f8f8e7fc640 1 -- 172.21.15.22:0/2982432764 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f8f84019020 con 0x7f8f900cdc30 2023-11-24T06:15:22.449 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:22.449 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:22.449 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8f7406b080 msgr2=0x7f8f7406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8f7406b080 0x7f8f7406d540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c036000 tx=0x7f8f7c03c040 comp rx=0 tx=0).stop 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900cdc30 msgr2=0x7f8f900c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900cdc30 0x7f8f900c8950 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400ba50 tx=0x7f8f8400bf10 comp rx=0 tx=0).stop 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 shutdown_connections 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8f7406b080 0x7f8f7406d540 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f9015d560 0x7f8f901e6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f900ce010 0x7f8f90159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 --2- 172.21.15.22:0/2982432764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f900cdc30 0x7f8f900c8950 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 >> 172.21.15.22:0/2982432764 conn(0x7f8f900d0e70 msgr2=0x7f8f900b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:22.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 shutdown_connections 2023-11-24T06:15:22.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:22.449+0000 7f8f968ca640 1 -- 172.21.15.22:0/2982432764 wait complete. 2023-11-24T06:15:22.472 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:22.718 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":24.541678597000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.788288106690388,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:22.719 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.788288106690388 }, "state": "open", "uptime": 24.541678597 } ] 2023-11-24T06:15:22.719 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:27.720 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:27.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.960+0000 7f58d441c640 1 Processor -- start 2023-11-24T06:15:27.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.960+0000 7f58d441c640 1 -- start start 2023-11-24T06:15:27.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.961+0000 7f58d441c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f58cc1442d0 0x7f58cc0b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.961+0000 7f58d441c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 0x7f58cc0b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.962+0000 7f58d441c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc144af0 con 0x7f58cc0d0b30 2023-11-24T06:15:27.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.962+0000 7f58d441c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58cc0c67c0 con 0x7f58cc1442d0 2023-11-24T06:15:27.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.962+0000 7f58d441c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc15faf0 con 0x7f58cc144cd0 2023-11-24T06:15:27.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.962+0000 7f58d21b8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f58cc1442d0 0x7f58cc0b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.962+0000 7f58d21b8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f58cc1442d0 0x7f58cc0b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40092/0 (socket says 172.21.15.22:40092) 2023-11-24T06:15:27.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.962+0000 7f58d21b8640 1 -- 172.21.15.22:0/2500489890 learned_addr learned my addr 172.21.15.22:0/2500489890 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:27.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.962+0000 7f58d29b9640 1 --2- 172.21.15.22:0/2500489890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 0x7f58cc0b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.963+0000 7f58d21b8640 1 -- 172.21.15.22:0/2500489890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 msgr2=0x7f58cc0b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:27.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.963+0000 7f58d21b8640 1 --2- 172.21.15.22:0/2500489890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 0x7f58cc0b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.963+0000 7f58d21b8640 1 -- 172.21.15.22:0/2500489890 >> v1:172.21.15.31:6789/0 conn(0x7f58cc0d0b30 legacy=0x7f58cc0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.963+0000 7f58d21b8640 1 -- 172.21.15.22:0/2500489890 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0c5fc0 con 0x7f58cc1442d0 2023-11-24T06:15:27.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.964+0000 7f58d21b8640 1 --2- 172.21.15.22:0/2500489890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc1442d0 0x7f58cc0b2c40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009870 tx=0x7f58c802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd6c187111ec37a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:27.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.964+0000 7f58d11b6640 1 -- 172.21.15.22:0/2500489890 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8031640 con 0x7f58cc1442d0 2023-11-24T06:15:27.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.964+0000 7f58d11b6640 1 -- 172.21.15.22:0/2500489890 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c80317a0 con 0x7f58cc1442d0 2023-11-24T06:15:27.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.964+0000 7f58d11b6640 1 -- 172.21.15.22:0/2500489890 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8031b30 con 0x7f58cc1442d0 2023-11-24T06:15:27.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.965+0000 7f58d441c640 1 -- 172.21.15.22:0/2500489890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc1442d0 msgr2=0x7f58cc0b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.965+0000 7f58d441c640 1 --2- 172.21.15.22:0/2500489890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc1442d0 0x7f58cc0b2c40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009870 tx=0x7f58c802b8f0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.965+0000 7f58d441c640 1 -- 172.21.15.22:0/2500489890 shutdown_connections 2023-11-24T06:15:27.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.965+0000 7f58d441c640 1 --2- 172.21.15.22:0/2500489890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 0x7f58cc0b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.965+0000 7f58d441c640 1 --2- 172.21.15.22:0/2500489890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc1442d0 0x7f58cc0b2c40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.965+0000 7f58d441c640 1 -- 172.21.15.22:0/2500489890 >> 172.21.15.22:0/2500489890 conn(0x7f58cc0661f0 msgr2=0x7f58cc0665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:27.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.965+0000 7f58d441c640 1 -- 172.21.15.22:0/2500489890 shutdown_connections 2023-11-24T06:15:27.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.965+0000 7f58d441c640 1 -- 172.21.15.22:0/2500489890 wait complete. 2023-11-24T06:15:27.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.967+0000 7f58d441c640 1 Processor -- start 2023-11-24T06:15:27.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.967+0000 7f58d441c640 1 -- start start 2023-11-24T06:15:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.968+0000 7f58d441c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc0d0b30 0x7f58cc15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.968+0000 7f58d441c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58cc1442d0 0x7f58cc06b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.968+0000 7f58d441c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 0x7f58cc1f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.968+0000 7f58d441c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc1425d0 con 0x7f58cc0d0b30 2023-11-24T06:15:27.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.968+0000 7f58d441c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc1f6a10 con 0x7f58cc1442d0 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.968+0000 7f58d441c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc1f6cb0 con 0x7f58cc144cd0 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.968+0000 7f58d21b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc0d0b30 0x7f58cc15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.968+0000 7f58d21b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc0d0b30 0x7f58cc15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40106/0 (socket says 172.21.15.22:40106) 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.968+0000 7f58d21b8640 1 -- 172.21.15.22:0/1028971194 learned_addr learned my addr 172.21.15.22:0/1028971194 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.969+0000 7f58d29b9640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 0x7f58cc1f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.969+0000 7f58d19b7640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58cc1442d0 0x7f58cc06b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.969+0000 7f58d21b8640 1 -- 172.21.15.22:0/1028971194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 msgr2=0x7f58cc1f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.969+0000 7f58d21b8640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 0x7f58cc1f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.969+0000 7f58d21b8640 1 -- 172.21.15.22:0/1028971194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58cc1442d0 msgr2=0x7f58cc06b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.969+0000 7f58d21b8640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58cc1442d0 0x7f58cc06b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.969+0000 7f58d21b8640 1 -- 172.21.15.22:0/1028971194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80094d0 con 0x7f58cc0d0b30 2023-11-24T06:15:27.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.969+0000 7f58d19b7640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58cc1442d0 0x7f58cc06b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.969+0000 7f58d21b8640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc0d0b30 0x7f58cc15e690 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f58c8000c00 tx=0x7f58c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.970+0000 7f58c2ffd640 1 -- 172.21.15.22:0/1028971194 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c803ac60 con 0x7f58cc0d0b30 2023-11-24T06:15:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.970+0000 7f58c2ffd640 1 -- 172.21.15.22:0/1028971194 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c803adc0 con 0x7f58cc0d0b30 2023-11-24T06:15:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.970+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc1f6f90 con 0x7f58cc0d0b30 2023-11-24T06:15:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.970+0000 7f58c2ffd640 1 -- 172.21.15.22:0/1028971194 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8044630 con 0x7f58cc0d0b30 2023-11-24T06:15:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.970+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc142230 con 0x7f58cc0d0b30 2023-11-24T06:15:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.971+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58cc074770 con 0x7f58cc0d0b30 2023-11-24T06:15:27.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.972+0000 7f58c2ffd640 1 -- 172.21.15.22:0/1028971194 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f58c802f050 con 0x7f58cc0d0b30 2023-11-24T06:15:27.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.973+0000 7f58c2ffd640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f58b006b0b0 0x7f58b006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.973+0000 7f58c2ffd640 1 -- 172.21.15.22:0/1028971194 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f58c80aba60 con 0x7f58cc0d0b30 2023-11-24T06:15:27.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.973+0000 7f58d19b7640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f58b006b0b0 0x7f58b006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.974+0000 7f58d19b7640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f58b006b0b0 0x7f58b006d570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0afba0 tx=0x7f58bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:27.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:27.978+0000 7f58c2ffd640 1 -- 172.21.15.22:0/1028971194 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58c8076650 con 0x7f58cc0d0b30 2023-11-24T06:15:28.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.215+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58cc0ce130 con 0x7f58cc0d0b30 2023-11-24T06:15:28.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.216+0000 7f58c2ffd640 1 -- 172.21.15.22:0/1028971194 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f58c8031e60 con 0x7f58cc0d0b30 2023-11-24T06:15:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:28.219 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:28.219 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:28.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f58b006b0b0 msgr2=0x7f58b006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f58b006b0b0 0x7f58b006d570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0afba0 tx=0x7f58bc009040 comp rx=0 tx=0).stop 2023-11-24T06:15:28.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc0d0b30 msgr2=0x7f58cc15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc0d0b30 0x7f58cc15e690 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f58c8000c00 tx=0x7f58c80046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 shutdown_connections 2023-11-24T06:15:28.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f58b006b0b0 0x7f58b006d570 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58cc144cd0 0x7f58cc1f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58cc1442d0 0x7f58cc06b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 --2- 172.21.15.22:0/1028971194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58cc0d0b30 0x7f58cc15e690 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 >> 172.21.15.22:0/1028971194 conn(0x7f58cc0661f0 msgr2=0x7f58cc0b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:28.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.219+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 shutdown_connections 2023-11-24T06:15:28.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:28.220+0000 7f58d441c640 1 -- 172.21.15.22:0/1028971194 wait complete. 2023-11-24T06:15:28.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:28.486 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":10,"uptime":30.310603077,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.513038544684626,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:28.487 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.513038544684626 }, "state": "open", "uptime": 30.310603077 } ] 2023-11-24T06:15:28.488 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:33.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.721+0000 7fdca96c2640 1 Processor -- start 2023-11-24T06:15:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.722+0000 7fdca96c2640 1 -- start start 2023-11-24T06:15:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.723+0000 7fdca96c2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca413dfd0 0x7fdca415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.723+0000 7fdca96c2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdca40cf4d0 0x7fdca406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.724+0000 7fdca96c2640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca40ce7c0 con 0x7fdca40cf050 2023-11-24T06:15:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.724+0000 7fdca96c2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca4140900 con 0x7fdca40cf4d0 2023-11-24T06:15:33.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.724+0000 7fdca96c2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca415fa70 con 0x7fdca413dfd0 2023-11-24T06:15:33.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.724+0000 7fdc9bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdca40cf050 0x7fdca406c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33294/0 (socket says 172.21.15.22:33294) 2023-11-24T06:15:33.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.724+0000 7fdc9bfff640 1 -- 172.21.15.22:0/3597214334 learned_addr learned my addr 172.21.15.22:0/3597214334 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:15:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.724+0000 7fdca3fff640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca413dfd0 0x7fdca415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.724+0000 7fdca8ec1640 1 --2- 172.21.15.22:0/3597214334 >> v2:172.21.15.31:3300/0 conn(0x7fdca40cf4d0 0x7fdca406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.724+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730357821 0 0) 0x7fdca40ce7c0 con 0x7fdca40cf050 2023-11-24T06:15:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc90003520 con 0x7fdca40cf050 2023-11-24T06:15:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627060017 0 0) 0x7fdc90003520 con 0x7fdca40cf050 2023-11-24T06:15:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca413dfd0 msgr2=0x7fdca415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca413dfd0 0x7fdca415be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 >> v2:172.21.15.31:3300/0 conn(0x7fdca40cf4d0 msgr2=0x7fdca406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 --2- 172.21.15.22:0/3597214334 >> v2:172.21.15.31:3300/0 conn(0x7fdca40cf4d0 0x7fdca406c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca415ee60 con 0x7fdca40cf050 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fdc8c001670 con 0x7fdca40cf050 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 >> v1:172.21.15.22:6789/0 conn(0x7fdca40cf050 legacy=0x7fdca406c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc900039e0 0x7fdc90003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca413dfd0 0x7fdc900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc90004d00 0x7fdc90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4140900 con 0x7fdc90004d00 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca415fa70 con 0x7fdc900039e0 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.725+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9000b980 con 0x7fdca413dfd0 2023-11-24T06:15:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdca8ec1640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc90004d00 0x7fdc90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdc9bfff640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca413dfd0 0x7fdc900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdca3fff640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc900039e0 0x7fdc90003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdca8ec1640 1 -- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca413dfd0 msgr2=0x7fdc900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdca8ec1640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca413dfd0 0x7fdc900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdca8ec1640 1 -- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc900039e0 msgr2=0x7fdc90003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdca8ec1640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc900039e0 0x7fdc90003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdca8ec1640 1 -- 172.21.15.22:0/3597214334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc90003520 con 0x7fdc90004d00 2023-11-24T06:15:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdc9bfff640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca413dfd0 0x7fdc900047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.726+0000 7fdca3fff640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc900039e0 0x7fdc90003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:33.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.727+0000 7fdca8ec1640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc90004d00 0x7fdc90005180 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009fc0 tx=0x7fdc900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855d87b7e97e75e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:33.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.727+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c02cc30 con 0x7fdc90004d00 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.727+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00f040 con 0x7fdc90004d00 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.727+0000 7fdca37fe640 1 -- 172.21.15.22:0/3597214334 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c034440 con 0x7fdc90004d00 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.728+0000 7fdca96c2640 1 -- 172.21.15.22:0/3597214334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc90004d00 msgr2=0x7fdc90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.728+0000 7fdca96c2640 1 --2- 172.21.15.22:0/3597214334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc90004d00 0x7fdc90005180 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009fc0 tx=0x7fdc900057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.728+0000 7fdca8ec1640 1 -- 172.21.15.22:0/3597214334 reap_dead start 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.728+0000 7fdca96c2640 1 -- 172.21.15.22:0/3597214334 shutdown_connections 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.728+0000 7fdca96c2640 1 -- 172.21.15.22:0/3597214334 >> 172.21.15.22:0/3597214334 conn(0x7fdca406a860 msgr2=0x7fdca406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.728+0000 7fdca96c2640 1 -- 172.21.15.22:0/3597214334 shutdown_connections 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.728+0000 7fdca96c2640 1 -- 172.21.15.22:0/3597214334 wait complete. 2023-11-24T06:15:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.730+0000 7fdca96c2640 1 Processor -- start 2023-11-24T06:15:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.730+0000 7fdca96c2640 1 -- start start 2023-11-24T06:15:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.731+0000 7fdca96c2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc90004d00 0x7fdca41f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.731+0000 7fdca96c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca41f5f90 0x7fdca4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.731+0000 7fdca96c2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca4158420 0x7fdca4155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.731+0000 7fdca96c2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40b27e0 con 0x7fdca41f5f90 2023-11-24T06:15:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.731+0000 7fdca96c2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca413af50 con 0x7fdc90004d00 2023-11-24T06:15:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.731+0000 7fdca96c2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40b1e40 con 0x7fdca4158420 2023-11-24T06:15:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdc9bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca41f5f90 0x7fdca4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdc9bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca41f5f90 0x7fdca4157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42614/0 (socket says 172.21.15.22:42614) 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdc9bfff640 1 -- 172.21.15.22:0/672226676 learned_addr learned my addr 172.21.15.22:0/672226676 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdca3fff640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc90004d00 0x7fdca41f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdca8ec1640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca4158420 0x7fdca4155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdc9bfff640 1 -- 172.21.15.22:0/672226676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca4158420 msgr2=0x7fdca4155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdc9bfff640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca4158420 0x7fdca4155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdc9bfff640 1 -- 172.21.15.22:0/672226676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc90004d00 msgr2=0x7fdca41f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdc9bfff640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc90004d00 0x7fdca41f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdc9bfff640 1 -- 172.21.15.22:0/672226676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40b2120 con 0x7fdca41f5f90 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.732+0000 7fdc9bfff640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca41f5f90 0x7fdca4157ee0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00d7e0 tx=0x7fdc8c00dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.733+0000 7fdca17fa640 1 -- 172.21.15.22:0/672226676 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0074e0 con 0x7fdca41f5f90 2023-11-24T06:15:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.733+0000 7fdca17fa640 1 -- 172.21.15.22:0/672226676 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c007640 con 0x7fdca41f5f90 2023-11-24T06:15:33.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.733+0000 7fdca17fa640 1 -- 172.21.15.22:0/672226676 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0049e0 con 0x7fdca41f5f90 2023-11-24T06:15:33.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.733+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca40b2400 con 0x7fdca41f5f90 2023-11-24T06:15:33.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.733+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca41588a0 con 0x7fdca41f5f90 2023-11-24T06:15:33.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.734+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca40b2920 con 0x7fdca41f5f90 2023-11-24T06:15:33.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.735+0000 7fdca17fa640 1 -- 172.21.15.22:0/672226676 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fdc8c004b40 con 0x7fdca41f5f90 2023-11-24T06:15:33.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.736+0000 7fdca17fa640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc8406b080 0x7fdc8406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.736+0000 7fdca17fa640 1 -- 172.21.15.22:0/672226676 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdc8c0894c0 con 0x7fdca41f5f90 2023-11-24T06:15:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.736+0000 7fdca3fff640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc8406b080 0x7fdc8406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.737+0000 7fdca3fff640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc8406b080 0x7fdc8406d540 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdc940099c0 tx=0x7fdc94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:33.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.741+0000 7fdca17fa640 1 -- 172.21.15.22:0/672226676 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdca40b2920 con 0x7fdca41f5f90 2023-11-24T06:15:33.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.982+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdca40b2920 con 0x7fdca41f5f90 2023-11-24T06:15:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.984+0000 7fdca17fa640 1 -- 172.21.15.22:0/672226676 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fdca40b2920 con 0x7fdca41f5f90 2023-11-24T06:15:33.987 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:33.987 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.986+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc8406b080 msgr2=0x7fdc8406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.986+0000 7fdca96c2640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc8406b080 0x7fdc8406d540 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdc940099c0 tx=0x7fdc94008040 comp rx=0 tx=0).stop 2023-11-24T06:15:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.986+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca41f5f90 msgr2=0x7fdca4157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.986+0000 7fdca96c2640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca41f5f90 0x7fdca4157ee0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00d7e0 tx=0x7fdc8c00dca0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.987+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 shutdown_connections 2023-11-24T06:15:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.987+0000 7fdca96c2640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc8406b080 0x7fdc8406d540 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.987+0000 7fdca96c2640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdca4158420 0x7fdca4155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.987+0000 7fdca96c2640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca41f5f90 0x7fdca4157ee0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.987+0000 7fdca96c2640 1 --2- 172.21.15.22:0/672226676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc90004d00 0x7fdca41f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.987+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 >> 172.21.15.22:0/672226676 conn(0x7fdca406a860 msgr2=0x7fdca4159e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:33.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.987+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 shutdown_connections 2023-11-24T06:15:33.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:33.987+0000 7fdca96c2640 1 -- 172.21.15.22:0/672226676 wait complete. 2023-11-24T06:15:34.009 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:34.244 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":36.067527714000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.241994666213795,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:34.244 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.241994666213795 }, "state": "open", "uptime": 36.067527714 } ] 2023-11-24T06:15:34.244 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:39.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:39.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.481+0000 7f05f093e640 1 Processor -- start 2023-11-24T06:15:39.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.481+0000 7f05f093e640 1 -- start start 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.483+0000 7f05f093e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec06d520 0x7f05ec06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.483+0000 7f05f093e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05ec0ad720 0x7f05ec15ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.483+0000 7f05f093e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec15c360 con 0x7f05ec0abff0 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.483+0000 7f05f093e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec0b41a0 con 0x7f05ec0ad720 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.483+0000 7f05f093e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec06de40 con 0x7f05ec06d520 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.483+0000 7f05e9d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05ec0ad720 0x7f05ec15ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.483+0000 7f05e9d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05ec0ad720 0x7f05ec15ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42622/0 (socket says 172.21.15.22:42622) 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.483+0000 7f05e9d9b640 1 -- 172.21.15.22:0/3446265314 learned_addr learned my addr 172.21.15.22:0/3446265314 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.484+0000 7f05ea59c640 1 --2- 172.21.15.22:0/3446265314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec06d520 0x7f05ec06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.484+0000 7f05e9d9b640 1 -- 172.21.15.22:0/3446265314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec06d520 msgr2=0x7f05ec06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:39.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.484+0000 7f05e9d9b640 1 --2- 172.21.15.22:0/3446265314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec06d520 0x7f05ec06d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.484+0000 7f05e9d9b640 1 -- 172.21.15.22:0/3446265314 >> v1:172.21.15.31:6789/0 conn(0x7f05ec0abff0 legacy=0x7f05ec15f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:39.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.484+0000 7f05e9d9b640 1 -- 172.21.15.22:0/3446265314 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec15ba30 con 0x7f05ec0ad720 2023-11-24T06:15:39.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.484+0000 7f05ea59c640 1 --2- 172.21.15.22:0/3446265314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec06d520 0x7f05ec06d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:39.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.485+0000 7f05e9d9b640 1 --2- 172.21.15.22:0/3446265314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec0ad720 0x7f05ec15ecd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009870 tx=0x7f05e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6b6ea87cb19654 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:39.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.485+0000 7f05e959a640 1 -- 172.21.15.22:0/3446265314 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0031640 con 0x7f05ec0ad720 2023-11-24T06:15:39.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05e959a640 1 -- 172.21.15.22:0/3446265314 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e00317a0 con 0x7f05ec0ad720 2023-11-24T06:15:39.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05e959a640 1 -- 172.21.15.22:0/3446265314 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0031b30 con 0x7f05ec0ad720 2023-11-24T06:15:39.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05f093e640 1 -- 172.21.15.22:0/3446265314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec0ad720 msgr2=0x7f05ec15ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05f093e640 1 --2- 172.21.15.22:0/3446265314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec0ad720 0x7f05ec15ecd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009870 tx=0x7f05e002b8f0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05f093e640 1 -- 172.21.15.22:0/3446265314 shutdown_connections 2023-11-24T06:15:39.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05f093e640 1 --2- 172.21.15.22:0/3446265314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec0ad720 0x7f05ec15ecd0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05f093e640 1 --2- 172.21.15.22:0/3446265314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec06d520 0x7f05ec06d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05f093e640 1 -- 172.21.15.22:0/3446265314 >> 172.21.15.22:0/3446265314 conn(0x7f05ec0b0d80 msgr2=0x7f05ec0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:39.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05f093e640 1 -- 172.21.15.22:0/3446265314 shutdown_connections 2023-11-24T06:15:39.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.486+0000 7f05f093e640 1 -- 172.21.15.22:0/3446265314 wait complete. 2023-11-24T06:15:39.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.488+0000 7f05f093e640 1 Processor -- start 2023-11-24T06:15:39.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.488+0000 7f05f093e640 1 -- start start 2023-11-24T06:15:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.489+0000 7f05f093e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec06d520 0x7f05ec14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.489+0000 7f05f093e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec0abff0 0x7f05ec0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.489+0000 7f05f093e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec0ad720 0x7f05ec0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.489+0000 7f05f093e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0cc970 con 0x7f05ec06d520 2023-11-24T06:15:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.489+0000 7f05f093e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec14b830 con 0x7f05ec0ad720 2023-11-24T06:15:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.489+0000 7f05f093e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0709f0 con 0x7f05ec0abff0 2023-11-24T06:15:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec06d520 0x7f05ec14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec06d520 0x7f05ec14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42638/0 (socket says 172.21.15.22:42638) 2023-11-24T06:15:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ea59c640 1 -- 172.21.15.22:0/3528055386 learned_addr learned my addr 172.21.15.22:0/3528055386 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05e9d9b640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec0abff0 0x7f05ec0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ead9d640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec0ad720 0x7f05ec0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ea59c640 1 -- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec0abff0 msgr2=0x7f05ec0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ea59c640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec0abff0 0x7f05ec0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ea59c640 1 -- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec0ad720 msgr2=0x7f05ec0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ea59c640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec0ad720 0x7f05ec0cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ea59c640 1 -- 172.21.15.22:0/3528055386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00094d0 con 0x7f05ec06d520 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05e9d9b640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec0abff0 0x7f05ec0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ead9d640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec0ad720 0x7f05ec0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.490+0000 7f05ea59c640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec06d520 0x7f05ec14b2f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00c7f0 tx=0x7f05dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.491+0000 7f05daffd640 1 -- 172.21.15.22:0/3528055386 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc007a30 con 0x7f05ec06d520 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.491+0000 7f05daffd640 1 -- 172.21.15.22:0/3528055386 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc007b90 con 0x7f05ec06d520 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.491+0000 7f05daffd640 1 -- 172.21.15.22:0/3528055386 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc00ce40 con 0x7f05ec06d520 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.491+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ec0cc3b0 con 0x7f05ec06d520 2023-11-24T06:15:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.491+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec0ccdb0 con 0x7f05ec06d520 2023-11-24T06:15:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.492+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec15b6a0 con 0x7f05ec06d520 2023-11-24T06:15:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.493+0000 7f05daffd640 1 -- 172.21.15.22:0/3528055386 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f05dc0113f0 con 0x7f05ec06d520 2023-11-24T06:15:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.494+0000 7f05daffd640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f05cc06b080 0x7f05cc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.494+0000 7f05daffd640 1 -- 172.21.15.22:0/3528055386 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f05dc089d90 con 0x7f05ec06d520 2023-11-24T06:15:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.494+0000 7f05e9d9b640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f05cc06b080 0x7f05cc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.495+0000 7f05e9d9b640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f05cc06b080 0x7f05cc06d540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f05e0036000 tx=0x7f05e003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.499+0000 7f05daffd640 1 -- 172.21.15.22:0/3528055386 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05dc054980 con 0x7f05ec06d520 2023-11-24T06:15:39.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.731+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05ec074770 con 0x7f05ec06d520 2023-11-24T06:15:39.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.733+0000 7f05daffd640 1 -- 172.21.15.22:0/3528055386 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f05dc01f090 con 0x7f05ec06d520 2023-11-24T06:15:39.736 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:39.736 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:39.736 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:39.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.735+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f05cc06b080 msgr2=0x7f05cc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.735+0000 7f05f093e640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f05cc06b080 0x7f05cc06d540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f05e0036000 tx=0x7f05e003c040 comp rx=0 tx=0).stop 2023-11-24T06:15:39.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.735+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec06d520 msgr2=0x7f05ec14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.735+0000 7f05f093e640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec06d520 0x7f05ec14b2f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00c7f0 tx=0x7f05dc00cbf0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.736+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 shutdown_connections 2023-11-24T06:15:39.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.736+0000 7f05f093e640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f05cc06b080 0x7f05cc06d540 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.736+0000 7f05f093e640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05ec0ad720 0x7f05ec0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.736+0000 7f05f093e640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05ec0abff0 0x7f05ec0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.736+0000 7f05f093e640 1 --2- 172.21.15.22:0/3528055386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05ec06d520 0x7f05ec14b2f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.736+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 >> 172.21.15.22:0/3528055386 conn(0x7f05ec0b0d80 msgr2=0x7f05ec0afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:39.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.736+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 shutdown_connections 2023-11-24T06:15:39.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:39.736+0000 7f05f093e640 1 -- 172.21.15.22:0/3528055386 wait complete. 2023-11-24T06:15:39.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:39.991 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":41.815452469999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.974947515445116,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:39.992 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.974947515445116 }, "state": "open", "uptime": 41.81545247 } ] 2023-11-24T06:15:39.992 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:44.992 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:45.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.227+0000 7f1f89413640 1 Processor -- start 2023-11-24T06:15:45.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.227+0000 7f1f89413640 1 -- start start 2023-11-24T06:15:45.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.229+0000 7f1f89413640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f84143570 0x7f1f840cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.229+0000 7f1f89413640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f84071700 con 0x7f1f8415e6b0 2023-11-24T06:15:45.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.229+0000 7f1f89413640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8415b410 con 0x7f1f84143950 2023-11-24T06:15:45.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.229+0000 7f1f89413640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8415b130 con 0x7f1f84143570 2023-11-24T06:15:45.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.229+0000 7f1f83fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f84143570 0x7f1f840cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.229+0000 7f1f83fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f84143570 0x7f1f840cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57662/0 (socket says 172.21.15.22:57662) 2023-11-24T06:15:45.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.229+0000 7f1f83fff640 1 -- 172.21.15.22:0/2596497167 learned_addr learned my addr 172.21.15.22:0/2596497167 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:45.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.229+0000 7f1f88c12640 1 --1- 172.21.15.22:0/2596497167 >> v1:172.21.15.22:6789/0 conn(0x7f1f8415e6b0 0x7f1f840b1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47042/0 (socket says 172.21.15.22:47042) 2023-11-24T06:15:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.230+0000 7f1f82ffd640 1 -- 172.21.15.22:0/2596497167 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380149980 0 0) 0x7f1f7c001110 con 0x7f1f8415e6b0 2023-11-24T06:15:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.230+0000 7f1f82ffd640 1 -- 172.21.15.22:0/2596497167 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f70003520 con 0x7f1f8415e6b0 2023-11-24T06:15:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.230+0000 7f1f83fff640 1 -- 172.21.15.22:0/2596497167 >> v1:172.21.15.31:6789/0 conn(0x7f1f84143950 legacy=0x7f1f8415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.230+0000 7f1f83fff640 1 -- 172.21.15.22:0/2596497167 >> v1:172.21.15.22:6789/0 conn(0x7f1f8415e6b0 legacy=0x7f1f840b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.230+0000 7f1f83fff640 1 -- 172.21.15.22:0/2596497167 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8415dbd0 con 0x7f1f84143570 2023-11-24T06:15:45.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.231+0000 7f1f83fff640 1 --2- 172.21.15.22:0/2596497167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 0x7f1f840cf050 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009870 tx=0x7f1f7402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ceb497aa2b0778 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:45.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.231+0000 7f1f82ffd640 1 -- 172.21.15.22:0/2596497167 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74030860 con 0x7f1f84143570 2023-11-24T06:15:45.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.231+0000 7f1f82ffd640 1 -- 172.21.15.22:0/2596497167 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f740309c0 con 0x7f1f84143570 2023-11-24T06:15:45.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.231+0000 7f1f82ffd640 1 -- 172.21.15.22:0/2596497167 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74030d50 con 0x7f1f84143570 2023-11-24T06:15:45.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.232+0000 7f1f89413640 1 -- 172.21.15.22:0/2596497167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 msgr2=0x7f1f840cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.232+0000 7f1f89413640 1 --2- 172.21.15.22:0/2596497167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 0x7f1f840cf050 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009870 tx=0x7f1f7402b9a0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.232+0000 7f1f89413640 1 -- 172.21.15.22:0/2596497167 shutdown_connections 2023-11-24T06:15:45.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.232+0000 7f1f89413640 1 --2- 172.21.15.22:0/2596497167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 0x7f1f840cf050 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.232+0000 7f1f89413640 1 -- 172.21.15.22:0/2596497167 >> 172.21.15.22:0/2596497167 conn(0x7f1f8406a860 msgr2=0x7f1f8406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:45.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.232+0000 7f1f89413640 1 -- 172.21.15.22:0/2596497167 shutdown_connections 2023-11-24T06:15:45.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.232+0000 7f1f89413640 1 -- 172.21.15.22:0/2596497167 wait complete. 2023-11-24T06:15:45.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.234+0000 7f1f89413640 1 Processor -- start 2023-11-24T06:15:45.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.234+0000 7f1f89413640 1 -- start start 2023-11-24T06:15:45.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.235+0000 7f1f89413640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 0x7f1f84159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.235+0000 7f1f89413640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f84143950 0x7f1f84158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.235+0000 7f1f89413640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f8415e6b0 0x7f1f840b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.235+0000 7f1f89413640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84158ec0 con 0x7f1f84143570 2023-11-24T06:15:45.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.235+0000 7f1f89413640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c8e20 con 0x7f1f84143950 2023-11-24T06:15:45.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.235+0000 7f1f89413640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c9100 con 0x7f1f8415e6b0 2023-11-24T06:15:45.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.235+0000 7f1f83fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 0x7f1f84159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.235+0000 7f1f83fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 0x7f1f84159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57668/0 (socket says 172.21.15.22:57668) 2023-11-24T06:15:45.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.235+0000 7f1f83fff640 1 -- 172.21.15.22:0/608685821 learned_addr learned my addr 172.21.15.22:0/608685821 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:45.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f83fff640 1 -- 172.21.15.22:0/608685821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f8415e6b0 msgr2=0x7f1f840b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f83fff640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f8415e6b0 0x7f1f840b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f83fff640 1 -- 172.21.15.22:0/608685821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f84143950 msgr2=0x7f1f84158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f83fff640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f84143950 0x7f1f84158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f83fff640 1 -- 172.21.15.22:0/608685821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f740094d0 con 0x7f1f84143570 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f83fff640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 0x7f1f84159b40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1f74000c00 tx=0x7f1f74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f80ff9640 1 -- 172.21.15.22:0/608685821 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74039c90 con 0x7f1f84143570 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f80ff9640 1 -- 172.21.15.22:0/608685821 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f74039df0 con 0x7f1f84143570 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f80ff9640 1 -- 172.21.15.22:0/608685821 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74043640 con 0x7f1f84143570 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.236+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f840c93e0 con 0x7f1f84143570 2023-11-24T06:15:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.237+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f84159830 con 0x7f1f84143570 2023-11-24T06:15:45.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.238+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f840c9900 con 0x7f1f84143570 2023-11-24T06:15:45.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.239+0000 7f1f80ff9640 1 -- 172.21.15.22:0/608685821 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f1f740437a0 con 0x7f1f84143570 2023-11-24T06:15:45.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.240+0000 7f1f80ff9640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f6406b080 0x7f1f6406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.240+0000 7f1f80ff9640 1 -- 172.21.15.22:0/608685821 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1f7403e070 con 0x7f1f84143570 2023-11-24T06:15:45.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.240+0000 7f1f837fe640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f6406b080 0x7f1f6406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.241+0000 7f1f837fe640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f6406b080 0x7f1f6406d540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1f84140010 tx=0x7f1f6c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.245+0000 7f1f80ff9640 1 -- 172.21.15.22:0/608685821 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f74077880 con 0x7f1f84143570 2023-11-24T06:15:45.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.474+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f8404e840 con 0x7f1f84143570 2023-11-24T06:15:45.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.476+0000 7f1f80ff9640 1 -- 172.21.15.22:0/608685821 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f1f74034090 con 0x7f1f84143570 2023-11-24T06:15:45.479 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:45.479 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:45.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.478+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f6406b080 msgr2=0x7f1f6406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.478+0000 7f1f89413640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f6406b080 0x7f1f6406d540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1f84140010 tx=0x7f1f6c007d30 comp rx=0 tx=0).stop 2023-11-24T06:15:45.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.478+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 msgr2=0x7f1f84159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.478+0000 7f1f89413640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 0x7f1f84159b40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1f74000c00 tx=0x7f1f74004730 comp rx=0 tx=0).stop 2023-11-24T06:15:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.479+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 shutdown_connections 2023-11-24T06:15:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.479+0000 7f1f89413640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1f6406b080 0x7f1f6406d540 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.479+0000 7f1f89413640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1f8415e6b0 0x7f1f840b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.479+0000 7f1f89413640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f84143950 0x7f1f84158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.479+0000 7f1f89413640 1 --2- 172.21.15.22:0/608685821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f84143570 0x7f1f84159b40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.479+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 >> 172.21.15.22:0/608685821 conn(0x7f1f8406a860 msgr2=0x7f1f840cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.479+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 shutdown_connections 2023-11-24T06:15:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:45.479+0000 7f1f89413640 1 -- 172.21.15.22:0/608685821 wait complete. 2023-11-24T06:15:45.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:45.733 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":47.559377275999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.711605616175344,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:45.734 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.711605616175344 }, "state": "open", "uptime": 47.559377276 } ] 2023-11-24T06:15:45.734 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:50.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:50.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.968+0000 7fd3fb2e1640 1 Processor -- start 2023-11-24T06:15:50.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.968+0000 7fd3fb2e1640 1 -- start start 2023-11-24T06:15:50.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.970+0000 7fd3fb2e1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3f413dfd0 0x7fd3f415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.970+0000 7fd3fb2e1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 0x7fd3f406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.970+0000 7fd3fb2e1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f40ce7c0 con 0x7fd3f40cf050 2023-11-24T06:15:50.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.970+0000 7fd3fb2e1640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f4140900 con 0x7fd3f413dfd0 2023-11-24T06:15:50.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.970+0000 7fd3fb2e1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f415fa70 con 0x7fd3f40cf500 2023-11-24T06:15:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.970+0000 7fd3fa2df640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3f413dfd0 0x7fd3f415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.971+0000 7fd3fa2df640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3f413dfd0 0x7fd3f415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34324/0 (socket says 172.21.15.22:34324) 2023-11-24T06:15:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.971+0000 7fd3fa2df640 1 -- 172.21.15.22:0/590656567 learned_addr learned my addr 172.21.15.22:0/590656567 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.971+0000 7fd3faae0640 1 --2- 172.21.15.22:0/590656567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 0x7fd3f406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.971+0000 7fd3fa2df640 1 -- 172.21.15.22:0/590656567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 msgr2=0x7fd3f406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.971+0000 7fd3fa2df640 1 --2- 172.21.15.22:0/590656567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 0x7fd3f406c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.971+0000 7fd3fa2df640 1 -- 172.21.15.22:0/590656567 >> v1:172.21.15.31:6789/0 conn(0x7fd3f40cf050 legacy=0x7fd3f406c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.971+0000 7fd3fa2df640 1 -- 172.21.15.22:0/590656567 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f40cf950 con 0x7fd3f413dfd0 2023-11-24T06:15:50.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.973+0000 7fd3fa2df640 1 --2- 172.21.15.22:0/590656567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 0x7fd3f415be70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40cfc10 tx=0x7fd3f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab37be2f047453f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:50.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.973+0000 7fd3f92dd640 1 -- 172.21.15.22:0/590656567 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0031830 con 0x7fd3f413dfd0 2023-11-24T06:15:50.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3f92dd640 1 -- 172.21.15.22:0/590656567 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f0031990 con 0x7fd3f413dfd0 2023-11-24T06:15:50.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3f92dd640 1 -- 172.21.15.22:0/590656567 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0031d20 con 0x7fd3f413dfd0 2023-11-24T06:15:50.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/590656567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 msgr2=0x7fd3f415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:50.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3fb2e1640 1 --2- 172.21.15.22:0/590656567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 0x7fd3f415be70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40cfc10 tx=0x7fd3f002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/590656567 shutdown_connections 2023-11-24T06:15:50.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3fb2e1640 1 --2- 172.21.15.22:0/590656567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 0x7fd3f406c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3fb2e1640 1 --2- 172.21.15.22:0/590656567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 0x7fd3f415be70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/590656567 >> 172.21.15.22:0/590656567 conn(0x7fd3f406a860 msgr2=0x7fd3f406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:50.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/590656567 shutdown_connections 2023-11-24T06:15:50.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.974+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/590656567 wait complete. 2023-11-24T06:15:50.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.976+0000 7fd3fb2e1640 1 Processor -- start 2023-11-24T06:15:50.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.976+0000 7fd3fb2e1640 1 -- start start 2023-11-24T06:15:50.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.977+0000 7fd3fb2e1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40cf050 0x7fd3f4139850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.977+0000 7fd3fb2e1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 0x7fd3f40b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.977+0000 7fd3fb2e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 0x7fd3f41f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.977+0000 7fd3fb2e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40b1dd0 con 0x7fd3f413dfd0 2023-11-24T06:15:50.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.977+0000 7fd3fb2e1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40b30d0 con 0x7fd3f40cf050 2023-11-24T06:15:50.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.977+0000 7fd3fb2e1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40b2030 con 0x7fd3f40cf500 2023-11-24T06:15:50.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3faae0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 0x7fd3f41f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3faae0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 0x7fd3f41f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34330/0 (socket says 172.21.15.22:34330) 2023-11-24T06:15:50.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3faae0640 1 -- 172.21.15.22:0/2321462687 learned_addr learned my addr 172.21.15.22:0/2321462687 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:50.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3f9ade640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 0x7fd3f40b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3fa2df640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40cf050 0x7fd3f4139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3faae0640 1 -- 172.21.15.22:0/2321462687 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 msgr2=0x7fd3f40b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:50.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3faae0640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 0x7fd3f40b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3faae0640 1 -- 172.21.15.22:0/2321462687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40cf050 msgr2=0x7fd3f4139850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:50.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3faae0640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40cf050 0x7fd3f4139850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3faae0640 1 -- 172.21.15.22:0/2321462687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00094d0 con 0x7fd3f413dfd0 2023-11-24T06:15:50.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.978+0000 7fd3faae0640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 0x7fd3f41f2670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec007e40 tx=0x7fd3ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:50.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.979+0000 7fd3eaffd640 1 -- 172.21.15.22:0/2321462687 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec014620 con 0x7fd3f413dfd0 2023-11-24T06:15:50.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.979+0000 7fd3eaffd640 1 -- 172.21.15.22:0/2321462687 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec00ee90 con 0x7fd3f413dfd0 2023-11-24T06:15:50.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.979+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f40b2310 con 0x7fd3f413dfd0 2023-11-24T06:15:50.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.979+0000 7fd3eaffd640 1 -- 172.21.15.22:0/2321462687 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec0149e0 con 0x7fd3f413dfd0 2023-11-24T06:15:50.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.979+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f40b28d0 con 0x7fd3f413dfd0 2023-11-24T06:15:50.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.980+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f404e840 con 0x7fd3f413dfd0 2023-11-24T06:15:50.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.981+0000 7fd3eaffd640 1 -- 172.21.15.22:0/2321462687 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fd3ec014b40 con 0x7fd3f413dfd0 2023-11-24T06:15:50.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.982+0000 7fd3eaffd640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3d806b080 0x7fd3d806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.982+0000 7fd3eaffd640 1 -- 172.21.15.22:0/2321462687 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd3ec08a340 con 0x7fd3f413dfd0 2023-11-24T06:15:50.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.983+0000 7fd3fa2df640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3d806b080 0x7fd3d806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.983+0000 7fd3fa2df640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3d806b080 0x7fd3d806d540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0036000 tx=0x7fd3f003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:50.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:50.987+0000 7fd3eaffd640 1 -- 172.21.15.22:0/2321462687 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3ec0551b0 con 0x7fd3f413dfd0 2023-11-24T06:15:51.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.223+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3f40ce9a0 con 0x7fd3f413dfd0 2023-11-24T06:15:51.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.224+0000 7fd3eaffd640 1 -- 172.21.15.22:0/2321462687 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fd3ec0587d0 con 0x7fd3f413dfd0 2023-11-24T06:15:51.227 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:51.227 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:51.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.227+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3d806b080 msgr2=0x7fd3d806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:51.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.227+0000 7fd3fb2e1640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3d806b080 0x7fd3d806d540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0036000 tx=0x7fd3f003c040 comp rx=0 tx=0).stop 2023-11-24T06:15:51.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 msgr2=0x7fd3f41f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:51.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 0x7fd3f41f2670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec007e40 tx=0x7fd3ec00e4b0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 shutdown_connections 2023-11-24T06:15:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd3d806b080 0x7fd3d806d540 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f413dfd0 0x7fd3f41f2670 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f40cf500 0x7fd3f40b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 --2- 172.21.15.22:0/2321462687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40cf050 0x7fd3f4139850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 >> 172.21.15.22:0/2321462687 conn(0x7fd3f406a860 msgr2=0x7fd3f41598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 shutdown_connections 2023-11-24T06:15:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:51.228+0000 7fd3fb2e1640 1 -- 172.21.15.22:0/2321462687 wait complete. 2023-11-24T06:15:51.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:51.503 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":53.326301782999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.45070186426215,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:51.503 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.45070186426215 }, "state": "open", "uptime": 53.326301783 } ] 2023-11-24T06:15:51.504 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:15:51.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:51.636 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:56.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:56.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.737+0000 7f2701541640 1 Processor -- start 2023-11-24T06:15:56.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.737+0000 7f2701541640 1 -- start start 2023-11-24T06:15:56.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.739+0000 7f2701541640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26fc0ad720 0x7f26fc0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.739+0000 7f2701541640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26fc0abff0 0x7f26fc0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.739+0000 7f2701541640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26fc15c360 con 0x7f26fc06d520 2023-11-24T06:15:56.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.739+0000 7f2701541640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26fc0b41a0 con 0x7f26fc0ad720 2023-11-24T06:15:56.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.739+0000 7f2701541640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc15ba30 con 0x7f26fc0abff0 2023-11-24T06:15:56.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.739+0000 7f26fa7fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26fc0ad720 0x7f26fc0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.739+0000 7f26fa7fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26fc0ad720 0x7f26fc0b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34336/0 (socket says 172.21.15.22:34336) 2023-11-24T06:15:56.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.739+0000 7f26fa7fc640 1 -- 172.21.15.22:0/130645157 learned_addr learned my addr 172.21.15.22:0/130645157 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:56.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.739+0000 7f26fb7fe640 1 --2- 172.21.15.22:0/130645157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26fc0abff0 0x7f26fc0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.740+0000 7f26fa7fc640 1 -- 172.21.15.22:0/130645157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26fc0abff0 msgr2=0x7f26fc0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:56.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.740+0000 7f26fa7fc640 1 --2- 172.21.15.22:0/130645157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26fc0abff0 0x7f26fc0b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.740+0000 7f26fa7fc640 1 -- 172.21.15.22:0/130645157 >> v1:172.21.15.31:6789/0 conn(0x7f26fc06d520 legacy=0x7f26fc06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.740+0000 7f26fa7fc640 1 -- 172.21.15.22:0/130645157 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc15bd10 con 0x7f26fc0ad720 2023-11-24T06:15:56.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.741+0000 7f26fa7fc640 1 --2- 172.21.15.22:0/130645157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc0ad720 0x7f26fc0b2080 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009870 tx=0x7f26e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5c27d2f9085410 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:56.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.742+0000 7f26f9ffb640 1 -- 172.21.15.22:0/130645157 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4030840 con 0x7f26fc0ad720 2023-11-24T06:15:56.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.742+0000 7f26f9ffb640 1 -- 172.21.15.22:0/130645157 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e40309a0 con 0x7f26fc0ad720 2023-11-24T06:15:56.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.742+0000 7f26f9ffb640 1 -- 172.21.15.22:0/130645157 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4030d30 con 0x7f26fc0ad720 2023-11-24T06:15:56.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.742+0000 7f2701541640 1 -- 172.21.15.22:0/130645157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc0ad720 msgr2=0x7f26fc0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.742+0000 7f2701541640 1 --2- 172.21.15.22:0/130645157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc0ad720 0x7f26fc0b2080 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009870 tx=0x7f26e402b980 comp rx=0 tx=0).stop 2023-11-24T06:15:56.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.743+0000 7f2701541640 1 -- 172.21.15.22:0/130645157 shutdown_connections 2023-11-24T06:15:56.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.743+0000 7f2701541640 1 --2- 172.21.15.22:0/130645157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26fc0abff0 0x7f26fc0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.743+0000 7f2701541640 1 --2- 172.21.15.22:0/130645157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc0ad720 0x7f26fc0b2080 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.743+0000 7f2701541640 1 -- 172.21.15.22:0/130645157 >> 172.21.15.22:0/130645157 conn(0x7f26fc0b0d80 msgr2=0x7f26fc0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:56.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.743+0000 7f2701541640 1 -- 172.21.15.22:0/130645157 shutdown_connections 2023-11-24T06:15:56.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.743+0000 7f2701541640 1 -- 172.21.15.22:0/130645157 wait complete. 2023-11-24T06:15:56.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.745+0000 7f2701541640 1 Processor -- start 2023-11-24T06:15:56.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.745+0000 7f2701541640 1 -- start start 2023-11-24T06:15:56.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.746+0000 7f2701541640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc06d520 0x7f26fc151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.746+0000 7f2701541640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26fc0abff0 0x7f26fc15e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.746+0000 7f2701541640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26fc0ad720 0x7f26fc071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.746+0000 7f2701541640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc14ac20 con 0x7f26fc06d520 2023-11-24T06:15:56.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.746+0000 7f2701541640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc15b110 con 0x7f26fc0abff0 2023-11-24T06:15:56.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.746+0000 7f2701541640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc152450 con 0x7f26fc0ad720 2023-11-24T06:15:56.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.746+0000 7f26faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc06d520 0x7f26fc151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.746+0000 7f26faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc06d520 0x7f26fc151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34342/0 (socket says 172.21.15.22:34342) 2023-11-24T06:15:56.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.746+0000 7f26faffd640 1 -- 172.21.15.22:0/667082834 learned_addr learned my addr 172.21.15.22:0/667082834 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:15:56.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26faffd640 1 -- 172.21.15.22:0/667082834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26fc0ad720 msgr2=0x7f26fc071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26faffd640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26fc0ad720 0x7f26fc071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26faffd640 1 -- 172.21.15.22:0/667082834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26fc0abff0 msgr2=0x7f26fc15e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26fa7fc640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26fc0abff0 0x7f26fc15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26faffd640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26fc0abff0 0x7f26fc15e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26faffd640 1 -- 172.21.15.22:0/667082834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e40094d0 con 0x7f26fc06d520 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26fa7fc640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26fc0abff0 0x7f26fc15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26faffd640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc06d520 0x7f26fc151f10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00c8a0 tx=0x7f26ec00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26f37fe640 1 -- 172.21.15.22:0/667082834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec003b70 con 0x7f26fc06d520 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26f37fe640 1 -- 172.21.15.22:0/667082834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec003cf0 con 0x7f26fc06d520 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc15e6b0 con 0x7f26fc06d520 2023-11-24T06:15:56.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f26f37fe640 1 -- 172.21.15.22:0/667082834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00aa90 con 0x7f26fc06d520 2023-11-24T06:15:56.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.747+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc15a870 con 0x7f26fc06d520 2023-11-24T06:15:56.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.749+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26fc0b34f0 con 0x7f26fc06d520 2023-11-24T06:15:56.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.750+0000 7f26f37fe640 1 -- 172.21.15.22:0/667082834 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f26ec00abf0 con 0x7f26fc06d520 2023-11-24T06:15:56.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.750+0000 7f26f37fe640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f26dc06b080 0x7f26dc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.751+0000 7f26f37fe640 1 -- 172.21.15.22:0/667082834 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f26ec089920 con 0x7f26fc06d520 2023-11-24T06:15:56.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.751+0000 7f26fa7fc640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f26dc06b080 0x7f26dc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.752+0000 7f26fa7fc640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f26dc06b080 0x7f26dc06d540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f26e4036000 tx=0x7f26e403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:56.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.755+0000 7f26f37fe640 1 -- 172.21.15.22:0/667082834 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26ec054620 con 0x7f26fc06d520 2023-11-24T06:15:56.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.984+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26fc0ae6d0 con 0x7f26fc06d520 2023-11-24T06:15:56.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.986+0000 7f26f37fe640 1 -- 172.21.15.22:0/667082834 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f26ec003e60 con 0x7f26fc06d520 2023-11-24T06:15:56.989 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:15:56.989 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:15:56.989 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:15:56.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f26dc06b080 msgr2=0x7f26dc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f26dc06b080 0x7f26dc06d540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f26e4036000 tx=0x7f26e403b040 comp rx=0 tx=0).stop 2023-11-24T06:15:56.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc06d520 msgr2=0x7f26fc151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc06d520 0x7f26fc151f10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00c8a0 tx=0x7f26ec00cd60 comp rx=0 tx=0).stop 2023-11-24T06:15:56.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 shutdown_connections 2023-11-24T06:15:56.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f26dc06b080 0x7f26dc06d540 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f26fc0ad720 0x7f26fc071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26fc0abff0 0x7f26fc15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 --2- 172.21.15.22:0/667082834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc06d520 0x7f26fc151f10 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 >> 172.21.15.22:0/667082834 conn(0x7f26fc0b0d80 msgr2=0x7f26fc0afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:56.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.988+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 shutdown_connections 2023-11-24T06:15:56.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:15:56.989+0000 7f2701541640 1 -- 172.21.15.22:0/667082834 wait complete. 2023-11-24T06:15:57.009 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:15:57.249 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":59.071226576999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.19422706711477,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:15:57.249 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.19422706711477 }, "state": "open", "uptime": 59.071226577 } ] 2023-11-24T06:15:57.250 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:16:02.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:02.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.487+0000 7f3914f35640 1 Processor -- start 2023-11-24T06:16:02.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.487+0000 7f3914f35640 1 -- start start 2023-11-24T06:16:02.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.488+0000 7f3914f35640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3910143570 0x7f39100cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.488+0000 7f3914f35640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143950 0x7f39100cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f3914f35640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3910071700 con 0x7f391015e6b0 2023-11-24T06:16:02.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f3914f35640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391015b410 con 0x7f3910143570 2023-11-24T06:16:02.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f3914f35640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391015b130 con 0x7f3910143950 2023-11-24T06:16:02.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f390f7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3910143570 0x7f39100cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f390ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f391015e6b0 0x7f391015a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48776/0 (socket says 172.21.15.22:48776) 2023-11-24T06:16:02.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f390ffff640 1 -- 172.21.15.22:0/4157196355 learned_addr learned my addr 172.21.15.22:0/4157196355 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:02.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f390effd640 1 --2- 172.21.15.22:0/4157196355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143950 0x7f39100cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f390f7fe640 1 -- 172.21.15.22:0/4157196355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143950 msgr2=0x7f39100cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:02.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f390f7fe640 1 --2- 172.21.15.22:0/4157196355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143950 0x7f39100cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f390f7fe640 1 -- 172.21.15.22:0/4157196355 >> v1:172.21.15.22:6789/0 conn(0x7f391015e6b0 legacy=0x7f391015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.490+0000 7f390f7fe640 1 -- 172.21.15.22:0/4157196355 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391015dbd0 con 0x7f3910143570 2023-11-24T06:16:02.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.489+0000 7f390e7fc640 1 -- 172.21.15.22:0/4157196355 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978822697 0 0) 0x7f3908001110 con 0x7f391015e6b0 2023-11-24T06:16:02.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.490+0000 7f390effd640 1 --2- 172.21.15.22:0/4157196355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143950 0x7f39100cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:02.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.491+0000 7f390f7fe640 1 --2- 172.21.15.22:0/4157196355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143570 0x7f39100cf050 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3900009d90 tx=0x7f390002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f95dd00b19e8a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:02.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.491+0000 7f390e7fc640 1 -- 172.21.15.22:0/4157196355 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390002cbc0 con 0x7f3910143570 2023-11-24T06:16:02.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.491+0000 7f390e7fc640 1 -- 172.21.15.22:0/4157196355 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390002cd20 con 0x7f3910143570 2023-11-24T06:16:02.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.491+0000 7f390e7fc640 1 -- 172.21.15.22:0/4157196355 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900034660 con 0x7f3910143570 2023-11-24T06:16:02.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.492+0000 7f3914f35640 1 -- 172.21.15.22:0/4157196355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143570 msgr2=0x7f39100cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.492+0000 7f3914f35640 1 --2- 172.21.15.22:0/4157196355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143570 0x7f39100cf050 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3900009d90 tx=0x7f390002be10 comp rx=0 tx=0).stop 2023-11-24T06:16:02.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.492+0000 7f3914f35640 1 -- 172.21.15.22:0/4157196355 shutdown_connections 2023-11-24T06:16:02.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.492+0000 7f3914f35640 1 --2- 172.21.15.22:0/4157196355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143950 0x7f39100cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.492+0000 7f3914f35640 1 --2- 172.21.15.22:0/4157196355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143570 0x7f39100cf050 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.492+0000 7f3914f35640 1 -- 172.21.15.22:0/4157196355 >> 172.21.15.22:0/4157196355 conn(0x7f391006a860 msgr2=0x7f391006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:02.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.492+0000 7f3914f35640 1 -- 172.21.15.22:0/4157196355 shutdown_connections 2023-11-24T06:16:02.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.492+0000 7f3914f35640 1 -- 172.21.15.22:0/4157196355 wait complete. 2023-11-24T06:16:02.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.494+0000 7f3914f35640 1 Processor -- start 2023-11-24T06:16:02.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.494+0000 7f3914f35640 1 -- start start 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.495+0000 7f3914f35640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143570 0x7f3910158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.495+0000 7f3914f35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143950 0x7f39100ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.495+0000 7f3914f35640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f391015e6b0 0x7f39100cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.495+0000 7f3914f35640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39100ca140 con 0x7f3910143950 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.495+0000 7f3914f35640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3910140870 con 0x7f391015e6b0 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.495+0000 7f3914f35640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39100c94c0 con 0x7f3910143570 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.495+0000 7f390effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143950 0x7f39100ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.495+0000 7f390effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143950 0x7f39100ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37340/0 (socket says 172.21.15.22:37340) 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.495+0000 7f390effd640 1 -- 172.21.15.22:0/2631465140 learned_addr learned my addr 172.21.15.22:0/2631465140 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:02.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f390f7fe640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143570 0x7f3910158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f390effd640 1 -- 172.21.15.22:0/2631465140 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143570 msgr2=0x7f3910158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f390effd640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143570 0x7f3910158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f390effd640 1 -- 172.21.15.22:0/2631465140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f391015e6b0 msgr2=0x7f39100cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f390effd640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f391015e6b0 0x7f39100cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f390effd640 1 -- 172.21.15.22:0/2631465140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3900009a70 con 0x7f3910143950 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f390effd640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143950 0x7f39100ca560 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f390400c7c0 tx=0x7f390400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f38f7fff640 1 -- 172.21.15.22:0/2631465140 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904007820 con 0x7f3910143950 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f38f7fff640 1 -- 172.21.15.22:0/2631465140 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904007980 con 0x7f3910143950 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f38f7fff640 1 -- 172.21.15.22:0/2631465140 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904007d10 con 0x7f3910143950 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39100c97a0 con 0x7f3910143950 2023-11-24T06:16:02.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.496+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39100c9d60 con 0x7f3910143950 2023-11-24T06:16:02.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.498+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39100ca280 con 0x7f3910143950 2023-11-24T06:16:02.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.499+0000 7f38f7fff640 1 -- 172.21.15.22:0/2631465140 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f39040113f0 con 0x7f3910143950 2023-11-24T06:16:02.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.500+0000 7f38f7fff640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f38fc06b080 0x7f38fc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.500+0000 7f38f7fff640 1 -- 172.21.15.22:0/2631465140 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3904089c70 con 0x7f3910143950 2023-11-24T06:16:02.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.500+0000 7f390f7fe640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f38fc06b080 0x7f38fc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.501+0000 7f390f7fe640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f38fc06b080 0x7f38fc06d540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3900036000 tx=0x7f3900030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:02.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.505+0000 7f38f7fff640 1 -- 172.21.15.22:0/2631465140 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39100ca280 con 0x7f3910143950 2023-11-24T06:16:02.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.739+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39100ca280 con 0x7f3910143950 2023-11-24T06:16:02.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.741+0000 7f38f7fff640 1 -- 172.21.15.22:0/2631465140 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f39100ca280 con 0x7f3910143950 2023-11-24T06:16:02.744 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:02.744 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:16:02.744 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f38fc06b080 msgr2=0x7f38fc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f38fc06b080 0x7f38fc06d540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3900036000 tx=0x7f3900030000 comp rx=0 tx=0).stop 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143950 msgr2=0x7f39100ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143950 0x7f39100ca560 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f390400c7c0 tx=0x7f390400cc80 comp rx=0 tx=0).stop 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 shutdown_connections 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f38fc06b080 0x7f38fc06d540 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f391015e6b0 0x7f39100cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3910143950 0x7f39100ca560 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 --2- 172.21.15.22:0/2631465140 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3910143570 0x7f3910158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.743+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 >> 172.21.15.22:0/2631465140 conn(0x7f391006a860 msgr2=0x7f39100718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.744+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 shutdown_connections 2023-11-24T06:16:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:02.744+0000 7f3914f35640 1 -- 172.21.15.22:0/2631465140 wait complete. 2023-11-24T06:16:02.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:16:02.998 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":64.822151293000005,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.940871543551573,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:16:02.998 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.940871543551573 }, "state": "open", "uptime": 64.822151293 } ] 2023-11-24T06:16:02.998 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:16:07.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.232+0000 7fc466767640 1 Processor -- start 2023-11-24T06:16:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.232+0000 7fc466767640 1 -- start start 2023-11-24T06:16:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.234+0000 7fc466767640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4600cf500 0x7fc4600cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.234+0000 7fc466767640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc460140900 con 0x7fc46013dfd0 2023-11-24T06:16:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.234+0000 7fc466767640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46015fa70 con 0x7fc4600cf050 2023-11-24T06:16:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.234+0000 7fc466767640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46015c580 con 0x7fc4600cf500 2023-11-24T06:16:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.234+0000 7fc465765640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc46013dfd0 0x7fc46015be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48784/0 (socket says 172.21.15.22:48784) 2023-11-24T06:16:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.234+0000 7fc465765640 1 -- 172.21.15.22:0/1397502412 learned_addr learned my addr 172.21.15.22:0/1397502412 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463335253 0 0) 0x7fc460140900 con 0x7fc46013dfd0 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc44c003520 con 0x7fc46013dfd0 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc465f66640 1 --2- 172.21.15.22:0/1397502412 >> v2:172.21.15.31:3300/0 conn(0x7fc4600cf500 0x7fc4600cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1739749944 0 0) 0x7fc44c003520 con 0x7fc46013dfd0 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 >> v2:172.21.15.31:3300/0 conn(0x7fc4600cf500 msgr2=0x7fc4600cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 --2- 172.21.15.22:0/1397502412 >> v2:172.21.15.31:3300/0 conn(0x7fc4600cf500 0x7fc4600cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 >> v1:172.21.15.31:6789/0 conn(0x7fc4600cf050 legacy=0x7fc4600cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46015ee60 con 0x7fc46013dfd0 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fc45c001670 con 0x7fc46013dfd0 2023-11-24T06:16:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 >> v1:172.21.15.22:6789/0 conn(0x7fc46013dfd0 legacy=0x7fc46015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc44c0039e0 0x7fc44c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc44c0047c0 0x7fc44c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44c0051f0 0x7fc44c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46015c580 con 0x7fc44c0047c0 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c00c150 con 0x7fc44c0051f0 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.235+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c00c310 con 0x7fc44c0039e0 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.236+0000 7fc464f64640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc44c0047c0 0x7fc44c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.236+0000 7fc465765640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc44c0039e0 0x7fc44c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.236+0000 7fc464f64640 1 -- 172.21.15.22:0/1397502412 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc44c0039e0 msgr2=0x7fc44c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.236+0000 7fc464f64640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc44c0039e0 0x7fc44c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.236+0000 7fc464f64640 1 -- 172.21.15.22:0/1397502412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44c0051f0 msgr2=0x7fc44c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.236+0000 7fc464f64640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44c0051f0 0x7fc44c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.236+0000 7fc464f64640 1 -- 172.21.15.22:0/1397502412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c003520 con 0x7fc44c0047c0 2023-11-24T06:16:08.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.236+0000 7fc465f66640 1 -- 172.21.15.22:0/1397502412 reap_dead start 2023-11-24T06:16:08.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.236+0000 7fc465765640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc44c0039e0 0x7fc44c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.237+0000 7fc464f64640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc44c0047c0 0x7fc44c004c40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc450001750 tx=0x7fc44c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119baa433f2015ba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.237+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500052d0 con 0x7fc44c0047c0 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.238+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45002e050 con 0x7fc44c0047c0 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.238+0000 7fc457fff640 1 -- 172.21.15.22:0/1397502412 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450003830 con 0x7fc44c0047c0 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.238+0000 7fc466767640 1 -- 172.21.15.22:0/1397502412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc44c0047c0 msgr2=0x7fc44c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.238+0000 7fc466767640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc44c0047c0 0x7fc44c004c40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc450001750 tx=0x7fc44c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.238+0000 7fc466767640 1 -- 172.21.15.22:0/1397502412 shutdown_connections 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.238+0000 7fc466767640 1 --2- 172.21.15.22:0/1397502412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc44c0047c0 0x7fc44c004c40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.238+0000 7fc466767640 1 -- 172.21.15.22:0/1397502412 >> 172.21.15.22:0/1397502412 conn(0x7fc46006a860 msgr2=0x7fc46006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.238+0000 7fc466767640 1 -- 172.21.15.22:0/1397502412 shutdown_connections 2023-11-24T06:16:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.238+0000 7fc466767640 1 -- 172.21.15.22:0/1397502412 wait complete. 2023-11-24T06:16:08.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.240+0000 7fc466767640 1 Processor -- start 2023-11-24T06:16:08.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.240+0000 7fc466767640 1 -- start start 2023-11-24T06:16:08.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.241+0000 7fc466767640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44c0047c0 0x7fc460155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.241+0000 7fc466767640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc46015e3d0 0x7fc460071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.241+0000 7fc466767640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc46013b810 0x7fc460071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.241+0000 7fc466767640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46015a520 con 0x7fc46013b810 2023-11-24T06:16:08.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.241+0000 7fc466767640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46015ada0 con 0x7fc44c0047c0 2023-11-24T06:16:08.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.241+0000 7fc466767640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46015eb40 con 0x7fc46015e3d0 2023-11-24T06:16:08.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465f66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc46013b810 0x7fc460071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465f66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc46013b810 0x7fc460071660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37358/0 (socket says 172.21.15.22:37358) 2023-11-24T06:16:08.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465f66640 1 -- 172.21.15.22:0/2192108589 learned_addr learned my addr 172.21.15.22:0/2192108589 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:08.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc464f64640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc46015e3d0 0x7fc460071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465765640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44c0047c0 0x7fc460155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465f66640 1 -- 172.21.15.22:0/2192108589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc46015e3d0 msgr2=0x7fc460071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465f66640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc46015e3d0 0x7fc460071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465f66640 1 -- 172.21.15.22:0/2192108589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44c0047c0 msgr2=0x7fc460155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465f66640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44c0047c0 0x7fc460155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465f66640 1 -- 172.21.15.22:0/2192108589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46015e860 con 0x7fc46013b810 2023-11-24T06:16:08.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465765640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44c0047c0 0x7fc460155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:08.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.242+0000 7fc465f66640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc46013b810 0x7fc460071660 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc4600cfd30 tx=0x7fc45800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.243+0000 7fc455ffb640 1 -- 172.21.15.22:0/2192108589 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45800ed90 con 0x7fc46013b810 2023-11-24T06:16:08.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.243+0000 7fc455ffb640 1 -- 172.21.15.22:0/2192108589 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc458014420 con 0x7fc46013b810 2023-11-24T06:16:08.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.243+0000 7fc455ffb640 1 -- 172.21.15.22:0/2192108589 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580147d0 con 0x7fc46013b810 2023-11-24T06:16:08.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.243+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46015a750 con 0x7fc46013b810 2023-11-24T06:16:08.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.243+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46015b230 con 0x7fc46013b810 2023-11-24T06:16:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.244+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46015af10 con 0x7fc46013b810 2023-11-24T06:16:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.245+0000 7fc455ffb640 1 -- 172.21.15.22:0/2192108589 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fc458014930 con 0x7fc46013b810 2023-11-24T06:16:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.246+0000 7fc455ffb640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc44406b080 0x7fc44406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.246+0000 7fc455ffb640 1 -- 172.21.15.22:0/2192108589 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc45808a070 con 0x7fc46013b810 2023-11-24T06:16:08.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.246+0000 7fc465765640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc44406b080 0x7fc44406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.247+0000 7fc465765640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc44406b080 0x7fc44406d540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0017a0 tx=0x7fc45c001470 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.251+0000 7fc455ffb640 1 -- 172.21.15.22:0/2192108589 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc458054db0 con 0x7fc46013b810 2023-11-24T06:16:08.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.480+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc46004e840 con 0x7fc46013b810 2023-11-24T06:16:08.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.481+0000 7fc455ffb640 1 -- 172.21.15.22:0/2192108589 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fc4580583d0 con 0x7fc46013b810 2023-11-24T06:16:08.485 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:16:08.486 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc44406b080 msgr2=0x7fc44406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc44406b080 0x7fc44406d540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0017a0 tx=0x7fc45c001470 comp rx=0 tx=0).stop 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc46013b810 msgr2=0x7fc460071660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc46013b810 0x7fc460071660 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc4600cfd30 tx=0x7fc45800e4b0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 shutdown_connections 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc44406b080 0x7fc44406d540 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc46013b810 0x7fc460071660 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc46015e3d0 0x7fc460071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 --2- 172.21.15.22:0/2192108589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc44c0047c0 0x7fc460155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 >> 172.21.15.22:0/2192108589 conn(0x7fc46006a860 msgr2=0x7fc4600afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:08.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.484+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 shutdown_connections 2023-11-24T06:16:08.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:08.485+0000 7fc466767640 1 -- 172.21.15.22:0/2192108589 wait complete. 2023-11-24T06:16:08.509 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:16:08.754 INFO:teuthology.orchestra.run.smithi022.stdout:[{"id":6159,"entity":{"name":{"type":"client","num":6159},"addr":{"type":"any","addr":"172.21.15.22:0","nonce":4264708692}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":6,"uptime":70.577075957000005,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.690687466506304,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6159 172.21.15.22:0/4264708692","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"y","hostname":"smithi022","pid":"88694","root":"/"}}] 2023-11-24T06:16:08.755 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi022", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88694", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.22:0", "nonce": 4264708692, "type": "any" }, "name": { "num": 6159, "type": "client" } }, "id": 6159, "inst": "client.6159 172.21.15.22:0/4264708692", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.690687466506304 }, "state": "open", "uptime": 70.577075957 } ] 2023-11-24T06:16:08.755 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T06:16:13.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:13.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.986+0000 7fd06759e640 1 Processor -- start 2023-11-24T06:16:13.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.987+0000 7fd06759e640 1 -- start start 2023-11-24T06:16:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.988+0000 7fd06759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 0x7fd06806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.988+0000 7fd06759e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd06815df80 0x7fd068070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.989+0000 7fd06759e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd068161670 con 0x7fd06806d080 2023-11-24T06:16:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.989+0000 7fd06759e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06815e410 con 0x7fd06815df80 2023-11-24T06:16:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.989+0000 7fd06759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06806d500 con 0x7fd068157770 2023-11-24T06:16:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.989+0000 7fd065d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd06806d080 0x7fd06815d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:40294/0 (socket says 172.21.15.22:40294) 2023-11-24T06:16:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.989+0000 7fd065d9b640 1 -- 172.21.15.22:0/786793165 learned_addr learned my addr 172.21.15.22:0/786793165 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.989+0000 7fd06659c640 1 --2- 172.21.15.22:0/786793165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 0x7fd06806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.990+0000 7fd066d9d640 1 --2- 172.21.15.22:0/786793165 >> v2:172.21.15.31:3300/0 conn(0x7fd06815df80 0x7fd068070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.990+0000 7fd06559a640 1 -- 172.21.15.22:0/786793165 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731200750 0 0) 0x7fd068161670 con 0x7fd06806d080 2023-11-24T06:16:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.990+0000 7fd06659c640 1 -- 172.21.15.22:0/786793165 >> v2:172.21.15.31:3300/0 conn(0x7fd06815df80 msgr2=0x7fd068070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.990+0000 7fd06659c640 1 --2- 172.21.15.22:0/786793165 >> v2:172.21.15.31:3300/0 conn(0x7fd06815df80 0x7fd068070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.990+0000 7fd06659c640 1 -- 172.21.15.22:0/786793165 >> v1:172.21.15.31:6789/0 conn(0x7fd06806d080 legacy=0x7fd06815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.990+0000 7fd06659c640 1 -- 172.21.15.22:0/786793165 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06815e610 con 0x7fd068157770 2023-11-24T06:16:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.992+0000 7fd06659c640 1 --2- 172.21.15.22:0/786793165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 0x7fd06806cb40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd058009d90 tx=0x7fd05802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27e1a10afca1da63 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.992+0000 7fd06559a640 1 -- 172.21.15.22:0/786793165 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05802cc60 con 0x7fd068157770 2023-11-24T06:16:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.992+0000 7fd06559a640 1 -- 172.21.15.22:0/786793165 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05802cdc0 con 0x7fd068157770 2023-11-24T06:16:13.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.992+0000 7fd06559a640 1 -- 172.21.15.22:0/786793165 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058034660 con 0x7fd068157770 2023-11-24T06:16:13.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.993+0000 7fd06759e640 1 -- 172.21.15.22:0/786793165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 msgr2=0x7fd06806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.993+0000 7fd06759e640 1 --2- 172.21.15.22:0/786793165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 0x7fd06806cb40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd058009d90 tx=0x7fd05802beb0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.993+0000 7fd06759e640 1 -- 172.21.15.22:0/786793165 shutdown_connections 2023-11-24T06:16:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.993+0000 7fd06759e640 1 --2- 172.21.15.22:0/786793165 >> v2:172.21.15.31:3300/0 conn(0x7fd06815df80 0x7fd068070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.993+0000 7fd06759e640 1 --2- 172.21.15.22:0/786793165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 0x7fd06806cb40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.993+0000 7fd06759e640 1 -- 172.21.15.22:0/786793165 >> 172.21.15.22:0/786793165 conn(0x7fd06806a860 msgr2=0x7fd06806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.993+0000 7fd06759e640 1 -- 172.21.15.22:0/786793165 shutdown_connections 2023-11-24T06:16:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.993+0000 7fd06759e640 1 -- 172.21.15.22:0/786793165 wait complete. 2023-11-24T06:16:13.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.995+0000 7fd06759e640 1 Processor -- start 2023-11-24T06:16:13.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.995+0000 7fd06759e640 1 -- start start 2023-11-24T06:16:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd06759e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06806d080 0x7fd0681f0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd06759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 0x7fd0680b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd06759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd06815df80 0x7fd0680b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd06759e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd068150920 con 0x7fd06815df80 2023-11-24T06:16:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd06759e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680cd6b0 con 0x7fd06806d080 2023-11-24T06:16:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd06759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0681f2ee0 con 0x7fd068157770 2023-11-24T06:16:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd06815df80 0x7fd0680b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd06815df80 0x7fd0680b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56796/0 (socket says 172.21.15.22:56796) 2023-11-24T06:16:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd066d9d640 1 -- 172.21.15.22:0/3498286074 learned_addr learned my addr 172.21.15.22:0/3498286074 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd06659c640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06806d080 0x7fd0681f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.997+0000 7fd065d9b640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 0x7fd0680b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd066d9d640 1 -- 172.21.15.22:0/3498286074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 msgr2=0x7fd0680b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd066d9d640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 0x7fd0680b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd066d9d640 1 -- 172.21.15.22:0/3498286074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06806d080 msgr2=0x7fd0681f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd066d9d640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06806d080 0x7fd0681f0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd066d9d640 1 -- 172.21.15.22:0/3498286074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009a70 con 0x7fd06815df80 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd066d9d640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd06815df80 0x7fd0680b3520 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd06000e7f0 tx=0x7fd06000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd05effd640 1 -- 172.21.15.22:0/3498286074 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060009510 con 0x7fd06815df80 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd05effd640 1 -- 172.21.15.22:0/3498286074 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000ee40 con 0x7fd06815df80 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd05effd640 1 -- 172.21.15.22:0/3498286074 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000cb80 con 0x7fd06815df80 2023-11-24T06:16:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.998+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0681f31c0 con 0x7fd06815df80 2023-11-24T06:16:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:13.999+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0681f3780 con 0x7fd06815df80 2023-11-24T06:16:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.000+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0681f39a0 con 0x7fd06815df80 2023-11-24T06:16:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.001+0000 7fd05effd640 1 -- 172.21.15.22:0/3498286074 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd06000cce0 con 0x7fd06815df80 2023-11-24T06:16:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.002+0000 7fd05effd640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd04806aff0 0x7fd04806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.002+0000 7fd05effd640 1 -- 172.21.15.22:0/3498286074 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd060089ad0 con 0x7fd06815df80 2023-11-24T06:16:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.002+0000 7fd06659c640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd04806aff0 0x7fd04806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:14.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.003+0000 7fd06659c640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd04806aff0 0x7fd04806d4b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd058036000 tx=0x7fd058030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.007+0000 7fd05effd640 1 -- 172.21.15.22:0/3498286074 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd060054820 con 0x7fd06815df80 2023-11-24T06:16:14.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.232+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd06804e840 con 0x7fd06815df80 2023-11-24T06:16:14.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.234+0000 7fd05effd640 1 -- 172.21.15.22:0/3498286074 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fd060017090 con 0x7fd06815df80 2023-11-24T06:16:14.236 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:14.237 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:16:14.237 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:16:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd04806aff0 msgr2=0x7fd04806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd04806aff0 0x7fd04806d4b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd058036000 tx=0x7fd058030000 comp rx=0 tx=0).stop 2023-11-24T06:16:14.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd06815df80 msgr2=0x7fd0680b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:14.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd06815df80 0x7fd0680b3520 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd06000e7f0 tx=0x7fd06000ebf0 comp rx=0 tx=0).stop 2023-11-24T06:16:14.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 shutdown_connections 2023-11-24T06:16:14.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd04806aff0 0x7fd04806d4b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:14.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd06815df80 0x7fd0680b3520 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:14.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd068157770 0x7fd0680b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:14.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 --2- 172.21.15.22:0/3498286074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd06806d080 0x7fd0681f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:14.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 >> 172.21.15.22:0/3498286074 conn(0x7fd06806a860 msgr2=0x7fd068156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:14.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.236+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 shutdown_connections 2023-11-24T06:16:14.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:14.237+0000 7fd06759e640 1 -- 172.21.15.22:0/3498286074 wait complete. 2023-11-24T06:16:14.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-11-24T06:16:14.499 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2023-11-24T06:16:14.499 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-11-24T06:16:14.499 DEBUG:tasks.ceph_test_case:wait_until_true: success in 65s and 0 retries 2023-11-24T06:16:14.499 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:16:14.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:14.607 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:14.737 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:16:14.737 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:16:14.738 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:14.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:16:14.799 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:16:14.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:14.800 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:16:14.852 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-24T06:16:14.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:16:14.853 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:16:14.854 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:14.919 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:16:14.919 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:16:14.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:14.919 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:16:14.977 INFO:teuthology.orchestra.run.smithi031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-24T06:16:14.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:16:14.978 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:16:14.978 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:15.040 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:16:15.040 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:16:15.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:15.040 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T06:16:15.097 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-24T06:16:15.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:16:15.098 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:16:15.098 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:15.161 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:16:15.161 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:16:15.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:15.162 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T06:16:15.216 INFO:teuthology.orchestra.run.smithi031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-24T06:16:15.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:16:15.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:15.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.449+0000 7f240c967640 1 Processor -- start 2023-11-24T06:16:15.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.450+0000 7f240c967640 1 -- start start 2023-11-24T06:16:15.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.451+0000 7f240c967640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240815d840 0x7f24080b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.451+0000 7f240c967640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24080cbf60 con 0x7f240815d460 2023-11-24T06:16:15.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.451+0000 7f240c967640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24080cc520 con 0x7f240806be70 2023-11-24T06:16:15.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.451+0000 7f240c967640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24080d03b0 con 0x7f240815d840 2023-11-24T06:16:15.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.451+0000 7f2406d9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f240815d460 0x7f240806b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45806/0 (socket says 172.21.15.22:45806) 2023-11-24T06:16:15.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.451+0000 7f2406d9d640 1 -- 172.21.15.22:0/3571823686 learned_addr learned my addr 172.21.15.22:0/3571823686 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:15.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516776967 0 0) 0x7f24080cbf60 con 0x7f240815d460 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240759e640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240815d840 0x7f24080b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f4003520 con 0x7f240815d460 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3234631439 0 0) 0x7f23f4003520 con 0x7f240815d460 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240815d840 msgr2=0x7f24080b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240659c640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240815d840 0x7f24080b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 >> v1:172.21.15.31:6789/0 conn(0x7f240806be70 legacy=0x7f24080cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240806c3c0 con 0x7f240815d460 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f23f8001670 con 0x7f240815d460 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.452+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 >> v1:172.21.15.22:6789/0 conn(0x7f240815d460 legacy=0x7f240806b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f240659c640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f23f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f240659c640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23f40047c0 0x7f23f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f240659c640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240815d840 0x7f23f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24080d03b0 con 0x7f23f4003a10 2023-11-24T06:16:15.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f40054e0 con 0x7f23f40047c0 2023-11-24T06:16:15.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f400bec0 con 0x7f240815d840 2023-11-24T06:16:15.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f2406d9d640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f23f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f23fffff640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23f40047c0 0x7f23f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f2406d9d640 1 -- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240815d840 msgr2=0x7f23f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f2406d9d640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240815d840 0x7f23f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f2406d9d640 1 -- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23f40047c0 msgr2=0x7f23f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.453+0000 7f2406d9d640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23f40047c0 0x7f23f4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.454+0000 7f2406d9d640 1 -- 172.21.15.22:0/3571823686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f4003520 con 0x7f23f4003a10 2023-11-24T06:16:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.454+0000 7f23fffff640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23f40047c0 0x7f23f4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.455+0000 7f2406d9d640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f23f4003e30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c0e0 tx=0x7f23f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a98345432ffb94 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.455+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8005ad0 con 0x7f23f4003a10 2023-11-24T06:16:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.455+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f8005c30 con 0x7f23f4003a10 2023-11-24T06:16:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.455+0000 7f240659c640 1 -- 172.21.15.22:0/3571823686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f802c7f0 con 0x7f23f4003a10 2023-11-24T06:16:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.456+0000 7f240c967640 1 -- 172.21.15.22:0/3571823686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 msgr2=0x7f23f4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.456+0000 7f240c967640 1 --2- 172.21.15.22:0/3571823686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f23f4003e30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c0e0 tx=0x7f23f40057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.456+0000 7f240759e640 1 -- 172.21.15.22:0/3571823686 reap_dead start 2023-11-24T06:16:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.456+0000 7f240c967640 1 -- 172.21.15.22:0/3571823686 shutdown_connections 2023-11-24T06:16:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.456+0000 7f240c967640 1 -- 172.21.15.22:0/3571823686 >> 172.21.15.22:0/3571823686 conn(0x7f24080d0f00 msgr2=0x7f24080d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.456+0000 7f240c967640 1 -- 172.21.15.22:0/3571823686 shutdown_connections 2023-11-24T06:16:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.456+0000 7f240c967640 1 -- 172.21.15.22:0/3571823686 wait complete. 2023-11-24T06:16:15.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.458+0000 7f240c967640 1 Processor -- start 2023-11-24T06:16:15.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.459+0000 7f240c967640 1 -- start start 2023-11-24T06:16:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.460+0000 7f240c967640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f240806f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.460+0000 7f240c967640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240806faf0 0x7f240814a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.460+0000 7f240c967640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240814fda0 0x7f240814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.460+0000 7f240c967640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240806e510 con 0x7f23f4003a10 2023-11-24T06:16:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.460+0000 7f240c967640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240806e7f0 con 0x7f240814fda0 2023-11-24T06:16:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.460+0000 7f240c967640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240806ead0 con 0x7f240806faf0 2023-11-24T06:16:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.460+0000 7f2406d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f240806f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.460+0000 7f2406d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f240806f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56808/0 (socket says 172.21.15.22:56808) 2023-11-24T06:16:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.460+0000 7f2406d9d640 1 -- 172.21.15.22:0/2135019746 learned_addr learned my addr 172.21.15.22:0/2135019746 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:15.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.461+0000 7f2406d9d640 1 -- 172.21.15.22:0/2135019746 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240806faf0 msgr2=0x7f240814a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.461+0000 7f2406d9d640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240806faf0 0x7f240814a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.461+0000 7f2406d9d640 1 -- 172.21.15.22:0/2135019746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240814fda0 msgr2=0x7f240814a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.461+0000 7f2406d9d640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240814fda0 0x7f240814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.461+0000 7f2406d9d640 1 -- 172.21.15.22:0/2135019746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240806edb0 con 0x7f23f4003a10 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.461+0000 7f2406d9d640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f240806f5b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c0e0 tx=0x7f23f802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.462+0000 7f23ff7fe640 1 -- 172.21.15.22:0/2135019746 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f803c040 con 0x7f23f4003a10 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.462+0000 7f23ff7fe640 1 -- 172.21.15.22:0/2135019746 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f802cd40 con 0x7f23f4003a10 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.462+0000 7f23ff7fe640 1 -- 172.21.15.22:0/2135019746 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f80072b0 con 0x7f23f4003a10 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.462+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240806f090 con 0x7f23f4003a10 2023-11-24T06:16:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.462+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24080b04a0 con 0x7f23f4003a10 2023-11-24T06:16:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.463+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240804e840 con 0x7f23f4003a10 2023-11-24T06:16:15.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.465+0000 7f23ff7fe640 1 -- 172.21.15.22:0/2135019746 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f23f8032070 con 0x7f23f4003a10 2023-11-24T06:16:15.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.466+0000 7f23ff7fe640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23e806aff0 0x7f23e806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.466+0000 7f23ff7fe640 1 -- 172.21.15.22:0/2135019746 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f23f80aaef0 con 0x7f23f4003a10 2023-11-24T06:16:15.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.466+0000 7f23fffff640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23e806aff0 0x7f23e806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:15.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.467+0000 7f23fffff640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23e806aff0 0x7f23e806d4b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f24080cdef0 tx=0x7f23f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:15.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.472+0000 7f23ff7fe640 1 -- 172.21.15.22:0/2135019746 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23f8075cd0 con 0x7f23f4003a10 2023-11-24T06:16:15.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.707+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f240806e170 con 0x7f23f4003a10 2023-11-24T06:16:15.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.709+0000 7f23ff7fe640 1 -- 172.21.15.22:0/2135019746 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f23f80792f0 con 0x7f23f4003a10 2023-11-24T06:16:15.711 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:15.711 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:16:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:16:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23e806aff0 msgr2=0x7f23e806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23e806aff0 0x7f23e806d4b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f24080cdef0 tx=0x7f23f0009040 comp rx=0 tx=0).stop 2023-11-24T06:16:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 msgr2=0x7f240806f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f240806f5b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c0e0 tx=0x7f23f802e070 comp rx=0 tx=0).stop 2023-11-24T06:16:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 shutdown_connections 2023-11-24T06:16:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f23e806aff0 0x7f23e806d4b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f240814fda0 0x7f240814a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f240806faf0 0x7f240814a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 --2- 172.21.15.22:0/2135019746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23f4003a10 0x7f240806f5b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 >> 172.21.15.22:0/2135019746 conn(0x7f24080d0f00 msgr2=0x7f24081608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 shutdown_connections 2023-11-24T06:16:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.711+0000 7f240c967640 1 -- 172.21.15.22:0/2135019746 wait complete. 2023-11-24T06:16:15.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:15.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.963+0000 7f712cb83640 1 Processor -- start 2023-11-24T06:16:15.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.963+0000 7f712cb83640 1 -- start start 2023-11-24T06:16:15.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f712cb83640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f712806f750 0x7f712815c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f712cb83640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712806fc00 con 0x7f7128144680 2023-11-24T06:16:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f712cb83640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71280cd3f0 con 0x7f712806ab50 2023-11-24T06:16:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f712cb83640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280cd6d0 con 0x7f712806f750 2023-11-24T06:16:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f7127fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f712806f750 0x7f712815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f71277fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7128144680 0x7f712806a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45818/0 (socket says 172.21.15.22:45818) 2023-11-24T06:16:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f7127fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f712806f750 0x7f712815c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56822/0 (socket says 172.21.15.22:56822) 2023-11-24T06:16:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f71277fe640 1 -- 172.21.15.22:0/1518577188 learned_addr learned my addr 172.21.15.22:0/1518577188 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f7127fff640 1 -- 172.21.15.22:0/1518577188 >> v1:172.21.15.31:6789/0 conn(0x7f712806ab50 legacy=0x7f712815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f7127fff640 1 -- 172.21.15.22:0/1518577188 >> v1:172.21.15.22:6789/0 conn(0x7f7128144680 legacy=0x7f712806a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.965+0000 7f7127fff640 1 -- 172.21.15.22:0/1518577188 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280cd9b0 con 0x7f712806f750 2023-11-24T06:16:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.967+0000 7f7127fff640 1 --2- 172.21.15.22:0/1518577188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 0x7f712815c060 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f71200097a0 tx=0x7f712002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f46fab0bcf9356 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.967+0000 7f7126ffd640 1 -- 172.21.15.22:0/1518577188 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120031830 con 0x7f712806f750 2023-11-24T06:16:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.967+0000 7f7126ffd640 1 -- 172.21.15.22:0/1518577188 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120031990 con 0x7f712806f750 2023-11-24T06:16:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.967+0000 7f7126ffd640 1 -- 172.21.15.22:0/1518577188 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120031d20 con 0x7f712806f750 2023-11-24T06:16:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.967+0000 7f712cb83640 1 -- 172.21.15.22:0/1518577188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 msgr2=0x7f712815c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.967+0000 7f712cb83640 1 --2- 172.21.15.22:0/1518577188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 0x7f712815c060 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f71200097a0 tx=0x7f712002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.968+0000 7f712cb83640 1 -- 172.21.15.22:0/1518577188 shutdown_connections 2023-11-24T06:16:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.968+0000 7f712cb83640 1 --2- 172.21.15.22:0/1518577188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 0x7f712815c060 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.968+0000 7f712cb83640 1 -- 172.21.15.22:0/1518577188 >> 172.21.15.22:0/1518577188 conn(0x7f71280b1c70 msgr2=0x7f71280b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.968+0000 7f712cb83640 1 -- 172.21.15.22:0/1518577188 shutdown_connections 2023-11-24T06:16:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.968+0000 7f712cb83640 1 -- 172.21.15.22:0/1518577188 wait complete. 2023-11-24T06:16:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.969+0000 7f712cb83640 1 Processor -- start 2023-11-24T06:16:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.970+0000 7f712cb83640 1 -- start start 2023-11-24T06:16:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f712cb83640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f712806ab50 0x7f712813baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f712cb83640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 0x7f71281e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f712cb83640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7128144680 0x7f712813a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f712cb83640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71281e5270 con 0x7f712806f750 2023-11-24T06:16:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f712cb83640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712813f7a0 con 0x7f7128144680 2023-11-24T06:16:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f712cb83640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712813fa40 con 0x7f712806ab50 2023-11-24T06:16:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f711effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 0x7f71281e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f711effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 0x7f71281e4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56834/0 (socket says 172.21.15.22:56834) 2023-11-24T06:16:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f711effd640 1 -- 172.21.15.22:0/3995853592 learned_addr learned my addr 172.21.15.22:0/3995853592 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f711effd640 1 -- 172.21.15.22:0/3995853592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f712806ab50 msgr2=0x7f712813baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f711effd640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f712806ab50 0x7f712813baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f711effd640 1 -- 172.21.15.22:0/3995853592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7128144680 msgr2=0x7f712813a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f711effd640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7128144680 0x7f712813a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.971+0000 7f711effd640 1 -- 172.21.15.22:0/3995853592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7120009400 con 0x7f712806f750 2023-11-24T06:16:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.972+0000 7f711effd640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 0x7f71281e4d30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f711000c400 tx=0x7f711000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.972+0000 7f7124ff9640 1 -- 172.21.15.22:0/3995853592 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110011790 con 0x7f712806f750 2023-11-24T06:16:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.972+0000 7f7124ff9640 1 -- 172.21.15.22:0/3995853592 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7110011930 con 0x7f712806f750 2023-11-24T06:16:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.972+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712813fd20 con 0x7f712806f750 2023-11-24T06:16:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.972+0000 7f7124ff9640 1 -- 172.21.15.22:0/3995853592 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110011ce0 con 0x7f712806f750 2023-11-24T06:16:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.972+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712813aad0 con 0x7f712806f750 2023-11-24T06:16:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.974+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712804e840 con 0x7f712806f750 2023-11-24T06:16:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.975+0000 7f7124ff9640 1 -- 172.21.15.22:0/3995853592 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f711001c460 con 0x7f712806f750 2023-11-24T06:16:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.976+0000 7f7124ff9640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f710806aff0 0x7f710806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.976+0000 7f7124ff9640 1 -- 172.21.15.22:0/3995853592 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7110089a20 con 0x7f712806f750 2023-11-24T06:16:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.976+0000 7f71277fe640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f710806aff0 0x7f710806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.977+0000 7f71277fe640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f710806aff0 0x7f710806d4b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7118001fd0 tx=0x7f71180015c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:15.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:15.981+0000 7f7124ff9640 1 -- 172.21.15.22:0/3995853592 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71100546e0 con 0x7f712806f750 2023-11-24T06:16:16.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.176+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71280ccc10 con 0x7f712806f750 2023-11-24T06:16:16.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.178+0000 7f7124ff9640 1 -- 172.21.15.22:0/3995853592 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16560 (secure 0 0 0) 0x7f7110057d00 con 0x7f712806f750 2023-11-24T06:16:16.181 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:16.181 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":49,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:42.443698+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:16.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f710806aff0 msgr2=0x7f710806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f710806aff0 0x7f710806d4b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7118001fd0 tx=0x7f71180015c0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 msgr2=0x7f71281e4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 0x7f71281e4d30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f711000c400 tx=0x7f711000c8c0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 shutdown_connections 2023-11-24T06:16:16.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f710806aff0 0x7f710806d4b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7128144680 0x7f712813a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f712806f750 0x7f71281e4d30 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 --2- 172.21.15.22:0/3995853592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f712806ab50 0x7f712813baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 >> 172.21.15.22:0/3995853592 conn(0x7f71280b1c70 msgr2=0x7f712815a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:16.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 shutdown_connections 2023-11-24T06:16:16.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.181+0000 7f712cb83640 1 -- 172.21.15.22:0/3995853592 wait complete. 2023-11-24T06:16:16.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:12.796187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:13.964719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:16.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:16.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.434+0000 7fec1ac51640 1 Processor -- start 2023-11-24T06:16:16.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.435+0000 7fec1ac51640 1 -- start start 2023-11-24T06:16:16.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec1ac51640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec14072280 0x7fec1406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec1ac51640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec14071780 con 0x7fec1406cad0 2023-11-24T06:16:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec1ac51640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec140711c0 con 0x7fec14160b10 2023-11-24T06:16:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec1ac51640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec140b2320 con 0x7fec14072280 2023-11-24T06:16:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec13fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fec1406cad0 0x7fec140b2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45820/0 (socket says 172.21.15.22:45820) 2023-11-24T06:16:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec13fff640 1 -- 172.21.15.22:0/4139313924 learned_addr learned my addr 172.21.15.22:0/4139313924 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec191ee640 1 --2- 172.21.15.22:0/4139313924 >> v2:172.21.15.22:3300/0 conn(0x7fec14072280 0x7fec1406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec137fe640 1 -- 172.21.15.22:0/4139313924 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466540824 0 0) 0x7fec14071780 con 0x7fec1406cad0 2023-11-24T06:16:16.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec137fe640 1 -- 172.21.15.22:0/4139313924 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febfc003520 con 0x7fec1406cad0 2023-11-24T06:16:16.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec191ee640 1 -- 172.21.15.22:0/4139313924 >> v1:172.21.15.31:6789/0 conn(0x7fec14160b10 legacy=0x7fec1406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.437+0000 7fec191ee640 1 -- 172.21.15.22:0/4139313924 >> v1:172.21.15.22:6789/0 conn(0x7fec1406cad0 legacy=0x7fec140b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.438+0000 7fec191ee640 1 -- 172.21.15.22:0/4139313924 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec140714a0 con 0x7fec14072280 2023-11-24T06:16:16.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.439+0000 7fec191ee640 1 --2- 172.21.15.22:0/4139313924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec14072280 0x7fec1406e420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009d90 tx=0x7fec0c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb19befe2230f2b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:16.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.439+0000 7fec137fe640 1 -- 172.21.15.22:0/4139313924 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c02cc60 con 0x7fec14072280 2023-11-24T06:16:16.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.439+0000 7fec137fe640 1 -- 172.21.15.22:0/4139313924 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c02cdc0 con 0x7fec14072280 2023-11-24T06:16:16.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.439+0000 7fec137fe640 1 -- 172.21.15.22:0/4139313924 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c034660 con 0x7fec14072280 2023-11-24T06:16:16.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.439+0000 7fec1ac51640 1 -- 172.21.15.22:0/4139313924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec14072280 msgr2=0x7fec1406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.439+0000 7fec1ac51640 1 --2- 172.21.15.22:0/4139313924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec14072280 0x7fec1406e420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009d90 tx=0x7fec0c02beb0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.440+0000 7fec1ac51640 1 -- 172.21.15.22:0/4139313924 shutdown_connections 2023-11-24T06:16:16.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.440+0000 7fec1ac51640 1 --2- 172.21.15.22:0/4139313924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec14072280 0x7fec1406e420 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.440+0000 7fec1ac51640 1 -- 172.21.15.22:0/4139313924 >> 172.21.15.22:0/4139313924 conn(0x7fec140b0ba0 msgr2=0x7fec140b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:16.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.440+0000 7fec1ac51640 1 -- 172.21.15.22:0/4139313924 shutdown_connections 2023-11-24T06:16:16.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.440+0000 7fec1ac51640 1 -- 172.21.15.22:0/4139313924 wait complete. 2023-11-24T06:16:16.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.441+0000 7fec1ac51640 1 Processor -- start 2023-11-24T06:16:16.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.442+0000 7fec1ac51640 1 -- start start 2023-11-24T06:16:16.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.442+0000 7fec1ac51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1406cad0 0x7fec1409a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec1ac51640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec14072280 0x7fec1415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec1ac51640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec14160b10 0x7fec1409b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec1ac51640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1409bc10 con 0x7fec1406cad0 2023-11-24T06:16:16.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec1ac51640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14099b30 con 0x7fec14160b10 2023-11-24T06:16:16.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec1ac51640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec14099e10 con 0x7fec14072280 2023-11-24T06:16:16.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec189ed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1406cad0 0x7fec1409a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec189ed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1406cad0 0x7fec1409a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56846/0 (socket says 172.21.15.22:56846) 2023-11-24T06:16:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec189ed640 1 -- 172.21.15.22:0/2503031147 learned_addr learned my addr 172.21.15.22:0/2503031147 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec13fff640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec14072280 0x7fec1415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec189ed640 1 -- 172.21.15.22:0/2503031147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec14072280 msgr2=0x7fec1415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec189ed640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec14072280 0x7fec1415afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec189ed640 1 -- 172.21.15.22:0/2503031147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec14160b10 msgr2=0x7fec1409b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec189ed640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec14160b10 0x7fec1409b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec189ed640 1 -- 172.21.15.22:0/2503031147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c009a70 con 0x7fec1406cad0 2023-11-24T06:16:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.443+0000 7fec13fff640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec14072280 0x7fec1415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.444+0000 7fec189ed640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1406cad0 0x7fec1409a8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fec0800c400 tx=0x7fec0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.444+0000 7fec117fa640 1 -- 172.21.15.22:0/2503031147 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec080052d0 con 0x7fec1406cad0 2023-11-24T06:16:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.444+0000 7fec117fa640 1 -- 172.21.15.22:0/2503031147 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec08005430 con 0x7fec1406cad0 2023-11-24T06:16:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.444+0000 7fec117fa640 1 -- 172.21.15.22:0/2503031147 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08003830 con 0x7fec1406cad0 2023-11-24T06:16:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.444+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1409a0f0 con 0x7fec1406cad0 2023-11-24T06:16:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.444+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1409ae30 con 0x7fec1406cad0 2023-11-24T06:16:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.445+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1409a610 con 0x7fec1406cad0 2023-11-24T06:16:16.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.446+0000 7fec117fa640 1 -- 172.21.15.22:0/2503031147 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fec08003990 con 0x7fec1406cad0 2023-11-24T06:16:16.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.447+0000 7fec117fa640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec0006aff0 0x7fec0006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.448+0000 7fec117fa640 1 -- 172.21.15.22:0/2503031147 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fec08088ee0 con 0x7fec1406cad0 2023-11-24T06:16:16.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.448+0000 7fec13fff640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec0006aff0 0x7fec0006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.449+0000 7fec13fff640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec0006aff0 0x7fec0006d4b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fec140cacd0 tx=0x7fec04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:16.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.452+0000 7fec117fa640 1 -- 172.21.15.22:0/2503031147 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec1409a610 con 0x7fec1406cad0 2023-11-24T06:16:16.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.645+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec1409a610 con 0x7fec1406cad0 2023-11-24T06:16:16.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.646+0000 7fec117fa640 1 -- 172.21.15.22:0/2503031147 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec1409a610 con 0x7fec1406cad0 2023-11-24T06:16:16.649 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:16:16.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.648+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec0006aff0 msgr2=0x7fec0006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.648+0000 7fec1ac51640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec0006aff0 0x7fec0006d4b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fec140cacd0 tx=0x7fec04009040 comp rx=0 tx=0).stop 2023-11-24T06:16:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1406cad0 msgr2=0x7fec1409a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1406cad0 0x7fec1409a8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fec0800c400 tx=0x7fec0800c8c0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 shutdown_connections 2023-11-24T06:16:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fec0006aff0 0x7fec0006d4b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec14160b10 0x7fec1409b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec14072280 0x7fec1415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 --2- 172.21.15.22:0/2503031147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1406cad0 0x7fec1409a8f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 >> 172.21.15.22:0/2503031147 conn(0x7fec140b0ba0 msgr2=0x7fec140b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 shutdown_connections 2023-11-24T06:16:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.649+0000 7fec1ac51640 1 -- 172.21.15.22:0/2503031147 wait complete. 2023-11-24T06:16:16.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:16:16.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.901+0000 7fbba359e640 1 Processor -- start 2023-11-24T06:16:16.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.901+0000 7fbba359e640 1 -- start start 2023-11-24T06:16:16.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba359e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbba4160960 0x7fbba40d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba40b4560 0x7fbba40cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbba40cffb0 0x7fbba40cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba359e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba40d3f60 con 0x7fbba4160960 2023-11-24T06:16:16.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba40d0440 con 0x7fbba40cffb0 2023-11-24T06:16:16.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba40b49c0 con 0x7fbba40b4560 2023-11-24T06:16:16.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbba4160960 0x7fbba40d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbba4160960 0x7fbba40d1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56856/0 (socket says 172.21.15.22:56856) 2023-11-24T06:16:16.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba259c640 1 -- 172.21.15.22:0/680384443 learned_addr learned my addr 172.21.15.22:0/680384443 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:16.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.903+0000 7fbba1d9b640 1 --2- 172.21.15.22:0/680384443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba40b4560 0x7fbba40cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.904+0000 7fbba259c640 1 -- 172.21.15.22:0/680384443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba40b4560 msgr2=0x7fbba40cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:16.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.904+0000 7fbba259c640 1 --2- 172.21.15.22:0/680384443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba40b4560 0x7fbba40cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.904+0000 7fbba2d9d640 1 --2- 172.21.15.22:0/680384443 >> v2:172.21.15.31:3300/0 conn(0x7fbba40cffb0 0x7fbba40cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.904+0000 7fbba259c640 1 -- 172.21.15.22:0/680384443 >> v2:172.21.15.31:3300/0 conn(0x7fbba40cffb0 msgr2=0x7fbba40cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:16.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.904+0000 7fbba259c640 1 --2- 172.21.15.22:0/680384443 >> v2:172.21.15.31:3300/0 conn(0x7fbba40cffb0 0x7fbba40cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.904+0000 7fbba259c640 1 -- 172.21.15.22:0/680384443 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba40cf270 con 0x7fbba4160960 2023-11-24T06:16:16.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.904+0000 7fbba1d9b640 1 --2- 172.21.15.22:0/680384443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba40b4560 0x7fbba40cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:16.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.905+0000 7fbba259c640 1 --2- 172.21.15.22:0/680384443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba4160960 0x7fbba40d1d50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbba40c6b30 tx=0x7fbb9402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbfa92de0fc32c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:16.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.905+0000 7fbba159a640 1 -- 172.21.15.22:0/680384443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9402c9e0 con 0x7fbba4160960 2023-11-24T06:16:16.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.905+0000 7fbba159a640 1 -- 172.21.15.22:0/680384443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9402cb40 con 0x7fbba4160960 2023-11-24T06:16:16.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.905+0000 7fbba159a640 1 -- 172.21.15.22:0/680384443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb940343f0 con 0x7fbba4160960 2023-11-24T06:16:16.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.906+0000 7fbba359e640 1 -- 172.21.15.22:0/680384443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba4160960 msgr2=0x7fbba40d1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.906+0000 7fbba359e640 1 --2- 172.21.15.22:0/680384443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba4160960 0x7fbba40d1d50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbba40c6b30 tx=0x7fbb9402be40 comp rx=0 tx=0).stop 2023-11-24T06:16:16.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.906+0000 7fbba359e640 1 -- 172.21.15.22:0/680384443 shutdown_connections 2023-11-24T06:16:16.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.906+0000 7fbba359e640 1 --2- 172.21.15.22:0/680384443 >> v2:172.21.15.31:3300/0 conn(0x7fbba40cffb0 0x7fbba40cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.906+0000 7fbba359e640 1 --2- 172.21.15.22:0/680384443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba40b4560 0x7fbba40cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.906+0000 7fbba359e640 1 --2- 172.21.15.22:0/680384443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba4160960 0x7fbba40d1d50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.906+0000 7fbba359e640 1 -- 172.21.15.22:0/680384443 >> 172.21.15.22:0/680384443 conn(0x7fbba409c390 msgr2=0x7fbba40d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:16.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.906+0000 7fbba359e640 1 -- 172.21.15.22:0/680384443 shutdown_connections 2023-11-24T06:16:16.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.906+0000 7fbba359e640 1 -- 172.21.15.22:0/680384443 wait complete. 2023-11-24T06:16:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.908+0000 7fbba359e640 1 Processor -- start 2023-11-24T06:16:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.908+0000 7fbba359e640 1 -- start start 2023-11-24T06:16:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.909+0000 7fbba359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba40b4560 0x7fbba415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.909+0000 7fbba359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba40cffb0 0x7fbba409cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.909+0000 7fbba359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba4160960 0x7fbba40b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.909+0000 7fbba359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba415ee10 con 0x7fbba40b4560 2023-11-24T06:16:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.909+0000 7fbba359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba40a0b70 con 0x7fbba40cffb0 2023-11-24T06:16:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.909+0000 7fbba359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba409ff60 con 0x7fbba4160960 2023-11-24T06:16:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba40b4560 0x7fbba415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba40b4560 0x7fbba415e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56872/0 (socket says 172.21.15.22:56872) 2023-11-24T06:16:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba259c640 1 -- 172.21.15.22:0/4192311782 learned_addr learned my addr 172.21.15.22:0/4192311782 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba2d9d640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba4160960 0x7fbba40b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba1d9b640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba40cffb0 0x7fbba409cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba259c640 1 -- 172.21.15.22:0/4192311782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba4160960 msgr2=0x7fbba40b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba259c640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba4160960 0x7fbba40b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba259c640 1 -- 172.21.15.22:0/4192311782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba40cffb0 msgr2=0x7fbba409cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba259c640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba40cffb0 0x7fbba409cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.910+0000 7fbba259c640 1 -- 172.21.15.22:0/4192311782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94009b30 con 0x7fbba40b4560 2023-11-24T06:16:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.911+0000 7fbba259c640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba40b4560 0x7fbba415e8d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fbb94000f80 tx=0x7fbb94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:16.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.911+0000 7fbb9affd640 1 -- 172.21.15.22:0/4192311782 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9403e450 con 0x7fbba40b4560 2023-11-24T06:16:16.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.911+0000 7fbb9affd640 1 -- 172.21.15.22:0/4192311782 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9403e5f0 con 0x7fbba40b4560 2023-11-24T06:16:16.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.911+0000 7fbb9affd640 1 -- 172.21.15.22:0/4192311782 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9403e9a0 con 0x7fbba40b4560 2023-11-24T06:16:16.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.911+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba40a0240 con 0x7fbba40b4560 2023-11-24T06:16:16.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.911+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba40a0800 con 0x7fbba40b4560 2023-11-24T06:16:16.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.912+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba404e840 con 0x7fbba40b4560 2023-11-24T06:16:16.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.913+0000 7fbb9affd640 1 -- 172.21.15.22:0/4192311782 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbb9403eb00 con 0x7fbba40b4560 2023-11-24T06:16:16.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.914+0000 7fbb9affd640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb8406aff0 0x7fbb8406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.914+0000 7fbb9affd640 1 -- 172.21.15.22:0/4192311782 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbb940ac930 con 0x7fbba40b4560 2023-11-24T06:16:16.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.914+0000 7fbba1d9b640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb8406aff0 0x7fbb8406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.915+0000 7fbba1d9b640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb8406aff0 0x7fbb8406d4b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbba41f5ff0 tx=0x7fbb8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:16.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:16.919+0000 7fbb9affd640 1 -- 172.21.15.22:0/4192311782 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb94077850 con 0x7fbba40b4560 2023-11-24T06:16:17.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.114+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbba40c97f0 con 0x7fbba40b4560 2023-11-24T06:16:17.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.115+0000 7fbb9affd640 1 -- 172.21.15.22:0/4192311782 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb9403edb0 con 0x7fbba40b4560 2023-11-24T06:16:17.118 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:16:17.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.118+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb8406aff0 msgr2=0x7fbb8406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.118+0000 7fbba359e640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb8406aff0 0x7fbb8406d4b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbba41f5ff0 tx=0x7fbb8c008040 comp rx=0 tx=0).stop 2023-11-24T06:16:17.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.118+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba40b4560 msgr2=0x7fbba415e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.118+0000 7fbba359e640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba40b4560 0x7fbba415e8d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fbb94000f80 tx=0x7fbb94004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.119+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 shutdown_connections 2023-11-24T06:16:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.119+0000 7fbba359e640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fbb8406aff0 0x7fbb8406d4b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.119+0000 7fbba359e640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbba4160960 0x7fbba40b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.119+0000 7fbba359e640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba40cffb0 0x7fbba409cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.119+0000 7fbba359e640 1 --2- 172.21.15.22:0/4192311782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbba40b4560 0x7fbba415e8d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.119+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 >> 172.21.15.22:0/4192311782 conn(0x7fbba409c390 msgr2=0x7fbba40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:17.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.119+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 shutdown_connections 2023-11-24T06:16:17.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.119+0000 7fbba359e640 1 -- 172.21.15.22:0/4192311782 wait complete. 2023-11-24T06:16:17.140 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:16:17.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.373+0000 7f6ae7147640 1 Processor -- start 2023-11-24T06:16:17.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.374+0000 7f6ae7147640 1 -- start start 2023-11-24T06:16:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.375+0000 7f6ae7147640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ae0144770 0x7f6ae015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.375+0000 7f6ae7147640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae015f0a0 0x7f6ae00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae7147640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae015f930 con 0x7f6ae00b35a0 2023-11-24T06:16:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae7147640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae00b43b0 con 0x7f6ae0144770 2023-11-24T06:16:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae7147640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae015f530 con 0x7f6ae015f0a0 2023-11-24T06:16:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae6145640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ae0144770 0x7f6ae015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae6145640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ae0144770 0x7f6ae015eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56876/0 (socket says 172.21.15.22:56876) 2023-11-24T06:16:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae6145640 1 -- 172.21.15.22:0/829409383 learned_addr learned my addr 172.21.15.22:0/829409383 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae6946640 1 --2- 172.21.15.22:0/829409383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae015f0a0 0x7f6ae00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae6145640 1 -- 172.21.15.22:0/829409383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae015f0a0 msgr2=0x7f6ae00ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae6145640 1 --2- 172.21.15.22:0/829409383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae015f0a0 0x7f6ae00ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae6145640 1 -- 172.21.15.22:0/829409383 >> v1:172.21.15.22:6789/0 conn(0x7f6ae00b35a0 legacy=0x7f6ae006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae6145640 1 -- 172.21.15.22:0/829409383 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00ce9f0 con 0x7f6ae0144770 2023-11-24T06:16:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.376+0000 7f6ae6946640 1 --2- 172.21.15.22:0/829409383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae015f0a0 0x7f6ae00ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.378+0000 7f6ae6145640 1 --2- 172.21.15.22:0/829409383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae0144770 0x7f6ae015eb60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009870 tx=0x7f6adc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1ab15ad4794225 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.378+0000 7f6ae5143640 1 -- 172.21.15.22:0/829409383 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc030840 con 0x7f6ae0144770 2023-11-24T06:16:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.378+0000 7f6ae5143640 1 -- 172.21.15.22:0/829409383 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc0309a0 con 0x7f6ae0144770 2023-11-24T06:16:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.378+0000 7f6ae5143640 1 -- 172.21.15.22:0/829409383 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc030d30 con 0x7f6ae0144770 2023-11-24T06:16:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.378+0000 7f6ae7147640 1 -- 172.21.15.22:0/829409383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae0144770 msgr2=0x7f6ae015eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.378+0000 7f6ae7147640 1 --2- 172.21.15.22:0/829409383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae0144770 0x7f6ae015eb60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009870 tx=0x7f6adc02b980 comp rx=0 tx=0).stop 2023-11-24T06:16:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.379+0000 7f6ae7147640 1 -- 172.21.15.22:0/829409383 shutdown_connections 2023-11-24T06:16:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.379+0000 7f6ae7147640 1 --2- 172.21.15.22:0/829409383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae015f0a0 0x7f6ae00ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.379+0000 7f6ae7147640 1 --2- 172.21.15.22:0/829409383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae0144770 0x7f6ae015eb60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.379+0000 7f6ae7147640 1 -- 172.21.15.22:0/829409383 >> 172.21.15.22:0/829409383 conn(0x7f6ae00cec10 msgr2=0x7f6ae00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.379+0000 7f6ae7147640 1 -- 172.21.15.22:0/829409383 shutdown_connections 2023-11-24T06:16:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.379+0000 7f6ae7147640 1 -- 172.21.15.22:0/829409383 wait complete. 2023-11-24T06:16:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.380+0000 7f6ae7147640 1 Processor -- start 2023-11-24T06:16:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.381+0000 7f6ae7147640 1 -- start start 2023-11-24T06:16:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae7147640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae00b35a0 0x7f6ae00c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae7147640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae0144770 0x7f6ae00cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae7147640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae015f0a0 0x7f6ae015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae7147640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae01f04d0 con 0x7f6ae015f0a0 2023-11-24T06:16:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae7147640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c93c0 con 0x7f6ae00b35a0 2023-11-24T06:16:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae7147640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c96a0 con 0x7f6ae0144770 2023-11-24T06:16:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae6946640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae015f0a0 0x7f6ae015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae6946640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae015f0a0 0x7f6ae015a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56886/0 (socket says 172.21.15.22:56886) 2023-11-24T06:16:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae6946640 1 -- 172.21.15.22:0/3258259887 learned_addr learned my addr 172.21.15.22:0/3258259887 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae6145640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae00b35a0 0x7f6ae00c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.382+0000 7f6ae5944640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae0144770 0x7f6ae00cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ae6946640 1 -- 172.21.15.22:0/3258259887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae0144770 msgr2=0x7f6ae00cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ae6946640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae0144770 0x7f6ae00cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ae6946640 1 -- 172.21.15.22:0/3258259887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae00b35a0 msgr2=0x7f6ae00c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ae6946640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae00b35a0 0x7f6ae00c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ae6946640 1 -- 172.21.15.22:0/3258259887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0094d0 con 0x7f6ae015f0a0 2023-11-24T06:16:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ae6946640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae015f0a0 0x7f6ae015a260 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800cd50 tx=0x7f6ad800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ad6ffd640 1 -- 172.21.15.22:0/3258259887 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800f680 con 0x7f6ae015f0a0 2023-11-24T06:16:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ad6ffd640 1 -- 172.21.15.22:0/3258259887 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad800f800 con 0x7f6ae015f0a0 2023-11-24T06:16:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ad6ffd640 1 -- 172.21.15.22:0/3258259887 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800fbb0 con 0x7f6ae015f0a0 2023-11-24T06:16:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.383+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae00c9980 con 0x7f6ae015f0a0 2023-11-24T06:16:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.384+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae00c9f40 con 0x7f6ae015f0a0 2023-11-24T06:16:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.385+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae00ca160 con 0x7f6ae015f0a0 2023-11-24T06:16:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.386+0000 7f6ad6ffd640 1 -- 172.21.15.22:0/3258259887 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6ad800b040 con 0x7f6ae015f0a0 2023-11-24T06:16:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.387+0000 7f6ad6ffd640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6ac406aff0 0x7f6ac406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.387+0000 7f6ad6ffd640 1 -- 172.21.15.22:0/3258259887 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6ad808a460 con 0x7f6ae015f0a0 2023-11-24T06:16:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.387+0000 7f6ae6145640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6ac406aff0 0x7f6ac406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.388+0000 7f6ae6145640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6ac406aff0 0x7f6ac406d4b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6adc036000 tx=0x7f6adc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.392+0000 7f6ad6ffd640 1 -- 172.21.15.22:0/3258259887 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ad80550a0 con 0x7f6ae015f0a0 2023-11-24T06:16:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.587+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ae004e840 con 0x7f6ae015f0a0 2023-11-24T06:16:17.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.590+0000 7f6ad6ffd640 1 -- 172.21.15.22:0/3258259887 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ad80586c0 con 0x7f6ae015f0a0 2023-11-24T06:16:17.593 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:16:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6ac406aff0 msgr2=0x7f6ac406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6ac406aff0 0x7f6ac406d4b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6adc036000 tx=0x7f6adc008030 comp rx=0 tx=0).stop 2023-11-24T06:16:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae015f0a0 msgr2=0x7f6ae015a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae015f0a0 0x7f6ae015a260 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800cd50 tx=0x7f6ad800a650 comp rx=0 tx=0).stop 2023-11-24T06:16:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 shutdown_connections 2023-11-24T06:16:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6ac406aff0 0x7f6ac406d4b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae015f0a0 0x7f6ae015a260 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ae0144770 0x7f6ae00cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 --2- 172.21.15.22:0/3258259887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae00b35a0 0x7f6ae00c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 >> 172.21.15.22:0/3258259887 conn(0x7f6ae00cec10 msgr2=0x7f6ae015da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 shutdown_connections 2023-11-24T06:16:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.593+0000 7f6ae7147640 1 -- 172.21.15.22:0/3258259887 wait complete. 2023-11-24T06:16:17.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:17.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.833+0000 7f94eef21640 1 Processor -- start 2023-11-24T06:16:17.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.833+0000 7f94eef21640 1 -- start start 2023-11-24T06:16:17.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.835+0000 7f94eef21640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94e813dfd0 0x7f94e815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.835+0000 7f94eef21640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80ce7c0 con 0x7f94e80cf500 2023-11-24T06:16:17.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.835+0000 7f94eef21640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e8140900 con 0x7f94e80cf050 2023-11-24T06:16:17.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.835+0000 7f94eef21640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e806cf50 con 0x7f94e813dfd0 2023-11-24T06:16:17.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.835+0000 7f94ee720640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f94e80cf500 0x7f94e806c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45836/0 (socket says 172.21.15.22:45836) 2023-11-24T06:16:17.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.835+0000 7f94ee720640 1 -- 172.21.15.22:0/879267637 learned_addr learned my addr 172.21.15.22:0/879267637 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:17.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576076026 0 0) 0x7f94e80ce7c0 con 0x7f94e80cf500 2023-11-24T06:16:17.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d4003520 con 0x7f94e80cf500 2023-11-24T06:16:17.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94edf1f640 1 --2- 172.21.15.22:0/879267637 >> v2:172.21.15.31:3300/0 conn(0x7f94e813dfd0 0x7f94e815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 786787740 0 0) 0x7f94d4003520 con 0x7f94e80cf500 2023-11-24T06:16:17.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 >> v2:172.21.15.31:3300/0 conn(0x7f94e813dfd0 msgr2=0x7f94e815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 --2- 172.21.15.22:0/879267637 >> v2:172.21.15.31:3300/0 conn(0x7f94e813dfd0 0x7f94e815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 >> v1:172.21.15.31:6789/0 conn(0x7f94e80cf050 legacy=0x7f94e806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e815fa70 con 0x7f94e80cf500 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f94e00019f0 con 0x7f94e80cf500 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 >> v1:172.21.15.22:6789/0 conn(0x7f94e80cf500 legacy=0x7f94e806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94d4003a30 0x7f94d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40047c0 0x7f94d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94d40052a0 0x7f94d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e806cf50 con 0x7f94d40052a0 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d400c1a0 con 0x7f94d40047c0 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.836+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d400c360 con 0x7f94d4003a30 2023-11-24T06:16:17.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.837+0000 7f94ee720640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94d40052a0 0x7f94d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.837+0000 7f94edf1f640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94d4003a30 0x7f94d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.837+0000 7f94ed71e640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40047c0 0x7f94d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.837+0000 7f94ee720640 1 -- 172.21.15.22:0/879267637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94d4003a30 msgr2=0x7f94d4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:17.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.837+0000 7f94ee720640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94d4003a30 0x7f94d4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.837+0000 7f94ee720640 1 -- 172.21.15.22:0/879267637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40047c0 msgr2=0x7f94d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:17.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.837+0000 7f94ee720640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40047c0 0x7f94d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.837+0000 7f94ee720640 1 -- 172.21.15.22:0/879267637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4003520 con 0x7f94d40052a0 2023-11-24T06:16:17.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.837+0000 7f94ed71e640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40047c0 0x7f94d4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:17.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.838+0000 7f94ee720640 1 -- 172.21.15.22:0/879267637 reap_dead start 2023-11-24T06:16:17.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.838+0000 7f94ee720640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94d40052a0 0x7f94d400b980 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f94e000a720 tx=0x7f94d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833509289106b156 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.838+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0034630 con 0x7f94d40052a0 2023-11-24T06:16:17.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.839+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e002f070 con 0x7f94d40052a0 2023-11-24T06:16:17.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.839+0000 7f94ecf1d640 1 -- 172.21.15.22:0/879267637 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00349d0 con 0x7f94d40052a0 2023-11-24T06:16:17.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.839+0000 7f94eef21640 1 -- 172.21.15.22:0/879267637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94d40052a0 msgr2=0x7f94d400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.839+0000 7f94eef21640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94d40052a0 0x7f94d400b980 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f94e000a720 tx=0x7f94d40057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.839+0000 7f94eef21640 1 -- 172.21.15.22:0/879267637 shutdown_connections 2023-11-24T06:16:17.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.839+0000 7f94eef21640 1 --2- 172.21.15.22:0/879267637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94d40052a0 0x7f94d400b980 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.839+0000 7f94eef21640 1 -- 172.21.15.22:0/879267637 >> 172.21.15.22:0/879267637 conn(0x7f94e806a860 msgr2=0x7f94e806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:17.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.839+0000 7f94eef21640 1 -- 172.21.15.22:0/879267637 shutdown_connections 2023-11-24T06:16:17.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.839+0000 7f94eef21640 1 -- 172.21.15.22:0/879267637 wait complete. 2023-11-24T06:16:17.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.841+0000 7f94eef21640 1 Processor -- start 2023-11-24T06:16:17.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.841+0000 7f94eef21640 1 -- start start 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.842+0000 7f94eef21640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40052a0 0x7f94e81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.842+0000 7f94eef21640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94e815e8a0 0x7f94e80cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.842+0000 7f94eef21640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94e80cb640 0x7f94e806c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.842+0000 7f94eef21640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8135df0 con 0x7f94e80cb640 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.842+0000 7f94eef21640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e815c050 con 0x7f94d40052a0 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.842+0000 7f94eef21640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e81586e0 con 0x7f94e815e8a0 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.842+0000 7f94ee720640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94e80cb640 0x7f94e806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94ee720640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94e80cb640 0x7f94e806c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56914/0 (socket says 172.21.15.22:56914) 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94ee720640 1 -- 172.21.15.22:0/1374045678 learned_addr learned my addr 172.21.15.22:0/1374045678 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94ed71e640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94e815e8a0 0x7f94e80cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94edf1f640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40052a0 0x7f94e81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94ee720640 1 -- 172.21.15.22:0/1374045678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94e815e8a0 msgr2=0x7f94e80cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94ee720640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94e815e8a0 0x7f94e80cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94ee720640 1 -- 172.21.15.22:0/1374045678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40052a0 msgr2=0x7f94e81581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94ee720640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40052a0 0x7f94e81581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94ee720640 1 -- 172.21.15.22:0/1374045678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e815d800 con 0x7f94e80cb640 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94edf1f640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40052a0 0x7f94e81581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94ee720640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94e80cb640 0x7f94e806c130 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f94e000a720 tx=0x7f94e815f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.843+0000 7f94de7fc640 1 -- 172.21.15.22:0/1374045678 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0004d60 con 0x7f94e80cb640 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.844+0000 7f94de7fc640 1 -- 172.21.15.22:0/1374045678 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e003f470 con 0x7f94e80cb640 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.844+0000 7f94de7fc640 1 -- 172.21.15.22:0/1374045678 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e003f7e0 con 0x7f94e80cb640 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.844+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e815dae0 con 0x7f94e80cb640 2023-11-24T06:16:17.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.844+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e815e0a0 con 0x7f94e80cb640 2023-11-24T06:16:17.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.845+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e804e840 con 0x7f94e80cb640 2023-11-24T06:16:17.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.846+0000 7f94de7fc640 1 -- 172.21.15.22:0/1374045678 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f94e0031030 con 0x7f94e80cb640 2023-11-24T06:16:17.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.847+0000 7f94de7fc640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f94cc06b020 0x7f94cc06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.847+0000 7f94de7fc640 1 -- 172.21.15.22:0/1374045678 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f94e00ab040 con 0x7f94e80cb640 2023-11-24T06:16:17.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.847+0000 7f94edf1f640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f94cc06b020 0x7f94cc06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.848+0000 7f94edf1f640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f94cc06b020 0x7f94cc06d4e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94e815a320 tx=0x7f94e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:17.851+0000 7f94de7fc640 1 -- 172.21.15.22:0/1374045678 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94e0075c90 con 0x7f94e80cb640 2023-11-24T06:16:18.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.085+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94e80ce9a0 con 0x7f94e80cb640 2023-11-24T06:16:18.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.086+0000 7f94de7fc640 1 -- 172.21.15.22:0/1374045678 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f94e00792b0 con 0x7f94e80cb640 2023-11-24T06:16:18.089 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:18.089 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:16:18.090 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f94cc06b020 msgr2=0x7f94cc06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f94cc06b020 0x7f94cc06d4e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94e815a320 tx=0x7f94e4008040 comp rx=0 tx=0).stop 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94e80cb640 msgr2=0x7f94e806c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94e80cb640 0x7f94e806c130 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f94e000a720 tx=0x7f94e815f9e0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 shutdown_connections 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f94cc06b020 0x7f94cc06d4e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94e80cb640 0x7f94e806c130 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94e815e8a0 0x7f94e80cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 --2- 172.21.15.22:0/1374045678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94d40052a0 0x7f94e81581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 >> 172.21.15.22:0/1374045678 conn(0x7f94e806a860 msgr2=0x7f94e815a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:18.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 shutdown_connections 2023-11-24T06:16:18.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.089+0000 7f94eef21640 1 -- 172.21.15.22:0/1374045678 wait complete. 2023-11-24T06:16:18.114 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:18.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.331+0000 7f207567c640 1 Processor -- start 2023-11-24T06:16:18.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.332+0000 7f207567c640 1 -- start start 2023-11-24T06:16:18.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.334+0000 7f207567c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20700abff0 0x7f2070071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.334+0000 7f207567c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207013da30 con 0x7f207015a100 2023-11-24T06:16:18.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.334+0000 7f207567c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20700ac560 con 0x7f20700b39a0 2023-11-24T06:16:18.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.334+0000 7f207567c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700ac840 con 0x7f20700abff0 2023-11-24T06:16:18.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.334+0000 7f206effd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f207015a100 0x7f20700b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45842/0 (socket says 172.21.15.22:45842) 2023-11-24T06:16:18.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.334+0000 7f206effd640 1 -- 172.21.15.22:0/3268976678 learned_addr learned my addr 172.21.15.22:0/3268976678 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:18.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.334+0000 7f206f7fe640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20700abff0 0x7f2070071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.334+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925304172 0 0) 0x7f207013da30 con 0x7f207015a100 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f205c005730 con 0x7f207015a100 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3001077380 0 0) 0x7f205c005730 con 0x7f207015a100 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20700abff0 msgr2=0x7f2070071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20700abff0 0x7f2070071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 >> v1:172.21.15.31:6789/0 conn(0x7f20700b39a0 legacy=0x7f2070071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2070070650 con 0x7f207015a100 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f2060001670 con 0x7f207015a100 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 >> v1:172.21.15.22:6789/0 conn(0x7f207015a100 legacy=0x7f20700b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20700abff0 0x7f205c005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f205c006180 0x7f205c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f205c006f10 0x7f205c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20700ac840 con 0x7f205c006f10 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c00dcd0 con 0x7f205c006180 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c00de90 con 0x7f20700abff0 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.335+0000 7f206f7fe640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f205c006f10 0x7f205c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.336+0000 7f206effd640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20700abff0 0x7f205c005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.336+0000 7f20667fc640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f205c006180 0x7f205c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.336+0000 7f206f7fe640 1 -- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20700abff0 msgr2=0x7f205c005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.336+0000 7f206f7fe640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20700abff0 0x7f205c005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.336+0000 7f206f7fe640 1 -- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f205c006180 msgr2=0x7f205c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.336+0000 7f206f7fe640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f205c006180 0x7f205c0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.336+0000 7f206f7fe640 1 -- 172.21.15.22:0/3268976678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c005730 con 0x7f205c006f10 2023-11-24T06:16:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.337+0000 7f206f7fe640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f205c006f10 0x7f205c007390 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2068009ac0 tx=0x7f205c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2f130c325db44f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.337+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206802c6b0 con 0x7f205c006f10 2023-11-24T06:16:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.337+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206802c810 con 0x7f205c006f10 2023-11-24T06:16:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.337+0000 7f206e7fc640 1 -- 172.21.15.22:0/3268976678 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206802cba0 con 0x7f205c006f10 2023-11-24T06:16:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.338+0000 7f207567c640 1 -- 172.21.15.22:0/3268976678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f205c006f10 msgr2=0x7f205c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.338+0000 7f207567c640 1 --2- 172.21.15.22:0/3268976678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f205c006f10 0x7f205c007390 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2068009ac0 tx=0x7f205c007a00 comp rx=0 tx=0).stop 2023-11-24T06:16:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.338+0000 7f206f7fe640 1 -- 172.21.15.22:0/3268976678 reap_dead start 2023-11-24T06:16:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.338+0000 7f207567c640 1 -- 172.21.15.22:0/3268976678 shutdown_connections 2023-11-24T06:16:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.338+0000 7f207567c640 1 -- 172.21.15.22:0/3268976678 >> 172.21.15.22:0/3268976678 conn(0x7f20700b0d80 msgr2=0x7f20700b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.338+0000 7f207567c640 1 -- 172.21.15.22:0/3268976678 shutdown_connections 2023-11-24T06:16:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.338+0000 7f207567c640 1 -- 172.21.15.22:0/3268976678 wait complete. 2023-11-24T06:16:18.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.340+0000 7f207567c640 1 Processor -- start 2023-11-24T06:16:18.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.340+0000 7f207567c640 1 -- start start 2023-11-24T06:16:18.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.341+0000 7f207567c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f205c006f10 0x7f20701f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.341+0000 7f207567c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20700c9320 0x7f20700c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.341+0000 7f207567c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20701557d0 0x7f2070155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.341+0000 7f207567c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2070156190 con 0x7f20700c9320 2023-11-24T06:16:18.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.341+0000 7f207567c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20700c9de0 con 0x7f20701557d0 2023-11-24T06:16:18.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.341+0000 7f207567c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700ca0c0 con 0x7f205c006f10 2023-11-24T06:16:18.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.341+0000 7f20667fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20700c9320 0x7f20700c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.341+0000 7f20667fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20700c9320 0x7f20700c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56926/0 (socket says 172.21.15.22:56926) 2023-11-24T06:16:18.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.341+0000 7f20667fc640 1 -- 172.21.15.22:0/3257794420 learned_addr learned my addr 172.21.15.22:0/3257794420 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:18.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f206effd640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f205c006f10 0x7f20701f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f20667fc640 1 -- 172.21.15.22:0/3257794420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f205c006f10 msgr2=0x7f20701f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f20667fc640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f205c006f10 0x7f20701f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f20667fc640 1 -- 172.21.15.22:0/3257794420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20701557d0 msgr2=0x7f2070155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f20667fc640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20701557d0 0x7f2070155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f20667fc640 1 -- 172.21.15.22:0/3257794420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20700ccc30 con 0x7f20700c9320 2023-11-24T06:16:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f20667fc640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20700c9320 0x7f20700c97a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f205800e810 tx=0x7f205800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f2067fff640 1 -- 172.21.15.22:0/3257794420 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058003b80 con 0x7f20700c9320 2023-11-24T06:16:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f2067fff640 1 -- 172.21.15.22:0/3257794420 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2058003ce0 con 0x7f20700c9320 2023-11-24T06:16:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20700ccf10 con 0x7f20700c9320 2023-11-24T06:16:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.342+0000 7f2067fff640 1 -- 172.21.15.22:0/3257794420 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058005310 con 0x7f20700c9320 2023-11-24T06:16:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.343+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20701f63b0 con 0x7f20700c9320 2023-11-24T06:16:18.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.344+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20700cca90 con 0x7f20700c9320 2023-11-24T06:16:18.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.344+0000 7f2067fff640 1 -- 172.21.15.22:0/3257794420 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2058005470 con 0x7f20700c9320 2023-11-24T06:16:18.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.345+0000 7f2067fff640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f205006aff0 0x7f205006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.346+0000 7f2067fff640 1 -- 172.21.15.22:0/3257794420 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f20580899c0 con 0x7f20700c9320 2023-11-24T06:16:18.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.346+0000 7f206effd640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f205006aff0 0x7f205006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.346+0000 7f206effd640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f205006aff0 0x7f205006d4b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2060001eb0 tx=0x7f2060000f70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:18.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.350+0000 7f2067fff640 1 -- 172.21.15.22:0/3257794420 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f20700cca90 con 0x7f20700c9320 2023-11-24T06:16:18.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.542+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20700cca90 con 0x7f20700c9320 2023-11-24T06:16:18.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.544+0000 7f2067fff640 1 -- 172.21.15.22:0/3257794420 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16560 (secure 0 0 0) 0x7f20700cca90 con 0x7f20700c9320 2023-11-24T06:16:18.547 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:18.547 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":49,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:42.443698+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:18.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f205006aff0 msgr2=0x7f205006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f205006aff0 0x7f205006d4b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2060001eb0 tx=0x7f2060000f70 comp rx=0 tx=0).stop 2023-11-24T06:16:18.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20700c9320 msgr2=0x7f20700c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20700c9320 0x7f20700c97a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f205800e810 tx=0x7f205800ecd0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 shutdown_connections 2023-11-24T06:16:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f205006aff0 0x7f205006d4b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20701557d0 0x7f2070155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20700c9320 0x7f20700c97a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 --2- 172.21.15.22:0/3257794420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f205c006f10 0x7f20701f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.546+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 >> 172.21.15.22:0/3257794420 conn(0x7f20700b0d80 msgr2=0x7f207006db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.547+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 shutdown_connections 2023-11-24T06:16:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.547+0000 7f207567c640 1 -- 172.21.15.22:0/3257794420 wait complete. 2023-11-24T06:16:18.570 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:16:18.570 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:18.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.787+0000 7f4e95d61640 1 Processor -- start 2023-11-24T06:16:18.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.787+0000 7f4e95d61640 1 -- start start 2023-11-24T06:16:18.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.788+0000 7f4e95d61640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e9015a100 0x7f4e900b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.789+0000 7f4e95d61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e900ae7e0 0x7f4e900b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.789+0000 7f4e95d61640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9013da30 con 0x7f4e900abff0 2023-11-24T06:16:18.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.789+0000 7f4e95d61640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e900ac840 con 0x7f4e9015a100 2023-11-24T06:16:18.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.789+0000 7f4e95d61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900ac560 con 0x7f4e900ae7e0 2023-11-24T06:16:18.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.789+0000 7f4e8ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e900ae7e0 0x7f4e900b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.789+0000 7f4e8ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e900ae7e0 0x7f4e900b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:54282/0 (socket says 172.21.15.22:54282) 2023-11-24T06:16:18.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.789+0000 7f4e8ffff640 1 -- 172.21.15.22:0/2899160796 learned_addr learned my addr 172.21.15.22:0/2899160796 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:18.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.790+0000 7f4e8f7fe640 1 --2- 172.21.15.22:0/2899160796 >> v2:172.21.15.31:3300/0 conn(0x7f4e9015a100 0x7f4e900b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.790+0000 7f4e8ffff640 1 -- 172.21.15.22:0/2899160796 >> v2:172.21.15.31:3300/0 conn(0x7f4e9015a100 msgr2=0x7f4e900b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:18.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.790+0000 7f4e8ffff640 1 --2- 172.21.15.22:0/2899160796 >> v2:172.21.15.31:3300/0 conn(0x7f4e9015a100 0x7f4e900b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.790+0000 7f4e8ffff640 1 -- 172.21.15.22:0/2899160796 >> v1:172.21.15.31:6789/0 conn(0x7f4e900abff0 legacy=0x7f4e9006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.790+0000 7f4e8ffff640 1 -- 172.21.15.22:0/2899160796 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90070650 con 0x7f4e900ae7e0 2023-11-24T06:16:18.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.791+0000 7f4e8ffff640 1 --2- 172.21.15.22:0/2899160796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e900ae7e0 0x7f4e900b37d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009e50 tx=0x7f4e8802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcbbb258da888ba2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:18.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.792+0000 7f4e8effd640 1 -- 172.21.15.22:0/2899160796 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8802cb00 con 0x7f4e900ae7e0 2023-11-24T06:16:18.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.792+0000 7f4e8effd640 1 -- 172.21.15.22:0/2899160796 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8802cc60 con 0x7f4e900ae7e0 2023-11-24T06:16:18.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.792+0000 7f4e8effd640 1 -- 172.21.15.22:0/2899160796 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e880343f0 con 0x7f4e900ae7e0 2023-11-24T06:16:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.793+0000 7f4e95d61640 1 -- 172.21.15.22:0/2899160796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e900ae7e0 msgr2=0x7f4e900b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.793+0000 7f4e95d61640 1 --2- 172.21.15.22:0/2899160796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e900ae7e0 0x7f4e900b37d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009e50 tx=0x7f4e8802bf60 comp rx=0 tx=0).stop 2023-11-24T06:16:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.793+0000 7f4e95d61640 1 -- 172.21.15.22:0/2899160796 shutdown_connections 2023-11-24T06:16:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.793+0000 7f4e95d61640 1 --2- 172.21.15.22:0/2899160796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e900ae7e0 0x7f4e900b37d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.793+0000 7f4e95d61640 1 --2- 172.21.15.22:0/2899160796 >> v2:172.21.15.31:3300/0 conn(0x7f4e9015a100 0x7f4e900b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.793+0000 7f4e95d61640 1 -- 172.21.15.22:0/2899160796 >> 172.21.15.22:0/2899160796 conn(0x7f4e900b0d80 msgr2=0x7f4e900b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.793+0000 7f4e95d61640 1 -- 172.21.15.22:0/2899160796 shutdown_connections 2023-11-24T06:16:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.793+0000 7f4e95d61640 1 -- 172.21.15.22:0/2899160796 wait complete. 2023-11-24T06:16:18.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.795+0000 7f4e95d61640 1 Processor -- start 2023-11-24T06:16:18.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.795+0000 7f4e95d61640 1 -- start start 2023-11-24T06:16:18.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.796+0000 7f4e95d61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e900abff0 0x7f4e9015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.796+0000 7f4e95d61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e900ae7e0 0x7f4e900cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.796+0000 7f4e95d61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9015a100 0x7f4e900ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.796+0000 7f4e95d61640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9015d120 con 0x7f4e900abff0 2023-11-24T06:16:18.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.796+0000 7f4e95d61640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9015c4a0 con 0x7f4e900ae7e0 2023-11-24T06:16:18.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.796+0000 7f4e95d61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9015c780 con 0x7f4e9015a100 2023-11-24T06:16:18.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e900abff0 0x7f4e9015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e900abff0 0x7f4e9015bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56934/0 (socket says 172.21.15.22:56934) 2023-11-24T06:16:18.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8f7fe640 1 -- 172.21.15.22:0/2340699264 learned_addr learned my addr 172.21.15.22:0/2340699264 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:18.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e87fff640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e900ae7e0 0x7f4e900cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8ffff640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9015a100 0x7f4e900ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8f7fe640 1 -- 172.21.15.22:0/2340699264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9015a100 msgr2=0x7f4e900ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8f7fe640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9015a100 0x7f4e900ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8f7fe640 1 -- 172.21.15.22:0/2340699264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e900ae7e0 msgr2=0x7f4e900cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8f7fe640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e900ae7e0 0x7f4e900cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8f7fe640 1 -- 172.21.15.22:0/2340699264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88009b30 con 0x7f4e900abff0 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e87fff640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e900ae7e0 0x7f4e900cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.797+0000 7f4e8f7fe640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e900abff0 0x7f4e9015bc50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000e930 tx=0x7f4e8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.798+0000 7f4e8cff9640 1 -- 172.21.15.22:0/2340699264 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80009690 con 0x7f4e900abff0 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.798+0000 7f4e8cff9640 1 -- 172.21.15.22:0/2340699264 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8000ca00 con 0x7f4e900abff0 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.798+0000 7f4e8cff9640 1 -- 172.21.15.22:0/2340699264 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000cdb0 con 0x7f4e900abff0 2023-11-24T06:16:18.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.798+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9015ca60 con 0x7f4e900abff0 2023-11-24T06:16:18.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.798+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9015d540 con 0x7f4e900abff0 2023-11-24T06:16:18.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.799+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e90067ee0 con 0x7f4e900abff0 2023-11-24T06:16:18.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.800+0000 7f4e8cff9640 1 -- 172.21.15.22:0/2340699264 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4e80013470 con 0x7f4e900abff0 2023-11-24T06:16:18.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.801+0000 7f4e8cff9640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e7006b020 0x7f4e7006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.801+0000 7f4e8cff9640 1 -- 172.21.15.22:0/2340699264 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4e80089c00 con 0x7f4e900abff0 2023-11-24T06:16:18.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.801+0000 7f4e87fff640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e7006b020 0x7f4e7006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.802+0000 7f4e87fff640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e7006b020 0x7f4e7006d4e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4e90158eb0 tx=0x7f4e78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:18.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:18.806+0000 7f4e8cff9640 1 -- 172.21.15.22:0/2340699264 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e80090080 con 0x7f4e900abff0 2023-11-24T06:16:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.031+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e90074770 con 0x7f4e900abff0 2023-11-24T06:16:19.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.032+0000 7f4e8cff9640 1 -- 172.21.15.22:0/2340699264 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f4e80017090 con 0x7f4e900abff0 2023-11-24T06:16:19.035 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:19.035 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:16:19.035 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:16:19.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e7006b020 msgr2=0x7f4e7006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e7006b020 0x7f4e7006d4e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4e90158eb0 tx=0x7f4e78009040 comp rx=0 tx=0).stop 2023-11-24T06:16:19.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e900abff0 msgr2=0x7f4e9015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e900abff0 0x7f4e9015bc50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000e930 tx=0x7f4e8000edf0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 shutdown_connections 2023-11-24T06:16:19.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4e7006b020 0x7f4e7006d4e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e9015a100 0x7f4e900ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e900ae7e0 0x7f4e900cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 --2- 172.21.15.22:0/2340699264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e900abff0 0x7f4e9015bc50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 >> 172.21.15.22:0/2340699264 conn(0x7f4e900b0d80 msgr2=0x7f4e90155420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:19.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 shutdown_connections 2023-11-24T06:16:19.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.035+0000 7f4e95d61640 1 -- 172.21.15.22:0/2340699264 wait complete. 2023-11-24T06:16:19.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.270+0000 7f6158aff640 1 Processor -- start 2023-11-24T06:16:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.271+0000 7f6158aff640 1 -- start start 2023-11-24T06:16:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.272+0000 7f6158aff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61540d14a0 0x7f61540d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.272+0000 7f6158aff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61540cf0c0 con 0x7f615415d5b0 2023-11-24T06:16:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.272+0000 7f6158aff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61540d1e40 con 0x7f61540b0640 2023-11-24T06:16:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.272+0000 7f6158aff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61540b01b0 con 0x7f61540d14a0 2023-11-24T06:16:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.272+0000 7f61537fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f615415d5b0 0x7f61540d3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45848/0 (socket says 172.21.15.22:45848) 2023-11-24T06:16:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.273+0000 7f61537fe640 1 -- 172.21.15.22:0/96285923 learned_addr learned my addr 172.21.15.22:0/96285923 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.273+0000 7f614bfff640 1 --2- 172.21.15.22:0/96285923 >> v2:172.21.15.22:3300/0 conn(0x7f61540d14a0 0x7f61540d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.273+0000 7f6152ffd640 1 -- 172.21.15.22:0/96285923 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060289352 0 0) 0x7f61540cf0c0 con 0x7f615415d5b0 2023-11-24T06:16:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.273+0000 7f6152ffd640 1 -- 172.21.15.22:0/96285923 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6140003520 con 0x7f615415d5b0 2023-11-24T06:16:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.273+0000 7f614bfff640 1 -- 172.21.15.22:0/96285923 >> v1:172.21.15.31:6789/0 conn(0x7f61540b0640 legacy=0x7f61540b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.273+0000 7f614bfff640 1 -- 172.21.15.22:0/96285923 >> v1:172.21.15.22:6789/0 conn(0x7f615415d5b0 legacy=0x7f61540d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.273+0000 7f614bfff640 1 -- 172.21.15.22:0/96285923 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615415d990 con 0x7f61540d14a0 2023-11-24T06:16:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.275+0000 7f614bfff640 1 --2- 172.21.15.22:0/96285923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540d14a0 0x7f61540d1900 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f613c0097a0 tx=0x7f613c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36409061b88c9d47 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.275+0000 7f6152ffd640 1 -- 172.21.15.22:0/96285923 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c030610 con 0x7f61540d14a0 2023-11-24T06:16:19.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.275+0000 7f6152ffd640 1 -- 172.21.15.22:0/96285923 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c030770 con 0x7f61540d14a0 2023-11-24T06:16:19.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.275+0000 7f6152ffd640 1 -- 172.21.15.22:0/96285923 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c030b00 con 0x7f61540d14a0 2023-11-24T06:16:19.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.275+0000 7f6158aff640 1 -- 172.21.15.22:0/96285923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540d14a0 msgr2=0x7f61540d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.275+0000 7f6158aff640 1 --2- 172.21.15.22:0/96285923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540d14a0 0x7f61540d1900 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f613c0097a0 tx=0x7f613c02b960 comp rx=0 tx=0).stop 2023-11-24T06:16:19.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.276+0000 7f6158aff640 1 -- 172.21.15.22:0/96285923 shutdown_connections 2023-11-24T06:16:19.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.276+0000 7f6158aff640 1 --2- 172.21.15.22:0/96285923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540d14a0 0x7f61540d1900 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.276+0000 7f6158aff640 1 -- 172.21.15.22:0/96285923 >> 172.21.15.22:0/96285923 conn(0x7f615409c3b0 msgr2=0x7f61540d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:19.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.276+0000 7f6158aff640 1 -- 172.21.15.22:0/96285923 shutdown_connections 2023-11-24T06:16:19.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.276+0000 7f6158aff640 1 -- 172.21.15.22:0/96285923 wait complete. 2023-11-24T06:16:19.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.278+0000 7f6158aff640 1 Processor -- start 2023-11-24T06:16:19.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.278+0000 7f6158aff640 1 -- start start 2023-11-24T06:16:19.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f6158aff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540b0640 0x7f61541528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f6158aff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61540d14a0 0x7f6154160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f6158aff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f615415d5b0 0x7f61540cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f6158aff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6154160a60 con 0x7f61540b0640 2023-11-24T06:16:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f6158aff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540c8260 con 0x7f615415d5b0 2023-11-24T06:16:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f6158aff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61540c8540 con 0x7f61540d14a0 2023-11-24T06:16:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f61537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540b0640 0x7f61541528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f61537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540b0640 0x7f61541528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56952/0 (socket says 172.21.15.22:56952) 2023-11-24T06:16:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f61537fe640 1 -- 172.21.15.22:0/2299553968 learned_addr learned my addr 172.21.15.22:0/2299553968 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.279+0000 7f614bfff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61540d14a0 0x7f6154160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f61537fe640 1 -- 172.21.15.22:0/2299553968 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61540d14a0 msgr2=0x7f6154160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f61537fe640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61540d14a0 0x7f6154160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f61537fe640 1 -- 172.21.15.22:0/2299553968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f615415d5b0 msgr2=0x7f61540cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f61537fe640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f615415d5b0 0x7f61540cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f61537fe640 1 -- 172.21.15.22:0/2299553968 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c009400 con 0x7f61540b0640 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f614bfff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61540d14a0 0x7f6154160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f61537fe640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540b0640 0x7f61541528b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f614400c410 tx=0x7f614400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f6150ff9640 1 -- 172.21.15.22:0/2299553968 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144005ce0 con 0x7f61540b0640 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f6150ff9640 1 -- 172.21.15.22:0/2299553968 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144005e40 con 0x7f61540b0640 2023-11-24T06:16:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61540c8820 con 0x7f61540b0640 2023-11-24T06:16:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f6150ff9640 1 -- 172.21.15.22:0/2299553968 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440072f0 con 0x7f61540b0640 2023-11-24T06:16:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.280+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61540c8de0 con 0x7f61540b0640 2023-11-24T06:16:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.281+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615404e840 con 0x7f61540b0640 2023-11-24T06:16:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.282+0000 7f6150ff9640 1 -- 172.21.15.22:0/2299553968 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6144007510 con 0x7f61540b0640 2023-11-24T06:16:19.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.283+0000 7f6150ff9640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406aff0 0x7f613406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.284+0000 7f6150ff9640 1 -- 172.21.15.22:0/2299553968 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f61440890e0 con 0x7f61540b0640 2023-11-24T06:16:19.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.284+0000 7f614bfff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406aff0 0x7f613406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:19.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.284+0000 7f614bfff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406aff0 0x7f613406d4b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f613c036000 tx=0x7f613c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:19.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.288+0000 7f6150ff9640 1 -- 172.21.15.22:0/2299553968 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6144053ef0 con 0x7f61540b0640 2023-11-24T06:16:19.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.521+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61540678d0 con 0x7f61540b0640 2023-11-24T06:16:19.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.522+0000 7f6150ff9640 1 -- 172.21.15.22:0/2299553968 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f6144057510 con 0x7f61540b0640 2023-11-24T06:16:19.525 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:19.525 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:14.915463+0000","modified":"2023-11-24T06:14:18.001307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/2759331881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2759331881},{"type":"v1","addr":"172.21.15.22:6837","nonce":2759331881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T06:16:19.525 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2023-11-24T06:16:19.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406aff0 msgr2=0x7f613406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406aff0 0x7f613406d4b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f613c036000 tx=0x7f613c03b040 comp rx=0 tx=0).stop 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540b0640 msgr2=0x7f61541528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540b0640 0x7f61541528b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f614400c410 tx=0x7f614400c8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 shutdown_connections 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f613406aff0 0x7f613406d4b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f615415d5b0 0x7f61540cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61540d14a0 0x7f6154160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 --2- 172.21.15.22:0/2299553968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61540b0640 0x7f61541528b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 >> 172.21.15.22:0/2299553968 conn(0x7f615409c3b0 msgr2=0x7f615406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 shutdown_connections 2023-11-24T06:16:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.525+0000 7f6158aff640 1 -- 172.21.15.22:0/2299553968 wait complete. 2023-11-24T06:16:19.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:19.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.772+0000 7f82f6d51640 1 Processor -- start 2023-11-24T06:16:19.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.772+0000 7f82f6d51640 1 -- start start 2023-11-24T06:16:19.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82f6d51640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 0x7f82f00b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82f6d51640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f82f00abff0 0x7f82f00b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82f6d51640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82f00ae7e0 0x7f82f006d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82f6d51640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00ac840 con 0x7f82f00abff0 2023-11-24T06:16:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82f6d51640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f013da30 con 0x7f82f00ae7e0 2023-11-24T06:16:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82f6d51640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00ac560 con 0x7f82f015a100 2023-11-24T06:16:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82effff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f82f00abff0 0x7f82f00b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82effff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f82f00abff0 0x7f82f00b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56962/0 (socket says 172.21.15.22:56962) 2023-11-24T06:16:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82effff640 1 -- 172.21.15.22:0/2025110646 learned_addr learned my addr 172.21.15.22:0/2025110646 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82effff640 1 -- 172.21.15.22:0/2025110646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 msgr2=0x7f82f00b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82effff640 1 --2- 172.21.15.22:0/2025110646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 0x7f82f00b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82effff640 1 -- 172.21.15.22:0/2025110646 >> v2:172.21.15.31:3300/0 conn(0x7f82f00ae7e0 msgr2=0x7f82f006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82effff640 1 --2- 172.21.15.22:0/2025110646 >> v2:172.21.15.31:3300/0 conn(0x7f82f00ae7e0 0x7f82f006d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.774+0000 7f82effff640 1 -- 172.21.15.22:0/2025110646 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0070650 con 0x7f82f00abff0 2023-11-24T06:16:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.776+0000 7f82effff640 1 --2- 172.21.15.22:0/2025110646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 0x7f82f00b37d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f82f00b0d10 tx=0x7f82dc02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8442c7f067d9a18 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.776+0000 7f82ef7fe640 1 -- 172.21.15.22:0/2025110646 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0317d0 con 0x7f82f00abff0 2023-11-24T06:16:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.776+0000 7f82ef7fe640 1 -- 172.21.15.22:0/2025110646 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc031930 con 0x7f82f00abff0 2023-11-24T06:16:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.776+0000 7f82ef7fe640 1 -- 172.21.15.22:0/2025110646 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc031cc0 con 0x7f82f00abff0 2023-11-24T06:16:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.777+0000 7f82f6d51640 1 -- 172.21.15.22:0/2025110646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 msgr2=0x7f82f00b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.777+0000 7f82f6d51640 1 --2- 172.21.15.22:0/2025110646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 0x7f82f00b37d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f82f00b0d10 tx=0x7f82dc02b870 comp rx=0 tx=0).stop 2023-11-24T06:16:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.777+0000 7f82f6d51640 1 -- 172.21.15.22:0/2025110646 shutdown_connections 2023-11-24T06:16:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.777+0000 7f82f6d51640 1 --2- 172.21.15.22:0/2025110646 >> v2:172.21.15.31:3300/0 conn(0x7f82f00ae7e0 0x7f82f006d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.777+0000 7f82f6d51640 1 --2- 172.21.15.22:0/2025110646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 0x7f82f00b37d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.777+0000 7f82f6d51640 1 --2- 172.21.15.22:0/2025110646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 0x7f82f00b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.777+0000 7f82f6d51640 1 -- 172.21.15.22:0/2025110646 >> 172.21.15.22:0/2025110646 conn(0x7f82f00b0d80 msgr2=0x7f82f00b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.777+0000 7f82f6d51640 1 -- 172.21.15.22:0/2025110646 shutdown_connections 2023-11-24T06:16:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.777+0000 7f82f6d51640 1 -- 172.21.15.22:0/2025110646 wait complete. 2023-11-24T06:16:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.779+0000 7f82f6d51640 1 Processor -- start 2023-11-24T06:16:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.779+0000 7f82f6d51640 1 -- start start 2023-11-24T06:16:19.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f6d51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 0x7f82f01f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f6d51640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f00ae7e0 0x7f82f013dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f6d51640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 0x7f82f013e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f6d51640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00b3710 con 0x7f82f00abff0 2023-11-24T06:16:19.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f6d51640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00b3c40 con 0x7f82f00ae7e0 2023-11-24T06:16:19.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f6d51640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00b3960 con 0x7f82f015a100 2023-11-24T06:16:19.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f4aed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 0x7f82f01f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:19.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f4aed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 0x7f82f01f6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56976/0 (socket says 172.21.15.22:56976) 2023-11-24T06:16:19.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f4aed640 1 -- 172.21.15.22:0/3426028112 learned_addr learned my addr 172.21.15.22:0/3426028112 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:19.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f4aed640 1 -- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 msgr2=0x7f82f013e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.780+0000 7f82f52ee640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 0x7f82f013e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:19.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82f4aed640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 0x7f82f013e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82effff640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f00ae7e0 0x7f82f013dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82f4aed640 1 -- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f00ae7e0 msgr2=0x7f82f013dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82f4aed640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f00ae7e0 0x7f82f013dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82f4aed640 1 -- 172.21.15.22:0/3426028112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc0094d0 con 0x7f82f00abff0 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82f52ee640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 0x7f82f013e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82effff640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f00ae7e0 0x7f82f013dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82f4aed640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 0x7f82f01f6760 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f82e400b4a0 tx=0x7f82e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82ed7fa640 1 -- 172.21.15.22:0/3426028112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e4010610 con 0x7f82f00abff0 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82ed7fa640 1 -- 172.21.15.22:0/3426028112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e4010770 con 0x7f82f00abff0 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82ed7fa640 1 -- 172.21.15.22:0/3426028112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e4010b20 con 0x7f82f00abff0 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f00968a0 con 0x7f82f00abff0 2023-11-24T06:16:19.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.781+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f00970a0 con 0x7f82f00abff0 2023-11-24T06:16:19.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.783+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f006edc0 con 0x7f82f00abff0 2023-11-24T06:16:19.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.784+0000 7f82ed7fa640 1 -- 172.21.15.22:0/3426028112 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f82e4010c80 con 0x7f82f00abff0 2023-11-24T06:16:19.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.784+0000 7f82ed7fa640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f82d406aff0 0x7f82d406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:19.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.785+0000 7f82ed7fa640 1 -- 172.21.15.22:0/3426028112 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f82e40895a0 con 0x7f82f00abff0 2023-11-24T06:16:19.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.785+0000 7f82effff640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f82d406aff0 0x7f82d406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:19.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.785+0000 7f82effff640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f82d406aff0 0x7f82d406d4b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f82dc036000 tx=0x7f82dc03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.789+0000 7f82ed7fa640 1 -- 172.21.15.22:0/3426028112 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82e4054380 con 0x7f82f00abff0 2023-11-24T06:16:19.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.987+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82f0074770 con 0x7f82f00abff0 2023-11-24T06:16:19.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.989+0000 7f82ed7fa640 1 -- 172.21.15.22:0/3426028112 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16560 (secure 0 0 0) 0x7f82e40579a0 con 0x7f82f00abff0 2023-11-24T06:16:19.992 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:19.992 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":49,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:14:42.443698+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:12.796187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:13.964719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f82d406aff0 msgr2=0x7f82d406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f82d406aff0 0x7f82d406d4b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f82dc036000 tx=0x7f82dc03d040 comp rx=0 tx=0).stop 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 msgr2=0x7f82f01f6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 0x7f82f01f6760 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f82e400b4a0 tx=0x7f82e400b960 comp rx=0 tx=0).stop 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 shutdown_connections 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f82d406aff0 0x7f82d406d4b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82f015a100 0x7f82f013e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f00ae7e0 0x7f82f013dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 --2- 172.21.15.22:0/3426028112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82f00abff0 0x7f82f01f6760 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 >> 172.21.15.22:0/3426028112 conn(0x7f82f00b0d80 msgr2=0x7f82f0071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 shutdown_connections 2023-11-24T06:16:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:19.992+0000 7f82f6d51640 1 -- 172.21.15.22:0/3426028112 wait complete. 2023-11-24T06:16:20.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:16:20.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.235+0000 7f81d5e52640 1 Processor -- start 2023-11-24T06:16:20.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.236+0000 7f81d5e52640 1 -- start start 2023-11-24T06:16:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.237+0000 7f81d5e52640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81d0141e80 0x7f81d006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.237+0000 7f81d5e52640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d0070bf0 con 0x7f81d015f460 2023-11-24T06:16:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.237+0000 7f81d5e52640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d006d850 con 0x7f81d01416f0 2023-11-24T06:16:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.237+0000 7f81d5e52640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d006db30 con 0x7f81d0141e80 2023-11-24T06:16:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.238+0000 7f81cffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f81d015f460 0x7f81d006cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45858/0 (socket says 172.21.15.22:45858) 2023-11-24T06:16:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.238+0000 7f81cffff640 1 -- 172.21.15.22:0/4276082373 learned_addr learned my addr 172.21.15.22:0/4276082373 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.238+0000 7f81d5651640 1 --2- 172.21.15.22:0/4276082373 >> v2:172.21.15.22:3300/0 conn(0x7f81d0141e80 0x7f81d006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.238+0000 7f81cf7fe640 1 -- 172.21.15.22:0/4276082373 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427232698 0 0) 0x7f81d0070bf0 con 0x7f81d015f460 2023-11-24T06:16:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.238+0000 7f81cf7fe640 1 -- 172.21.15.22:0/4276082373 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c0003520 con 0x7f81d015f460 2023-11-24T06:16:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.238+0000 7f81d5651640 1 -- 172.21.15.22:0/4276082373 >> v1:172.21.15.31:6789/0 conn(0x7f81d01416f0 legacy=0x7f81d015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.238+0000 7f81d5651640 1 -- 172.21.15.22:0/4276082373 >> v1:172.21.15.22:6789/0 conn(0x7f81d015f460 legacy=0x7f81d006cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.238+0000 7f81d5651640 1 -- 172.21.15.22:0/4276082373 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00705a0 con 0x7f81d0141e80 2023-11-24T06:16:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.240+0000 7f81d5651640 1 --2- 172.21.15.22:0/4276082373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d0141e80 0x7f81d006d230 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009d90 tx=0x7f81c802bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290c4c8428b6578f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.240+0000 7f81cf7fe640 1 -- 172.21.15.22:0/4276082373 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c802ccf0 con 0x7f81d0141e80 2023-11-24T06:16:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.240+0000 7f81cf7fe640 1 -- 172.21.15.22:0/4276082373 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c802ce50 con 0x7f81d0141e80 2023-11-24T06:16:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.240+0000 7f81cf7fe640 1 -- 172.21.15.22:0/4276082373 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8034660 con 0x7f81d0141e80 2023-11-24T06:16:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.240+0000 7f81d5e52640 1 -- 172.21.15.22:0/4276082373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d0141e80 msgr2=0x7f81d006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.240+0000 7f81d5e52640 1 --2- 172.21.15.22:0/4276082373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d0141e80 0x7f81d006d230 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009d90 tx=0x7f81c802bf40 comp rx=0 tx=0).stop 2023-11-24T06:16:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.241+0000 7f81d5e52640 1 -- 172.21.15.22:0/4276082373 shutdown_connections 2023-11-24T06:16:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.241+0000 7f81d5e52640 1 --2- 172.21.15.22:0/4276082373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d0141e80 0x7f81d006d230 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.241+0000 7f81d5e52640 1 -- 172.21.15.22:0/4276082373 >> 172.21.15.22:0/4276082373 conn(0x7f81d00b0840 msgr2=0x7f81d00b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.241+0000 7f81d5e52640 1 -- 172.21.15.22:0/4276082373 shutdown_connections 2023-11-24T06:16:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.241+0000 7f81d5e52640 1 -- 172.21.15.22:0/4276082373 wait complete. 2023-11-24T06:16:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.243+0000 7f81d5e52640 1 Processor -- start 2023-11-24T06:16:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.243+0000 7f81d5e52640 1 -- start start 2023-11-24T06:16:20.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d5e52640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d01416f0 0x7f81d00b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d5e52640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81d0141e80 0x7f81d015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d5e52640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81d015f460 0x7f81d015e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d5e52640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d015aba0 con 0x7f81d01416f0 2023-11-24T06:16:20.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d5e52640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d015e910 con 0x7f81d015f460 2023-11-24T06:16:20.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d5e52640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d015b7d0 con 0x7f81d0141e80 2023-11-24T06:16:20.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d4e50640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d01416f0 0x7f81d00b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:20.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d4e50640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d01416f0 0x7f81d00b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56992/0 (socket says 172.21.15.22:56992) 2023-11-24T06:16:20.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d4e50640 1 -- 172.21.15.22:0/1871550702 learned_addr learned my addr 172.21.15.22:0/1871550702 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:20.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d4e50640 1 -- 172.21.15.22:0/1871550702 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81d0141e80 msgr2=0x7f81d015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d4e50640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81d0141e80 0x7f81d015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d4e50640 1 -- 172.21.15.22:0/1871550702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81d015f460 msgr2=0x7f81d015e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d4e50640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81d015f460 0x7f81d015e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.244+0000 7f81d4e50640 1 -- 172.21.15.22:0/1871550702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8009a70 con 0x7f81d01416f0 2023-11-24T06:16:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.245+0000 7f81d4e50640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d01416f0 0x7f81d00b2bd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c400 tx=0x7f81c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.245+0000 7f81cd7fa640 1 -- 172.21.15.22:0/1871550702 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40052d0 con 0x7f81d01416f0 2023-11-24T06:16:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.245+0000 7f81cd7fa640 1 -- 172.21.15.22:0/1871550702 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4005430 con 0x7f81d01416f0 2023-11-24T06:16:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.245+0000 7f81cd7fa640 1 -- 172.21.15.22:0/1871550702 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4003830 con 0x7f81d01416f0 2023-11-24T06:16:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.245+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d015c070 con 0x7f81d01416f0 2023-11-24T06:16:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.245+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d015ba20 con 0x7f81d01416f0 2023-11-24T06:16:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.247+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d004e840 con 0x7f81d01416f0 2023-11-24T06:16:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.248+0000 7f81cd7fa640 1 -- 172.21.15.22:0/1871550702 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f81c4003990 con 0x7f81d01416f0 2023-11-24T06:16:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.249+0000 7f81cd7fa640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f81b406aff0 0x7f81b406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.249+0000 7f81cd7fa640 1 -- 172.21.15.22:0/1871550702 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f81c4088e60 con 0x7f81d01416f0 2023-11-24T06:16:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.249+0000 7f81cffff640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f81b406aff0 0x7f81b406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.250+0000 7f81cffff640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f81b406aff0 0x7f81b406d4b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f81d00cbd30 tx=0x7f81bc007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:20.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.254+0000 7f81cd7fa640 1 -- 172.21.15.22:0/1871550702 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81c4053c40 con 0x7f81d01416f0 2023-11-24T06:16:20.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.490+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f81d00b1580 con 0x7f81d01416f0 2023-11-24T06:16:20.493 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-11-24T06:16:20.491+0000 7f6dde801640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:16:20.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.495+0000 7f81cd7fa640 1 -- 172.21.15.22:0/1871550702 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f81c4017090 con 0x7f81d01416f0 2023-11-24T06:16:20.498 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:16:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.498+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f81b406aff0 msgr2=0x7f81b406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.498+0000 7f81d5e52640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f81b406aff0 0x7f81b406d4b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f81d00cbd30 tx=0x7f81bc007930 comp rx=0 tx=0).stop 2023-11-24T06:16:20.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.498+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d01416f0 msgr2=0x7f81d00b2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.498+0000 7f81d5e52640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d01416f0 0x7f81d00b2bd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c400 tx=0x7f81c400c8c0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.499+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 shutdown_connections 2023-11-24T06:16:20.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.499+0000 7f81d5e52640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f81b406aff0 0x7f81b406d4b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.499+0000 7f81d5e52640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81d015f460 0x7f81d015e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.499+0000 7f81d5e52640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81d0141e80 0x7f81d015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.499+0000 7f81d5e52640 1 --2- 172.21.15.22:0/1871550702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81d01416f0 0x7f81d00b2bd0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.499+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 >> 172.21.15.22:0/1871550702 conn(0x7f81d00b0840 msgr2=0x7f81d00aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:20.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.500+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 shutdown_connections 2023-11-24T06:16:20.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.500+0000 7f81d5e52640 1 -- 172.21.15.22:0/1871550702 wait complete. 2023-11-24T06:16:20.523 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:16:20.532 INFO:tasks.ceph.mds.c.smithi022.stderr: -9550> 2023-11-24T06:14:21.419+0000 7fd2bebdd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:16:20.619 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-11-24T06:16:20.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.723+0000 7f46662ad640 1 Processor -- start 2023-11-24T06:16:20.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.724+0000 7f46662ad640 1 -- start start 2023-11-24T06:16:20.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.725+0000 7f46662ad640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4660160bd0 0x7f46600b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.725+0000 7f46662ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46600b3210 0x7f4660167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.725+0000 7f46662ad640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46600b23e0 con 0x7f46600b48d0 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.725+0000 7f46662ad640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46600cdc70 con 0x7f4660160bd0 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.725+0000 7f46662ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46600b2870 con 0x7f46600b3210 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.725+0000 7f465ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4660160bd0 0x7f46600b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.726+0000 7f465ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4660160bd0 0x7f46600b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57022/0 (socket says 172.21.15.22:57022) 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.726+0000 7f465ffff640 1 -- 172.21.15.22:0/1179651726 learned_addr learned my addr 172.21.15.22:0/1179651726 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.726+0000 7f466484a640 1 --2- 172.21.15.22:0/1179651726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46600b3210 0x7f4660167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.726+0000 7f465ffff640 1 -- 172.21.15.22:0/1179651726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46600b3210 msgr2=0x7f4660167290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.726+0000 7f465ffff640 1 --2- 172.21.15.22:0/1179651726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46600b3210 0x7f4660167290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.726+0000 7f465ffff640 1 -- 172.21.15.22:0/1179651726 >> v1:172.21.15.31:6789/0 conn(0x7f46600b48d0 legacy=0x7f46600b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.726+0000 7f465ffff640 1 -- 172.21.15.22:0/1179651726 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600d41b0 con 0x7f4660160bd0 2023-11-24T06:16:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.727+0000 7f465ffff640 1 --2- 172.21.15.22:0/1179651726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4660160bd0 0x7f46600b1ea0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4650009870 tx=0x7f465002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccac892574485b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.728+0000 7f465f7fe640 1 -- 172.21.15.22:0/1179651726 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650031640 con 0x7f4660160bd0 2023-11-24T06:16:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.728+0000 7f465f7fe640 1 -- 172.21.15.22:0/1179651726 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46500317a0 con 0x7f4660160bd0 2023-11-24T06:16:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.728+0000 7f465f7fe640 1 -- 172.21.15.22:0/1179651726 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650031b30 con 0x7f4660160bd0 2023-11-24T06:16:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.728+0000 7f46662ad640 1 -- 172.21.15.22:0/1179651726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4660160bd0 msgr2=0x7f46600b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.728+0000 7f46662ad640 1 --2- 172.21.15.22:0/1179651726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4660160bd0 0x7f46600b1ea0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4650009870 tx=0x7f465002b8f0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.729+0000 7f46662ad640 1 -- 172.21.15.22:0/1179651726 shutdown_connections 2023-11-24T06:16:20.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.729+0000 7f46662ad640 1 --2- 172.21.15.22:0/1179651726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46600b3210 0x7f4660167290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.729+0000 7f46662ad640 1 --2- 172.21.15.22:0/1179651726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4660160bd0 0x7f46600b1ea0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.729+0000 7f46662ad640 1 -- 172.21.15.22:0/1179651726 >> 172.21.15.22:0/1179651726 conn(0x7f466009c5a0 msgr2=0x7f46600d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:20.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.729+0000 7f46662ad640 1 -- 172.21.15.22:0/1179651726 shutdown_connections 2023-11-24T06:16:20.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.729+0000 7f46662ad640 1 -- 172.21.15.22:0/1179651726 wait complete. 2023-11-24T06:16:20.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.730+0000 7f46662ad640 1 Processor -- start 2023-11-24T06:16:20.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.731+0000 7f46662ad640 1 -- start start 2023-11-24T06:16:20.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.731+0000 7f46662ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46600b3210 0x7f4660158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.731+0000 7f46662ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46600b48d0 0x7f46600cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f46662ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4660160bd0 0x7f46600c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f46662ad640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46600b7ae0 con 0x7f46600b3210 2023-11-24T06:16:20.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f46662ad640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46600b8270 con 0x7f46600b48d0 2023-11-24T06:16:20.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f46662ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46600b8a60 con 0x7f4660160bd0 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f465ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46600b3210 0x7f4660158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f465ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46600b3210 0x7f4660158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57038/0 (socket says 172.21.15.22:57038) 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f465ffff640 1 -- 172.21.15.22:0/2652874796 learned_addr learned my addr 172.21.15.22:0/2652874796 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f465ffff640 1 -- 172.21.15.22:0/2652874796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4660160bd0 msgr2=0x7f46600c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f465ffff640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4660160bd0 0x7f46600c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f465ffff640 1 -- 172.21.15.22:0/2652874796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46600b48d0 msgr2=0x7f46600cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f4657fff640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46600b48d0 0x7f46600cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f465ffff640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46600b48d0 0x7f46600cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.732+0000 7f465ffff640 1 -- 172.21.15.22:0/2652874796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46500094d0 con 0x7f46600b3210 2023-11-24T06:16:20.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.733+0000 7f465ffff640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46600b3210 0x7f4660158150 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4650009870 tx=0x7f46500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:20.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.733+0000 7f465d7fa640 1 -- 172.21.15.22:0/2652874796 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465003ac60 con 0x7f46600b3210 2023-11-24T06:16:20.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.733+0000 7f465d7fa640 1 -- 172.21.15.22:0/2652874796 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465003adc0 con 0x7f46600b3210 2023-11-24T06:16:20.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.733+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46600b8d40 con 0x7f46600b3210 2023-11-24T06:16:20.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.733+0000 7f465d7fa640 1 -- 172.21.15.22:0/2652874796 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650044630 con 0x7f46600b3210 2023-11-24T06:16:20.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.733+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46600b9020 con 0x7f46600b3210 2023-11-24T06:16:20.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.734+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46600b20e0 con 0x7f46600b3210 2023-11-24T06:16:20.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.735+0000 7f465d7fa640 1 -- 172.21.15.22:0/2652874796 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f465002f050 con 0x7f46600b3210 2023-11-24T06:16:20.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.736+0000 7f465d7fa640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f464006aff0 0x7f464006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:20.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.736+0000 7f465d7fa640 1 -- 172.21.15.22:0/2652874796 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f46500ab9f0 con 0x7f46600b3210 2023-11-24T06:16:20.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.737+0000 7f4657fff640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f464006aff0 0x7f464006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:20.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.737+0000 7f4657fff640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f464006aff0 0x7f464006d4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f46600b7a10 tx=0x7f4648009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:20.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.741+0000 7f465d7fa640 1 -- 172.21.15.22:0/2652874796 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46500765e0 con 0x7f46600b3210 2023-11-24T06:16:20.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:20.974+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f46600a1210 con 0x7f46600b3210 2023-11-24T06:16:21.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.617+0000 7f465d7fa640 1 -- 172.21.15.22:0/2652874796 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4650031e60 con 0x7f46600b3210 2023-11-24T06:16:21.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f464006aff0 msgr2=0x7f464006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:21.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f464006aff0 0x7f464006d4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f46600b7a10 tx=0x7f4648009040 comp rx=0 tx=0).stop 2023-11-24T06:16:21.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46600b3210 msgr2=0x7f4660158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:21.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46600b3210 0x7f4660158150 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4650009870 tx=0x7f46500046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 shutdown_connections 2023-11-24T06:16:21.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f464006aff0 0x7f464006d4b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4660160bd0 0x7f46600c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46600b48d0 0x7f46600cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 --2- 172.21.15.22:0/2652874796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46600b3210 0x7f4660158150 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.621+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 >> 172.21.15.22:0/2652874796 conn(0x7f466009c5a0 msgr2=0x7f46600ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:21.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.622+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 shutdown_connections 2023-11-24T06:16:21.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.622+0000 7f46662ad640 1 -- 172.21.15.22:0/2652874796 wait complete. 2023-11-24T06:16:21.648 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:16:21.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:16:21.781 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:16:21.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.921+0000 7f8cd8bbe640 1 Processor -- start 2023-11-24T06:16:21.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.922+0000 7f8cd8bbe640 1 -- start start 2023-11-24T06:16:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.923+0000 7f8cd8bbe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cd409cb30 0x7f8cd40abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.923+0000 7f8cd8bbe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8cd40adb60 0x7f8cd40adf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.923+0000 7f8cd8bbe640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd415b730 con 0x7f8cd415b350 2023-11-24T06:16:21.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.923+0000 7f8cd8bbe640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40ac740 con 0x7f8cd409cb30 2023-11-24T06:16:21.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.923+0000 7f8cd8bbe640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40ac460 con 0x7f8cd40adb60 2023-11-24T06:16:21.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cc9d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cd409cb30 0x7f8cd40abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:21.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cd259c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8cd415b350 0x7f8cd40b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36910/0 (socket says 172.21.15.22:36910) 2023-11-24T06:16:21.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cd259c640 1 -- 172.21.15.22:0/3355281059 learned_addr learned my addr 172.21.15.22:0/3355281059 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cd2d9d640 1 --2- 172.21.15.22:0/3355281059 >> v2:172.21.15.31:3300/0 conn(0x7f8cd40adb60 0x7f8cd40adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cc9d9b640 1 -- 172.21.15.22:0/3355281059 >> v2:172.21.15.31:3300/0 conn(0x7f8cd40adb60 msgr2=0x7f8cd40adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cc9d9b640 1 --2- 172.21.15.22:0/3355281059 >> v2:172.21.15.31:3300/0 conn(0x7f8cd40adb60 0x7f8cd40adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cc9d9b640 1 -- 172.21.15.22:0/3355281059 >> v1:172.21.15.22:6789/0 conn(0x7f8cd415b350 legacy=0x7f8cd40b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cc9d9b640 1 -- 172.21.15.22:0/3355281059 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd40b2a50 con 0x7f8cd409cb30 2023-11-24T06:16:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cd2d9d640 1 --2- 172.21.15.22:0/3355281059 >> v2:172.21.15.31:3300/0 conn(0x7f8cd40adb60 0x7f8cd40adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.924+0000 7f8cd1d9b640 1 -- 172.21.15.22:0/3355281059 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169844717 0 0) 0x7f8cc4001110 con 0x7f8cd415b350 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.925+0000 7f8cc9d9b640 1 --2- 172.21.15.22:0/3355281059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd409cb30 0x7f8cd40abe80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8cd406dac0 tx=0x7f8cbc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a993634d70789ba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.926+0000 7f8cd1d9b640 1 -- 172.21.15.22:0/3355281059 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc031830 con 0x7f8cd409cb30 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.926+0000 7f8cd1d9b640 1 -- 172.21.15.22:0/3355281059 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc031990 con 0x7f8cd409cb30 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.926+0000 7f8cd1d9b640 1 -- 172.21.15.22:0/3355281059 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc031d20 con 0x7f8cd409cb30 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.926+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/3355281059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd409cb30 msgr2=0x7f8cd40abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.926+0000 7f8cd8bbe640 1 --2- 172.21.15.22:0/3355281059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd409cb30 0x7f8cd40abe80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8cd406dac0 tx=0x7f8cbc02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.926+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/3355281059 shutdown_connections 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.926+0000 7f8cd8bbe640 1 --2- 172.21.15.22:0/3355281059 >> v2:172.21.15.31:3300/0 conn(0x7f8cd40adb60 0x7f8cd40adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.926+0000 7f8cd8bbe640 1 --2- 172.21.15.22:0/3355281059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd409cb30 0x7f8cd40abe80 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.926+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/3355281059 >> 172.21.15.22:0/3355281059 conn(0x7f8cd40b0ba0 msgr2=0x7f8cd40b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.927+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/3355281059 shutdown_connections 2023-11-24T06:16:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.927+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/3355281059 wait complete. 2023-11-24T06:16:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.928+0000 7f8cd8bbe640 1 Processor -- start 2023-11-24T06:16:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.929+0000 7f8cd8bbe640 1 -- start start 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.929+0000 7f8cd8bbe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8cd409cb30 0x7f8cd415e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cd8bbe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40adb60 0x7f8cd413ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cd8bbe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cd415b350 0x7f8cd4151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cd8bbe640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd41511f0 con 0x7f8cd40adb60 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cd8bbe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd413cfd0 con 0x7f8cd415b350 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cd8bbe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd415be40 con 0x7f8cd409cb30 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cc9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40adb60 0x7f8cd413ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cc9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40adb60 0x7f8cd413ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43718/0 (socket says 172.21.15.22:43718) 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cc9d9b640 1 -- 172.21.15.22:0/658219755 learned_addr learned my addr 172.21.15.22:0/658219755 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cd2d9d640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cd415b350 0x7f8cd4151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cc9d9b640 1 -- 172.21.15.22:0/658219755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8cd409cb30 msgr2=0x7f8cd415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cc9d9b640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8cd409cb30 0x7f8cd415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cc9d9b640 1 -- 172.21.15.22:0/658219755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cd415b350 msgr2=0x7f8cd4151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cc9d9b640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cd415b350 0x7f8cd4151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.930+0000 7f8cc9d9b640 1 -- 172.21.15.22:0/658219755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc009400 con 0x7f8cd40adb60 2023-11-24T06:16:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.931+0000 7f8cc9d9b640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40adb60 0x7f8cd413ca90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009890 tx=0x7f8cbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.931+0000 7f8ccb7fe640 1 -- 172.21.15.22:0/658219755 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc03ba70 con 0x7f8cd40adb60 2023-11-24T06:16:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.931+0000 7f8ccb7fe640 1 -- 172.21.15.22:0/658219755 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc03bbf0 con 0x7f8cd40adb60 2023-11-24T06:16:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.931+0000 7f8ccb7fe640 1 -- 172.21.15.22:0/658219755 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc045400 con 0x7f8cd40adb60 2023-11-24T06:16:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.931+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd4150b30 con 0x7f8cd40adb60 2023-11-24T06:16:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.931+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd414af80 con 0x7f8cd40adb60 2023-11-24T06:16:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.932+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd4159930 con 0x7f8cd40adb60 2023-11-24T06:16:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.933+0000 7f8ccb7fe640 1 -- 172.21.15.22:0/658219755 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8cbc04e440 con 0x7f8cd40adb60 2023-11-24T06:16:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.934+0000 7f8ccb7fe640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8cb806aff0 0x7f8cb806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.934+0000 7f8ccb7fe640 1 -- 172.21.15.22:0/658219755 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8cbc0abe40 con 0x7f8cd40adb60 2023-11-24T06:16:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.935+0000 7f8cd259c640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8cb806aff0 0x7f8cb806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.935+0000 7f8cd259c640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8cb806aff0 0x7f8cb806d4b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4007fd0 tx=0x7f8cc4007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:21.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:21.939+0000 7f8ccb7fe640 1 -- 172.21.15.22:0/658219755 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cbc076ac0 con 0x7f8cd40adb60 2023-11-24T06:16:22.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.137+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8cd4150990 con 0x7f8cd40adb60 2023-11-24T06:16:22.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.621+0000 7f8ccb7fe640 1 -- 172.21.15.22:0/658219755 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8cd4150990 con 0x7f8cd40adb60 2023-11-24T06:16:22.624 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:16:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.625+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8cb806aff0 msgr2=0x7f8cb806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.625+0000 7f8cd8bbe640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8cb806aff0 0x7f8cb806d4b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4007fd0 tx=0x7f8cc4007960 comp rx=0 tx=0).stop 2023-11-24T06:16:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.625+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40adb60 msgr2=0x7f8cd413ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.625+0000 7f8cd8bbe640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40adb60 0x7f8cd413ca90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009890 tx=0x7f8cbc0046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.626+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 shutdown_connections 2023-11-24T06:16:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.626+0000 7f8cd8bbe640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8cb806aff0 0x7f8cb806d4b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.626+0000 7f8cd8bbe640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cd415b350 0x7f8cd4151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.626+0000 7f8cd8bbe640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40adb60 0x7f8cd413ca90 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.626+0000 7f8cd8bbe640 1 --2- 172.21.15.22:0/658219755 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8cd409cb30 0x7f8cd415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.626+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 >> 172.21.15.22:0/658219755 conn(0x7f8cd40b0ba0 msgr2=0x7f8cd406db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:22.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.626+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 shutdown_connections 2023-11-24T06:16:22.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.626+0000 7f8cd8bbe640 1 -- 172.21.15.22:0/658219755 wait complete. 2023-11-24T06:16:22.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:16:22.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.921+0000 7f5f3549f640 1 Processor -- start 2023-11-24T06:16:22.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.921+0000 7f5f3549f640 1 -- start start 2023-11-24T06:16:22.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.923+0000 7f5f3549f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f30144770 0x7f5f3015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.923+0000 7f5f3549f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f3015f0a0 0x7f5f300ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.923+0000 7f5f3549f640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3015f930 con 0x7f5f300b35a0 2023-11-24T06:16:22.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.923+0000 7f5f3549f640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f300b43b0 con 0x7f5f3015f0a0 2023-11-24T06:16:22.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.923+0000 7f5f3549f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3015f530 con 0x7f5f30144770 2023-11-24T06:16:22.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.923+0000 7f5f2f7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5f300b35a0 0x7f5f3006c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36918/0 (socket says 172.21.15.22:36918) 2023-11-24T06:16:22.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.923+0000 7f5f34c9e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f3015f0a0 0x7f5f300ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.923+0000 7f5f2f7fe640 1 -- 172.21.15.22:0/692721428 learned_addr learned my addr 172.21.15.22:0/692721428 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:22.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.924+0000 7f5f2ffff640 1 --2- 172.21.15.22:0/692721428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f30144770 0x7f5f3015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.924+0000 7f5f34c9e640 1 -- 172.21.15.22:0/692721428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f30144770 msgr2=0x7f5f3015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:22.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.924+0000 7f5f34c9e640 1 --2- 172.21.15.22:0/692721428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f30144770 0x7f5f3015eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.924+0000 7f5f34c9e640 1 -- 172.21.15.22:0/692721428 >> v1:172.21.15.22:6789/0 conn(0x7f5f300b35a0 legacy=0x7f5f3006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.924+0000 7f5f2effd640 1 -- 172.21.15.22:0/692721428 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554322944 0 0) 0x7f5f3015f930 con 0x7f5f300b35a0 2023-11-24T06:16:22.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.924+0000 7f5f34c9e640 1 -- 172.21.15.22:0/692721428 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f300ce9f0 con 0x7f5f3015f0a0 2023-11-24T06:16:22.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.925+0000 7f5f34c9e640 1 --2- 172.21.15.22:0/692721428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f3015f0a0 0x7f5f300ce4b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009dc0 tx=0x7f5f2802be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d1a0573da733fb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:22.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.926+0000 7f5f2effd640 1 -- 172.21.15.22:0/692721428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2802cc40 con 0x7f5f3015f0a0 2023-11-24T06:16:22.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.926+0000 7f5f2effd640 1 -- 172.21.15.22:0/692721428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2802cda0 con 0x7f5f3015f0a0 2023-11-24T06:16:22.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.926+0000 7f5f2effd640 1 -- 172.21.15.22:0/692721428 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28034660 con 0x7f5f3015f0a0 2023-11-24T06:16:22.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.926+0000 7f5f3549f640 1 -- 172.21.15.22:0/692721428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f3015f0a0 msgr2=0x7f5f300ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.926+0000 7f5f3549f640 1 --2- 172.21.15.22:0/692721428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f3015f0a0 0x7f5f300ce4b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009dc0 tx=0x7f5f2802be90 comp rx=0 tx=0).stop 2023-11-24T06:16:22.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.926+0000 7f5f3549f640 1 -- 172.21.15.22:0/692721428 shutdown_connections 2023-11-24T06:16:22.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.926+0000 7f5f3549f640 1 --2- 172.21.15.22:0/692721428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f3015f0a0 0x7f5f300ce4b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.926+0000 7f5f3549f640 1 --2- 172.21.15.22:0/692721428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f30144770 0x7f5f3015eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.926+0000 7f5f3549f640 1 -- 172.21.15.22:0/692721428 >> 172.21.15.22:0/692721428 conn(0x7f5f300cec10 msgr2=0x7f5f300cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:22.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.927+0000 7f5f3549f640 1 -- 172.21.15.22:0/692721428 shutdown_connections 2023-11-24T06:16:22.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.927+0000 7f5f3549f640 1 -- 172.21.15.22:0/692721428 wait complete. 2023-11-24T06:16:22.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.928+0000 7f5f3549f640 1 Processor -- start 2023-11-24T06:16:22.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.928+0000 7f5f3549f640 1 -- start start 2023-11-24T06:16:22.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.929+0000 7f5f3549f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f300b35a0 0x7f5f301f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.929+0000 7f5f3549f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f30144770 0x7f5f30135f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f3549f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3015f0a0 0x7f5f30143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f3549f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f301f39d0 con 0x7f5f30144770 2023-11-24T06:16:22.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f3549f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f301364d0 con 0x7f5f3015f0a0 2023-11-24T06:16:22.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f3549f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f30143b50 con 0x7f5f300b35a0 2023-11-24T06:16:22.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f30144770 0x7f5f30135f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f30144770 0x7f5f30135f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43728/0 (socket says 172.21.15.22:43728) 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f2f7fe640 1 -- 172.21.15.22:0/2088372712 learned_addr learned my addr 172.21.15.22:0/2088372712 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f2ffff640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f300b35a0 0x7f5f301f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f2f7fe640 1 -- 172.21.15.22:0/2088372712 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f300b35a0 msgr2=0x7f5f301f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f2f7fe640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f300b35a0 0x7f5f301f3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f2f7fe640 1 -- 172.21.15.22:0/2088372712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3015f0a0 msgr2=0x7f5f30143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f2f7fe640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3015f0a0 0x7f5f30143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.930+0000 7f5f2f7fe640 1 -- 172.21.15.22:0/2088372712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28009a70 con 0x7f5f30144770 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.931+0000 7f5f2f7fe640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f30144770 0x7f5f30135f90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c430 tx=0x7f5f2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.931+0000 7f5f2cff9640 1 -- 172.21.15.22:0/2088372712 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240074e0 con 0x7f5f30144770 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.931+0000 7f5f2cff9640 1 -- 172.21.15.22:0/2088372712 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f24007660 con 0x7f5f30144770 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.931+0000 7f5f2cff9640 1 -- 172.21.15.22:0/2088372712 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24004a20 con 0x7f5f30144770 2023-11-24T06:16:22.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.931+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f30136c40 con 0x7f5f30144770 2023-11-24T06:16:22.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.931+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f301f2c90 con 0x7f5f30144770 2023-11-24T06:16:22.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.932+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3004e840 con 0x7f5f30144770 2023-11-24T06:16:22.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.933+0000 7f5f2cff9640 1 -- 172.21.15.22:0/2088372712 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5f24004b80 con 0x7f5f30144770 2023-11-24T06:16:22.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.934+0000 7f5f2cff9640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.934+0000 7f5f2cff9640 1 -- 172.21.15.22:0/2088372712 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f5f240895b0 con 0x7f5f30144770 2023-11-24T06:16:22.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.935+0000 7f5f2ffff640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.935+0000 7f5f2ffff640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f20006fd0 tx=0x7f5f20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:22.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:22.939+0000 7f5f2cff9640 1 -- 172.21.15.22:0/2088372712 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f24054590 con 0x7f5f30144770 2023-11-24T06:16:23.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.133+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5f300b2460 con 0x7f5f30144770 2023-11-24T06:16:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.640+0000 7f5f2cff9640 1 -- 172.21.15.22:0/2088372712 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5f24057bb0 con 0x7f5f30144770 2023-11-24T06:16:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-11-24T06:16:23.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.644+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 msgr2=0x7f5f1c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.644+0000 7f5f3549f640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f20006fd0 tx=0x7f5f20008040 comp rx=0 tx=0).stop 2023-11-24T06:16:23.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.644+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f30144770 msgr2=0x7f5f30135f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.644+0000 7f5f3549f640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f30144770 0x7f5f30135f90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c430 tx=0x7f5f2400c8f0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.644+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 shutdown_connections 2023-11-24T06:16:23.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.644+0000 7f5f3549f640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.644+0000 7f5f3549f640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3015f0a0 0x7f5f30143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.644+0000 7f5f3549f640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f30144770 0x7f5f30135f90 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.644+0000 7f5f3549f640 1 --2- 172.21.15.22:0/2088372712 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f300b35a0 0x7f5f301f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.645+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 >> 172.21.15.22:0/2088372712 conn(0x7f5f300cec10 msgr2=0x7f5f30070530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.645+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 shutdown_connections 2023-11-24T06:16:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.645+0000 7f5f3549f640 1 -- 172.21.15.22:0/2088372712 wait complete. 2023-11-24T06:16:23.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:16:23.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.884+0000 7f4c1a9ba640 1 Processor -- start 2023-11-24T06:16:23.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.885+0000 7f4c1a9ba640 1 -- start start 2023-11-24T06:16:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.886+0000 7f4c1a9ba640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4c140ce6f0 0x7f4c140d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.886+0000 7f4c1a9ba640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140cf190 con 0x7f4c140cfcb0 2023-11-24T06:16:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.886+0000 7f4c1a9ba640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140b2e60 con 0x7f4c14160ab0 2023-11-24T06:16:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.886+0000 7f4c1a9ba640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c140cebd0 con 0x7f4c140ce6f0 2023-11-24T06:16:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.886+0000 7f4c191b7640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4c140cfcb0 0x7f4c140b32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36930/0 (socket says 172.21.15.22:36930) 2023-11-24T06:16:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.886+0000 7f4c191b7640 1 -- 172.21.15.22:0/4111023400 learned_addr learned my addr 172.21.15.22:0/4111023400 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.886+0000 7f4c1a1b9640 1 --2- 172.21.15.22:0/4111023400 >> v2:172.21.15.22:3300/0 conn(0x7f4c140ce6f0 0x7f4c140d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.887+0000 7f4c189b6640 1 -- 172.21.15.22:0/4111023400 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939429604 0 0) 0x7f4c140cf190 con 0x7f4c140cfcb0 2023-11-24T06:16:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.887+0000 7f4c189b6640 1 -- 172.21.15.22:0/4111023400 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bfc003520 con 0x7f4c140cfcb0 2023-11-24T06:16:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.887+0000 7f4c1a1b9640 1 -- 172.21.15.22:0/4111023400 >> v1:172.21.15.31:6789/0 conn(0x7f4c14160ab0 legacy=0x7f4c140cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.887+0000 7f4c1a1b9640 1 -- 172.21.15.22:0/4111023400 >> v1:172.21.15.22:6789/0 conn(0x7f4c140cfcb0 legacy=0x7f4c140b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.887+0000 7f4c1a1b9640 1 -- 172.21.15.22:0/4111023400 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140ceeb0 con 0x7f4c140ce6f0 2023-11-24T06:16:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.888+0000 7f4c1a1b9640 1 --2- 172.21.15.22:0/4111023400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c140ce6f0 0x7f4c140d3b80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0097a0 tx=0x7f4c0c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f761ebfc9e143c60 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.888+0000 7f4c189b6640 1 -- 172.21.15.22:0/4111023400 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c031830 con 0x7f4c140ce6f0 2023-11-24T06:16:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.888+0000 7f4c189b6640 1 -- 172.21.15.22:0/4111023400 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c031990 con 0x7f4c140ce6f0 2023-11-24T06:16:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.888+0000 7f4c189b6640 1 -- 172.21.15.22:0/4111023400 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c031d20 con 0x7f4c140ce6f0 2023-11-24T06:16:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.889+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/4111023400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c140ce6f0 msgr2=0x7f4c140d3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.889+0000 7f4c1a9ba640 1 --2- 172.21.15.22:0/4111023400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c140ce6f0 0x7f4c140d3b80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0097a0 tx=0x7f4c0c02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.889+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/4111023400 shutdown_connections 2023-11-24T06:16:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.889+0000 7f4c1a9ba640 1 --2- 172.21.15.22:0/4111023400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c140ce6f0 0x7f4c140d3b80 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.889+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/4111023400 >> 172.21.15.22:0/4111023400 conn(0x7f4c140d3060 msgr2=0x7f4c140d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.889+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/4111023400 shutdown_connections 2023-11-24T06:16:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.889+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/4111023400 wait complete. 2023-11-24T06:16:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.891+0000 7f4c1a9ba640 1 Processor -- start 2023-11-24T06:16:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.891+0000 7f4c1a9ba640 1 -- start start 2023-11-24T06:16:23.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.892+0000 7f4c1a9ba640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c140ce6f0 0x7f4c140b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.892+0000 7f4c1a9ba640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c140cfcb0 0x7f4c140cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.892+0000 7f4c1a9ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14160ab0 0x7f4c1415b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.892+0000 7f4c1a9ba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140cc210 con 0x7f4c14160ab0 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.892+0000 7f4c1a9ba640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140cc4f0 con 0x7f4c140cfcb0 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.892+0000 7f4c1a9ba640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140cc7d0 con 0x7f4c140ce6f0 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.892+0000 7f4c1a1b9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14160ab0 0x7f4c1415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.892+0000 7f4c1a1b9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14160ab0 0x7f4c1415b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43734/0 (socket says 172.21.15.22:43734) 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.892+0000 7f4c1a1b9640 1 -- 172.21.15.22:0/2999309704 learned_addr learned my addr 172.21.15.22:0/2999309704 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c191b7640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c140cfcb0 0x7f4c140cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c1a1b9640 1 -- 172.21.15.22:0/2999309704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c140ce6f0 msgr2=0x7f4c140b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c199b8640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c140ce6f0 0x7f4c140b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c1a1b9640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c140ce6f0 0x7f4c140b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c1a1b9640 1 -- 172.21.15.22:0/2999309704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c140cfcb0 msgr2=0x7f4c140cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c1a1b9640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c140cfcb0 0x7f4c140cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c1a1b9640 1 -- 172.21.15.22:0/2999309704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c009400 con 0x7f4c14160ab0 2023-11-24T06:16:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c191b7640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c140cfcb0 0x7f4c140cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c1a1b9640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14160ab0 0x7f4c1415b310 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0098c0 tx=0x7f4c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.893+0000 7f4c127fc640 1 -- 172.21.15.22:0/2999309704 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c03a630 con 0x7f4c14160ab0 2023-11-24T06:16:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.894+0000 7f4c127fc640 1 -- 172.21.15.22:0/2999309704 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c03a790 con 0x7f4c14160ab0 2023-11-24T06:16:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.894+0000 7f4c127fc640 1 -- 172.21.15.22:0/2999309704 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c03ab40 con 0x7f4c14160ab0 2023-11-24T06:16:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.894+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c140ccab0 con 0x7f4c14160ab0 2023-11-24T06:16:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.894+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c140c99a0 con 0x7f4c14160ab0 2023-11-24T06:16:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.895+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c140ccfd0 con 0x7f4c14160ab0 2023-11-24T06:16:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.896+0000 7f4c127fc640 1 -- 172.21.15.22:0/2999309704 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4c0c03aca0 con 0x7f4c14160ab0 2023-11-24T06:16:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.897+0000 7f4c127fc640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4c0006b070 0x7f4c0006d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.897+0000 7f4c127fc640 1 -- 172.21.15.22:0/2999309704 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4c0c0ab4b0 con 0x7f4c14160ab0 2023-11-24T06:16:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.897+0000 7f4c199b8640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4c0006b070 0x7f4c0006d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.898+0000 7f4c199b8640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4c0006b070 0x7f4c0006d530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4c04007fd0 tx=0x7f4c04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:23.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:23.901+0000 7f4c127fc640 1 -- 172.21.15.22:0/2999309704 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c140ccfd0 con 0x7f4c14160ab0 2023-11-24T06:16:24.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.114+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4c140ccfd0 con 0x7f4c14160ab0 2023-11-24T06:16:24.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.119+0000 7f4c127fc640 1 -- 172.21.15.22:0/2999309704 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c140ccfd0 con 0x7f4c14160ab0 2023-11-24T06:16:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.122+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4c0006b070 msgr2=0x7f4c0006d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.122+0000 7f4c1a9ba640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4c0006b070 0x7f4c0006d530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4c04007fd0 tx=0x7f4c04009040 comp rx=0 tx=0).stop 2023-11-24T06:16:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.122+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14160ab0 msgr2=0x7f4c1415b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.122+0000 7f4c1a9ba640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14160ab0 0x7f4c1415b310 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0098c0 tx=0x7f4c0c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.123+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 shutdown_connections 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.123+0000 7f4c1a9ba640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f4c0006b070 0x7f4c0006d530 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.123+0000 7f4c1a9ba640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14160ab0 0x7f4c1415b310 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.123+0000 7f4c1a9ba640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c140cfcb0 0x7f4c140cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.123+0000 7f4c1a9ba640 1 --2- 172.21.15.22:0/2999309704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c140ce6f0 0x7f4c140b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.123+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 >> 172.21.15.22:0/2999309704 conn(0x7f4c140d3060 msgr2=0x7f4c1415e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.123+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 shutdown_connections 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.123+0000 7f4c1a9ba640 1 -- 172.21.15.22:0/2999309704 wait complete. 2023-11-24T06:16:24.143 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-11-24T06:16:24.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.343+0000 7f5ca21e9640 1 Processor -- start 2023-11-24T06:16:24.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.343+0000 7f5ca21e9640 1 -- start start 2023-11-24T06:16:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.344+0000 7f5ca21e9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c9c143570 0x7f5c9c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.344+0000 7f5ca21e9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5c9c143950 0x7f5c9c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.344+0000 7f5ca21e9640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c071700 con 0x7f5c9c15e6b0 2023-11-24T06:16:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.344+0000 7f5ca21e9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c15b410 con 0x7f5c9c143950 2023-11-24T06:16:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.344+0000 7f5ca21e9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c15b130 con 0x7f5c9c143570 2023-11-24T06:16:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.345+0000 7f5ca09e6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5c9c143950 0x7f5c9c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.345+0000 7f5ca09e6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5c9c143950 0x7f5c9c0cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43740/0 (socket says 172.21.15.22:43740) 2023-11-24T06:16:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.345+0000 7f5ca09e6640 1 -- 172.21.15.22:0/721543323 learned_addr learned my addr 172.21.15.22:0/721543323 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.345+0000 7f5ca11e7640 1 --2- 172.21.15.22:0/721543323 >> v2:172.21.15.31:3300/0 conn(0x7f5c9c143570 0x7f5c9c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.345+0000 7f5ca09e6640 1 -- 172.21.15.22:0/721543323 >> v2:172.21.15.31:3300/0 conn(0x7f5c9c143570 msgr2=0x7f5c9c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.345+0000 7f5ca09e6640 1 --2- 172.21.15.22:0/721543323 >> v2:172.21.15.31:3300/0 conn(0x7f5c9c143570 0x7f5c9c0cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.345+0000 7f5ca09e6640 1 -- 172.21.15.22:0/721543323 >> v1:172.21.15.22:6789/0 conn(0x7f5c9c15e6b0 legacy=0x7f5c9c15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.345+0000 7f5ca09e6640 1 -- 172.21.15.22:0/721543323 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c15dbd0 con 0x7f5c9c143950 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.346+0000 7f5ca09e6640 1 --2- 172.21.15.22:0/721543323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 0x7f5c9c0cf590 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c070c70 tx=0x7f5c8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8922683dbf4bf27c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5c93fff640 1 -- 172.21.15.22:0/721543323 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c031870 con 0x7f5c9c143950 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5c93fff640 1 -- 172.21.15.22:0/721543323 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c0319d0 con 0x7f5c9c143950 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5c93fff640 1 -- 172.21.15.22:0/721543323 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c031d60 con 0x7f5c9c143950 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5ca21e9640 1 -- 172.21.15.22:0/721543323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 msgr2=0x7f5c9c0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5ca21e9640 1 --2- 172.21.15.22:0/721543323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 0x7f5c9c0cf590 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c070c70 tx=0x7f5c8c02b910 comp rx=0 tx=0).stop 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5ca21e9640 1 -- 172.21.15.22:0/721543323 shutdown_connections 2023-11-24T06:16:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5ca21e9640 1 --2- 172.21.15.22:0/721543323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 0x7f5c9c0cf590 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5ca21e9640 1 --2- 172.21.15.22:0/721543323 >> v2:172.21.15.31:3300/0 conn(0x7f5c9c143570 0x7f5c9c0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5ca21e9640 1 -- 172.21.15.22:0/721543323 >> 172.21.15.22:0/721543323 conn(0x7f5c9c06a860 msgr2=0x7f5c9c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5ca21e9640 1 -- 172.21.15.22:0/721543323 shutdown_connections 2023-11-24T06:16:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.347+0000 7f5ca21e9640 1 -- 172.21.15.22:0/721543323 wait complete. 2023-11-24T06:16:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.349+0000 7f5ca21e9640 1 Processor -- start 2023-11-24T06:16:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.349+0000 7f5ca21e9640 1 -- start start 2023-11-24T06:16:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.350+0000 7f5ca21e9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c9c143570 0x7f5c9c157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.350+0000 7f5ca21e9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 0x7f5c9c13ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.350+0000 7f5ca21e9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c15e6b0 0x7f5c9c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.350+0000 7f5ca21e9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c13fd40 con 0x7f5c9c143950 2023-11-24T06:16:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.350+0000 7f5ca21e9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c13f0c0 con 0x7f5c9c15e6b0 2023-11-24T06:16:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.350+0000 7f5ca21e9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c13f3a0 con 0x7f5c9c143570 2023-11-24T06:16:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca09e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 0x7f5c9c13ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca09e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 0x7f5c9c13ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43750/0 (socket says 172.21.15.22:43750) 2023-11-24T06:16:24.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca09e6640 1 -- 172.21.15.22:0/1640361127 learned_addr learned my addr 172.21.15.22:0/1640361127 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca11e7640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c9c143570 0x7f5c9c157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca19e8640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c15e6b0 0x7f5c9c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca09e6640 1 -- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c9c143570 msgr2=0x7f5c9c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca09e6640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c9c143570 0x7f5c9c157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca09e6640 1 -- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c15e6b0 msgr2=0x7f5c9c0ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca09e6640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c15e6b0 0x7f5c9c0ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca09e6640 1 -- 172.21.15.22:0/1640361127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c0094d0 con 0x7f5c9c143950 2023-11-24T06:16:24.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca19e8640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c15e6b0 0x7f5c9c0ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca11e7640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c9c143570 0x7f5c9c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.351+0000 7f5ca09e6640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 0x7f5c9c13ba40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c02b950 tx=0x7f5c8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.352+0000 7f5c91ffb640 1 -- 172.21.15.22:0/1640361127 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c031860 con 0x7f5c9c143950 2023-11-24T06:16:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.352+0000 7f5c91ffb640 1 -- 172.21.15.22:0/1640361127 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c0443f0 con 0x7f5c9c143950 2023-11-24T06:16:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.352+0000 7f5c91ffb640 1 -- 172.21.15.22:0/1640361127 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c0447a0 con 0x7f5c9c143950 2023-11-24T06:16:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.352+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c13f680 con 0x7f5c9c143950 2023-11-24T06:16:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.352+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c13bf80 con 0x7f5c9c143950 2023-11-24T06:16:24.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.353+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9c13fe80 con 0x7f5c9c143950 2023-11-24T06:16:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.354+0000 7f5c91ffb640 1 -- 172.21.15.22:0/1640361127 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5c8c044900 con 0x7f5c9c143950 2023-11-24T06:16:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.355+0000 7f5c91ffb640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c8006aff0 0x7f5c8006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.355+0000 7f5c91ffb640 1 -- 172.21.15.22:0/1640361127 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5c8c02d040 con 0x7f5c9c143950 2023-11-24T06:16:24.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.355+0000 7f5ca11e7640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c8006aff0 0x7f5c8006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.356+0000 7f5ca11e7640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c8006aff0 0x7f5c8006d4b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800b820 tx=0x7f5c98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.359+0000 7f5c91ffb640 1 -- 172.21.15.22:0/1640361127 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c8c076ed0 con 0x7f5c9c143950 2023-11-24T06:16:24.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.626+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f5c9c04e840 con 0x7f5c9c143950 2023-11-24T06:16:24.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.644+0000 7f5c91ffb640 1 -- 172.21.15.22:0/1640361127 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v241) v1 ==== 140+0+0 (secure 0 0 0) 0x7f5c8c035020 con 0x7f5c9c143950 2023-11-24T06:16:24.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c8006aff0 msgr2=0x7f5c8006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c8006aff0 0x7f5c8006d4b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800b820 tx=0x7f5c98008040 comp rx=0 tx=0).stop 2023-11-24T06:16:24.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 msgr2=0x7f5c9c13ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 0x7f5c9c13ba40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c02b950 tx=0x7f5c8c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 shutdown_connections 2023-11-24T06:16:24.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5c8006aff0 0x7f5c8006d4b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c15e6b0 0x7f5c9c0ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c9c143950 0x7f5c9c13ba40 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 --2- 172.21.15.22:0/1640361127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c9c143570 0x7f5c9c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 >> 172.21.15.22:0/1640361127 conn(0x7f5c9c06a860 msgr2=0x7f5c9c06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:24.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 shutdown_connections 2023-11-24T06:16:24.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.647+0000 7f5ca21e9640 1 -- 172.21.15.22:0/1640361127 wait complete. 2023-11-24T06:16:24.670 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2023-11-24T06:16:24.670 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T06:16:24.671 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T06:16:24.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.892+0000 7f8feab81640 1 Processor -- start 2023-11-24T06:16:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.893+0000 7f8feab81640 1 -- start start 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.894+0000 7f8feab81640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe415d5b0 0x7f8fe40d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.894+0000 7f8feab81640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fe40b1650 0x7f8fe40d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.894+0000 7f8feab81640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe40cf0c0 con 0x7f8fe40d14a0 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.894+0000 7f8feab81640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe40b01b0 con 0x7f8fe40b1650 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.894+0000 7f8feab81640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe415d990 con 0x7f8fe415d5b0 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.894+0000 7f8fea380640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fe40b1650 0x7f8fe40d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.894+0000 7f8fea380640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fe40b1650 0x7f8fe40d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43752/0 (socket says 172.21.15.22:43752) 2023-11-24T06:16:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.894+0000 7f8fea380640 1 -- 172.21.15.22:0/2841472652 learned_addr learned my addr 172.21.15.22:0/2841472652 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.895+0000 7f8fe9b7f640 1 --2- 172.21.15.22:0/2841472652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe415d5b0 0x7f8fe40d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.895+0000 7f8fea380640 1 -- 172.21.15.22:0/2841472652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe415d5b0 msgr2=0x7f8fe40d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.895+0000 7f8fea380640 1 --2- 172.21.15.22:0/2841472652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe415d5b0 0x7f8fe40d3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.895+0000 7f8fea380640 1 -- 172.21.15.22:0/2841472652 >> v1:172.21.15.31:6789/0 conn(0x7f8fe40d14a0 legacy=0x7f8fe40cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.895+0000 7f8fea380640 1 -- 172.21.15.22:0/2841472652 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe40d1e40 con 0x7f8fe40b1650 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.896+0000 7f8fea380640 1 --2- 172.21.15.22:0/2841472652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40b1650 0x7f8fe40d1900 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009e50 tx=0x7f8fdc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75026ddc10ed15dc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.896+0000 7f8fe8b7d640 1 -- 172.21.15.22:0/2841472652 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc02ca70 con 0x7f8fe40b1650 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.896+0000 7f8fe8b7d640 1 -- 172.21.15.22:0/2841472652 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc02cbd0 con 0x7f8fe40b1650 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.896+0000 7f8fe8b7d640 1 -- 172.21.15.22:0/2841472652 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0343f0 con 0x7f8fe40b1650 2023-11-24T06:16:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.897+0000 7f8feab81640 1 -- 172.21.15.22:0/2841472652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40b1650 msgr2=0x7f8fe40d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.897+0000 7f8feab81640 1 --2- 172.21.15.22:0/2841472652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40b1650 0x7f8fe40d1900 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009e50 tx=0x7f8fdc02bed0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.897+0000 7f8feab81640 1 -- 172.21.15.22:0/2841472652 shutdown_connections 2023-11-24T06:16:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.897+0000 7f8feab81640 1 --2- 172.21.15.22:0/2841472652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40b1650 0x7f8fe40d1900 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.897+0000 7f8feab81640 1 --2- 172.21.15.22:0/2841472652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe415d5b0 0x7f8fe40d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.897+0000 7f8feab81640 1 -- 172.21.15.22:0/2841472652 >> 172.21.15.22:0/2841472652 conn(0x7f8fe409c3b0 msgr2=0x7f8fe40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.897+0000 7f8feab81640 1 -- 172.21.15.22:0/2841472652 shutdown_connections 2023-11-24T06:16:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.897+0000 7f8feab81640 1 -- 172.21.15.22:0/2841472652 wait complete. 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.899+0000 7f8feab81640 1 Processor -- start 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.899+0000 7f8feab81640 1 -- start start 2023-11-24T06:16:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.900+0000 7f8feab81640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe40b1650 0x7f8fe4149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.900+0000 7f8feab81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40d14a0 0x7f8fe40d3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.900+0000 7f8feab81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fe415d5b0 0x7f8fe40d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.900+0000 7f8feab81640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40ccc60 con 0x7f8fe40d14a0 2023-11-24T06:16:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.900+0000 7f8feab81640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe4149990 con 0x7f8fe415d5b0 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.900+0000 7f8feab81640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40cbfe0 con 0x7f8fe40b1650 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.900+0000 7f8fe937e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40d14a0 0x7f8fe40d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.900+0000 7f8fe937e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40d14a0 0x7f8fe40d3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43762/0 (socket says 172.21.15.22:43762) 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.900+0000 7f8fe937e640 1 -- 172.21.15.22:0/2984934376 learned_addr learned my addr 172.21.15.22:0/2984934376 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fe9b7f640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe40b1650 0x7f8fe4149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fea380640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fe415d5b0 0x7f8fe40d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fe937e640 1 -- 172.21.15.22:0/2984934376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe40b1650 msgr2=0x7f8fe4149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fe937e640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe40b1650 0x7f8fe4149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fe937e640 1 -- 172.21.15.22:0/2984934376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fe415d5b0 msgr2=0x7f8fe40d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fe937e640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fe415d5b0 0x7f8fe40d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fe937e640 1 -- 172.21.15.22:0/2984934376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc009b30 con 0x7f8fe40d14a0 2023-11-24T06:16:24.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fe937e640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40d14a0 0x7f8fe40d3070 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400b3f0 tx=0x7f8fd400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fda7fc640 1 -- 172.21.15.22:0/2984934376 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4011830 con 0x7f8fe40d14a0 2023-11-24T06:16:24.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fda7fc640 1 -- 172.21.15.22:0/2984934376 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4011990 con 0x7f8fe40d14a0 2023-11-24T06:16:24.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.901+0000 7f8fda7fc640 1 -- 172.21.15.22:0/2984934376 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4011d40 con 0x7f8fe40d14a0 2023-11-24T06:16:24.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.902+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe40cc2c0 con 0x7f8fe40d14a0 2023-11-24T06:16:24.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.902+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe40cc880 con 0x7f8fe40d14a0 2023-11-24T06:16:24.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.903+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe404e840 con 0x7f8fe40d14a0 2023-11-24T06:16:24.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.904+0000 7f8fda7fc640 1 -- 172.21.15.22:0/2984934376 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8fd401a400 con 0x7f8fe40d14a0 2023-11-24T06:16:24.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.905+0000 7f8fda7fc640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8fc806aff0 0x7f8fc806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.905+0000 7f8fda7fc640 1 -- 172.21.15.22:0/2984934376 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8fd4089440 con 0x7f8fe40d14a0 2023-11-24T06:16:24.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.905+0000 7f8fe9b7f640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8fc806aff0 0x7f8fc806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.906+0000 7f8fe9b7f640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8fc806aff0 0x7f8fc806d4b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0006fd0 tx=0x7f8fe0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:24.909+0000 7f8fda7fc640 1 -- 172.21.15.22:0/2984934376 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8fd4054560 con 0x7f8fe40d14a0 2023-11-24T06:16:25.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.101+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fe40678d0 con 0x7f8fe40d14a0 2023-11-24T06:16:25.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.104+0000 7f8fda7fc640 1 -- 172.21.15.22:0/2984934376 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+12938 (secure 0 0 0) 0x7f8fd4057b80 con 0x7f8fe40d14a0 2023-11-24T06:16:25.107 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:25.107 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":52,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:23.631508+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6837/2759331881":"2023-11-25T06:16:20.491713+0000","172.21.15.22:6835/2759331881":"2023-11-25T06:16:20.491713+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:25.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.106+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8fc806aff0 msgr2=0x7f8fc806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.106+0000 7f8feab81640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8fc806aff0 0x7f8fc806d4b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0006fd0 tx=0x7f8fe0008040 comp rx=0 tx=0).stop 2023-11-24T06:16:25.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.106+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40d14a0 msgr2=0x7f8fe40d3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.106+0000 7f8feab81640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40d14a0 0x7f8fe40d3070 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400b3f0 tx=0x7f8fd400b8b0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.106+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 shutdown_connections 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.106+0000 7f8feab81640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f8fc806aff0 0x7f8fc806d4b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.106+0000 7f8feab81640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fe415d5b0 0x7f8fe40d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.106+0000 7f8feab81640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe40d14a0 0x7f8fe40d3070 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.107+0000 7f8feab81640 1 --2- 172.21.15.22:0/2984934376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fe40b1650 0x7f8fe4149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.107+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 >> 172.21.15.22:0/2984934376 conn(0x7f8fe409c3b0 msgr2=0x7f8fe40b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:25.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.107+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 shutdown_connections 2023-11-24T06:16:25.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.107+0000 7f8feab81640 1 -- 172.21.15.22:0/2984934376 wait complete. 2023-11-24T06:16:25.127 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:25.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:25.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.341+0000 7f5979ea3640 1 Processor -- start 2023-11-24T06:16:25.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.341+0000 7f5979ea3640 1 -- start start 2023-11-24T06:16:25.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.343+0000 7f5979ea3640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f597415f270 0x7f59740cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.343+0000 7f5979ea3640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597415f930 con 0x7f5974144770 2023-11-24T06:16:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.343+0000 7f5979ea3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59740b3b10 con 0x7f597406d9e0 2023-11-24T06:16:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.343+0000 7f5979ea3640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59740b43b0 con 0x7f597415f270 2023-11-24T06:16:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.343+0000 7f5978ea1640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5974144770 0x7f597415eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36946/0 (socket says 172.21.15.22:36946) 2023-11-24T06:16:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.343+0000 7f5978ea1640 1 -- 172.21.15.22:0/2495255814 learned_addr learned my addr 172.21.15.22:0/2495255814 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:25.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.343+0000 7f5973fff640 1 --2- 172.21.15.22:0/2495255814 >> v2:172.21.15.22:3300/0 conn(0x7f597415f270 0x7f59740cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.344+0000 7f5973fff640 1 -- 172.21.15.22:0/2495255814 >> v1:172.21.15.31:6789/0 conn(0x7f597406d9e0 legacy=0x7f59740cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:25.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.344+0000 7f5973fff640 1 -- 172.21.15.22:0/2495255814 >> v1:172.21.15.22:6789/0 conn(0x7f5974144770 legacy=0x7f597415eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.344+0000 7f5973fff640 1 -- 172.21.15.22:0/2495255814 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59740b3df0 con 0x7f597415f270 2023-11-24T06:16:25.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.344+0000 7f59737fe640 1 -- 172.21.15.22:0/2495255814 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818711177 0 0) 0x7f597415f930 con 0x7f5974144770 2023-11-24T06:16:25.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.345+0000 7f5973fff640 1 --2- 172.21.15.22:0/2495255814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597415f270 0x7f59740cd4a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f59600097a0 tx=0x7f596002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e62bc1f2ee9bd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.345+0000 7f59737fe640 1 -- 172.21.15.22:0/2495255814 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960031830 con 0x7f597415f270 2023-11-24T06:16:25.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.345+0000 7f59737fe640 1 -- 172.21.15.22:0/2495255814 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5960031990 con 0x7f597415f270 2023-11-24T06:16:25.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.345+0000 7f59737fe640 1 -- 172.21.15.22:0/2495255814 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960031d20 con 0x7f597415f270 2023-11-24T06:16:25.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.346+0000 7f5979ea3640 1 -- 172.21.15.22:0/2495255814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597415f270 msgr2=0x7f59740cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.346+0000 7f5979ea3640 1 --2- 172.21.15.22:0/2495255814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597415f270 0x7f59740cd4a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f59600097a0 tx=0x7f596002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.346+0000 7f5979ea3640 1 -- 172.21.15.22:0/2495255814 shutdown_connections 2023-11-24T06:16:25.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.346+0000 7f5979ea3640 1 --2- 172.21.15.22:0/2495255814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597415f270 0x7f59740cd4a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.346+0000 7f5979ea3640 1 -- 172.21.15.22:0/2495255814 >> 172.21.15.22:0/2495255814 conn(0x7f59740cec10 msgr2=0x7f59740cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:25.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.346+0000 7f5979ea3640 1 -- 172.21.15.22:0/2495255814 shutdown_connections 2023-11-24T06:16:25.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.346+0000 7f5979ea3640 1 -- 172.21.15.22:0/2495255814 wait complete. 2023-11-24T06:16:25.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.348+0000 7f5979ea3640 1 Processor -- start 2023-11-24T06:16:25.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.348+0000 7f5979ea3640 1 -- start start 2023-11-24T06:16:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.349+0000 7f5979ea3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597406d9e0 0x7f597413a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.349+0000 7f5979ea3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5974144770 0x7f59741e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.349+0000 7f5979ea3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f597415f270 0x7f597413d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.349+0000 7f5979ea3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597413ac50 con 0x7f597406d9e0 2023-11-24T06:16:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.349+0000 7f5979ea3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597415c030 con 0x7f597415f270 2023-11-24T06:16:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.349+0000 7f5979ea3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597415b700 con 0x7f5974144770 2023-11-24T06:16:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.349+0000 7f5978ea1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597406d9e0 0x7f597413a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.349+0000 7f5978ea1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597406d9e0 0x7f597413a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43780/0 (socket says 172.21.15.22:43780) 2023-11-24T06:16:25.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.349+0000 7f5978ea1640 1 -- 172.21.15.22:0/2211229420 learned_addr learned my addr 172.21.15.22:0/2211229420 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:25.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f5973fff640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5974144770 0x7f59741e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f5978ea1640 1 -- 172.21.15.22:0/2211229420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5974144770 msgr2=0x7f59741e57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f5978ea1640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5974144770 0x7f59741e57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f5978ea1640 1 -- 172.21.15.22:0/2211229420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f597415f270 msgr2=0x7f597413d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f5978ea1640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f597415f270 0x7f597413d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f5978ea1640 1 -- 172.21.15.22:0/2211229420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960009400 con 0x7f597406d9e0 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f5978ea1640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597406d9e0 0x7f597413a710 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f596800c4d0 tx=0x7f596800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f59717fa640 1 -- 172.21.15.22:0/2211229420 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680074e0 con 0x7f597406d9e0 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f59717fa640 1 -- 172.21.15.22:0/2211229420 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968007660 con 0x7f597406d9e0 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597415b9e0 con 0x7f597406d9e0 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.350+0000 7f59717fa640 1 -- 172.21.15.22:0/2211229420 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968004a20 con 0x7f597406d9e0 2023-11-24T06:16:25.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.351+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59741e5cf0 con 0x7f597406d9e0 2023-11-24T06:16:25.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.352+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597404e840 con 0x7f597406d9e0 2023-11-24T06:16:25.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.353+0000 7f59717fa640 1 -- 172.21.15.22:0/2211229420 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5968004b80 con 0x7f597406d9e0 2023-11-24T06:16:25.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.354+0000 7f59717fa640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f595806aff0 0x7f595806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.354+0000 7f59717fa640 1 -- 172.21.15.22:0/2211229420 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5968088ea0 con 0x7f597406d9e0 2023-11-24T06:16:25.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.354+0000 7f5973fff640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f595806aff0 0x7f595806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.355+0000 7f5973fff640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f595806aff0 0x7f595806d4b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5960036000 tx=0x7f596003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.358+0000 7f59717fa640 1 -- 172.21.15.22:0/2211229420 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59680540b0 con 0x7f597406d9e0 2023-11-24T06:16:25.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.552+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59740675d0 con 0x7f597406d9e0 2023-11-24T06:16:25.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.553+0000 7f59717fa640 1 -- 172.21.15.22:0/2211229420 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59680180a0 con 0x7f597406d9e0 2023-11-24T06:16:25.556 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:16:25.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.555+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f595806aff0 msgr2=0x7f595806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.555+0000 7f5979ea3640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f595806aff0 0x7f595806d4b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5960036000 tx=0x7f596003c040 comp rx=0 tx=0).stop 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.555+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597406d9e0 msgr2=0x7f597413a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.555+0000 7f5979ea3640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597406d9e0 0x7f597413a710 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f596800c4d0 tx=0x7f596800c990 comp rx=0 tx=0).stop 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.556+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 shutdown_connections 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.556+0000 7f5979ea3640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f595806aff0 0x7f595806d4b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.556+0000 7f5979ea3640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f597415f270 0x7f597413d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.556+0000 7f5979ea3640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5974144770 0x7f59741e57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.556+0000 7f5979ea3640 1 --2- 172.21.15.22:0/2211229420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f597406d9e0 0x7f597413a710 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.556+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 >> 172.21.15.22:0/2211229420 conn(0x7f59740cec10 msgr2=0x7f59740cdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.556+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 shutdown_connections 2023-11-24T06:16:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.556+0000 7f5979ea3640 1 -- 172.21.15.22:0/2211229420 wait complete. 2023-11-24T06:16:25.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-11-24T06:16:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.788+0000 7fd181d83640 1 Processor -- start 2023-11-24T06:16:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.788+0000 7fd181d83640 1 -- start start 2023-11-24T06:16:25.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.789+0000 7fd181d83640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c13dfd0 0x7fd17c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.789+0000 7fd181d83640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd17c0cf4d0 0x7fd17c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.789+0000 7fd181d83640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c0ce7c0 con 0x7fd17c0cf050 2023-11-24T06:16:25.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.789+0000 7fd181d83640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17c140900 con 0x7fd17c0cf4d0 2023-11-24T06:16:25.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.789+0000 7fd181d83640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c15fa70 con 0x7fd17c13dfd0 2023-11-24T06:16:25.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.790+0000 7fd180d81640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c13dfd0 0x7fd17c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.790+0000 7fd180d81640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c13dfd0 0x7fd17c15be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:41388/0 (socket says 172.21.15.22:41388) 2023-11-24T06:16:25.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.790+0000 7fd180d81640 1 -- 172.21.15.22:0/3612040497 learned_addr learned my addr 172.21.15.22:0/3612040497 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:25.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.791+0000 7fd181582640 1 --2- 172.21.15.22:0/3612040497 >> v2:172.21.15.31:3300/0 conn(0x7fd17c0cf4d0 0x7fd17c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.791+0000 7fd180d81640 1 -- 172.21.15.22:0/3612040497 >> v2:172.21.15.31:3300/0 conn(0x7fd17c0cf4d0 msgr2=0x7fd17c06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:25.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.791+0000 7fd180d81640 1 --2- 172.21.15.22:0/3612040497 >> v2:172.21.15.31:3300/0 conn(0x7fd17c0cf4d0 0x7fd17c06c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.791+0000 7fd180d81640 1 -- 172.21.15.22:0/3612040497 >> v1:172.21.15.31:6789/0 conn(0x7fd17c0cf050 legacy=0x7fd17c06c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.791+0000 7fd17b7fe640 1 -- 172.21.15.22:0/3612040497 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588410833 0 0) 0x7fd17c0ce7c0 con 0x7fd17c0cf050 2023-11-24T06:16:25.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.791+0000 7fd180d81640 1 -- 172.21.15.22:0/3612040497 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c15ee60 con 0x7fd17c13dfd0 2023-11-24T06:16:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.793+0000 7fd180d81640 1 --2- 172.21.15.22:0/3612040497 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c13dfd0 0x7fd17c15be70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd16c009e50 tx=0x7fd16c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85ea54581ee7be58 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.794+0000 7fd17b7fe640 1 -- 172.21.15.22:0/3612040497 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c02cb00 con 0x7fd17c13dfd0 2023-11-24T06:16:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.794+0000 7fd17b7fe640 1 -- 172.21.15.22:0/3612040497 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c02cc60 con 0x7fd17c13dfd0 2023-11-24T06:16:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.794+0000 7fd17b7fe640 1 -- 172.21.15.22:0/3612040497 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c0343f0 con 0x7fd17c13dfd0 2023-11-24T06:16:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.794+0000 7fd181d83640 1 -- 172.21.15.22:0/3612040497 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c13dfd0 msgr2=0x7fd17c15be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.794+0000 7fd181d83640 1 --2- 172.21.15.22:0/3612040497 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c13dfd0 0x7fd17c15be70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd16c009e50 tx=0x7fd16c02bf60 comp rx=0 tx=0).stop 2023-11-24T06:16:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.795+0000 7fd181d83640 1 -- 172.21.15.22:0/3612040497 shutdown_connections 2023-11-24T06:16:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.795+0000 7fd181d83640 1 --2- 172.21.15.22:0/3612040497 >> v2:172.21.15.31:3300/0 conn(0x7fd17c0cf4d0 0x7fd17c06c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.795+0000 7fd181d83640 1 --2- 172.21.15.22:0/3612040497 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c13dfd0 0x7fd17c15be70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.795+0000 7fd181d83640 1 -- 172.21.15.22:0/3612040497 >> 172.21.15.22:0/3612040497 conn(0x7fd17c06a860 msgr2=0x7fd17c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:25.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.795+0000 7fd181d83640 1 -- 172.21.15.22:0/3612040497 shutdown_connections 2023-11-24T06:16:25.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.795+0000 7fd181d83640 1 -- 172.21.15.22:0/3612040497 wait complete. 2023-11-24T06:16:25.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.797+0000 7fd181d83640 1 Processor -- start 2023-11-24T06:16:25.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.797+0000 7fd181d83640 1 -- start start 2023-11-24T06:16:25.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd181d83640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0cf050 0x7fd17c13b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd181d83640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c0cf4d0 0x7fd17c1582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd181d83640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd17c13dfd0 0x7fd17c13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd181d83640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c1f64b0 con 0x7fd17c13dfd0 2023-11-24T06:16:25.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd181d83640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c1f7310 con 0x7fd17c0cf050 2023-11-24T06:16:25.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd181d83640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c1f6700 con 0x7fd17c0cf4d0 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd181582640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd17c13dfd0 0x7fd17c13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd181582640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd17c13dfd0 0x7fd17c13e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43790/0 (socket says 172.21.15.22:43790) 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd181582640 1 -- 172.21.15.22:0/537680476 learned_addr learned my addr 172.21.15.22:0/537680476 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.798+0000 7fd17bfff640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c0cf4d0 0x7fd17c1582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd181582640 1 -- 172.21.15.22:0/537680476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c0cf4d0 msgr2=0x7fd17c1582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd181582640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c0cf4d0 0x7fd17c1582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd181582640 1 -- 172.21.15.22:0/537680476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0cf050 msgr2=0x7fd17c13b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd181582640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0cf050 0x7fd17c13b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd181582640 1 -- 172.21.15.22:0/537680476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c009b30 con 0x7fd17c13dfd0 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd17bfff640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c0cf4d0 0x7fd17c1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:25.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd181582640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd17c13dfd0 0x7fd17c13e8c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd17400e960 tx=0x7fd17400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd1797fa640 1 -- 172.21.15.22:0/537680476 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174009690 con 0x7fd17c13dfd0 2023-11-24T06:16:25.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd1797fa640 1 -- 172.21.15.22:0/537680476 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17400c980 con 0x7fd17c13dfd0 2023-11-24T06:16:25.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd1797fa640 1 -- 172.21.15.22:0/537680476 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17400cd30 con 0x7fd17c13dfd0 2023-11-24T06:16:25.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c1f69e0 con 0x7fd17c13dfd0 2023-11-24T06:16:25.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.799+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c1f6fa0 con 0x7fd17c13dfd0 2023-11-24T06:16:25.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.800+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c04e840 con 0x7fd17c13dfd0 2023-11-24T06:16:25.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.801+0000 7fd1797fa640 1 -- 172.21.15.22:0/537680476 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd174013470 con 0x7fd17c13dfd0 2023-11-24T06:16:25.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.802+0000 7fd1797fa640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd15c06aff0 0x7fd15c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.802+0000 7fd1797fa640 1 -- 172.21.15.22:0/537680476 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd1740898b0 con 0x7fd17c13dfd0 2023-11-24T06:16:25.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.803+0000 7fd180d81640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd15c06aff0 0x7fd15c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.803+0000 7fd180d81640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd15c06aff0 0x7fd15c06d4b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd16c035000 tx=0x7fd16c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:25.807+0000 7fd1797fa640 1 -- 172.21.15.22:0/537680476 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd174054940 con 0x7fd17c13dfd0 2023-11-24T06:16:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.070+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7fd17c13f460 con 0x7fd17c13dfd0 2023-11-24T06:16:26.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.654+0000 7fd1797fa640 1 -- 172.21.15.22:0/537680476 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v243) v1 ==== 164+0+0 (secure 0 0 0) 0x7fd1740170e0 con 0x7fd17c13dfd0 2023-11-24T06:16:26.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd15c06aff0 msgr2=0x7fd15c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd15c06aff0 0x7fd15c06d4b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd16c035000 tx=0x7fd16c02e000 comp rx=0 tx=0).stop 2023-11-24T06:16:26.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd17c13dfd0 msgr2=0x7fd17c13e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd17c13dfd0 0x7fd17c13e8c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd17400e960 tx=0x7fd17400ee20 comp rx=0 tx=0).stop 2023-11-24T06:16:26.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 shutdown_connections 2023-11-24T06:16:26.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd15c06aff0 0x7fd15c06d4b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd17c13dfd0 0x7fd17c13e8c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd17c0cf4d0 0x7fd17c1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 --2- 172.21.15.22:0/537680476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0cf050 0x7fd17c13b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.660+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 >> 172.21.15.22:0/537680476 conn(0x7fd17c06a860 msgr2=0x7fd17c0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:26.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.661+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 shutdown_connections 2023-11-24T06:16:26.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.661+0000 7fd181d83640 1 -- 172.21.15.22:0/537680476 wait complete. 2023-11-24T06:16:26.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:16:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.915+0000 7f1b1ae3d640 1 Processor -- start 2023-11-24T06:16:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.915+0000 7f1b1ae3d640 1 -- start start 2023-11-24T06:16:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.917+0000 7f1b1ae3d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1b1415b350 0x7f1b140abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.917+0000 7f1b1ae3d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b1409cb30 0x7f1b140b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.917+0000 7f1b1ae3d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1415b730 con 0x7f1b140adb60 2023-11-24T06:16:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.917+0000 7f1b1ae3d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b140ac740 con 0x7f1b1415b350 2023-11-24T06:16:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.917+0000 7f1b1ae3d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140ac460 con 0x7f1b1409cb30 2023-11-24T06:16:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b193da640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1b140adb60 0x7f1b140adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36956/0 (socket says 172.21.15.22:36956) 2023-11-24T06:16:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b193da640 1 -- 172.21.15.22:0/480100436 learned_addr learned my addr 172.21.15.22:0/480100436 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b18bd9640 1 --2- 172.21.15.22:0/480100436 >> v2:172.21.15.22:3300/0 conn(0x7f1b1415b350 0x7f1b140abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b13fff640 1 --2- 172.21.15.22:0/480100436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b1409cb30 0x7f1b140b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b137fe640 1 -- 172.21.15.22:0/480100436 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772645815 0 0) 0x7f1b0c001490 con 0x7f1b140adb60 2023-11-24T06:16:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b137fe640 1 -- 172.21.15.22:0/480100436 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b04003520 con 0x7f1b140adb60 2023-11-24T06:16:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b18bd9640 1 -- 172.21.15.22:0/480100436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b1409cb30 msgr2=0x7f1b140b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b18bd9640 1 --2- 172.21.15.22:0/480100436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b1409cb30 0x7f1b140b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b18bd9640 1 -- 172.21.15.22:0/480100436 >> v1:172.21.15.22:6789/0 conn(0x7f1b140adb60 legacy=0x7f1b140adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.918+0000 7f1b18bd9640 1 -- 172.21.15.22:0/480100436 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b140b2a50 con 0x7f1b1415b350 2023-11-24T06:16:26.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.920+0000 7f1b18bd9640 1 --2- 172.21.15.22:0/480100436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1415b350 0x7f1b140abe80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1b080097a0 tx=0x7f1b0802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fe18d9e02e7e25 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.920+0000 7f1b137fe640 1 -- 172.21.15.22:0/480100436 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0802d040 con 0x7f1b1415b350 2023-11-24T06:16:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.920+0000 7f1b137fe640 1 -- 172.21.15.22:0/480100436 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b08031810 con 0x7f1b1415b350 2023-11-24T06:16:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.920+0000 7f1b137fe640 1 -- 172.21.15.22:0/480100436 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08031ba0 con 0x7f1b1415b350 2023-11-24T06:16:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.920+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/480100436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1415b350 msgr2=0x7f1b140abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.920+0000 7f1b1ae3d640 1 --2- 172.21.15.22:0/480100436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1415b350 0x7f1b140abe80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1b080097a0 tx=0x7f1b0802b8b0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.921+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/480100436 shutdown_connections 2023-11-24T06:16:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.921+0000 7f1b1ae3d640 1 --2- 172.21.15.22:0/480100436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b1409cb30 0x7f1b140b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.921+0000 7f1b1ae3d640 1 --2- 172.21.15.22:0/480100436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1415b350 0x7f1b140abe80 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.921+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/480100436 >> 172.21.15.22:0/480100436 conn(0x7f1b140b0ba0 msgr2=0x7f1b140b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.921+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/480100436 shutdown_connections 2023-11-24T06:16:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.921+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/480100436 wait complete. 2023-11-24T06:16:26.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.922+0000 7f1b1ae3d640 1 Processor -- start 2023-11-24T06:16:26.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.923+0000 7f1b1ae3d640 1 -- start start 2023-11-24T06:16:26.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.923+0000 7f1b1ae3d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1409cb30 0x7f1b141e1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b1ae3d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b140adb60 0x7f1b141e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b1ae3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b1415b350 0x7f1b141588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b1ae3d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b141e0e20 con 0x7f1b1409cb30 2023-11-24T06:16:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b1ae3d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b141f74e0 con 0x7f1b1415b350 2023-11-24T06:16:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b1ae3d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b141e0760 con 0x7f1b140adb60 2023-11-24T06:16:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b18bd9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1409cb30 0x7f1b141e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b18bd9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1409cb30 0x7f1b141e1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43798/0 (socket says 172.21.15.22:43798) 2023-11-24T06:16:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b18bd9640 1 -- 172.21.15.22:0/2305759008 learned_addr learned my addr 172.21.15.22:0/2305759008 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b193da640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b1415b350 0x7f1b141588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b18bd9640 1 -- 172.21.15.22:0/2305759008 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b140adb60 msgr2=0x7f1b141e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b18bd9640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b140adb60 0x7f1b141e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b18bd9640 1 -- 172.21.15.22:0/2305759008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b1415b350 msgr2=0x7f1b141588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b18bd9640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b1415b350 0x7f1b141588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.924+0000 7f1b18bd9640 1 -- 172.21.15.22:0/2305759008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08009400 con 0x7f1b1409cb30 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.925+0000 7f1b18bd9640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1409cb30 0x7f1b141e1240 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000c00 tx=0x7f1b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.925+0000 7f1b117fa640 1 -- 172.21.15.22:0/2305759008 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0803ad60 con 0x7f1b1409cb30 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.925+0000 7f1b117fa640 1 -- 172.21.15.22:0/2305759008 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b080443f0 con 0x7f1b1409cb30 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.925+0000 7f1b117fa640 1 -- 172.21.15.22:0/2305759008 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080445a0 con 0x7f1b1409cb30 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.925+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b141e0a40 con 0x7f1b1409cb30 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.925+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b14158de0 con 0x7f1b1409cb30 2023-11-24T06:16:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.926+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b14066ed0 con 0x7f1b1409cb30 2023-11-24T06:16:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.927+0000 7f1b117fa640 1 -- 172.21.15.22:0/2305759008 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1b0804d450 con 0x7f1b1409cb30 2023-11-24T06:16:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.929+0000 7f1b117fa640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1af806aff0 0x7f1af806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.929+0000 7f1b117fa640 1 -- 172.21.15.22:0/2305759008 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1b080ab850 con 0x7f1b1409cb30 2023-11-24T06:16:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.929+0000 7f1b13fff640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1af806aff0 0x7f1af806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.930+0000 7f1b13fff640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1af806aff0 0x7f1af806d4b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1b00006a90 tx=0x7f1b00006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:26.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:26.934+0000 7f1b117fa640 1 -- 172.21.15.22:0/2305759008 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b08076860 con 0x7f1b1409cb30 2023-11-24T06:16:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.129+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1b1409d200 con 0x7f1b1409cb30 2023-11-24T06:16:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.136+0000 7f1b117fa640 1 -- 172.21.15.22:0/2305759008 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1b08079e80 con 0x7f1b1409cb30 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1af806aff0 msgr2=0x7f1af806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1af806aff0 0x7f1af806d4b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1b00006a90 tx=0x7f1b00006a20 comp rx=0 tx=0).stop 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1409cb30 msgr2=0x7f1b141e1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1409cb30 0x7f1b141e1240 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000c00 tx=0x7f1b080046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 shutdown_connections 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1af806aff0 0x7f1af806d4b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b1415b350 0x7f1b141588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b140adb60 0x7f1b141e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 --2- 172.21.15.22:0/2305759008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1409cb30 0x7f1b141e1240 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 >> 172.21.15.22:0/2305759008 conn(0x7f1b140b0ba0 msgr2=0x7f1b1415a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 shutdown_connections 2023-11-24T06:16:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.140+0000 7f1b1ae3d640 1 -- 172.21.15.22:0/2305759008 wait complete. 2023-11-24T06:16:27.161 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:16:27.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:27.283 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:27.423 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:16:27.423 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:16:27.423 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:27.486 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:16:27.487 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:16:27.487 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:27.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:16:27.549 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:16:27.549 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:27.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:16:27.613 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:16:27.614 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:27.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:16:27.679 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:16:27.679 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:27.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.907+0000 7f422daca640 1 Processor -- start 2023-11-24T06:16:27.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.907+0000 7f422daca640 1 -- start start 2023-11-24T06:16:27.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.909+0000 7f422daca640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f422806d250 0x7f422815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.909+0000 7f422daca640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f422815ddb0 0x7f4228070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.909+0000 7f422daca640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4228161670 con 0x7f4228157770 2023-11-24T06:16:27.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.909+0000 7f422daca640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422815e610 con 0x7f422806d250 2023-11-24T06:16:27.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.909+0000 7f422daca640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4228160d40 con 0x7f422815ddb0 2023-11-24T06:16:27.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.909+0000 7f4227fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f422806d250 0x7f422815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.910+0000 7f4227fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f422806d250 0x7f422815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43810/0 (socket says 172.21.15.22:43810) 2023-11-24T06:16:27.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.910+0000 7f4227fff640 1 -- 172.21.15.22:0/698046920 learned_addr learned my addr 172.21.15.22:0/698046920 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:27.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.910+0000 7f4227fff640 1 -- 172.21.15.22:0/698046920 >> v2:172.21.15.31:3300/0 conn(0x7f422815ddb0 msgr2=0x7f4228070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:27.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.910+0000 7f4227fff640 1 --2- 172.21.15.22:0/698046920 >> v2:172.21.15.31:3300/0 conn(0x7f422815ddb0 0x7f4228070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.910+0000 7f4227fff640 1 -- 172.21.15.22:0/698046920 >> v1:172.21.15.31:6789/0 conn(0x7f4228157770 legacy=0x7f422806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:27.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.910+0000 7f4227fff640 1 -- 172.21.15.22:0/698046920 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228161020 con 0x7f422806d250 2023-11-24T06:16:27.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.911+0000 7f4227fff640 1 --2- 172.21.15.22:0/698046920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422806d250 0x7f422815d870 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f42280b1da0 tx=0x7f421402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e1c91e052ed8df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:27.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.911+0000 7f42277fe640 1 -- 172.21.15.22:0/698046920 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214031870 con 0x7f422806d250 2023-11-24T06:16:27.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.911+0000 7f42277fe640 1 -- 172.21.15.22:0/698046920 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42140319d0 con 0x7f422806d250 2023-11-24T06:16:27.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.911+0000 7f42277fe640 1 -- 172.21.15.22:0/698046920 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214031d60 con 0x7f422806d250 2023-11-24T06:16:27.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.912+0000 7f422daca640 1 -- 172.21.15.22:0/698046920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422806d250 msgr2=0x7f422815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.912+0000 7f422daca640 1 --2- 172.21.15.22:0/698046920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422806d250 0x7f422815d870 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f42280b1da0 tx=0x7f421402b910 comp rx=0 tx=0).stop 2023-11-24T06:16:27.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.912+0000 7f422daca640 1 -- 172.21.15.22:0/698046920 shutdown_connections 2023-11-24T06:16:27.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.912+0000 7f422daca640 1 --2- 172.21.15.22:0/698046920 >> v2:172.21.15.31:3300/0 conn(0x7f422815ddb0 0x7f4228070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.912+0000 7f422daca640 1 --2- 172.21.15.22:0/698046920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422806d250 0x7f422815d870 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.912+0000 7f422daca640 1 -- 172.21.15.22:0/698046920 >> 172.21.15.22:0/698046920 conn(0x7f422806a860 msgr2=0x7f422806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:27.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.912+0000 7f422daca640 1 -- 172.21.15.22:0/698046920 shutdown_connections 2023-11-24T06:16:27.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.912+0000 7f422daca640 1 -- 172.21.15.22:0/698046920 wait complete. 2023-11-24T06:16:27.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.914+0000 7f422daca640 1 Processor -- start 2023-11-24T06:16:27.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.914+0000 7f422daca640 1 -- start start 2023-11-24T06:16:27.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.915+0000 7f422daca640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f422806d250 0x7f42281417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.915+0000 7f422daca640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4228157770 0x7f42280cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.915+0000 7f422daca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422815ddb0 0x7f42280ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.915+0000 7f422daca640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42280caea0 con 0x7f422815ddb0 2023-11-24T06:16:27.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.915+0000 7f422daca640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42280cbd00 con 0x7f422806d250 2023-11-24T06:16:27.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.915+0000 7f422daca640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42280cc6d0 con 0x7f4228157770 2023-11-24T06:16:27.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.915+0000 7f422d2c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422815ddb0 0x7f42280ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.915+0000 7f422d2c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422815ddb0 0x7f42280ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43816/0 (socket says 172.21.15.22:43816) 2023-11-24T06:16:27.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f422d2c9640 1 -- 172.21.15.22:0/821713025 learned_addr learned my addr 172.21.15.22:0/821713025 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:27.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f4227fff640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4228157770 0x7f42280cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f422cac8640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f422806d250 0x7f42281417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f422d2c9640 1 -- 172.21.15.22:0/821713025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4228157770 msgr2=0x7f42280cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f422d2c9640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4228157770 0x7f42280cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f422d2c9640 1 -- 172.21.15.22:0/821713025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f422806d250 msgr2=0x7f42281417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f422d2c9640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f422806d250 0x7f42281417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f422d2c9640 1 -- 172.21.15.22:0/821713025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42140094d0 con 0x7f422815ddb0 2023-11-24T06:16:27.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f4227fff640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4228157770 0x7f42280cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:27.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.916+0000 7f422d2c9640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422815ddb0 0x7f42280ccf60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f422000b970 tx=0x7f422000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:27.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.917+0000 7f42257fa640 1 -- 172.21.15.22:0/821713025 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000cb40 con 0x7f422815ddb0 2023-11-24T06:16:27.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.917+0000 7f42257fa640 1 -- 172.21.15.22:0/821713025 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422000ccc0 con 0x7f422815ddb0 2023-11-24T06:16:27.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.917+0000 7f42257fa640 1 -- 172.21.15.22:0/821713025 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220014680 con 0x7f422815ddb0 2023-11-24T06:16:27.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.917+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4228161c80 con 0x7f422815ddb0 2023-11-24T06:16:27.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.917+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42280cb3d0 con 0x7f422815ddb0 2023-11-24T06:16:27.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.918+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4228066e50 con 0x7f422815ddb0 2023-11-24T06:16:27.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.919+0000 7f42257fa640 1 -- 172.21.15.22:0/821713025 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4220007370 con 0x7f422815ddb0 2023-11-24T06:16:27.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.920+0000 7f42257fa640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f420c06aff0 0x7f420c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.920+0000 7f42257fa640 1 -- 172.21.15.22:0/821713025 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4220089640 con 0x7f422815ddb0 2023-11-24T06:16:27.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.920+0000 7f422cac8640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f420c06aff0 0x7f420c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.921+0000 7f422cac8640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f420c06aff0 0x7f420c06d4b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f421c0015d0 tx=0x7f421c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:27.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:27.924+0000 7f42257fa640 1 -- 172.21.15.22:0/821713025 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42200546d0 con 0x7f422815ddb0 2023-11-24T06:16:28.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.156+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f422804e840 con 0x7f422815ddb0 2023-11-24T06:16:28.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.157+0000 7f42257fa640 1 -- 172.21.15.22:0/821713025 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f4220019090 con 0x7f422815ddb0 2023-11-24T06:16:28.160 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:28.160 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3613577677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3613577677},{"type":"v1","addr":"172.21.15.31:6835","nonce":3613577677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1861914084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1861914084},{"type":"v1","addr":"172.21.15.31:6834","nonce":1861914084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/2073825276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2073825276},{"type":"v1","addr":"172.21.15.22:6836","nonce":2073825276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3780370897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":3780370897},{"type":"v1","addr":"172.21.15.22:6837","nonce":3780370897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2023-11-24T06:16:28.160 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2023-11-24T06:16:28.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.159+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f420c06aff0 msgr2=0x7f420c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.159+0000 7f422daca640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f420c06aff0 0x7f420c06d4b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f421c0015d0 tx=0x7f421c009040 comp rx=0 tx=0).stop 2023-11-24T06:16:28.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.159+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422815ddb0 msgr2=0x7f42280ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.159+0000 7f422daca640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422815ddb0 0x7f42280ccf60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f422000b970 tx=0x7f422000be30 comp rx=0 tx=0).stop 2023-11-24T06:16:28.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.160+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 shutdown_connections 2023-11-24T06:16:28.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.160+0000 7f422daca640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f420c06aff0 0x7f420c06d4b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.160+0000 7f422daca640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422815ddb0 0x7f42280ccf60 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.160+0000 7f422daca640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4228157770 0x7f42280cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.160+0000 7f422daca640 1 --2- 172.21.15.22:0/821713025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f422806d250 0x7f42281417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.160+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 >> 172.21.15.22:0/821713025 conn(0x7f422806a860 msgr2=0x7f4228155490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:28.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.160+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 shutdown_connections 2023-11-24T06:16:28.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.160+0000 7f422daca640 1 -- 172.21.15.22:0/821713025 wait complete. 2023-11-24T06:16:28.180 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:16:28.181 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:16:28.181 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:16:28.181 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:16:28.181 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:16:28.181 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:16:28.181 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:16:28.181 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:16:28.182 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:16:28.182 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:16:28.182 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:16:28.182 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:16:28.182 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:16:28.182 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:16:28.183 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:16:28.183 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:16:28.197 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:16:28.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:16:28.198 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:16:28.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:16:28.207 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:16:28.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:16:28.210 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:16:28.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:16:28.247 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:16:28.247 DEBUG:teuthology.parallel:result is None 2023-11-24T06:16:28.253 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:16:28.254 DEBUG:teuthology.parallel:result is None 2023-11-24T06:16:28.259 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:16:28.259 DEBUG:teuthology.parallel:result is None 2023-11-24T06:16:28.267 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:16:28.267 DEBUG:teuthology.parallel:result is None 2023-11-24T06:16:28.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:16:28.412 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-11-24T06:16:28.412 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-11-24T06:16:28.428 INFO:tasks.ceph.mds.d.smithi031.stdout:starting mds.d at 2023-11-24T06:16:28.428 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2023-11-24T06:16:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.456+0000 7f038a11d640 1 Processor -- start 2023-11-24T06:16:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.457+0000 7f038a11d640 1 -- start start 2023-11-24T06:16:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.458+0000 7f038a11d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f038415dc50 0x7f038415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.458+0000 7f038a11d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03840ce230 con 0x7f03840ccc00 2023-11-24T06:16:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.458+0000 7f038a11d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03841611c0 con 0x7f03840cddd0 2023-11-24T06:16:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.458+0000 7f038a11d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0384160fe0 con 0x7f038415dc50 2023-11-24T06:16:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.458+0000 7f03837fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f03840ccc00 0x7f03840ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36966/0 (socket says 172.21.15.22:36966) 2023-11-24T06:16:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.458+0000 7f03837fe640 1 -- 172.21.15.22:0/3209045620 learned_addr learned my addr 172.21.15.22:0/3209045620 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.458+0000 7f0383fff640 1 --2- 172.21.15.22:0/3209045620 >> v2:172.21.15.22:3300/0 conn(0x7f038415dc50 0x7f038415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.459+0000 7f0382ffd640 1 -- 172.21.15.22:0/3209045620 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476214798 0 0) 0x7f03840ce230 con 0x7f03840ccc00 2023-11-24T06:16:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.459+0000 7f0382ffd640 1 -- 172.21.15.22:0/3209045620 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0370003520 con 0x7f03840ccc00 2023-11-24T06:16:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.459+0000 7f0383fff640 1 -- 172.21.15.22:0/3209045620 >> v1:172.21.15.31:6789/0 conn(0x7f03840cddd0 legacy=0x7f03840b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.459+0000 7f0382ffd640 1 -- 172.21.15.22:0/3209045620 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633647584 0 0) 0x7f03841611c0 con 0x7f03840cddd0 2023-11-24T06:16:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.459+0000 7f0383fff640 1 -- 172.21.15.22:0/3209045620 >> v1:172.21.15.22:6789/0 conn(0x7f03840ccc00 legacy=0x7f03840ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.459+0000 7f0383fff640 1 -- 172.21.15.22:0/3209045620 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03841614a0 con 0x7f038415dc50 2023-11-24T06:16:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.460+0000 7f0383fff640 1 --2- 172.21.15.22:0/3209045620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 0x7f038415e0e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f037c009d90 tx=0x7f037c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb7f370c4c1ad59 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.460+0000 7f0382ffd640 1 -- 172.21.15.22:0/3209045620 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c02cd00 con 0x7f038415dc50 2023-11-24T06:16:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.460+0000 7f0382ffd640 1 -- 172.21.15.22:0/3209045620 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c02ce60 con 0x7f038415dc50 2023-11-24T06:16:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.460+0000 7f0382ffd640 1 -- 172.21.15.22:0/3209045620 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c034660 con 0x7f038415dc50 2023-11-24T06:16:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.461+0000 7f038a11d640 1 -- 172.21.15.22:0/3209045620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 msgr2=0x7f038415e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.461+0000 7f038a11d640 1 --2- 172.21.15.22:0/3209045620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 0x7f038415e0e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f037c009d90 tx=0x7f037c02bf50 comp rx=0 tx=0).stop 2023-11-24T06:16:28.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.461+0000 7f038a11d640 1 -- 172.21.15.22:0/3209045620 shutdown_connections 2023-11-24T06:16:28.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.461+0000 7f038a11d640 1 --2- 172.21.15.22:0/3209045620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 0x7f038415e0e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.461+0000 7f038a11d640 1 -- 172.21.15.22:0/3209045620 >> 172.21.15.22:0/3209045620 conn(0x7f03840b23e0 msgr2=0x7f03840cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:28.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.461+0000 7f038a11d640 1 -- 172.21.15.22:0/3209045620 shutdown_connections 2023-11-24T06:16:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.461+0000 7f038a11d640 1 -- 172.21.15.22:0/3209045620 wait complete. 2023-11-24T06:16:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.463+0000 7f038a11d640 1 Processor -- start 2023-11-24T06:16:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.463+0000 7f038a11d640 1 -- start start 2023-11-24T06:16:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f038a11d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03840ccc00 0x7f03841f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f038a11d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03840cddd0 0x7f038406e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f038a11d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 0x7f03840c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f038a11d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0384161e40 con 0x7f038415dc50 2023-11-24T06:16:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f038a11d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03841587b0 con 0x7f03840cddd0 2023-11-24T06:16:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f038a11d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03840add70 con 0x7f03840ccc00 2023-11-24T06:16:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f0383fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 0x7f03840c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f0383fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 0x7f03840c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43860/0 (socket says 172.21.15.22:43860) 2023-11-24T06:16:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f0383fff640 1 -- 172.21.15.22:0/1275213568 learned_addr learned my addr 172.21.15.22:0/1275213568 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f037bfff640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03840cddd0 0x7f038406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.464+0000 7f03837fe640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03840ccc00 0x7f03841f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f0383fff640 1 -- 172.21.15.22:0/1275213568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03840ccc00 msgr2=0x7f03841f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f0383fff640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03840ccc00 0x7f03841f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f0383fff640 1 -- 172.21.15.22:0/1275213568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03840cddd0 msgr2=0x7f038406e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f0383fff640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03840cddd0 0x7f038406e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f0383fff640 1 -- 172.21.15.22:0/1275213568 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c009a70 con 0x7f038415dc50 2023-11-24T06:16:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f0383fff640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 0x7f03840c53d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f037c037040 tx=0x7f037c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f0380ff9640 1 -- 172.21.15.22:0/1275213568 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c03d600 con 0x7f038415dc50 2023-11-24T06:16:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f0380ff9640 1 -- 172.21.15.22:0/1275213568 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c03d7a0 con 0x7f038415dc50 2023-11-24T06:16:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f0380ff9640 1 -- 172.21.15.22:0/1275213568 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c03db50 con 0x7f038415dc50 2023-11-24T06:16:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f038a11d640 1 -- 172.21.15.22:0/1275213568 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03840ad160 con 0x7f038415dc50 2023-11-24T06:16:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.465+0000 7f038a11d640 1 -- 172.21.15.22:0/1275213568 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03840ad720 con 0x7f038415dc50 2023-11-24T06:16:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.467+0000 7f0379ffb640 1 -- 172.21.15.22:0/1275213568 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03840adee0 con 0x7f038415dc50 2023-11-24T06:16:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.468+0000 7f0380ff9640 1 -- 172.21.15.22:0/1275213568 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f037c03b040 con 0x7f038415dc50 2023-11-24T06:16:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.468+0000 7f0380ff9640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f036406aff0 0x7f036406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.469+0000 7f0380ff9640 1 -- 172.21.15.22:0/1275213568 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f037c0ab820 con 0x7f038415dc50 2023-11-24T06:16:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.469+0000 7f03837fe640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f036406aff0 0x7f036406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.469+0000 7f03837fe640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f036406aff0 0x7f036406d4b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0374005880 tx=0x7f0374009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.473+0000 7f0380ff9640 1 -- 172.21.15.22:0/1275213568 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f037c076a60 con 0x7f038415dc50 2023-11-24T06:16:28.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:28.679+0000 7f0379ffb640 1 -- 172.21.15.22:0/1275213568 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0384074770 con 0x7f038415dc50 2023-11-24T06:16:29.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.707+0000 7f0380ff9640 1 -- 172.21.15.22:0/1275213568 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7f037c039020 con 0x7f038415dc50 2023-11-24T06:16:29.710 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 -- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f036406aff0 msgr2=0x7f036406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f036406aff0 0x7f036406d4b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0374005880 tx=0x7f0374009040 comp rx=0 tx=0).stop 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 -- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 msgr2=0x7f03840c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 0x7f03840c53d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f037c037040 tx=0x7f037c004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 -- 172.21.15.22:0/1275213568 shutdown_connections 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f036406aff0 0x7f036406d4b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f038415dc50 0x7f03840c53d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03840cddd0 0x7f038406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 --2- 172.21.15.22:0/1275213568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03840ccc00 0x7f03841f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 -- 172.21.15.22:0/1275213568 >> 172.21.15.22:0/1275213568 conn(0x7f03840b23e0 msgr2=0x7f03840af710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:29.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 -- 172.21.15.22:0/1275213568 shutdown_connections 2023-11-24T06:16:29.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.711+0000 7f0379ffb640 1 -- 172.21.15.22:0/1275213568 wait complete. 2023-11-24T06:16:29.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:16:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.959+0000 7f695df5c640 1 Processor -- start 2023-11-24T06:16:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.959+0000 7f695df5c640 1 -- start start 2023-11-24T06:16:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.961+0000 7f695df5c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f695815ed20 0x7f6958141e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.961+0000 7f695df5c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6958071820 0x7f695806cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.961+0000 7f695df5c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695806cae0 con 0x7f695815f100 2023-11-24T06:16:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.961+0000 7f695df5c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6958071e40 con 0x7f6958071820 2023-11-24T06:16:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.961+0000 7f695df5c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695806c1b0 con 0x7f695815ed20 2023-11-24T06:16:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.962+0000 7f695d75b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6958071820 0x7f695806cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.962+0000 7f695d75b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6958071820 0x7f695806cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43872/0 (socket says 172.21.15.22:43872) 2023-11-24T06:16:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.962+0000 7f695d75b640 1 -- 172.21.15.22:0/1671883622 learned_addr learned my addr 172.21.15.22:0/1671883622 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.962+0000 7f695cf5a640 1 --2- 172.21.15.22:0/1671883622 >> v2:172.21.15.31:3300/0 conn(0x7f695815ed20 0x7f6958141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.962+0000 7f695d75b640 1 -- 172.21.15.22:0/1671883622 >> v2:172.21.15.31:3300/0 conn(0x7f695815ed20 msgr2=0x7f6958141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.962+0000 7f695d75b640 1 --2- 172.21.15.22:0/1671883622 >> v2:172.21.15.31:3300/0 conn(0x7f695815ed20 0x7f6958141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.962+0000 7f695d75b640 1 -- 172.21.15.22:0/1671883622 >> v1:172.21.15.31:6789/0 conn(0x7f695815f100 legacy=0x7f6958071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.962+0000 7f695d75b640 1 -- 172.21.15.22:0/1671883622 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695806c490 con 0x7f6958071820 2023-11-24T06:16:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.963+0000 7f695d75b640 1 --2- 172.21.15.22:0/1671883622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6958071820 0x7f695806cf70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6950009e50 tx=0x7f695002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371e6c9c80603693 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.964+0000 7f69577fe640 1 -- 172.21.15.22:0/1671883622 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695002ca80 con 0x7f6958071820 2023-11-24T06:16:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.964+0000 7f69577fe640 1 -- 172.21.15.22:0/1671883622 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695002cbe0 con 0x7f6958071820 2023-11-24T06:16:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.964+0000 7f69577fe640 1 -- 172.21.15.22:0/1671883622 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500343f0 con 0x7f6958071820 2023-11-24T06:16:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.964+0000 7f695df5c640 1 -- 172.21.15.22:0/1671883622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6958071820 msgr2=0x7f695806cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.964+0000 7f695df5c640 1 --2- 172.21.15.22:0/1671883622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6958071820 0x7f695806cf70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6950009e50 tx=0x7f695002bee0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.964+0000 7f695df5c640 1 -- 172.21.15.22:0/1671883622 shutdown_connections 2023-11-24T06:16:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.964+0000 7f695df5c640 1 --2- 172.21.15.22:0/1671883622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6958071820 0x7f695806cf70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.964+0000 7f695df5c640 1 --2- 172.21.15.22:0/1671883622 >> v2:172.21.15.31:3300/0 conn(0x7f695815ed20 0x7f6958141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.964+0000 7f695df5c640 1 -- 172.21.15.22:0/1671883622 >> 172.21.15.22:0/1671883622 conn(0x7f69580b0840 msgr2=0x7f69580b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.965+0000 7f695df5c640 1 -- 172.21.15.22:0/1671883622 shutdown_connections 2023-11-24T06:16:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.965+0000 7f695df5c640 1 -- 172.21.15.22:0/1671883622 wait complete. 2023-11-24T06:16:29.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.966+0000 7f695df5c640 1 Processor -- start 2023-11-24T06:16:29.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.966+0000 7f695df5c640 1 -- start start 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.967+0000 7f695df5c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6958071820 0x7f695815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.967+0000 7f695df5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f695815ed20 0x7f69581e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.967+0000 7f695df5c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695815f100 0x7f69581e67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.967+0000 7f695df5c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69581e9b20 con 0x7f695815ed20 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.967+0000 7f695df5c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695815ba70 con 0x7f695815f100 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.967+0000 7f695df5c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695815b740 con 0x7f6958071820 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f6957fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f695815ed20 0x7f69581e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f6957fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f695815ed20 0x7f69581e95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43880/0 (socket says 172.21.15.22:43880) 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f6957fff640 1 -- 172.21.15.22:0/634441050 learned_addr learned my addr 172.21.15.22:0/634441050 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f695cf5a640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6958071820 0x7f695815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f6957fff640 1 -- 172.21.15.22:0/634441050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6958071820 msgr2=0x7f695815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f6957fff640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6958071820 0x7f695815d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f6957fff640 1 -- 172.21.15.22:0/634441050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695815f100 msgr2=0x7f69581e67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f695d75b640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695815f100 0x7f69581e67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f6957fff640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695815f100 0x7f69581e67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.968+0000 7f6957fff640 1 -- 172.21.15.22:0/634441050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950009b30 con 0x7f695815ed20 2023-11-24T06:16:29.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.969+0000 7f6957fff640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f695815ed20 0x7f69581e95e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f694400c410 tx=0x7f694400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:29.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.969+0000 7f69557fa640 1 -- 172.21.15.22:0/634441050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69440035f0 con 0x7f695815ed20 2023-11-24T06:16:29.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.969+0000 7f69557fa640 1 -- 172.21.15.22:0/634441050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6944003750 con 0x7f695815ed20 2023-11-24T06:16:29.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.969+0000 7f69557fa640 1 -- 172.21.15.22:0/634441050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944003b40 con 0x7f695815ed20 2023-11-24T06:16:29.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.969+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695815de70 con 0x7f695815ed20 2023-11-24T06:16:29.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.969+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695815e430 con 0x7f695815ed20 2023-11-24T06:16:29.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.970+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6958067d10 con 0x7f695815ed20 2023-11-24T06:16:29.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.971+0000 7f69557fa640 1 -- 172.21.15.22:0/634441050 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6944003ca0 con 0x7f695815ed20 2023-11-24T06:16:29.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.972+0000 7f69557fa640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f693c06aff0 0x7f693c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.972+0000 7f69557fa640 1 -- 172.21.15.22:0/634441050 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6944088830 con 0x7f695815ed20 2023-11-24T06:16:29.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.972+0000 7f695cf5a640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f693c06aff0 0x7f693c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.973+0000 7f695cf5a640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f693c06aff0 0x7f693c06d4b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f694c006fd0 tx=0x7f694c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:29.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:29.977+0000 7f69557fa640 1 -- 172.21.15.22:0/634441050 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f69440539a0 con 0x7f695815ed20 2023-11-24T06:16:30.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.240+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f695804e840 con 0x7f695815ed20 2023-11-24T06:16:30.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.241+0000 7f69557fa640 1 -- 172.21.15.22:0/634441050 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6944056fc0 con 0x7f695815ed20 2023-11-24T06:16:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:30.244 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:16:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-11-24T06:16:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBlC0/KHRAAP3OMqK3lsC21mJ3yyEa2uQ==", 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-11-24T06:16:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBl1X/aBhAAY61uwiv5vBaTPkDByOLPmw==", 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBlfblGMBAAjEBBQvn4tcLAx4BB3IjQrw==", 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBlxcDDGBAAMX5i2Zfh+M5ZvjS1gKUVwA==", 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:16:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQByPmBl1c3MDBAAG4T9x4tKBMvnezzPu4t21g==", 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB1PmBlnqt2JxAASc03pLw8zZ4XPH46+FtW3Q==", 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB5PmBld+YeBhAA8jBhyD2sGPOXouNHKK4mUQ==", 2023-11-24T06:16:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB8PmBlx3blDxAAuB/aw9Wmh3rIxKpm7HK73A==", 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCDPmBlows5IRAAcEuvr47gyOcmFYg2HRRakw==", 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCHPmBlYK2jABAAJ093DHd2vAmF07tYS/qHzA==", 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCKPmBlYV2SGxAAArDvmB2DRwHwVy+cOu3JNw==", 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:16:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-11-24T06:16:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCNPmBlyZsANhAAKCXDIC1kjqyk42AJqK93/g==", 2023-11-24T06:16:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBlp6jYJxAA527jQJV49tBf9Am4wak0NA==", 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBwPmBlGvWoBBAAvbXYydB5FV2WWwhJpeoP/A==", 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:16:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBvPmBld3CuMxAAwvncg0GHEOgekURnLX45ow==", 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBwPmBlWinREBAALUxc6wrq/vbCi/RkUtnoLw==", 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBtPmBlU/GnCxAAg5trW7FqqDD3pTR9iBuH6A==", 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBlLBh/EBAA1PD6yyS4WDatwZsP2fu8Nw==", 2023-11-24T06:16:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuPmBl35NuAxAAr2yZZ37B4v9xkzTh/HGQhg==", 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-11-24T06:16:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-11-24T06:16:30.260 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:16:30.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f693c06aff0 msgr2=0x7f693c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f693c06aff0 0x7f693c06d4b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f694c006fd0 tx=0x7f694c008040 comp rx=0 tx=0).stop 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f695815ed20 msgr2=0x7f69581e95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f695815ed20 0x7f69581e95e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f694400c410 tx=0x7f694400c8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 shutdown_connections 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f693c06aff0 0x7f693c06d4b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695815f100 0x7f69581e67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f695815ed20 0x7f69581e95e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 --2- 172.21.15.22:0/634441050 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6958071820 0x7f695815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 >> 172.21.15.22:0/634441050 conn(0x7f69580b0840 msgr2=0x7f69580afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 shutdown_connections 2023-11-24T06:16:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.244+0000 7f695df5c640 1 -- 172.21.15.22:0/634441050 wait complete. 2023-11-24T06:16:30.265 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.479+0000 7fee2b147640 1 Processor -- start 2023-11-24T06:16:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.480+0000 7fee2b147640 1 -- start start 2023-11-24T06:16:30.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.481+0000 7fee2b147640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee24157770 0x7fee2406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.481+0000 7fee2b147640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee24161670 con 0x7fee2406d080 2023-11-24T06:16:30.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.481+0000 7fee2b147640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2415e610 con 0x7fee2415df80 2023-11-24T06:16:30.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.481+0000 7fee2b147640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2415e410 con 0x7fee24157770 2023-11-24T06:16:30.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.482+0000 7fee29944640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fee2406d080 0x7fee2415d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36976/0 (socket says 172.21.15.22:36976) 2023-11-24T06:16:30.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.482+0000 7fee29944640 1 -- 172.21.15.22:0/2726856510 learned_addr learned my addr 172.21.15.22:0/2726856510 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.482+0000 7fee2a145640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee24157770 0x7fee2406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.482+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910531685 0 0) 0x7fee24161670 con 0x7fee2406d080 2023-11-24T06:16:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.482+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee10003520 con 0x7fee2406d080 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.482+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 250792697 0 0) 0x7fee10003520 con 0x7fee2406d080 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.482+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee24157770 msgr2=0x7fee2406cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.482+0000 7fee29143640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee24157770 0x7fee2406cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 >> v1:172.21.15.31:6789/0 conn(0x7fee2415df80 legacy=0x7fee24070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee24160d40 con 0x7fee2406d080 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fee18001670 con 0x7fee2406d080 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 >> v1:172.21.15.22:6789/0 conn(0x7fee2406d080 legacy=0x7fee2415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee10003a10 0x7fee10003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee100047c0 0x7fee10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee24157770 0x7fee1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2415e410 con 0x7fee10003a10 2023-11-24T06:16:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100054e0 con 0x7fee100047c0 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1000bec0 con 0x7fee24157770 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee2a145640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee10003a10 0x7fee10003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee29944640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee100047c0 0x7fee10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.483+0000 7fee2a946640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee24157770 0x7fee1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.484+0000 7fee2a145640 1 -- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee24157770 msgr2=0x7fee1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.484+0000 7fee2a145640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee24157770 0x7fee1000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.484+0000 7fee2a145640 1 -- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee100047c0 msgr2=0x7fee10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.484+0000 7fee2a145640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee100047c0 0x7fee10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.484+0000 7fee2a145640 1 -- 172.21.15.22:0/2726856510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10003520 con 0x7fee10003a10 2023-11-24T06:16:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.484+0000 7fee2a946640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee24157770 0x7fee1000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:30.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.485+0000 7fee2a145640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee10003a10 0x7fee10003e30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fee2000ba30 tx=0x7fee100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f9b6bcf8b546a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.485+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20032620 con 0x7fee10003a10 2023-11-24T06:16:30.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.485+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee20032780 con 0x7fee10003a10 2023-11-24T06:16:30.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.485+0000 7fee29143640 1 -- 172.21.15.22:0/2726856510 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20032b10 con 0x7fee10003a10 2023-11-24T06:16:30.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.486+0000 7fee2b147640 1 -- 172.21.15.22:0/2726856510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee10003a10 msgr2=0x7fee10003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.486+0000 7fee2b147640 1 --2- 172.21.15.22:0/2726856510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee10003a10 0x7fee10003e30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fee2000ba30 tx=0x7fee100057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.486+0000 7fee2a946640 1 -- 172.21.15.22:0/2726856510 reap_dead start 2023-11-24T06:16:30.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.486+0000 7fee2b147640 1 -- 172.21.15.22:0/2726856510 shutdown_connections 2023-11-24T06:16:30.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.486+0000 7fee2b147640 1 -- 172.21.15.22:0/2726856510 >> 172.21.15.22:0/2726856510 conn(0x7fee2406a860 msgr2=0x7fee2406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:30.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.486+0000 7fee2b147640 1 -- 172.21.15.22:0/2726856510 shutdown_connections 2023-11-24T06:16:30.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.486+0000 7fee2b147640 1 -- 172.21.15.22:0/2726856510 wait complete. 2023-11-24T06:16:30.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.488+0000 7fee2b147640 1 Processor -- start 2023-11-24T06:16:30.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.488+0000 7fee2b147640 1 -- start start 2023-11-24T06:16:30.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.489+0000 7fee2b147640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee10003a10 0x7fee240cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.489+0000 7fee2b147640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee241415f0 0x7fee2415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.489+0000 7fee2b147640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee2415cfa0 0x7fee24159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.489+0000 7fee2b147640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240cbe60 con 0x7fee241415f0 2023-11-24T06:16:30.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.489+0000 7fee2b147640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240cc830 con 0x7fee10003a10 2023-11-24T06:16:30.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.489+0000 7fee2b147640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee240cb250 con 0x7fee2415cfa0 2023-11-24T06:16:30.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee29944640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee241415f0 0x7fee2415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee29944640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee241415f0 0x7fee2415ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43912/0 (socket says 172.21.15.22:43912) 2023-11-24T06:16:30.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee29944640 1 -- 172.21.15.22:0/514750414 learned_addr learned my addr 172.21.15.22:0/514750414 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee2a145640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee10003a10 0x7fee240cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee29944640 1 -- 172.21.15.22:0/514750414 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee2415cfa0 msgr2=0x7fee24159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee29944640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee2415cfa0 0x7fee24159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee29944640 1 -- 172.21.15.22:0/514750414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee10003a10 msgr2=0x7fee240cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee29944640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee10003a10 0x7fee240cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee29944640 1 -- 172.21.15.22:0/514750414 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240cb530 con 0x7fee241415f0 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.490+0000 7fee29944640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee241415f0 0x7fee2415ca60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fee180017a0 tx=0x7fee1800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.491+0000 7fee16ffd640 1 -- 172.21.15.22:0/514750414 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1800c6c0 con 0x7fee241415f0 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.491+0000 7fee16ffd640 1 -- 172.21.15.22:0/514750414 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1800c820 con 0x7fee241415f0 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.491+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee240cb810 con 0x7fee241415f0 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.491+0000 7fee16ffd640 1 -- 172.21.15.22:0/514750414 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1800cbd0 con 0x7fee241415f0 2023-11-24T06:16:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.491+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee240caee0 con 0x7fee241415f0 2023-11-24T06:16:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.492+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee240cbfd0 con 0x7fee241415f0 2023-11-24T06:16:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.493+0000 7fee16ffd640 1 -- 172.21.15.22:0/514750414 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fee1801d460 con 0x7fee241415f0 2023-11-24T06:16:30.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.494+0000 7fee16ffd640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee0806b020 0x7fee0806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.494+0000 7fee16ffd640 1 -- 172.21.15.22:0/514750414 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee180897b0 con 0x7fee241415f0 2023-11-24T06:16:30.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.495+0000 7fee2a145640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee0806b020 0x7fee0806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.495+0000 7fee2a145640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee0806b020 0x7fee0806d4e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fee2000ba00 tx=0x7fee2003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.499+0000 7fee16ffd640 1 -- 172.21.15.22:0/514750414 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee18054890 con 0x7fee241415f0 2023-11-24T06:16:30.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.692+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee2404e840 con 0x7fee241415f0 2023-11-24T06:16:30.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.693+0000 7fee16ffd640 1 -- 172.21.15.22:0/514750414 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+12809 (secure 0 0 0) 0x7fee180014c0 con 0x7fee241415f0 2023-11-24T06:16:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:30.697 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":57,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:29.702724+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:30.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee0806b020 msgr2=0x7fee0806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee0806b020 0x7fee0806d4e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fee2000ba00 tx=0x7fee2003d040 comp rx=0 tx=0).stop 2023-11-24T06:16:30.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee241415f0 msgr2=0x7fee2415ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee241415f0 0x7fee2415ca60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fee180017a0 tx=0x7fee1800eb90 comp rx=0 tx=0).stop 2023-11-24T06:16:30.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 shutdown_connections 2023-11-24T06:16:30.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fee0806b020 0x7fee0806d4e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee2415cfa0 0x7fee24159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee241415f0 0x7fee2415ca60 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 --2- 172.21.15.22:0/514750414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee10003a10 0x7fee240cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.696+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 >> 172.21.15.22:0/514750414 conn(0x7fee2406a860 msgr2=0x7fee24071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:30.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.697+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 shutdown_connections 2023-11-24T06:16:30.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.697+0000 7fee2b147640 1 -- 172.21.15.22:0/514750414 wait complete. 2023-11-24T06:16:30.720 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:30.720 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:30.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.947+0000 7f51797c9640 1 Processor -- start 2023-11-24T06:16:30.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.947+0000 7f51797c9640 1 -- start start 2023-11-24T06:16:30.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.948+0000 7f51797c9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f517415d550 0x7f51740d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.948+0000 7f51797c9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51740cf1b0 0x7f51740cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.948+0000 7f51797c9640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51740d0450 con 0x7f51740cfab0 2023-11-24T06:16:30.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.948+0000 7f51797c9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51740d2380 con 0x7f517415d550 2023-11-24T06:16:30.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.948+0000 7f51797c9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51740d19b0 con 0x7f51740cf1b0 2023-11-24T06:16:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f51737fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f51740cfab0 0x7f51740ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38218/0 (socket says 172.21.15.22:38218) 2023-11-24T06:16:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f51737fe640 1 -- 172.21.15.22:0/3518921363 learned_addr learned my addr 172.21.15.22:0/3518921363 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f5173fff640 1 --2- 172.21.15.22:0/3518921363 >> v2:172.21.15.22:3300/0 conn(0x7f517415d550 0x7f51740d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f5178fc8640 1 --2- 172.21.15.22:0/3518921363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51740cf1b0 0x7f51740cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f5172ffd640 1 -- 172.21.15.22:0/3518921363 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753307882 0 0) 0x7f51740d0450 con 0x7f51740cfab0 2023-11-24T06:16:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f5172ffd640 1 -- 172.21.15.22:0/3518921363 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5160003520 con 0x7f51740cfab0 2023-11-24T06:16:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f5173fff640 1 -- 172.21.15.22:0/3518921363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51740cf1b0 msgr2=0x7f51740cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f5173fff640 1 --2- 172.21.15.22:0/3518921363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51740cf1b0 0x7f51740cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f5173fff640 1 -- 172.21.15.22:0/3518921363 >> v1:172.21.15.22:6789/0 conn(0x7f51740cfab0 legacy=0x7f51740ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.949+0000 7f5173fff640 1 -- 172.21.15.22:0/3518921363 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51740d0da0 con 0x7f517415d550 2023-11-24T06:16:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.950+0000 7f5173fff640 1 --2- 172.21.15.22:0/3518921363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f517415d550 0x7f51740d1e40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5164009d90 tx=0x7f516402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937885ce4d51bc01 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.951+0000 7f5172ffd640 1 -- 172.21.15.22:0/3518921363 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516402cbc0 con 0x7f517415d550 2023-11-24T06:16:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.951+0000 7f5172ffd640 1 -- 172.21.15.22:0/3518921363 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516402cd20 con 0x7f517415d550 2023-11-24T06:16:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.951+0000 7f5172ffd640 1 -- 172.21.15.22:0/3518921363 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164034660 con 0x7f517415d550 2023-11-24T06:16:30.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.951+0000 7f51797c9640 1 -- 172.21.15.22:0/3518921363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f517415d550 msgr2=0x7f51740d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.951+0000 7f51797c9640 1 --2- 172.21.15.22:0/3518921363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f517415d550 0x7f51740d1e40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5164009d90 tx=0x7f516402be10 comp rx=0 tx=0).stop 2023-11-24T06:16:30.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.951+0000 7f51797c9640 1 -- 172.21.15.22:0/3518921363 shutdown_connections 2023-11-24T06:16:30.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.951+0000 7f51797c9640 1 --2- 172.21.15.22:0/3518921363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51740cf1b0 0x7f51740cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.951+0000 7f51797c9640 1 --2- 172.21.15.22:0/3518921363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f517415d550 0x7f51740d1e40 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.951+0000 7f51797c9640 1 -- 172.21.15.22:0/3518921363 >> 172.21.15.22:0/3518921363 conn(0x7f51740d30a0 msgr2=0x7f51740d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:30.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.952+0000 7f51797c9640 1 -- 172.21.15.22:0/3518921363 shutdown_connections 2023-11-24T06:16:30.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.952+0000 7f51797c9640 1 -- 172.21.15.22:0/3518921363 wait complete. 2023-11-24T06:16:30.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.953+0000 7f51797c9640 1 Processor -- start 2023-11-24T06:16:30.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.953+0000 7f51797c9640 1 -- start start 2023-11-24T06:16:30.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.954+0000 7f51797c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51740cf1b0 0x7f51740b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.954+0000 7f51797c9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51740cfab0 0x7f51740ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.954+0000 7f51797c9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f517415d550 0x7f5174156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.954+0000 7f51797c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51740cab30 con 0x7f51740cf1b0 2023-11-24T06:16:30.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.954+0000 7f51797c9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51740cae10 con 0x7f51740cfab0 2023-11-24T06:16:30.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.954+0000 7f51797c9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51740cb0f0 con 0x7f517415d550 2023-11-24T06:16:30.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.955+0000 7f5173fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51740cf1b0 0x7f51740b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.955+0000 7f5173fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51740cf1b0 0x7f51740b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46222/0 (socket says 172.21.15.22:46222) 2023-11-24T06:16:30.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.955+0000 7f5173fff640 1 -- 172.21.15.22:0/3773965930 learned_addr learned my addr 172.21.15.22:0/3773965930 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:30.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.955+0000 7f5173fff640 1 -- 172.21.15.22:0/3773965930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f517415d550 msgr2=0x7f5174156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.955+0000 7f5173fff640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f517415d550 0x7f5174156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.955+0000 7f5173fff640 1 -- 172.21.15.22:0/3773965930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51740cfab0 msgr2=0x7f51740ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.955+0000 7f5173fff640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51740cfab0 0x7f51740ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.955+0000 7f5173fff640 1 -- 172.21.15.22:0/3773965930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5164009a70 con 0x7f51740cf1b0 2023-11-24T06:16:30.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.956+0000 7f5173fff640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51740cf1b0 0x7f51740b3b80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5164009d90 tx=0x7f5164004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.956+0000 7f5170ff9640 1 -- 172.21.15.22:0/3773965930 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164040650 con 0x7f51740cf1b0 2023-11-24T06:16:30.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.956+0000 7f5170ff9640 1 -- 172.21.15.22:0/3773965930 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516402ce90 con 0x7f51740cf1b0 2023-11-24T06:16:30.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.956+0000 7f5170ff9640 1 -- 172.21.15.22:0/3773965930 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640409f0 con 0x7f51740cf1b0 2023-11-24T06:16:30.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.956+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51740cbc60 con 0x7f51740cf1b0 2023-11-24T06:16:30.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.956+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51740b40c0 con 0x7f51740cf1b0 2023-11-24T06:16:30.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.957+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51740b42b0 con 0x7f51740cf1b0 2023-11-24T06:16:30.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.958+0000 7f5170ff9640 1 -- 172.21.15.22:0/3773965930 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5164040b50 con 0x7f51740cf1b0 2023-11-24T06:16:30.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.959+0000 7f5170ff9640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f515406b020 0x7f515406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.959+0000 7f5170ff9640 1 -- 172.21.15.22:0/3773965930 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51640ac080 con 0x7f51740cf1b0 2023-11-24T06:16:30.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.960+0000 7f51737fe640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f515406b020 0x7f515406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.960+0000 7f51737fe640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f515406b020 0x7f515406d4e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5174160a30 tx=0x7f515c007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:30.964+0000 7f5170ff9640 1 -- 172.21.15.22:0/3773965930 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51640dee90 con 0x7f51740cf1b0 2023-11-24T06:16:31.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.159+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5174067960 con 0x7f51740cf1b0 2023-11-24T06:16:31.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.160+0000 7f5170ff9640 1 -- 172.21.15.22:0/3773965930 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51640771f0 con 0x7f51740cf1b0 2023-11-24T06:16:31.163 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:16:31.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.163+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f515406b020 msgr2=0x7f515406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.163+0000 7f51797c9640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f515406b020 0x7f515406d4e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5174160a30 tx=0x7f515c007930 comp rx=0 tx=0).stop 2023-11-24T06:16:31.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.163+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51740cf1b0 msgr2=0x7f51740b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.163+0000 7f51797c9640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51740cf1b0 0x7f51740b3b80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5164009d90 tx=0x7f5164004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:31.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.163+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 shutdown_connections 2023-11-24T06:16:31.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.163+0000 7f51797c9640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f515406b020 0x7f515406d4e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.163+0000 7f51797c9640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f517415d550 0x7f5174156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.163+0000 7f51797c9640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51740cfab0 0x7f51740ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.163+0000 7f51797c9640 1 --2- 172.21.15.22:0/3773965930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51740cf1b0 0x7f51740b3b80 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.164+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 >> 172.21.15.22:0/3773965930 conn(0x7f51740d30a0 msgr2=0x7f51740cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:31.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.164+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 shutdown_connections 2023-11-24T06:16:31.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.164+0000 7f51797c9640 1 -- 172.21.15.22:0/3773965930 wait complete. 2023-11-24T06:16:31.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:16:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.410+0000 7f715d278640 1 Processor -- start 2023-11-24T06:16:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.410+0000 7f715d278640 1 -- start start 2023-11-24T06:16:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.411+0000 7f715d278640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f71580cf050 0x7f71580cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.411+0000 7f715d278640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71580cd7b0 0x7f71580cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.411+0000 7f715d278640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715815fa70 con 0x7f715813dfd0 2023-11-24T06:16:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.411+0000 7f715d278640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71580cfa40 con 0x7f71580cf050 2023-11-24T06:16:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.411+0000 7f715d278640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715815c580 con 0x7f71580cd7b0 2023-11-24T06:16:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.412+0000 7f7157fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f715813dfd0 0x7f715815be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38220/0 (socket says 172.21.15.22:38220) 2023-11-24T06:16:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.412+0000 7f7157fff640 1 -- 172.21.15.22:0/4083608582 learned_addr learned my addr 172.21.15.22:0/4083608582 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.412+0000 7f714ffff640 1 --2- 172.21.15.22:0/4083608582 >> v2:172.21.15.22:3300/0 conn(0x7f71580cf050 0x7f71580cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.412+0000 7f715ca77640 1 --2- 172.21.15.22:0/4083608582 >> v2:172.21.15.31:3300/0 conn(0x7f71580cd7b0 0x7f71580cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.412+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958942074 0 0) 0x7f715815fa70 con 0x7f715813dfd0 2023-11-24T06:16:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.412+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7144003520 con 0x7f715813dfd0 2023-11-24T06:16:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1352736718 0 0) 0x7f7144003520 con 0x7f715813dfd0 2023-11-24T06:16:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 >> v2:172.21.15.31:3300/0 conn(0x7f71580cd7b0 msgr2=0x7f71580cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 --2- 172.21.15.22:0/4083608582 >> v2:172.21.15.31:3300/0 conn(0x7f71580cd7b0 0x7f71580cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 >> v2:172.21.15.22:3300/0 conn(0x7f71580cf050 msgr2=0x7f71580cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 --2- 172.21.15.22:0/4083608582 >> v2:172.21.15.22:3300/0 conn(0x7f71580cf050 0x7f71580cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158140900 con 0x7f715813dfd0 2023-11-24T06:16:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f7148001670 con 0x7f715813dfd0 2023-11-24T06:16:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f714ffff640 1 --2- 172.21.15.22:0/4083608582 >> v2:172.21.15.22:3300/0 conn(0x7f71580cf050 0x7f71580cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:16:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 >> v1:172.21.15.22:6789/0 conn(0x7f715813dfd0 legacy=0x7f715815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f7144003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71440047c0 0x7f7144004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7144005180 0x7f714400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71580cfa40 con 0x7f7144003a30 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715815c580 con 0x7f71440047c0 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714400bff0 con 0x7f7144005180 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.413+0000 7f7157fff640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f7144003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.414+0000 7f7157fff640 1 -- 172.21.15.22:0/4083608582 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7144005180 msgr2=0x7f714400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.414+0000 7f7157fff640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7144005180 0x7f714400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.414+0000 7f714ffff640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71440047c0 0x7f7144004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.414+0000 7f7157fff640 1 -- 172.21.15.22:0/4083608582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71440047c0 msgr2=0x7f7144004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.414+0000 7f7157fff640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71440047c0 0x7f7144004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.414+0000 7f7157fff640 1 -- 172.21.15.22:0/4083608582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7144003520 con 0x7f7144003a30 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.414+0000 7f715ca77640 1 -- 172.21.15.22:0/4083608582 reap_dead start 2023-11-24T06:16:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.414+0000 7f714ffff640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71440047c0 0x7f7144004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.415+0000 7f7157fff640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f7144003e50 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f714800c0e0 tx=0x7f71440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166e7d4b860e32fc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.415+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148005ad0 con 0x7f7144003a30 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.415+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7148005c30 con 0x7f7144003a30 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.415+0000 7f71577fe640 1 -- 172.21.15.22:0/4083608582 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714802c7c0 con 0x7f7144003a30 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.416+0000 7f715d278640 1 -- 172.21.15.22:0/4083608582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 msgr2=0x7f7144003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.416+0000 7f715d278640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f7144003e50 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f714800c0e0 tx=0x7f71440057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.416+0000 7f715d278640 1 -- 172.21.15.22:0/4083608582 shutdown_connections 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.416+0000 7f715d278640 1 --2- 172.21.15.22:0/4083608582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f7144003e50 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.416+0000 7f715d278640 1 -- 172.21.15.22:0/4083608582 >> 172.21.15.22:0/4083608582 conn(0x7f715806a860 msgr2=0x7f715806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.416+0000 7f715d278640 1 -- 172.21.15.22:0/4083608582 shutdown_connections 2023-11-24T06:16:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.416+0000 7f715d278640 1 -- 172.21.15.22:0/4083608582 wait complete. 2023-11-24T06:16:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.418+0000 7f715d278640 1 Processor -- start 2023-11-24T06:16:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.418+0000 7f715d278640 1 -- start start 2023-11-24T06:16:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.419+0000 7f715d278640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f715815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.419+0000 7f715d278640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71580ac870 0x7f715813a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.419+0000 7f715d278640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f715813ad70 0x7f7158071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.419+0000 7f715d278640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71581f39b0 con 0x7f7144003a30 2023-11-24T06:16:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.419+0000 7f715d278640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71581f2af0 con 0x7f71580ac870 2023-11-24T06:16:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.419+0000 7f715d278640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71581f2da0 con 0x7f715813ad70 2023-11-24T06:16:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.419+0000 7f7157fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f715815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.420+0000 7f7157fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f715815aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46252/0 (socket says 172.21.15.22:46252) 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.420+0000 7f7157fff640 1 -- 172.21.15.22:0/2643182178 learned_addr learned my addr 172.21.15.22:0/2643182178 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.420+0000 7f714ffff640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71580ac870 0x7f715813a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.420+0000 7f7157fff640 1 -- 172.21.15.22:0/2643182178 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f715813ad70 msgr2=0x7f7158071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.420+0000 7f7157fff640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f715813ad70 0x7f7158071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.420+0000 7f7157fff640 1 -- 172.21.15.22:0/2643182178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71580ac870 msgr2=0x7f715813a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.420+0000 7f7157fff640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71580ac870 0x7f715813a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.420+0000 7f7157fff640 1 -- 172.21.15.22:0/2643182178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71581f3080 con 0x7f7144003a30 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.420+0000 7f7157fff640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f715815aa40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f714800c200 tx=0x7f715815f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.421+0000 7f71557fa640 1 -- 172.21.15.22:0/2643182178 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714802cbd0 con 0x7f7144003a30 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.421+0000 7f71557fa640 1 -- 172.21.15.22:0/2643182178 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714802cd30 con 0x7f7144003a30 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.421+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71581f3360 con 0x7f7144003a30 2023-11-24T06:16:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.421+0000 7f71557fa640 1 -- 172.21.15.22:0/2643182178 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148007290 con 0x7f7144003a30 2023-11-24T06:16:31.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.421+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715815af80 con 0x7f7144003a30 2023-11-24T06:16:31.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.422+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715804e840 con 0x7f7144003a30 2023-11-24T06:16:31.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.423+0000 7f71557fa640 1 -- 172.21.15.22:0/2643182178 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7148032070 con 0x7f7144003a30 2023-11-24T06:16:31.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.424+0000 7f71557fa640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f713806b020 0x7f713806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.424+0000 7f71557fa640 1 -- 172.21.15.22:0/2643182178 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f714803c040 con 0x7f7144003a30 2023-11-24T06:16:31.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.424+0000 7f714ffff640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f713806b020 0x7f713806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.425+0000 7f714ffff640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f713806b020 0x7f713806d4e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f715813a7c0 tx=0x7f7140008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.429+0000 7f71557fa640 1 -- 172.21.15.22:0/2643182178 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7148076200 con 0x7f7144003a30 2023-11-24T06:16:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.625+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f71580ce9a0 con 0x7f7144003a30 2023-11-24T06:16:31.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.626+0000 7f71557fa640 1 -- 172.21.15.22:0/2643182178 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7148079820 con 0x7f7144003a30 2023-11-24T06:16:31.629 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:31.629 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-11-24T06:16:31.629 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:31.629 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-11-24T06:16:31.629 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-11-24T06:16:31.629 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:31.629 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-11-24T06:16:31.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f713806b020 msgr2=0x7f713806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f713806b020 0x7f713806d4e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f715813a7c0 tx=0x7f7140008040 comp rx=0 tx=0).stop 2023-11-24T06:16:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 msgr2=0x7f715815aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f715815aa40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f714800c200 tx=0x7f715815f9e0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 shutdown_connections 2023-11-24T06:16:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f713806b020 0x7f713806d4e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f715813ad70 0x7f7158071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71580ac870 0x7f715813a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 --2- 172.21.15.22:0/2643182178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7144003a30 0x7f715815aa40 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 >> 172.21.15.22:0/2643182178 conn(0x7f715806a860 msgr2=0x7f715815c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:31.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 shutdown_connections 2023-11-24T06:16:31.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.629+0000 7f715d278640 1 -- 172.21.15.22:0/2643182178 wait complete. 2023-11-24T06:16:31.652 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:16:31.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:16:31.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.879+0000 7fb1fe259640 1 Processor -- start 2023-11-24T06:16:31.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.879+0000 7fb1fe259640 1 -- start start 2023-11-24T06:16:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.880+0000 7fb1fe259640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1f80d1d90 0x7fb1f80ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.881+0000 7fb1fe259640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f80c6bf0 con 0x7fb1f80d0fa0 2023-11-24T06:16:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.881+0000 7fb1fe259640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f80d13f0 con 0x7fb1f815d3b0 2023-11-24T06:16:31.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.881+0000 7fb1fe259640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f80cedc0 con 0x7fb1f80d1d90 2023-11-24T06:16:31.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.881+0000 7fb1fca56640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1f80d1d90 0x7fb1f80ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.881+0000 7fb1fda58640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb1f80d0fa0 0x7fb1f80b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38234/0 (socket says 172.21.15.22:38234) 2023-11-24T06:16:31.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.881+0000 7fb1fda58640 1 -- 172.21.15.22:0/3167825089 learned_addr learned my addr 172.21.15.22:0/3167825089 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:31.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.882+0000 7fb1fca56640 1 -- 172.21.15.22:0/3167825089 >> v1:172.21.15.31:6789/0 conn(0x7fb1f815d3b0 legacy=0x7fb1f80d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.882+0000 7fb1fca56640 1 -- 172.21.15.22:0/3167825089 >> v1:172.21.15.22:6789/0 conn(0x7fb1f80d0fa0 legacy=0x7fb1f80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.882+0000 7fb1fca56640 1 -- 172.21.15.22:0/3167825089 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80c6e40 con 0x7fb1f80d1d90 2023-11-24T06:16:31.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.883+0000 7fb1fca56640 1 --2- 172.21.15.22:0/3167825089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f80d1d90 0x7fb1f80ce6c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80097a0 tx=0x7fb1e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d705b22b11d4ee7a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.883+0000 7fb1effff640 1 -- 172.21.15.22:0/3167825089 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e802e070 con 0x7fb1f80d1d90 2023-11-24T06:16:31.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.883+0000 7fb1effff640 1 -- 172.21.15.22:0/3167825089 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e80315a0 con 0x7fb1f80d1d90 2023-11-24T06:16:31.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.883+0000 7fb1effff640 1 -- 172.21.15.22:0/3167825089 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8031930 con 0x7fb1f80d1d90 2023-11-24T06:16:31.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.884+0000 7fb1fe259640 1 -- 172.21.15.22:0/3167825089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f80d1d90 msgr2=0x7fb1f80ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.884+0000 7fb1fe259640 1 --2- 172.21.15.22:0/3167825089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f80d1d90 0x7fb1f80ce6c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80097a0 tx=0x7fb1e802b840 comp rx=0 tx=0).stop 2023-11-24T06:16:31.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.884+0000 7fb1fe259640 1 -- 172.21.15.22:0/3167825089 shutdown_connections 2023-11-24T06:16:31.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.884+0000 7fb1fe259640 1 --2- 172.21.15.22:0/3167825089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f80d1d90 0x7fb1f80ce6c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.884+0000 7fb1fe259640 1 -- 172.21.15.22:0/3167825089 >> 172.21.15.22:0/3167825089 conn(0x7fb1f80d30a0 msgr2=0x7fb1f80d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:31.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.884+0000 7fb1fe259640 1 -- 172.21.15.22:0/3167825089 shutdown_connections 2023-11-24T06:16:31.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.885+0000 7fb1fe259640 1 -- 172.21.15.22:0/3167825089 wait complete. 2023-11-24T06:16:31.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.887+0000 7fb1fe259640 1 Processor -- start 2023-11-24T06:16:31.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.887+0000 7fb1fe259640 1 -- start start 2023-11-24T06:16:31.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.888+0000 7fb1fe259640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1f80d0fa0 0x7fb1f81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fe259640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f80d1d90 0x7fb1f809d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fe259640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f815d3b0 0x7fb1f80b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fe259640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80a0d00 con 0x7fb1f815d3b0 2023-11-24T06:16:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fe259640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f8156b20 con 0x7fb1f80d1d90 2023-11-24T06:16:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fe259640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80a00f0 con 0x7fb1f80d0fa0 2023-11-24T06:16:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fda58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f815d3b0 0x7fb1f80b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fda58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f815d3b0 0x7fb1f80b7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46268/0 (socket says 172.21.15.22:46268) 2023-11-24T06:16:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fda58640 1 -- 172.21.15.22:0/1593685324 learned_addr learned my addr 172.21.15.22:0/1593685324 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:31.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fca56640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f80d1d90 0x7fb1f809d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fda58640 1 -- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1f80d0fa0 msgr2=0x7fb1f81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fd257640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1f80d0fa0 0x7fb1f81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fda58640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1f80d0fa0 0x7fb1f81565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fda58640 1 -- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f80d1d90 msgr2=0x7fb1f809d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fda58640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f80d1d90 0x7fb1f809d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fda58640 1 -- 172.21.15.22:0/1593685324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8009400 con 0x7fb1f815d3b0 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fca56640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f80d1d90 0x7fb1f809d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.889+0000 7fb1fd257640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1f80d0fa0 0x7fb1f81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.890+0000 7fb1fda58640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f815d3b0 0x7fb1f80b7e90 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000cbc0 tx=0x7fb1f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.890+0000 7fb1edffb640 1 -- 172.21.15.22:0/1593685324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000ad40 con 0x7fb1f815d3b0 2023-11-24T06:16:31.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.890+0000 7fb1edffb640 1 -- 172.21.15.22:0/1593685324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0012400 con 0x7fb1f815d3b0 2023-11-24T06:16:31.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.890+0000 7fb1edffb640 1 -- 172.21.15.22:0/1593685324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000aea0 con 0x7fb1f815d3b0 2023-11-24T06:16:31.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.890+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f80a03d0 con 0x7fb1f815d3b0 2023-11-24T06:16:31.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.890+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f80a0990 con 0x7fb1f815d3b0 2023-11-24T06:16:31.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.892+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f80cb690 con 0x7fb1f815d3b0 2023-11-24T06:16:31.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.892+0000 7fb1edffb640 1 -- 172.21.15.22:0/1593685324 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb1f0007070 con 0x7fb1f815d3b0 2023-11-24T06:16:31.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.893+0000 7fb1edffb640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1dc06b020 0x7fb1dc06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.893+0000 7fb1edffb640 1 -- 172.21.15.22:0/1593685324 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb1f00894f0 con 0x7fb1f815d3b0 2023-11-24T06:16:31.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.894+0000 7fb1fd257640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1dc06b020 0x7fb1dc06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.894+0000 7fb1fd257640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1dc06b020 0x7fb1dc06d4e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400a830 tx=0x7fb1f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:31.898+0000 7fb1edffb640 1 -- 172.21.15.22:0/1593685324 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1f80cb690 con 0x7fb1f815d3b0 2023-11-24T06:16:32.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.095+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb1f80cb690 con 0x7fb1f815d3b0 2023-11-24T06:16:32.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.721+0000 7fb1edffb640 1 -- 172.21.15.22:0/1593685324 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb1f80cb690 con 0x7fb1f815d3b0 2023-11-24T06:16:32.724 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-11-24T06:16:32.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.725+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1dc06b020 msgr2=0x7fb1dc06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.725+0000 7fb1fe259640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1dc06b020 0x7fb1dc06d4e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400a830 tx=0x7fb1f4008040 comp rx=0 tx=0).stop 2023-11-24T06:16:32.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.725+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f815d3b0 msgr2=0x7fb1f80b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.725+0000 7fb1fe259640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f815d3b0 0x7fb1f80b7e90 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000cbc0 tx=0x7fb1f000a430 comp rx=0 tx=0).stop 2023-11-24T06:16:32.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.726+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 shutdown_connections 2023-11-24T06:16:32.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.726+0000 7fb1fe259640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb1dc06b020 0x7fb1dc06d4e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.726+0000 7fb1fe259640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f815d3b0 0x7fb1f80b7e90 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.726+0000 7fb1fe259640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f80d1d90 0x7fb1f809d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.726+0000 7fb1fe259640 1 --2- 172.21.15.22:0/1593685324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1f80d0fa0 0x7fb1f81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.726+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 >> 172.21.15.22:0/1593685324 conn(0x7fb1f80d30a0 msgr2=0x7fb1f80d1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:32.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.726+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 shutdown_connections 2023-11-24T06:16:32.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.726+0000 7fb1fe259640 1 -- 172.21.15.22:0/1593685324 wait complete. 2023-11-24T06:16:32.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:16:32.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.961+0000 7faf056e0640 1 Processor -- start 2023-11-24T06:16:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.961+0000 7faf056e0640 1 -- start start 2023-11-24T06:16:32.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.963+0000 7faf056e0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000acd70 0x7faf0006dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.963+0000 7faf056e0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf000ae490 0x7faf000ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.963+0000 7faf056e0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0006d7a0 con 0x7faf000ad690 2023-11-24T06:16:32.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.963+0000 7faf056e0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0015a5b0 con 0x7faf000ae490 2023-11-24T06:16:32.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.963+0000 7faf056e0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0006ce70 con 0x7faf000acd70 2023-11-24T06:16:32.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.963+0000 7faefe7fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf000ae490 0x7faf000ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.963+0000 7faeff7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faf000ad690 0x7faf00070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38242/0 (socket says 172.21.15.22:38242) 2023-11-24T06:16:32.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.963+0000 7faeff7fe640 1 -- 172.21.15.22:0/839429916 learned_addr learned my addr 172.21.15.22:0/839429916 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:32.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.964+0000 7faefeffd640 1 --2- 172.21.15.22:0/839429916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000acd70 0x7faf0006dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.964+0000 7faefe7fc640 1 -- 172.21.15.22:0/839429916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000acd70 msgr2=0x7faf0006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:32.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.964+0000 7faefe7fc640 1 --2- 172.21.15.22:0/839429916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000acd70 0x7faf0006dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.964+0000 7faefe7fc640 1 -- 172.21.15.22:0/839429916 >> v1:172.21.15.22:6789/0 conn(0x7faf000ad690 legacy=0x7faf00070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.964+0000 7faefe7fc640 1 -- 172.21.15.22:0/839429916 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0006d150 con 0x7faf000ae490 2023-11-24T06:16:32.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.965+0000 7faefe7fc640 1 --2- 172.21.15.22:0/839429916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000ae490 0x7faf000ad150 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6daf65b6764760 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:32.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.965+0000 7faefdffb640 1 -- 172.21.15.22:0/839429916 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4031830 con 0x7faf000ae490 2023-11-24T06:16:32.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.965+0000 7faefdffb640 1 -- 172.21.15.22:0/839429916 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4031990 con 0x7faf000ae490 2023-11-24T06:16:32.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.965+0000 7faefdffb640 1 -- 172.21.15.22:0/839429916 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4031d20 con 0x7faf000ae490 2023-11-24T06:16:32.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.966+0000 7faf056e0640 1 -- 172.21.15.22:0/839429916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000ae490 msgr2=0x7faf000ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.966+0000 7faf056e0640 1 --2- 172.21.15.22:0/839429916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000ae490 0x7faf000ad150 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.966+0000 7faf056e0640 1 -- 172.21.15.22:0/839429916 shutdown_connections 2023-11-24T06:16:32.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.966+0000 7faf056e0640 1 --2- 172.21.15.22:0/839429916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000ae490 0x7faf000ad150 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.966+0000 7faf056e0640 1 --2- 172.21.15.22:0/839429916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000acd70 0x7faf0006dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.966+0000 7faf056e0640 1 -- 172.21.15.22:0/839429916 >> 172.21.15.22:0/839429916 conn(0x7faf000b0ba0 msgr2=0x7faf000b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:32.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.966+0000 7faf056e0640 1 -- 172.21.15.22:0/839429916 shutdown_connections 2023-11-24T06:16:32.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.966+0000 7faf056e0640 1 -- 172.21.15.22:0/839429916 wait complete. 2023-11-24T06:16:32.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.968+0000 7faf056e0640 1 Processor -- start 2023-11-24T06:16:32.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.968+0000 7faf056e0640 1 -- start start 2023-11-24T06:16:32.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.969+0000 7faf056e0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000acd70 0x7faf000ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.969+0000 7faf056e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf000ad690 0x7faf00155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.969+0000 7faf056e0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000ae490 0x7faf00156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.969+0000 7faf056e0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf000ce5d0 con 0x7faf000acd70 2023-11-24T06:16:32.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.969+0000 7faf056e0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0009a6f0 con 0x7faf000ad690 2023-11-24T06:16:32.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.969+0000 7faf056e0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0009a9d0 con 0x7faf000ae490 2023-11-24T06:16:32.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faefeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000acd70 0x7faf000ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faefeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000acd70 0x7faf000ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46292/0 (socket says 172.21.15.22:46292) 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faefeffd640 1 -- 172.21.15.22:0/1729260883 learned_addr learned my addr 172.21.15.22:0/1729260883 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faeff7fe640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000ae490 0x7faf00156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faefe7fc640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf000ad690 0x7faf00155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faefeffd640 1 -- 172.21.15.22:0/1729260883 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000ae490 msgr2=0x7faf00156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faefeffd640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000ae490 0x7faf00156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faefeffd640 1 -- 172.21.15.22:0/1729260883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf000ad690 msgr2=0x7faf00155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faefeffd640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf000ad690 0x7faf00155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.970+0000 7faefeffd640 1 -- 172.21.15.22:0/1729260883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009400 con 0x7faf000acd70 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.971+0000 7faefeffd640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000acd70 0x7faf000ce090 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7faef0007e40 tx=0x7faef000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.971+0000 7faee77fe640 1 -- 172.21.15.22:0/1729260883 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0014620 con 0x7faf000acd70 2023-11-24T06:16:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.971+0000 7faee77fe640 1 -- 172.21.15.22:0/1729260883 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef000ee90 con 0x7faf000acd70 2023-11-24T06:16:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.971+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0009acb0 con 0x7faf000acd70 2023-11-24T06:16:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.971+0000 7faee77fe640 1 -- 172.21.15.22:0/1729260883 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef00149c0 con 0x7faf000acd70 2023-11-24T06:16:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.971+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0009b270 con 0x7faf000acd70 2023-11-24T06:16:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.972+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0009d200 con 0x7faf000acd70 2023-11-24T06:16:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.974+0000 7faee77fe640 1 -- 172.21.15.22:0/1729260883 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faef0014b20 con 0x7faf000acd70 2023-11-24T06:16:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.975+0000 7faee77fe640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faeec06aff0 0x7faeec06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.975+0000 7faee77fe640 1 -- 172.21.15.22:0/1729260883 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5227+0+0 (secure 0 0 0) 0x7faef008a0e0 con 0x7faf000acd70 2023-11-24T06:16:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.975+0000 7faefe7fc640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faeec06aff0 0x7faeec06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.976+0000 7faefe7fc640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faeec06aff0 0x7faeec06d4b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faef4036000 tx=0x7faef403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:32.980+0000 7faee77fe640 1 -- 172.21.15.22:0/1729260883 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faef00bce90 con 0x7faf000acd70 2023-11-24T06:16:33.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.175+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faf000cc180 con 0x7faf000acd70 2023-11-24T06:16:33.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.735+0000 7faee77fe640 1 -- 172.21.15.22:0/1729260883 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) v1 ==== 170+0+0 (secure 0 0 0) 0x7faef00550e0 con 0x7faf000acd70 2023-11-24T06:16:33.738 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-11-24T06:16:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faeec06aff0 msgr2=0x7faeec06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faeec06aff0 0x7faeec06d4b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faef4036000 tx=0x7faef403c040 comp rx=0 tx=0).stop 2023-11-24T06:16:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000acd70 msgr2=0x7faf000ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000acd70 0x7faf000ce090 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7faef0007e40 tx=0x7faef000e4b0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 shutdown_connections 2023-11-24T06:16:33.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7faeec06aff0 0x7faeec06d4b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000ae490 0x7faf00156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf000ad690 0x7faf00155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 --2- 172.21.15.22:0/1729260883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000acd70 0x7faf000ce090 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.738+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 >> 172.21.15.22:0/1729260883 conn(0x7faf000b0ba0 msgr2=0x7faf0015a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:33.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.739+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 shutdown_connections 2023-11-24T06:16:33.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.739+0000 7faf056e0640 1 -- 172.21.15.22:0/1729260883 wait complete. 2023-11-24T06:16:33.775 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:16:33.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.967+0000 7fe4771d5640 1 Processor -- start 2023-11-24T06:16:33.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.967+0000 7fe4771d5640 1 -- start start 2023-11-24T06:16:33.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.968+0000 7fe4771d5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe470160bd0 0x7fe4700b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.968+0000 7fe4771d5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b48d0 0x7fe4700b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.968+0000 7fe4771d5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe4700b3040 0x7fe470166280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.968+0000 7fe4771d5640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4700cdc70 con 0x7fe4700b3040 2023-11-24T06:16:33.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.968+0000 7fe4771d5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4700b2870 con 0x7fe470160bd0 2023-11-24T06:16:33.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.968+0000 7fe4771d5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700b23e0 con 0x7fe4700b48d0 2023-11-24T06:16:33.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.969+0000 7fe475772640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe4700b3040 0x7fe470166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.969+0000 7fe475772640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe4700b3040 0x7fe470166280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46298/0 (socket says 172.21.15.22:46298) 2023-11-24T06:16:33.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.969+0000 7fe475772640 1 -- 172.21.15.22:0/1198626452 learned_addr learned my addr 172.21.15.22:0/1198626452 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:33.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.969+0000 7fe474f71640 1 --2- 172.21.15.22:0/1198626452 >> v2:172.21.15.31:3300/0 conn(0x7fe470160bd0 0x7fe4700b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.969+0000 7fe46ffff640 1 --2- 172.21.15.22:0/1198626452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b48d0 0x7fe4700b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.970+0000 7fe475772640 1 -- 172.21.15.22:0/1198626452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b48d0 msgr2=0x7fe4700b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:33.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.970+0000 7fe475772640 1 --2- 172.21.15.22:0/1198626452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b48d0 0x7fe4700b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.970+0000 7fe475772640 1 -- 172.21.15.22:0/1198626452 >> v2:172.21.15.31:3300/0 conn(0x7fe470160bd0 msgr2=0x7fe4700b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:33.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.970+0000 7fe475772640 1 --2- 172.21.15.22:0/1198626452 >> v2:172.21.15.31:3300/0 conn(0x7fe470160bd0 0x7fe4700b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.970+0000 7fe475772640 1 -- 172.21.15.22:0/1198626452 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700d41b0 con 0x7fe4700b3040 2023-11-24T06:16:33.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.971+0000 7fe475772640 1 --2- 172.21.15.22:0/1198626452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b3040 0x7fe470166280 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe4700cda60 tx=0x7fe46802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5e349b68293363 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:33.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe46f7fe640 1 -- 172.21.15.22:0/1198626452 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4680317e0 con 0x7fe4700b3040 2023-11-24T06:16:33.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe46f7fe640 1 -- 172.21.15.22:0/1198626452 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe468031940 con 0x7fe4700b3040 2023-11-24T06:16:33.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe46f7fe640 1 -- 172.21.15.22:0/1198626452 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468031cd0 con 0x7fe4700b3040 2023-11-24T06:16:33.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe4771d5640 1 -- 172.21.15.22:0/1198626452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b3040 msgr2=0x7fe470166280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe4771d5640 1 --2- 172.21.15.22:0/1198626452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b3040 0x7fe470166280 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe4700cda60 tx=0x7fe46802b880 comp rx=0 tx=0).stop 2023-11-24T06:16:33.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe4771d5640 1 -- 172.21.15.22:0/1198626452 shutdown_connections 2023-11-24T06:16:33.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe4771d5640 1 --2- 172.21.15.22:0/1198626452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b3040 0x7fe470166280 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe4771d5640 1 --2- 172.21.15.22:0/1198626452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b48d0 0x7fe4700b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe4771d5640 1 --2- 172.21.15.22:0/1198626452 >> v2:172.21.15.31:3300/0 conn(0x7fe470160bd0 0x7fe4700b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.972+0000 7fe4771d5640 1 -- 172.21.15.22:0/1198626452 >> 172.21.15.22:0/1198626452 conn(0x7fe47009c5a0 msgr2=0x7fe4700d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:33.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.973+0000 7fe4771d5640 1 -- 172.21.15.22:0/1198626452 shutdown_connections 2023-11-24T06:16:33.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.973+0000 7fe4771d5640 1 -- 172.21.15.22:0/1198626452 wait complete. 2023-11-24T06:16:33.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.975+0000 7fe4771d5640 1 Processor -- start 2023-11-24T06:16:33.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.975+0000 7fe4771d5640 1 -- start start 2023-11-24T06:16:33.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe4771d5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b3040 0x7fe470148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe4771d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b48d0 0x7fe4700c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe4771d5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe470160bd0 0x7fe4700c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe4771d5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c8440 con 0x7fe4700b48d0 2023-11-24T06:16:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe4771d5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c7e60 con 0x7fe470160bd0 2023-11-24T06:16:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe4771d5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700ccc50 con 0x7fe4700b3040 2023-11-24T06:16:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe46ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b48d0 0x7fe4700c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe46ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b48d0 0x7fe4700c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46312/0 (socket says 172.21.15.22:46312) 2023-11-24T06:16:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe46ffff640 1 -- 172.21.15.22:0/3649313898 learned_addr learned my addr 172.21.15.22:0/3649313898 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe475772640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe470160bd0 0x7fe4700c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.976+0000 7fe474f71640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b3040 0x7fe470148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe46ffff640 1 -- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b3040 msgr2=0x7fe470148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe46ffff640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b3040 0x7fe470148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe46ffff640 1 -- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe470160bd0 msgr2=0x7fe4700c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe46ffff640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe470160bd0 0x7fe4700c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe46ffff640 1 -- 172.21.15.22:0/3649313898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4680094d0 con 0x7fe4700b48d0 2023-11-24T06:16:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe475772640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe470160bd0 0x7fe4700c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe474f71640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b3040 0x7fe470148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe46ffff640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b48d0 0x7fe4700c88d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe45800d830 tx=0x7fe45800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe46d7fa640 1 -- 172.21.15.22:0/3649313898 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580096a0 con 0x7fe4700b48d0 2023-11-24T06:16:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe46d7fa640 1 -- 172.21.15.22:0/3649313898 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe458009800 con 0x7fe4700b48d0 2023-11-24T06:16:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe46d7fa640 1 -- 172.21.15.22:0/3649313898 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458009b90 con 0x7fe4700b48d0 2023-11-24T06:16:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4700cced0 con 0x7fe4700b48d0 2023-11-24T06:16:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.977+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe470149290 con 0x7fe4700b48d0 2023-11-24T06:16:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.979+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4700c85f0 con 0x7fe4700b48d0 2023-11-24T06:16:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.980+0000 7fe46d7fa640 1 -- 172.21.15.22:0/3649313898 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe45801e460 con 0x7fe4700b48d0 2023-11-24T06:16:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.981+0000 7fe46d7fa640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe45006b020 0x7fe45006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.981+0000 7fe46d7fa640 1 -- 172.21.15.22:0/3649313898 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe458089f90 con 0x7fe4700b48d0 2023-11-24T06:16:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.981+0000 7fe474f71640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe45006b020 0x7fe45006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.982+0000 7fe474f71640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe45006b020 0x7fe45006d4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe460009f50 tx=0x7fe46000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:33.986+0000 7fe46d7fa640 1 -- 172.21.15.22:0/3649313898 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4580bce90 con 0x7fe4700b48d0 2023-11-24T06:16:34.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.216+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe4700a1210 con 0x7fe4700b48d0 2023-11-24T06:16:34.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.739+0000 7fe46d7fa640 1 -- 172.21.15.22:0/3649313898 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v31) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe4700c85f0 con 0x7fe4700b48d0 2023-11-24T06:16:34.743 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 8 and data pool 9 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.743+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe45006b020 msgr2=0x7fe45006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.743+0000 7fe4771d5640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe45006b020 0x7fe45006d4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe460009f50 tx=0x7fe46000b040 comp rx=0 tx=0).stop 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.743+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b48d0 msgr2=0x7fe4700c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.743+0000 7fe4771d5640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b48d0 0x7fe4700c88d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe45800d830 tx=0x7fe45800dcf0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.744+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 shutdown_connections 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.744+0000 7fe4771d5640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe45006b020 0x7fe45006d4e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.744+0000 7fe4771d5640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe470160bd0 0x7fe4700c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.744+0000 7fe4771d5640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4700b48d0 0x7fe4700c88d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.744+0000 7fe4771d5640 1 --2- 172.21.15.22:0/3649313898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4700b3040 0x7fe470148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.744+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 >> 172.21.15.22:0/3649313898 conn(0x7fe47009c5a0 msgr2=0x7fe4700b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.744+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 shutdown_connections 2023-11-24T06:16:34.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.744+0000 7fe4771d5640 1 -- 172.21.15.22:0/3649313898 wait complete. 2023-11-24T06:16:34.779 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:34.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.969+0000 7ff1cac02640 1 Processor -- start 2023-11-24T06:16:34.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.969+0000 7ff1cac02640 1 -- start start 2023-11-24T06:16:34.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.970+0000 7ff1cac02640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1c40b39a0 0x7ff1c4071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.970+0000 7ff1cac02640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1c40abff0 0x7ff1c4071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.970+0000 7ff1cac02640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c413da30 con 0x7ff1c415a100 2023-11-24T06:16:34.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.970+0000 7ff1cac02640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c40ac840 con 0x7ff1c40b39a0 2023-11-24T06:16:34.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.970+0000 7ff1cac02640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c40ac560 con 0x7ff1c40abff0 2023-11-24T06:16:34.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.971+0000 7ff1c3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1c40b39a0 0x7ff1c4071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:34.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.971+0000 7ff1c3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1c40b39a0 0x7ff1c4071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46320/0 (socket says 172.21.15.22:46320) 2023-11-24T06:16:34.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.971+0000 7ff1c3fff640 1 -- 172.21.15.22:0/2089704723 learned_addr learned my addr 172.21.15.22:0/2089704723 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:34.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.971+0000 7ff1c919f640 1 --2- 172.21.15.22:0/2089704723 >> v2:172.21.15.31:3300/0 conn(0x7ff1c40abff0 0x7ff1c4071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.971+0000 7ff1c3fff640 1 -- 172.21.15.22:0/2089704723 >> v2:172.21.15.31:3300/0 conn(0x7ff1c40abff0 msgr2=0x7ff1c4071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.971+0000 7ff1c3fff640 1 --2- 172.21.15.22:0/2089704723 >> v2:172.21.15.31:3300/0 conn(0x7ff1c40abff0 0x7ff1c4071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.971+0000 7ff1c3fff640 1 -- 172.21.15.22:0/2089704723 >> v1:172.21.15.31:6789/0 conn(0x7ff1c415a100 legacy=0x7ff1c40b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.971+0000 7ff1c3fff640 1 -- 172.21.15.22:0/2089704723 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4070650 con 0x7ff1c40b39a0 2023-11-24T06:16:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.971+0000 7ff1c919f640 1 --2- 172.21.15.22:0/2089704723 >> v2:172.21.15.31:3300/0 conn(0x7ff1c40abff0 0x7ff1c4071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.972+0000 7ff1c3fff640 1 --2- 172.21.15.22:0/2089704723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 0x7ff1c4071130 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40b3e50 tx=0x7ff1b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f1e219929fb844 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.973+0000 7ff1c37fe640 1 -- 172.21.15.22:0/2089704723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0031870 con 0x7ff1c40b39a0 2023-11-24T06:16:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.973+0000 7ff1c37fe640 1 -- 172.21.15.22:0/2089704723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b00319d0 con 0x7ff1c40b39a0 2023-11-24T06:16:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.973+0000 7ff1c37fe640 1 -- 172.21.15.22:0/2089704723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0031d60 con 0x7ff1c40b39a0 2023-11-24T06:16:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.973+0000 7ff1cac02640 1 -- 172.21.15.22:0/2089704723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 msgr2=0x7ff1c4071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.973+0000 7ff1cac02640 1 --2- 172.21.15.22:0/2089704723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 0x7ff1c4071130 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40b3e50 tx=0x7ff1b002b910 comp rx=0 tx=0).stop 2023-11-24T06:16:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.974+0000 7ff1cac02640 1 -- 172.21.15.22:0/2089704723 shutdown_connections 2023-11-24T06:16:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.974+0000 7ff1cac02640 1 --2- 172.21.15.22:0/2089704723 >> v2:172.21.15.31:3300/0 conn(0x7ff1c40abff0 0x7ff1c4071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.974+0000 7ff1cac02640 1 --2- 172.21.15.22:0/2089704723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 0x7ff1c4071130 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.974+0000 7ff1cac02640 1 -- 172.21.15.22:0/2089704723 >> 172.21.15.22:0/2089704723 conn(0x7ff1c40b0d80 msgr2=0x7ff1c40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.974+0000 7ff1cac02640 1 -- 172.21.15.22:0/2089704723 shutdown_connections 2023-11-24T06:16:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.974+0000 7ff1cac02640 1 -- 172.21.15.22:0/2089704723 wait complete. 2023-11-24T06:16:34.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.975+0000 7ff1cac02640 1 Processor -- start 2023-11-24T06:16:34.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.976+0000 7ff1cac02640 1 -- start start 2023-11-24T06:16:34.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.976+0000 7ff1cac02640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c40abff0 0x7ff1c4165710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.976+0000 7ff1cac02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 0x7ff1c414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.976+0000 7ff1cac02640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c415a100 0x7ff1c40af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.976+0000 7ff1cac02640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c415a660 con 0x7ff1c40b39a0 2023-11-24T06:16:34.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.976+0000 7ff1cac02640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c415a940 con 0x7ff1c415a100 2023-11-24T06:16:34.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.976+0000 7ff1cac02640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4098820 con 0x7ff1c40abff0 2023-11-24T06:16:34.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.977+0000 7ff1c3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 0x7ff1c414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:34.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.977+0000 7ff1c3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 0x7ff1c414cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46334/0 (socket says 172.21.15.22:46334) 2023-11-24T06:16:34.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.977+0000 7ff1c3fff640 1 -- 172.21.15.22:0/2583936332 learned_addr learned my addr 172.21.15.22:0/2583936332 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.977+0000 7ff1c899e640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c40abff0 0x7ff1c4165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.977+0000 7ff1c3fff640 1 -- 172.21.15.22:0/2583936332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c40abff0 msgr2=0x7ff1c4165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.977+0000 7ff1c3fff640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c40abff0 0x7ff1c4165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.977+0000 7ff1c3fff640 1 -- 172.21.15.22:0/2583936332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c415a100 msgr2=0x7ff1c40af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.977+0000 7ff1c919f640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c415a100 0x7ff1c40af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.978+0000 7ff1c3fff640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c415a100 0x7ff1c40af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.978+0000 7ff1c3fff640 1 -- 172.21.15.22:0/2583936332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b00094d0 con 0x7ff1c40b39a0 2023-11-24T06:16:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.978+0000 7ff1c919f640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c415a100 0x7ff1c40af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.978+0000 7ff1c3fff640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 0x7ff1c414cd00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff1b002b950 tx=0x7ff1b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.978+0000 7ff1c17fa640 1 -- 172.21.15.22:0/2583936332 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0031840 con 0x7ff1c40b39a0 2023-11-24T06:16:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.978+0000 7ff1c17fa640 1 -- 172.21.15.22:0/2583936332 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b00443f0 con 0x7ff1c40b39a0 2023-11-24T06:16:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.978+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c4150a80 con 0x7ff1c40b39a0 2023-11-24T06:16:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.978+0000 7ff1c17fa640 1 -- 172.21.15.22:0/2583936332 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b00447a0 con 0x7ff1c40b39a0 2023-11-24T06:16:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.979+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c4151020 con 0x7ff1c40b39a0 2023-11-24T06:16:34.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.980+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c4067960 con 0x7ff1c40b39a0 2023-11-24T06:16:34.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.981+0000 7ff1c17fa640 1 -- 172.21.15.22:0/2583936332 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff1b0044900 con 0x7ff1c40b39a0 2023-11-24T06:16:34.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.982+0000 7ff1c17fa640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1a806aff0 0x7ff1a806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.982+0000 7ff1c17fa640 1 -- 172.21.15.22:0/2583936332 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1b002d040 con 0x7ff1c40b39a0 2023-11-24T06:16:34.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.982+0000 7ff1c899e640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1a806aff0 0x7ff1a806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:34.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.983+0000 7ff1c899e640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1a806aff0 0x7ff1a806d4b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8007fd0 tx=0x7ff1b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:34.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:34.987+0000 7ff1c17fa640 1 -- 172.21.15.22:0/2583936332 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1b00dee90 con 0x7ff1c40b39a0 2023-11-24T06:16:35.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.182+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1c415aaf0 con 0x7ff1c40b39a0 2023-11-24T06:16:35.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.186+0000 7ff1c17fa640 1 -- 172.21.15.22:0/2583936332 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16530 (secure 0 0 0) 0x7ff1c415aaf0 con 0x7ff1c40b39a0 2023-11-24T06:16:35.189 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:35.189 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":60,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:34.217776+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:32.153129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:33.228812+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:35.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1a806aff0 msgr2=0x7ff1a806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1a806aff0 0x7ff1a806d4b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8007fd0 tx=0x7ff1b8009040 comp rx=0 tx=0).stop 2023-11-24T06:16:35.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 msgr2=0x7ff1c414cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 0x7ff1c414cd00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff1b002b950 tx=0x7ff1b00046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 shutdown_connections 2023-11-24T06:16:35.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff1a806aff0 0x7ff1a806d4b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1c415a100 0x7ff1c40af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c40b39a0 0x7ff1c414cd00 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 --2- 172.21.15.22:0/2583936332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1c40abff0 0x7ff1c4165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 >> 172.21.15.22:0/2583936332 conn(0x7ff1c40b0d80 msgr2=0x7ff1c41591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.188+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 shutdown_connections 2023-11-24T06:16:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.189+0000 7ff1cac02640 1 -- 172.21.15.22:0/2583936332 wait complete. 2023-11-24T06:16:35.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:35.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.430+0000 7efd8e4aa640 1 Processor -- start 2023-11-24T06:16:35.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.430+0000 7efd8e4aa640 1 -- start start 2023-11-24T06:16:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.432+0000 7efd8e4aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd880cf500 0x7efd880cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.432+0000 7efd8e4aa640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd88140900 con 0x7efd880cf050 2023-11-24T06:16:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.432+0000 7efd8e4aa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8815fa70 con 0x7efd8813dfd0 2023-11-24T06:16:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.432+0000 7efd8e4aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8815c580 con 0x7efd880cf500 2023-11-24T06:16:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.432+0000 7efd8cca7640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efd880cf050 0x7efd880cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38254/0 (socket says 172.21.15.22:38254) 2023-11-24T06:16:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.432+0000 7efd8cca7640 1 -- 172.21.15.22:0/4247283373 learned_addr learned my addr 172.21.15.22:0/4247283373 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.432+0000 7efd8dca9640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd880cf500 0x7efd880cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160520073 0 0) 0x7efd88140900 con 0x7efd880cf050 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd74003520 con 0x7efd880cf050 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279917681 0 0) 0x7efd74003520 con 0x7efd880cf050 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd880cf500 msgr2=0x7efd880cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd880cf500 0x7efd880cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 >> v1:172.21.15.31:6789/0 conn(0x7efd8813dfd0 legacy=0x7efd8815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd880cf950 con 0x7efd880cf050 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7efd78001690 con 0x7efd880cf050 2023-11-24T06:16:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 >> v1:172.21.15.22:6789/0 conn(0x7efd880cf050 legacy=0x7efd880cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd74003a10 0x7efd74003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd880cf500 0x7efd74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8815c580 con 0x7efd740047c0 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7400ba80 con 0x7efd74003a10 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7400bc40 con 0x7efd880cf500 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.433+0000 7efd8cca7640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.434+0000 7efd8dca9640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd880cf500 0x7efd74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.434+0000 7efd8d4a8640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd74003a10 0x7efd74003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.434+0000 7efd8cca7640 1 -- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd880cf500 msgr2=0x7efd74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:35.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.434+0000 7efd8cca7640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd880cf500 0x7efd74005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.434+0000 7efd8cca7640 1 -- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd74003a10 msgr2=0x7efd74003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:35.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.434+0000 7efd8cca7640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd74003a10 0x7efd74003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.434+0000 7efd8cca7640 1 -- 172.21.15.22:0/4247283373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74003520 con 0x7efd740047c0 2023-11-24T06:16:35.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.434+0000 7efd8d4a8640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd74003a10 0x7efd74003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:35.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.435+0000 7efd8cca7640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd74004c40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7efd88141720 tx=0x7efd740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad5710afa8cb1f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:35.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.435+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78005ad0 con 0x7efd740047c0 2023-11-24T06:16:35.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.435+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd78005c30 con 0x7efd740047c0 2023-11-24T06:16:35.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.435+0000 7efd7ffff640 1 -- 172.21.15.22:0/4247283373 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7802c890 con 0x7efd740047c0 2023-11-24T06:16:35.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.436+0000 7efd8e4aa640 1 -- 172.21.15.22:0/4247283373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 msgr2=0x7efd74004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.436+0000 7efd8e4aa640 1 --2- 172.21.15.22:0/4247283373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd74004c40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7efd88141720 tx=0x7efd740057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.436+0000 7efd8dca9640 1 -- 172.21.15.22:0/4247283373 reap_dead start 2023-11-24T06:16:35.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.436+0000 7efd8e4aa640 1 -- 172.21.15.22:0/4247283373 shutdown_connections 2023-11-24T06:16:35.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.436+0000 7efd8e4aa640 1 -- 172.21.15.22:0/4247283373 >> 172.21.15.22:0/4247283373 conn(0x7efd8806a860 msgr2=0x7efd8806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:35.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.436+0000 7efd8e4aa640 1 -- 172.21.15.22:0/4247283373 shutdown_connections 2023-11-24T06:16:35.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.436+0000 7efd8e4aa640 1 -- 172.21.15.22:0/4247283373 wait complete. 2023-11-24T06:16:35.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.438+0000 7efd8e4aa640 1 Processor -- start 2023-11-24T06:16:35.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.438+0000 7efd8e4aa640 1 -- start start 2023-11-24T06:16:35.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.439+0000 7efd8e4aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd8813cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.439+0000 7efd8e4aa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd8813d050 0x7efd8813f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.439+0000 7efd8e4aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd8813d5a0 0x7efd8813f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.439+0000 7efd8e4aa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8815e6f0 con 0x7efd740047c0 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.439+0000 7efd8e4aa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd881579e0 con 0x7efd8813d050 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.439+0000 7efd8e4aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd88156dd0 con 0x7efd8813d5a0 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8d4a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd8813cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8d4a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd8813cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46354/0 (socket says 172.21.15.22:46354) 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8d4a8640 1 -- 172.21.15.22:0/1045505005 learned_addr learned my addr 172.21.15.22:0/1045505005 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8cca7640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd8813d050 0x7efd8813f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8dca9640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd8813d5a0 0x7efd8813f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8d4a8640 1 -- 172.21.15.22:0/1045505005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd8813d5a0 msgr2=0x7efd8813f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8d4a8640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd8813d5a0 0x7efd8813f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8d4a8640 1 -- 172.21.15.22:0/1045505005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd8813d050 msgr2=0x7efd8813f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8d4a8640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd8813d050 0x7efd8813f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8d4a8640 1 -- 172.21.15.22:0/1045505005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd881570b0 con 0x7efd740047c0 2023-11-24T06:16:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8cca7640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd8813d050 0x7efd8813f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.440+0000 7efd8d4a8640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd8813cad0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7efd8400d7a0 tx=0x7efd8400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.441+0000 7efd7dffb640 1 -- 172.21.15.22:0/1045505005 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84005270 con 0x7efd740047c0 2023-11-24T06:16:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.441+0000 7efd7dffb640 1 -- 172.21.15.22:0/1045505005 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd840053d0 con 0x7efd740047c0 2023-11-24T06:16:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.441+0000 7efd7dffb640 1 -- 172.21.15.22:0/1045505005 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400b8f0 con 0x7efd740047c0 2023-11-24T06:16:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.441+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd88157390 con 0x7efd740047c0 2023-11-24T06:16:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.441+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd88156960 con 0x7efd740047c0 2023-11-24T06:16:35.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.442+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd88156b20 con 0x7efd740047c0 2023-11-24T06:16:35.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.443+0000 7efd7dffb640 1 -- 172.21.15.22:0/1045505005 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7efd8400ba50 con 0x7efd740047c0 2023-11-24T06:16:35.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.444+0000 7efd7dffb640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd6c06b020 0x7efd6c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.444+0000 7efd7dffb640 1 -- 172.21.15.22:0/1045505005 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd84089960 con 0x7efd740047c0 2023-11-24T06:16:35.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.445+0000 7efd8cca7640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd6c06b020 0x7efd6c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.445+0000 7efd8cca7640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd6c06b020 0x7efd6c06d4e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efd78034000 tx=0x7efd78009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:35.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.449+0000 7efd7dffb640 1 -- 172.21.15.22:0/1045505005 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd84054680 con 0x7efd740047c0 2023-11-24T06:16:35.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.645+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd8804e840 con 0x7efd740047c0 2023-11-24T06:16:35.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.646+0000 7efd7dffb640 1 -- 172.21.15.22:0/1045505005 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16530 (secure 0 0 0) 0x7efd84019310 con 0x7efd740047c0 2023-11-24T06:16:35.649 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:35.649 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":60,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:34.217776+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:32.153129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:33.228812+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:35.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.648+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd6c06b020 msgr2=0x7efd6c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.648+0000 7efd8e4aa640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd6c06b020 0x7efd6c06d4e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efd78034000 tx=0x7efd78009030 comp rx=0 tx=0).stop 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.648+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 msgr2=0x7efd8813cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.648+0000 7efd8e4aa640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd8813cad0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7efd8400d7a0 tx=0x7efd8400dc60 comp rx=0 tx=0).stop 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.649+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 shutdown_connections 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.649+0000 7efd8e4aa640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd6c06b020 0x7efd6c06d4e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.649+0000 7efd8e4aa640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd8813d5a0 0x7efd8813f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.649+0000 7efd8e4aa640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd8813d050 0x7efd8813f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.649+0000 7efd8e4aa640 1 --2- 172.21.15.22:0/1045505005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd740047c0 0x7efd8813cad0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.649+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 >> 172.21.15.22:0/1045505005 conn(0x7efd8806a860 msgr2=0x7efd880afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.649+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 shutdown_connections 2023-11-24T06:16:35.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.649+0000 7efd8e4aa640 1 -- 172.21.15.22:0/1045505005 wait complete. 2023-11-24T06:16:35.672 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:16:35.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.897+0000 7f5f3fdb0640 1 Processor -- start 2023-11-24T06:16:35.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.897+0000 7f5f3fdb0640 1 -- start start 2023-11-24T06:16:35.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.898+0000 7f5f3fdb0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f3806cad0 0x7f5f3806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.898+0000 7f5f3fdb0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f38072280 0x7f5f380b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.898+0000 7f5f3fdb0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f38071780 con 0x7f5f38160b10 2023-11-24T06:16:35.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3fdb0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f380b2320 con 0x7f5f38072280 2023-11-24T06:16:35.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3fdb0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3806df30 con 0x7f5f3806cad0 2023-11-24T06:16:35.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3db4c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5f38160b10 0x7f5f3806c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38256/0 (socket says 172.21.15.22:38256) 2023-11-24T06:16:35.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3db4c640 1 -- 172.21.15.22:0/2768507791 learned_addr learned my addr 172.21.15.22:0/2768507791 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:35.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3e34d640 1 --2- 172.21.15.22:0/2768507791 >> v2:172.21.15.22:3300/0 conn(0x7f5f38072280 0x7f5f380b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3d34b640 1 --2- 172.21.15.22:0/2768507791 >> v2:172.21.15.31:3300/0 conn(0x7f5f3806cad0 0x7f5f3806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3cb4a640 1 -- 172.21.15.22:0/2768507791 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580031343 0 0) 0x7f5f38071780 con 0x7f5f38160b10 2023-11-24T06:16:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3cb4a640 1 -- 172.21.15.22:0/2768507791 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f24003520 con 0x7f5f38160b10 2023-11-24T06:16:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3e34d640 1 -- 172.21.15.22:0/2768507791 >> v2:172.21.15.31:3300/0 conn(0x7f5f3806cad0 msgr2=0x7f5f3806e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3e34d640 1 --2- 172.21.15.22:0/2768507791 >> v2:172.21.15.31:3300/0 conn(0x7f5f3806cad0 0x7f5f3806e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.899+0000 7f5f3e34d640 1 -- 172.21.15.22:0/2768507791 >> v1:172.21.15.22:6789/0 conn(0x7f5f38160b10 legacy=0x7f5f3806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.900+0000 7f5f3e34d640 1 -- 172.21.15.22:0/2768507791 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380711c0 con 0x7f5f38072280 2023-11-24T06:16:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.901+0000 7f5f3e34d640 1 --2- 172.21.15.22:0/2768507791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38072280 0x7f5f380b2740 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5f380d0100 tx=0x7f5f3002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e2961dc851c83b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.901+0000 7f5f3cb4a640 1 -- 172.21.15.22:0/2768507791 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3002cbd0 con 0x7f5f38072280 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.901+0000 7f5f3cb4a640 1 -- 172.21.15.22:0/2768507791 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3002cd30 con 0x7f5f38072280 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.901+0000 7f5f3cb4a640 1 -- 172.21.15.22:0/2768507791 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3002cea0 con 0x7f5f38072280 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.902+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/2768507791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38072280 msgr2=0x7f5f380b2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.902+0000 7f5f3fdb0640 1 --2- 172.21.15.22:0/2768507791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38072280 0x7f5f380b2740 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5f380d0100 tx=0x7f5f3002be20 comp rx=0 tx=0).stop 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.902+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/2768507791 shutdown_connections 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.902+0000 7f5f3fdb0640 1 --2- 172.21.15.22:0/2768507791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38072280 0x7f5f380b2740 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.902+0000 7f5f3fdb0640 1 --2- 172.21.15.22:0/2768507791 >> v2:172.21.15.31:3300/0 conn(0x7f5f3806cad0 0x7f5f3806e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.902+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/2768507791 >> 172.21.15.22:0/2768507791 conn(0x7f5f380b0ba0 msgr2=0x7f5f380b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.902+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/2768507791 shutdown_connections 2023-11-24T06:16:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.902+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/2768507791 wait complete. 2023-11-24T06:16:35.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.903+0000 7f5f3fdb0640 1 Processor -- start 2023-11-24T06:16:35.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.904+0000 7f5f3fdb0640 1 -- start start 2023-11-24T06:16:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3fdb0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3806cad0 0x7f5f381f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3fdb0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f38072280 0x7f5f380ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3fdb0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38160b10 0x7f5f380cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3fdb0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380c99a0 con 0x7f5f38160b10 2023-11-24T06:16:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3fdb0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380cbae0 con 0x7f5f3806cad0 2023-11-24T06:16:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3fdb0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380cbd50 con 0x7f5f38072280 2023-11-24T06:16:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3e34d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38160b10 0x7f5f380cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3e34d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38160b10 0x7f5f380cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46376/0 (socket says 172.21.15.22:46376) 2023-11-24T06:16:35.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3e34d640 1 -- 172.21.15.22:0/4223746983 learned_addr learned my addr 172.21.15.22:0/4223746983 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:35.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3db4c640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3806cad0 0x7f5f381f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3e34d640 1 -- 172.21.15.22:0/4223746983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f38072280 msgr2=0x7f5f380ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3e34d640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f38072280 0x7f5f380ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3e34d640 1 -- 172.21.15.22:0/4223746983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3806cad0 msgr2=0x7f5f381f3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3e34d640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3806cad0 0x7f5f381f3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3e34d640 1 -- 172.21.15.22:0/4223746983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30009a70 con 0x7f5f38160b10 2023-11-24T06:16:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.905+0000 7f5f3db4c640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3806cad0 0x7f5f381f3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.906+0000 7f5f3e34d640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38160b10 0x7f5f380cd050 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009eb0 tx=0x7f5f30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.906+0000 7f5f2e7fc640 1 -- 172.21.15.22:0/4223746983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3002cea0 con 0x7f5f38160b10 2023-11-24T06:16:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.906+0000 7f5f2e7fc640 1 -- 172.21.15.22:0/4223746983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f30040650 con 0x7f5f38160b10 2023-11-24T06:16:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.906+0000 7f5f2e7fc640 1 -- 172.21.15.22:0/4223746983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30040a00 con 0x7f5f38160b10 2023-11-24T06:16:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.906+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f380cc030 con 0x7f5f38160b10 2023-11-24T06:16:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.906+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f380cc5f0 con 0x7f5f38160b10 2023-11-24T06:16:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.907+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f380cc7e0 con 0x7f5f38160b10 2023-11-24T06:16:35.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.908+0000 7f5f2e7fc640 1 -- 172.21.15.22:0/4223746983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5f30040b60 con 0x7f5f38160b10 2023-11-24T06:16:35.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.910+0000 7f5f2e7fc640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.910+0000 7f5f2e7fc640 1 -- 172.21.15.22:0/4223746983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f300ac560 con 0x7f5f38160b10 2023-11-24T06:16:35.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.910+0000 7f5f3db4c640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.911+0000 7f5f3db4c640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5f340011e0 tx=0x7f5f34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:35.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:35.915+0000 7f5f2e7fc640 1 -- 172.21.15.22:0/4223746983 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f30077380 con 0x7f5f38160b10 2023-11-24T06:16:36.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.147+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5f3809d200 con 0x7f5f38160b10 2023-11-24T06:16:36.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.774+0000 7f5f2e7fc640 1 -- 172.21.15.22:0/4223746983 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5f30009450 con 0x7f5f38160b10 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 msgr2=0x7f5f1c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5f340011e0 tx=0x7f5f34009040 comp rx=0 tx=0).stop 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38160b10 msgr2=0x7f5f380cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38160b10 0x7f5f380cd050 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009eb0 tx=0x7f5f30004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 shutdown_connections 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f1c06aff0 0x7f5f1c06d4b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f38160b10 0x7f5f380cd050 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f38072280 0x7f5f380ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 --2- 172.21.15.22:0/4223746983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f3806cad0 0x7f5f381f3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 >> 172.21.15.22:0/4223746983 conn(0x7f5f380b0ba0 msgr2=0x7f5f3815fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:36.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 shutdown_connections 2023-11-24T06:16:36.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:36.778+0000 7f5f3fdb0640 1 -- 172.21.15.22:0/4223746983 wait complete. 2023-11-24T06:16:36.803 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:16:36.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:16:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.026+0000 7fc758c8c640 1 Processor -- start 2023-11-24T06:16:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.026+0000 7fc758c8c640 1 -- start start 2023-11-24T06:16:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.028+0000 7fc758c8c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc75415d3b0 0x7fc7540ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.028+0000 7fc758c8c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7540d0fa0 0x7fc7540d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.028+0000 7fc758c8c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7540d2010 con 0x7fc7540d1bc0 2023-11-24T06:16:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.028+0000 7fc758c8c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7540c6bf0 con 0x7fc75415d3b0 2023-11-24T06:16:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.028+0000 7fc758c8c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540d1400 con 0x7fc7540d0fa0 2023-11-24T06:16:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.028+0000 7fc753fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc7540d1bc0 0x7fc7540b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38268/0 (socket says 172.21.15.22:38268) 2023-11-24T06:16:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.028+0000 7fc753fff640 1 -- 172.21.15.22:0/3893821646 learned_addr learned my addr 172.21.15.22:0/3893821646 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:37.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.028+0000 7fc74bfff640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7540d0fa0 0x7fc7540d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.028+0000 7fc7537fe640 1 --2- 172.21.15.22:0/3893821646 >> v2:172.21.15.31:3300/0 conn(0x7fc75415d3b0 0x7fc7540ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230956840 0 0) 0x7fc74c001490 con 0x7fc7540d1bc0 2023-11-24T06:16:37.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc740003520 con 0x7fc7540d1bc0 2023-11-24T06:16:37.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 634410736 0 0) 0x7fc740003520 con 0x7fc7540d1bc0 2023-11-24T06:16:37.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7540d0fa0 msgr2=0x7fc7540d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:37.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7540d0fa0 0x7fc7540d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 >> v2:172.21.15.31:3300/0 conn(0x7fc75415d3b0 msgr2=0x7fc7540ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 --2- 172.21.15.22:0/3893821646 >> v2:172.21.15.31:3300/0 conn(0x7fc75415d3b0 0x7fc7540ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540cedc0 con 0x7fc7540d1bc0 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fc74c001b80 con 0x7fc7540d1bc0 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 >> v1:172.21.15.22:6789/0 conn(0x7fc7540d1bc0 legacy=0x7fc7540b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7540d0fa0 0x7fc7400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.029+0000 7fc752ffd640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740003fb0 0x7fc7400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.030+0000 7fc752ffd640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc740004d00 0x7fc740005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.030+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540c6bf0 con 0x7fc740004d00 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.030+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540d1400 con 0x7fc740003fb0 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.030+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74000ba80 con 0x7fc7540d0fa0 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.030+0000 7fc753fff640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc740004d00 0x7fc740005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.030+0000 7fc7537fe640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7540d0fa0 0x7fc7400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.030+0000 7fc74bfff640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740003fb0 0x7fc7400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.031+0000 7fc753fff640 1 -- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7540d0fa0 msgr2=0x7fc7400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.031+0000 7fc753fff640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7540d0fa0 0x7fc7400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.031+0000 7fc753fff640 1 -- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740003fb0 msgr2=0x7fc7400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.031+0000 7fc753fff640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740003fb0 0x7fc7400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.031+0000 7fc753fff640 1 -- 172.21.15.22:0/3893821646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740003520 con 0x7fc740004d00 2023-11-24T06:16:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.031+0000 7fc74bfff640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc740003fb0 0x7fc7400047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:37.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.033+0000 7fc753fff640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc740004d00 0x7fc740005180 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00a760 tx=0x7fc7400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87828cf8fa16903 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.033+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c034630 con 0x7fc740004d00 2023-11-24T06:16:37.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.033+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c02f070 con 0x7fc740004d00 2023-11-24T06:16:37.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.033+0000 7fc752ffd640 1 -- 172.21.15.22:0/3893821646 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0349d0 con 0x7fc740004d00 2023-11-24T06:16:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.034+0000 7fc758c8c640 1 -- 172.21.15.22:0/3893821646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc740004d00 msgr2=0x7fc740005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.034+0000 7fc758c8c640 1 --2- 172.21.15.22:0/3893821646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc740004d00 0x7fc740005180 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00a760 tx=0x7fc7400057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.034+0000 7fc753fff640 1 -- 172.21.15.22:0/3893821646 reap_dead start 2023-11-24T06:16:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.034+0000 7fc758c8c640 1 -- 172.21.15.22:0/3893821646 shutdown_connections 2023-11-24T06:16:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.034+0000 7fc758c8c640 1 -- 172.21.15.22:0/3893821646 >> 172.21.15.22:0/3893821646 conn(0x7fc7540d30a0 msgr2=0x7fc7540d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.034+0000 7fc758c8c640 1 -- 172.21.15.22:0/3893821646 shutdown_connections 2023-11-24T06:16:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.034+0000 7fc758c8c640 1 -- 172.21.15.22:0/3893821646 wait complete. 2023-11-24T06:16:37.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.036+0000 7fc758c8c640 1 Processor -- start 2023-11-24T06:16:37.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.036+0000 7fc758c8c640 1 -- start start 2023-11-24T06:16:37.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.037+0000 7fc758c8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc75415b8e0 0x7fc7540b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.037+0000 7fc758c8c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7541f39f0 0x7fc7541e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.037+0000 7fc758c8c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7541e7380 0x7fc7541e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.037+0000 7fc758c8c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7541e7810 con 0x7fc7541f39f0 2023-11-24T06:16:37.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.037+0000 7fc758c8c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7541f4160 con 0x7fc75415b8e0 2023-11-24T06:16:37.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.037+0000 7fc758c8c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540b8dc0 con 0x7fc7541e7380 2023-11-24T06:16:37.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.037+0000 7fc74bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7541f39f0 0x7fc7541e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.037+0000 7fc74bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7541f39f0 0x7fc7541e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46394/0 (socket says 172.21.15.22:46394) 2023-11-24T06:16:37.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.037+0000 7fc74bfff640 1 -- 172.21.15.22:0/2424527610 learned_addr learned my addr 172.21.15.22:0/2424527610 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:37.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.038+0000 7fc7537fe640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc75415b8e0 0x7fc7540b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.038+0000 7fc753fff640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7541e7380 0x7fc7541e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.038+0000 7fc74bfff640 1 -- 172.21.15.22:0/2424527610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7541e7380 msgr2=0x7fc7541e59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.038+0000 7fc74bfff640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7541e7380 0x7fc7541e59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.038+0000 7fc74bfff640 1 -- 172.21.15.22:0/2424527610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc75415b8e0 msgr2=0x7fc7540b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.038+0000 7fc74bfff640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc75415b8e0 0x7fc7540b8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.038+0000 7fc74bfff640 1 -- 172.21.15.22:0/2424527610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540b79f0 con 0x7fc7541f39f0 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.038+0000 7fc753fff640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7541e7380 0x7fc7541e59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.038+0000 7fc74bfff640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7541f39f0 0x7fc7541e6e40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc73c011570 tx=0x7fc73c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.039+0000 7fc750ff9640 1 -- 172.21.15.22:0/2424527610 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c015870 con 0x7fc7541f39f0 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.039+0000 7fc750ff9640 1 -- 172.21.15.22:0/2424527610 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c0159d0 con 0x7fc7541f39f0 2023-11-24T06:16:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.039+0000 7fc750ff9640 1 -- 172.21.15.22:0/2424527610 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c015d40 con 0x7fc7541f39f0 2023-11-24T06:16:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.039+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75415c0c0 con 0x7fc7541f39f0 2023-11-24T06:16:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.039+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7540b7c90 con 0x7fc7541f39f0 2023-11-24T06:16:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.040+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7540b7850 con 0x7fc7541f39f0 2023-11-24T06:16:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.041+0000 7fc750ff9640 1 -- 172.21.15.22:0/2424527610 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc73c00f460 con 0x7fc7541f39f0 2023-11-24T06:16:37.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.042+0000 7fc750ff9640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc73406aff0 0x7fc73406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.043+0000 7fc750ff9640 1 -- 172.21.15.22:0/2424527610 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc73c08a180 con 0x7fc7541f39f0 2023-11-24T06:16:37.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.043+0000 7fc7537fe640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc73406aff0 0x7fc73406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.043+0000 7fc7537fe640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc73406aff0 0x7fc73406d4b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc744009b80 tx=0x7fc744008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.047+0000 7fc750ff9640 1 -- 172.21.15.22:0/2424527610 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7540b7850 con 0x7fc7541f39f0 2023-11-24T06:16:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.279+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc7540b7850 con 0x7fc7541f39f0 2023-11-24T06:16:37.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.794+0000 7fc750ff9640 1 -- 172.21.15.22:0/2424527610 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc7540b7850 con 0x7fc7541f39f0 2023-11-24T06:16:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.798+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc73406aff0 msgr2=0x7fc73406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.798+0000 7fc758c8c640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc73406aff0 0x7fc73406d4b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc744009b80 tx=0x7fc744008040 comp rx=0 tx=0).stop 2023-11-24T06:16:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.798+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7541f39f0 msgr2=0x7fc7541e6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.798+0000 7fc758c8c640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7541f39f0 0x7fc7541e6e40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc73c011570 tx=0x7fc73c011a30 comp rx=0 tx=0).stop 2023-11-24T06:16:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.798+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 shutdown_connections 2023-11-24T06:16:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.798+0000 7fc758c8c640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc73406aff0 0x7fc73406d4b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.798+0000 7fc758c8c640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7541e7380 0x7fc7541e59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.799+0000 7fc758c8c640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7541f39f0 0x7fc7541e6e40 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.799+0000 7fc758c8c640 1 --2- 172.21.15.22:0/2424527610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc75415b8e0 0x7fc7540b8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.799+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 >> 172.21.15.22:0/2424527610 conn(0x7fc7540d30a0 msgr2=0x7fc754160100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.799+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 shutdown_connections 2023-11-24T06:16:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:37.799+0000 7fc758c8c640 1 -- 172.21.15.22:0/2424527610 wait complete. 2023-11-24T06:16:37.823 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:16:37.824 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:38.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.044+0000 7f1c27cd4640 1 Processor -- start 2023-11-24T06:16:38.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.045+0000 7f1c27cd4640 1 -- start start 2023-11-24T06:16:38.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.046+0000 7f1c27cd4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200ad720 0x7f1c200b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.046+0000 7f1c27cd4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c200abff0 0x7f1c200b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.046+0000 7f1c27cd4640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2015c360 con 0x7f1c2006d520 2023-11-24T06:16:38.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.046+0000 7f1c27cd4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200b41a0 con 0x7f1c200abff0 2023-11-24T06:16:38.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.046+0000 7f1c27cd4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2015ba30 con 0x7f1c200ad720 2023-11-24T06:16:38.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.046+0000 7f1c25a70640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1c2006d520 0x7f1c2006d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38284/0 (socket says 172.21.15.22:38284) 2023-11-24T06:16:38.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.046+0000 7f1c25a70640 1 -- 172.21.15.22:0/735587034 learned_addr learned my addr 172.21.15.22:0/735587034 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:38.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c2526f640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200ad720 0x7f1c200b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c26271640 1 --2- 172.21.15.22:0/735587034 >> v2:172.21.15.31:3300/0 conn(0x7f1c200abff0 0x7f1c200b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024736428 0 0) 0x7f1c2015c360 con 0x7f1c2006d520 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c0c003520 con 0x7f1c2006d520 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2008124982 0 0) 0x7f1c0c003520 con 0x7f1c2006d520 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200ad720 msgr2=0x7f1c200b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200ad720 0x7f1c200b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 >> v2:172.21.15.31:3300/0 conn(0x7f1c200abff0 msgr2=0x7f1c200b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 --2- 172.21.15.22:0/735587034 >> v2:172.21.15.31:3300/0 conn(0x7f1c200abff0 0x7f1c200b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2015bd10 con 0x7f1c2006d520 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f1c1c001670 con 0x7f1c2006d520 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.047+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 >> v1:172.21.15.22:6789/0 conn(0x7f1c2006d520 legacy=0x7f1c2006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c24a6e640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c0c003970 0x7f1c0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c24a6e640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c24a6e640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200ad720 0x7f1c0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2015ba30 con 0x7f1c0c0047c0 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c00b980 con 0x7f1c0c003970 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c00bac0 con 0x7f1c200ad720 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c2526f640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c25a70640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c0c003970 0x7f1c0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c26271640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200ad720 0x7f1c0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c2526f640 1 -- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200ad720 msgr2=0x7f1c0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c2526f640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200ad720 0x7f1c0c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c2526f640 1 -- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c0c003970 msgr2=0x7f1c0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c2526f640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c0c003970 0x7f1c0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c2526f640 1 -- 172.21.15.22:0/735587034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c003520 con 0x7f1c0c0047c0 2023-11-24T06:16:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.048+0000 7f1c25a70640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c0c003970 0x7f1c0c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:38.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.050+0000 7f1c2526f640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c0c004c40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009a90 tx=0x7f1c0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00f506fda99a439 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.050+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1002c680 con 0x7f1c0c0047c0 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.050+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1002c7e0 con 0x7f1c0c0047c0 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.050+0000 7f1c24a6e640 1 -- 172.21.15.22:0/735587034 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1002cb70 con 0x7f1c0c0047c0 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.050+0000 7f1c27cd4640 1 -- 172.21.15.22:0/735587034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 msgr2=0x7f1c0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.050+0000 7f1c27cd4640 1 --2- 172.21.15.22:0/735587034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c0c004c40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009a90 tx=0x7f1c0c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.051+0000 7f1c26271640 1 -- 172.21.15.22:0/735587034 reap_dead start 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.051+0000 7f1c27cd4640 1 -- 172.21.15.22:0/735587034 shutdown_connections 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.051+0000 7f1c27cd4640 1 -- 172.21.15.22:0/735587034 >> 172.21.15.22:0/735587034 conn(0x7f1c200b0d80 msgr2=0x7f1c200b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.051+0000 7f1c27cd4640 1 -- 172.21.15.22:0/735587034 shutdown_connections 2023-11-24T06:16:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.051+0000 7f1c27cd4640 1 -- 172.21.15.22:0/735587034 wait complete. 2023-11-24T06:16:38.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.053+0000 7f1c27cd4640 1 Processor -- start 2023-11-24T06:16:38.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.053+0000 7f1c27cd4640 1 -- start start 2023-11-24T06:16:38.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c27cd4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c2015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c27cd4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200cd870 0x7f1c200af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c27cd4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c20151c30 0x7f1c200af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c27cd4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20099580 con 0x7f1c0c0047c0 2023-11-24T06:16:38.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c27cd4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200ccfe0 con 0x7f1c20151c30 2023-11-24T06:16:38.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c27cd4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200cd2c0 con 0x7f1c200cd870 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c25a70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c2015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c25a70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c2015d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46406/0 (socket says 172.21.15.22:46406) 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c25a70640 1 -- 172.21.15.22:0/2779760671 learned_addr learned my addr 172.21.15.22:0/2779760671 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c2526f640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200cd870 0x7f1c200af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c25a70640 1 -- 172.21.15.22:0/2779760671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200cd870 msgr2=0x7f1c200af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c25a70640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200cd870 0x7f1c200af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c25a70640 1 -- 172.21.15.22:0/2779760671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c20151c30 msgr2=0x7f1c200af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c25a70640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c20151c30 0x7f1c200af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.054+0000 7f1c25a70640 1 -- 172.21.15.22:0/2779760671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20099210 con 0x7f1c0c0047c0 2023-11-24T06:16:38.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.055+0000 7f1c25a70640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c2015d4d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00d830 tx=0x7f1c1c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:38.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.055+0000 7f1c167fc640 1 -- 172.21.15.22:0/2779760671 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0074e0 con 0x7f1c0c0047c0 2023-11-24T06:16:38.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.055+0000 7f1c167fc640 1 -- 172.21.15.22:0/2779760671 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c007640 con 0x7f1c0c0047c0 2023-11-24T06:16:38.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.055+0000 7f1c167fc640 1 -- 172.21.15.22:0/2779760671 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0049e0 con 0x7f1c0c0047c0 2023-11-24T06:16:38.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.055+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c200cd5a0 con 0x7f1c0c0047c0 2023-11-24T06:16:38.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.055+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c20156c90 con 0x7f1c0c0047c0 2023-11-24T06:16:38.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.056+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c200993a0 con 0x7f1c0c0047c0 2023-11-24T06:16:38.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.057+0000 7f1c167fc640 1 -- 172.21.15.22:0/2779760671 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1c1c004b40 con 0x7f1c0c0047c0 2023-11-24T06:16:38.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.058+0000 7f1c167fc640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1c0406aff0 0x7f1c0406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.058+0000 7f1c167fc640 1 -- 172.21.15.22:0/2779760671 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c1c089450 con 0x7f1c0c0047c0 2023-11-24T06:16:38.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.059+0000 7f1c2526f640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1c0406aff0 0x7f1c0406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.060+0000 7f1c2526f640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1c0406aff0 0x7f1c0406d4b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1c10036000 tx=0x7f1c10030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.063+0000 7f1c167fc640 1 -- 172.21.15.22:0/2779760671 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c1c054190 con 0x7f1c0c0047c0 2023-11-24T06:16:38.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.292+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c20074770 con 0x7f1c0c0047c0 2023-11-24T06:16:38.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.294+0000 7f1c167fc640 1 -- 172.21.15.22:0/2779760671 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f1c1c0577b0 con 0x7f1c0c0047c0 2023-11-24T06:16:38.296 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:38.296 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3364238617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3364238617},{"type":"v1","addr":"172.21.15.31:6835","nonce":3364238617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6420,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/1299665813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1299665813},{"type":"v1","addr":"172.21.15.22:6836","nonce":1299665813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1568499503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1568499503},{"type":"v1","addr":"172.21.15.22:6837","nonce":1568499503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:34.218301+0000","modified":"2023-11-24T06:16:37.280807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6435":{"gid":6435,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2376501260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2376501260},{"type":"v1","addr":"172.21.15.31:6834","nonce":2376501260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:16:38.297 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 34 2023-11-24T06:16:38.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1c0406aff0 msgr2=0x7f1c0406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1c0406aff0 0x7f1c0406d4b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1c10036000 tx=0x7f1c10030000 comp rx=0 tx=0).stop 2023-11-24T06:16:38.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 msgr2=0x7f1c2015d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c2015d4d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00d830 tx=0x7f1c1c00dcf0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 shutdown_connections 2023-11-24T06:16:38.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1c0406aff0 0x7f1c0406d4b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c20151c30 0x7f1c200af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c200cd870 0x7f1c200af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 --2- 172.21.15.22:0/2779760671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c0047c0 0x7f1c2015d4d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.296+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 >> 172.21.15.22:0/2779760671 conn(0x7f1c200b0d80 msgr2=0x7f1c200acc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:38.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.297+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 shutdown_connections 2023-11-24T06:16:38.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.297+0000 7f1c27cd4640 1 -- 172.21.15.22:0/2779760671 wait complete. 2023-11-24T06:16:38.320 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:38.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.546+0000 7f137cfb3640 1 Processor -- start 2023-11-24T06:16:38.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.546+0000 7f137cfb3640 1 -- start start 2023-11-24T06:16:38.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.548+0000 7f137cfb3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 0x7f137815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.548+0000 7f137cfb3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13780cf050 0x7f13780cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.548+0000 7f137cfb3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780ce7c0 con 0x7f137806c130 2023-11-24T06:16:38.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.548+0000 7f137cfb3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780cfa10 con 0x7f13780cf050 2023-11-24T06:16:38.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.548+0000 7f137cfb3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1378140900 con 0x7f137813dfd0 2023-11-24T06:16:38.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.549+0000 7f136ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13780cf050 0x7f13780cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.549+0000 7f13777fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 0x7f137815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.549+0000 7f136ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13780cf050 0x7f13780cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:50272/0 (socket says 172.21.15.22:50272) 2023-11-24T06:16:38.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.549+0000 7f136ffff640 1 -- 172.21.15.22:0/4285431102 learned_addr learned my addr 172.21.15.22:0/4285431102 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:38.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.550+0000 7f136ffff640 1 -- 172.21.15.22:0/4285431102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 msgr2=0x7f137815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:38.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.550+0000 7f136ffff640 1 --2- 172.21.15.22:0/4285431102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 0x7f137815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.550+0000 7f136ffff640 1 -- 172.21.15.22:0/4285431102 >> v1:172.21.15.31:6789/0 conn(0x7f137806c130 legacy=0x7f137806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.550+0000 7f136ffff640 1 -- 172.21.15.22:0/4285431102 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137815fa70 con 0x7f13780cf050 2023-11-24T06:16:38.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.550+0000 7f13777fe640 1 --2- 172.21.15.22:0/4285431102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 0x7f137815be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:16:38.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.551+0000 7f136ffff640 1 --2- 172.21.15.22:0/4285431102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13780cf050 0x7f13780cf4d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1360009870 tx=0x7f136002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8343b4bb974763b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:38.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.552+0000 7f1376ffd640 1 -- 172.21.15.22:0/4285431102 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360030840 con 0x7f13780cf050 2023-11-24T06:16:38.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.552+0000 7f1376ffd640 1 -- 172.21.15.22:0/4285431102 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13600309a0 con 0x7f13780cf050 2023-11-24T06:16:38.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.552+0000 7f1376ffd640 1 -- 172.21.15.22:0/4285431102 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360030d30 con 0x7f13780cf050 2023-11-24T06:16:38.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.552+0000 7f137cfb3640 1 -- 172.21.15.22:0/4285431102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13780cf050 msgr2=0x7f13780cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.552+0000 7f137cfb3640 1 --2- 172.21.15.22:0/4285431102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13780cf050 0x7f13780cf4d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1360009870 tx=0x7f136002b980 comp rx=0 tx=0).stop 2023-11-24T06:16:38.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.553+0000 7f137cfb3640 1 -- 172.21.15.22:0/4285431102 shutdown_connections 2023-11-24T06:16:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.553+0000 7f137cfb3640 1 --2- 172.21.15.22:0/4285431102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13780cf050 0x7f13780cf4d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.553+0000 7f137cfb3640 1 --2- 172.21.15.22:0/4285431102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 0x7f137815be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.553+0000 7f137cfb3640 1 -- 172.21.15.22:0/4285431102 >> 172.21.15.22:0/4285431102 conn(0x7f137806a860 msgr2=0x7f137806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.553+0000 7f137cfb3640 1 -- 172.21.15.22:0/4285431102 shutdown_connections 2023-11-24T06:16:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.553+0000 7f137cfb3640 1 -- 172.21.15.22:0/4285431102 wait complete. 2023-11-24T06:16:38.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.555+0000 7f137cfb3640 1 Processor -- start 2023-11-24T06:16:38.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.555+0000 7f137cfb3640 1 -- start start 2023-11-24T06:16:38.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f137cfb3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f137806c130 0x7f137815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f137cfb3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13780cf050 0x7f13780b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f137cfb3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 0x7f13780b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f137cfb3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13781f3cb0 con 0x7f13780cf050 2023-11-24T06:16:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f137cfb3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13781f2c40 con 0x7f137806c130 2023-11-24T06:16:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f137cfb3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13781f2ef0 con 0x7f137813dfd0 2023-11-24T06:16:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f136ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13780cf050 0x7f13780b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f136ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13780cf050 0x7f13780b28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46418/0 (socket says 172.21.15.22:46418) 2023-11-24T06:16:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f136ffff640 1 -- 172.21.15.22:0/1736137831 learned_addr learned my addr 172.21.15.22:0/1736137831 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f1377fff640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 0x7f13780b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.556+0000 7f13777fe640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f137806c130 0x7f137815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f136ffff640 1 -- 172.21.15.22:0/1736137831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 msgr2=0x7f13780b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f136ffff640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 0x7f13780b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f136ffff640 1 -- 172.21.15.22:0/1736137831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f137806c130 msgr2=0x7f137815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f136ffff640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f137806c130 0x7f137815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f136ffff640 1 -- 172.21.15.22:0/1736137831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368009400 con 0x7f13780cf050 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f13777fe640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f137806c130 0x7f137815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f136ffff640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13780cf050 0x7f13780b28e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1360000c00 tx=0x7f1360004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f1374ff9640 1 -- 172.21.15.22:0/1736137831 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360039c90 con 0x7f13780cf050 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f1374ff9640 1 -- 172.21.15.22:0/1736137831 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360039e10 con 0x7f13780cf050 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f1374ff9640 1 -- 172.21.15.22:0/1736137831 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360043640 con 0x7f13780cf050 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.557+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13600094d0 con 0x7f13780cf050 2023-11-24T06:16:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.558+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13781f34b0 con 0x7f13780cf050 2023-11-24T06:16:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.559+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137804e840 con 0x7f13780cf050 2023-11-24T06:16:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.560+0000 7f1374ff9640 1 -- 172.21.15.22:0/1736137831 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f13600437a0 con 0x7f13780cf050 2023-11-24T06:16:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.561+0000 7f1374ff9640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f135806aff0 0x7f135806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.561+0000 7f1374ff9640 1 -- 172.21.15.22:0/1736137831 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f136003e070 con 0x7f13780cf050 2023-11-24T06:16:38.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.561+0000 7f13777fe640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f135806aff0 0x7f135806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:38.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.562+0000 7f13777fe640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f135806aff0 0x7f135806d4b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1368009bb0 tx=0x7f1368008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:38.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.565+0000 7f1374ff9640 1 -- 172.21.15.22:0/1736137831 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1360077740 con 0x7f13780cf050 2023-11-24T06:16:38.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.761+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13780ce9a0 con 0x7f13780cf050 2023-11-24T06:16:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.764+0000 7f1374ff9640 1 -- 172.21.15.22:0/1736137831 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f136007ad60 con 0x7f13780cf050 2023-11-24T06:16:38.767 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:35.760665+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:32.153129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:33.228812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f135806aff0 msgr2=0x7f135806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f135806aff0 0x7f135806d4b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1368009bb0 tx=0x7f1368008040 comp rx=0 tx=0).stop 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13780cf050 msgr2=0x7f13780b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13780cf050 0x7f13780b28e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1360000c00 tx=0x7f1360004730 comp rx=0 tx=0).stop 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 shutdown_connections 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f135806aff0 0x7f135806d4b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f137813dfd0 0x7f13780b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13780cf050 0x7f13780b28e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 --2- 172.21.15.22:0/1736137831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f137806c130 0x7f137815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 >> 172.21.15.22:0/1736137831 conn(0x7f137806a860 msgr2=0x7f1378159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 shutdown_connections 2023-11-24T06:16:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:38.767+0000 7f137cfb3640 1 -- 172.21.15.22:0/1736137831 wait complete. 2023-11-24T06:16:38.788 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:16:38.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.003+0000 7fdce8d81640 1 Processor -- start 2023-11-24T06:16:39.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.003+0000 7fdce8d81640 1 -- start start 2023-11-24T06:16:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.005+0000 7fdce8d81640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdce40cf050 0x7fdce40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.005+0000 7fdce8d81640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdce40cd7b0 0x7fdce40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.005+0000 7fdce8d81640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce415fa70 con 0x7fdce413dfd0 2023-11-24T06:16:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.005+0000 7fdce8d81640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40cfa40 con 0x7fdce40cf050 2023-11-24T06:16:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.005+0000 7fdce8d81640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce415c580 con 0x7fdce40cd7b0 2023-11-24T06:16:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.005+0000 7fdce37fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdce413dfd0 0x7fdce415be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38286/0 (socket says 172.21.15.22:38286) 2023-11-24T06:16:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.005+0000 7fdce37fe640 1 -- 172.21.15.22:0/4111510832 learned_addr learned my addr 172.21.15.22:0/4111510832 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.005+0000 7fdcdbfff640 1 --2- 172.21.15.22:0/4111510832 >> v2:172.21.15.22:3300/0 conn(0x7fdce40cf050 0x7fdce40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.006+0000 7fdce3fff640 1 --2- 172.21.15.22:0/4111510832 >> v2:172.21.15.31:3300/0 conn(0x7fdce40cd7b0 0x7fdce40cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.006+0000 7fdcdbfff640 1 -- 172.21.15.22:0/4111510832 >> v2:172.21.15.31:3300/0 conn(0x7fdce40cd7b0 msgr2=0x7fdce40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.006+0000 7fdcdbfff640 1 --2- 172.21.15.22:0/4111510832 >> v2:172.21.15.31:3300/0 conn(0x7fdce40cd7b0 0x7fdce40cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.006+0000 7fdcdbfff640 1 -- 172.21.15.22:0/4111510832 >> v1:172.21.15.22:6789/0 conn(0x7fdce413dfd0 legacy=0x7fdce415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.006+0000 7fdcdbfff640 1 -- 172.21.15.22:0/4111510832 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce4140900 con 0x7fdce40cf050 2023-11-24T06:16:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.006+0000 7fdce3fff640 1 --2- 172.21.15.22:0/4111510832 >> v2:172.21.15.31:3300/0 conn(0x7fdce40cd7b0 0x7fdce40cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:39.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.007+0000 7fdcdbfff640 1 --2- 172.21.15.22:0/4111510832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 0x7fdce40cf500 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdce41416f0 tx=0x7fdccc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88550396e96ba609 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.007+0000 7fdce2ffd640 1 -- 172.21.15.22:0/4111510832 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc031830 con 0x7fdce40cf050 2023-11-24T06:16:39.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.007+0000 7fdce2ffd640 1 -- 172.21.15.22:0/4111510832 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc031990 con 0x7fdce40cf050 2023-11-24T06:16:39.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.007+0000 7fdce2ffd640 1 -- 172.21.15.22:0/4111510832 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc031d20 con 0x7fdce40cf050 2023-11-24T06:16:39.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.008+0000 7fdce8d81640 1 -- 172.21.15.22:0/4111510832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 msgr2=0x7fdce40cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.008+0000 7fdce8d81640 1 --2- 172.21.15.22:0/4111510832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 0x7fdce40cf500 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdce41416f0 tx=0x7fdccc02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.008+0000 7fdce8d81640 1 -- 172.21.15.22:0/4111510832 shutdown_connections 2023-11-24T06:16:39.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.008+0000 7fdce8d81640 1 --2- 172.21.15.22:0/4111510832 >> v2:172.21.15.31:3300/0 conn(0x7fdce40cd7b0 0x7fdce40cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.008+0000 7fdce8d81640 1 --2- 172.21.15.22:0/4111510832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 0x7fdce40cf500 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.008+0000 7fdce8d81640 1 -- 172.21.15.22:0/4111510832 >> 172.21.15.22:0/4111510832 conn(0x7fdce406a860 msgr2=0x7fdce406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:39.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.008+0000 7fdce8d81640 1 -- 172.21.15.22:0/4111510832 shutdown_connections 2023-11-24T06:16:39.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.008+0000 7fdce8d81640 1 -- 172.21.15.22:0/4111510832 wait complete. 2023-11-24T06:16:39.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.010+0000 7fdce8d81640 1 Processor -- start 2023-11-24T06:16:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.010+0000 7fdce8d81640 1 -- start start 2023-11-24T06:16:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.011+0000 7fdce8d81640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40cd7b0 0x7fdce41544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.011+0000 7fdce8d81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 0x7fdce4138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.011+0000 7fdce8d81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce413dfd0 0x7fdce413b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.011+0000 7fdce8d81640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40b35f0 con 0x7fdce40cf050 2023-11-24T06:16:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.011+0000 7fdce8d81640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40b0ee0 con 0x7fdce413dfd0 2023-11-24T06:16:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.011+0000 7fdce8d81640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41391a0 con 0x7fdce40cd7b0 2023-11-24T06:16:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.011+0000 7fdcdbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 0x7fdce4138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.011+0000 7fdcdbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 0x7fdce4138c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46424/0 (socket says 172.21.15.22:46424) 2023-11-24T06:16:39.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.012+0000 7fdcdbfff640 1 -- 172.21.15.22:0/3505749608 learned_addr learned my addr 172.21.15.22:0/3505749608 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:39.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.012+0000 7fdce37fe640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40cd7b0 0x7fdce41544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.012+0000 7fdcdbfff640 1 -- 172.21.15.22:0/3505749608 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40cd7b0 msgr2=0x7fdce41544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.012+0000 7fdcdbfff640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40cd7b0 0x7fdce41544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.012+0000 7fdcdbfff640 1 -- 172.21.15.22:0/3505749608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce413dfd0 msgr2=0x7fdce413b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.012+0000 7fdcdbfff640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce413dfd0 0x7fdce413b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.012+0000 7fdcdbfff640 1 -- 172.21.15.22:0/3505749608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc009400 con 0x7fdce40cf050 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.012+0000 7fdcdbfff640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 0x7fdce4138c60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009890 tx=0x7fdccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.012+0000 7fdce0ff9640 1 -- 172.21.15.22:0/3505749608 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc03ba70 con 0x7fdce40cf050 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.013+0000 7fdce0ff9640 1 -- 172.21.15.22:0/3505749608 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc03bbf0 con 0x7fdce40cf050 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.013+0000 7fdce0ff9640 1 -- 172.21.15.22:0/3505749608 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc045400 con 0x7fdce40cf050 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.013+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce40b0c00 con 0x7fdce40cf050 2023-11-24T06:16:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.013+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce40b3280 con 0x7fdce40cf050 2023-11-24T06:16:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.014+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce4158e60 con 0x7fdce40cf050 2023-11-24T06:16:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.015+0000 7fdce0ff9640 1 -- 172.21.15.22:0/3505749608 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fdccc04e440 con 0x7fdce40cf050 2023-11-24T06:16:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.016+0000 7fdce0ff9640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdcc406aff0 0x7fdcc406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.016+0000 7fdce0ff9640 1 -- 172.21.15.22:0/3505749608 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdccc0abe30 con 0x7fdce40cf050 2023-11-24T06:16:39.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.017+0000 7fdce37fe640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdcc406aff0 0x7fdcc406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.017+0000 7fdce37fe640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdcc406aff0 0x7fdcc406d4b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4005880 tx=0x7fdcd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.020+0000 7fdce0ff9640 1 -- 172.21.15.22:0/3505749608 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdce4158e60 con 0x7fdce40cf050 2023-11-24T06:16:39.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.210+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdce406ac40 con 0x7fdcc406aff0 2023-11-24T06:16:39.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.226+0000 7fdce0ff9640 1 -- 172.21.15.22:0/3505749608 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281219 (secure 0 0 0) 0x7fdce406ac40 con 0x7fdcc406aff0 2023-11-24T06:16:39.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:39.234 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:16:39.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdcc406aff0 msgr2=0x7fdcc406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdcc406aff0 0x7fdcc406d4b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4005880 tx=0x7fdcd4009040 comp rx=0 tx=0).stop 2023-11-24T06:16:39.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 msgr2=0x7fdce4138c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 0x7fdce4138c60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009890 tx=0x7fdccc0046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 shutdown_connections 2023-11-24T06:16:39.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdcc406aff0 0x7fdcc406d4b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce413dfd0 0x7fdce413b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdce40cf050 0x7fdce4138c60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 --2- 172.21.15.22:0/3505749608 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40cd7b0 0x7fdce41544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 >> 172.21.15.22:0/3505749608 conn(0x7fdce406a860 msgr2=0x7fdce415c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:39.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.231+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 shutdown_connections 2023-11-24T06:16:39.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.232+0000 7fdce8d81640 1 -- 172.21.15.22:0/3505749608 wait complete. 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-11-24T06:16:38.743357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":243560,"kb_used_data":6588,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731160,"statfs":{"total":773094113280,"available":772844707840,"internally_reserved":0,"allocated":6746112,"data_stored":3459475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002953"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755217+0000","last_change":"2023-11-24T06:16:33.755217+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755217+0000","last_undegraded":"2023-11-24T06:16:33.755217+0000","last_fullsized":"2023-11-24T06:16:33.755217+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748693+0000","last_change":"2023-11-24T06:16:33.748693+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748693+0000","last_undegraded":"2023-11-24T06:16:33.748693+0000","last_fullsized":"2023-11-24T06:16:33.748693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-11-24T06:16:34.757677+0000","last_change":"2023-11-24T06:16:34.757677+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:34.757677+0000","last_undegraded":"2023-11-24T06:16:34.757677+0000","last_fullsized":"2023-11-24T06:16:34.757677+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:55.062755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753321+0000","last_change":"2023-11-24T06:16:33.753321+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753321+0000","last_undegraded":"2023-11-24T06:16:33.753321+0000","last_fullsized":"2023-11-24T06:16:33.753321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751392+0000","last_change":"2023-11-24T06:16:33.751392+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751392+0000","last_undegraded":"2023-11-24T06:16:33.751392+0000","last_fullsized":"2023-11-24T06:16:33.751392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748600+0000","last_change":"2023-11-24T06:16:33.748600+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748600+0000","last_undegraded":"2023-11-24T06:16:33.748600+0000","last_fullsized":"2023-11-24T06:16:33.748600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755904+0000","last_change":"2023-11-24T06:16:33.755904+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755904+0000","last_undegraded":"2023-11-24T06:16:33.755904+0000","last_fullsized":"2023-11-24T06:16:33.755904+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187437+0000","last_change":"2023-11-24T06:16:34.781609+0000","last_active":"2023-11-24T06:16:36.187437+0000","last_peered":"2023-11-24T06:16:36.187437+0000","last_clean":"2023-11-24T06:16:36.187437+0000","last_became_active":"2023-11-24T06:16:34.778750+0000","last_became_peered":"2023-11-24T06:16:34.778750+0000","last_unstale":"2023-11-24T06:16:36.187437+0000","last_undegraded":"2023-11-24T06:16:36.187437+0000","last_fullsized":"2023-11-24T06:16:36.187437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:59:05.773308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187160+0000","last_change":"2023-11-24T06:16:34.790561+0000","last_active":"2023-11-24T06:16:36.187160+0000","last_peered":"2023-11-24T06:16:36.187160+0000","last_clean":"2023-11-24T06:16:36.187160+0000","last_became_active":"2023-11-24T06:16:34.790318+0000","last_became_peered":"2023-11-24T06:16:34.790318+0000","last_unstale":"2023-11-24T06:16:36.187160+0000","last_undegraded":"2023-11-24T06:16:36.187160+0000","last_fullsized":"2023-11-24T06:16:36.187160+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:54.298750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.771827+0000","last_change":"2023-11-24T06:16:34.771827+0000","last_active":"2023-11-24T06:16:34.771827+0000","last_peered":"2023-11-24T06:16:34.771827+0000","last_clean":"2023-11-24T06:16:34.771827+0000","last_became_active":"2023-11-24T06:16:34.769123+0000","last_became_peered":"2023-11-24T06:16:34.769123+0000","last_unstale":"2023-11-24T06:16:34.771827+0000","last_undegraded":"2023-11-24T06:16:34.771827+0000","last_fullsized":"2023-11-24T06:16:34.771827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:01.068796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754269+0000","last_change":"2023-11-24T06:16:33.754269+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754269+0000","last_undegraded":"2023-11-24T06:16:33.754269+0000","last_fullsized":"2023-11-24T06:16:33.754269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755288+0000","last_change":"2023-11-24T06:16:33.755288+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755288+0000","last_undegraded":"2023-11-24T06:16:33.755288+0000","last_fullsized":"2023-11-24T06:16:33.755288+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749954+0000","last_change":"2023-11-24T06:16:33.749954+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749954+0000","last_undegraded":"2023-11-24T06:16:33.749954+0000","last_fullsized":"2023-11-24T06:16:33.749954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750778+0000","last_change":"2023-11-24T06:16:33.750778+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750778+0000","last_undegraded":"2023-11-24T06:16:33.750778+0000","last_fullsized":"2023-11-24T06:16:33.750778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749569+0000","last_change":"2023-11-24T06:16:33.749569+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749569+0000","last_undegraded":"2023-11-24T06:16:33.749569+0000","last_fullsized":"2023-11-24T06:16:33.749569+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749861+0000","last_change":"2023-11-24T06:16:33.749861+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749861+0000","last_undegraded":"2023-11-24T06:16:33.749861+0000","last_fullsized":"2023-11-24T06:16:33.749861+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750123+0000","last_change":"2023-11-24T06:16:33.750123+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750123+0000","last_undegraded":"2023-11-24T06:16:33.750123+0000","last_fullsized":"2023-11-24T06:16:33.750123+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753167+0000","last_change":"2023-11-24T06:16:33.753167+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753167+0000","last_undegraded":"2023-11-24T06:16:33.753167+0000","last_fullsized":"2023-11-24T06:16:33.753167+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755115+0000","last_change":"2023-11-24T06:16:33.755115+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755115+0000","last_undegraded":"2023-11-24T06:16:33.755115+0000","last_fullsized":"2023-11-24T06:16:33.755115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751842+0000","last_change":"2023-11-24T06:16:33.751842+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751842+0000","last_undegraded":"2023-11-24T06:16:33.751842+0000","last_fullsized":"2023-11-24T06:16:33.751842+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751586+0000","last_change":"2023-11-24T06:16:33.751586+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751586+0000","last_undegraded":"2023-11-24T06:16:33.751586+0000","last_fullsized":"2023-11-24T06:16:33.751586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.775482+0000","last_change":"2023-11-24T06:16:34.775482+0000","last_active":"2023-11-24T06:16:34.775482+0000","last_peered":"2023-11-24T06:16:34.775482+0000","last_clean":"2023-11-24T06:16:34.775482+0000","last_became_active":"2023-11-24T06:16:34.775130+0000","last_became_peered":"2023-11-24T06:16:34.775130+0000","last_unstale":"2023-11-24T06:16:34.775482+0000","last_undegraded":"2023-11-24T06:16:34.775482+0000","last_fullsized":"2023-11-24T06:16:34.775482+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:52.385508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754884+0000","last_change":"2023-11-24T06:16:33.754884+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754884+0000","last_undegraded":"2023-11-24T06:16:33.754884+0000","last_fullsized":"2023-11-24T06:16:33.754884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.752445+0000","last_change":"2023-11-24T06:16:33.752445+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.752445+0000","last_undegraded":"2023-11-24T06:16:33.752445+0000","last_fullsized":"2023-11-24T06:16:33.752445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747147+0000","last_change":"2023-11-24T06:16:33.747147+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747147+0000","last_undegraded":"2023-11-24T06:16:33.747147+0000","last_fullsized":"2023-11-24T06:16:33.747147+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750054+0000","last_change":"2023-11-24T06:16:33.750054+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750054+0000","last_undegraded":"2023-11-24T06:16:33.750054+0000","last_fullsized":"2023-11-24T06:16:33.750054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755407+0000","last_change":"2023-11-24T06:16:33.755407+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755407+0000","last_undegraded":"2023-11-24T06:16:33.755407+0000","last_fullsized":"2023-11-24T06:16:33.755407+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.750229+0000","last_change":"2023-11-24T06:16:33.750229+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750229+0000","last_undegraded":"2023-11-24T06:16:33.750229+0000","last_fullsized":"2023-11-24T06:16:33.750229+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:58.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184656+0000","last_change":"2023-11-24T06:16:34.781959+0000","last_active":"2023-11-24T06:16:36.184656+0000","last_peered":"2023-11-24T06:16:36.184656+0000","last_clean":"2023-11-24T06:16:36.184656+0000","last_became_active":"2023-11-24T06:16:34.781005+0000","last_became_peered":"2023-11-24T06:16:34.781005+0000","last_unstale":"2023-11-24T06:16:36.184656+0000","last_undegraded":"2023-11-24T06:16:36.184656+0000","last_fullsized":"2023-11-24T06:16:36.184656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:39.144025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.755340+0000","last_change":"2023-11-24T06:16:33.755340+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755340+0000","last_undegraded":"2023-11-24T06:16:33.755340+0000","last_fullsized":"2023-11-24T06:16:33.755340+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:16.548503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753232+0000","last_change":"2023-11-24T06:16:33.753232+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753232+0000","last_undegraded":"2023-11-24T06:16:33.753232+0000","last_fullsized":"2023-11-24T06:16:33.753232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.754464+0000","last_change":"2023-11-24T06:16:33.754464+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754464+0000","last_undegraded":"2023-11-24T06:16:33.754464+0000","last_fullsized":"2023-11-24T06:16:33.754464+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:21.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754403+0000","last_change":"2023-11-24T06:16:33.754403+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754403+0000","last_undegraded":"2023-11-24T06:16:33.754403+0000","last_fullsized":"2023-11-24T06:16:33.754403+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.773550+0000","last_change":"2023-11-24T06:16:33.770950+0000","last_active":"2023-11-24T06:16:34.773550+0000","last_peered":"2023-11-24T06:16:34.773550+0000","last_clean":"2023-11-24T06:16:34.773550+0000","last_became_active":"2023-11-24T06:16:33.770565+0000","last_became_peered":"2023-11-24T06:16:33.770565+0000","last_unstale":"2023-11-24T06:16:34.773550+0000","last_undegraded":"2023-11-24T06:16:34.773550+0000","last_fullsized":"2023-11-24T06:16:34.773550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754608+0000","last_change":"2023-11-24T06:16:33.754608+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754608+0000","last_undegraded":"2023-11-24T06:16:33.754608+0000","last_fullsized":"2023-11-24T06:16:33.754608+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.775128+0000","last_change":"2023-11-24T06:16:33.772396+0000","last_active":"2023-11-24T06:16:33.775128+0000","last_peered":"2023-11-24T06:16:33.775128+0000","last_clean":"2023-11-24T06:16:33.775128+0000","last_became_active":"2023-11-24T06:16:33.771826+0000","last_became_peered":"2023-11-24T06:16:33.771826+0000","last_unstale":"2023-11-24T06:16:33.775128+0000","last_undegraded":"2023-11-24T06:16:33.775128+0000","last_fullsized":"2023-11-24T06:16:33.775128+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:53.124439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754313+0000","last_change":"2023-11-24T06:16:33.754313+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754313+0000","last_undegraded":"2023-11-24T06:16:33.754313+0000","last_fullsized":"2023-11-24T06:16:33.754313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.753234+0000","last_change":"2023-11-24T06:16:33.753234+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753234+0000","last_undegraded":"2023-11-24T06:16:33.753234+0000","last_fullsized":"2023-11-24T06:16:33.753234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:54.046458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750440+0000","last_change":"2023-11-24T06:16:33.750440+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750440+0000","last_undegraded":"2023-11-24T06:16:33.750440+0000","last_fullsized":"2023-11-24T06:16:33.750440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761610+0000","last_change":"2023-11-24T06:16:33.770060+0000","last_active":"2023-11-24T06:16:34.761610+0000","last_peered":"2023-11-24T06:16:34.761610+0000","last_clean":"2023-11-24T06:16:34.761610+0000","last_became_active":"2023-11-24T06:16:33.769764+0000","last_became_peered":"2023-11-24T06:16:33.769764+0000","last_unstale":"2023-11-24T06:16:34.761610+0000","last_undegraded":"2023-11-24T06:16:34.761610+0000","last_fullsized":"2023-11-24T06:16:34.761610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749417+0000","last_change":"2023-11-24T06:16:33.749417+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749417+0000","last_undegraded":"2023-11-24T06:16:33.749417+0000","last_fullsized":"2023-11-24T06:16:33.749417+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.772916+0000","last_change":"2023-11-24T06:16:33.769378+0000","last_active":"2023-11-24T06:16:33.772916+0000","last_peered":"2023-11-24T06:16:33.772916+0000","last_clean":"2023-11-24T06:16:33.772916+0000","last_became_active":"2023-11-24T06:16:33.768768+0000","last_became_peered":"2023-11-24T06:16:33.768768+0000","last_unstale":"2023-11-24T06:16:33.772916+0000","last_undegraded":"2023-11-24T06:16:33.772916+0000","last_fullsized":"2023-11-24T06:16:33.772916+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:40.407859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750286+0000","last_change":"2023-11-24T06:16:33.750286+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750286+0000","last_undegraded":"2023-11-24T06:16:33.750286+0000","last_fullsized":"2023-11-24T06:16:33.750286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.773310+0000","last_change":"2023-11-24T06:16:33.770422+0000","last_active":"2023-11-24T06:16:33.773310+0000","last_peered":"2023-11-24T06:16:33.773310+0000","last_clean":"2023-11-24T06:16:33.773310+0000","last_became_active":"2023-11-24T06:16:33.769391+0000","last_became_peered":"2023-11-24T06:16:33.769391+0000","last_unstale":"2023-11-24T06:16:33.773310+0000","last_undegraded":"2023-11-24T06:16:33.773310+0000","last_fullsized":"2023-11-24T06:16:33.773310+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:26.932738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747335+0000","last_change":"2023-11-24T06:16:33.747335+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747335+0000","last_undegraded":"2023-11-24T06:16:33.747335+0000","last_fullsized":"2023-11-24T06:16:33.747335+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.754241+0000","last_change":"2023-11-24T06:16:33.754241+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754241+0000","last_undegraded":"2023-11-24T06:16:33.754241+0000","last_fullsized":"2023-11-24T06:16:33.754241+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:34.619640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186420+0000","last_change":"2023-11-24T06:16:34.776486+0000","last_active":"2023-11-24T06:16:36.186420+0000","last_peered":"2023-11-24T06:16:36.186420+0000","last_clean":"2023-11-24T06:16:36.186420+0000","last_became_active":"2023-11-24T06:16:34.776078+0000","last_became_peered":"2023-11-24T06:16:34.776078+0000","last_unstale":"2023-11-24T06:16:36.186420+0000","last_undegraded":"2023-11-24T06:16:36.186420+0000","last_fullsized":"2023-11-24T06:16:36.186420+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:28.810438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.760422+0000","last_change":"2023-11-24T06:16:33.760422+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.760422+0000","last_undegraded":"2023-11-24T06:16:33.760422+0000","last_fullsized":"2023-11-24T06:16:33.760422+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:34.797956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747572+0000","last_change":"2023-11-24T06:16:33.747572+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747572+0000","last_undegraded":"2023-11-24T06:16:33.747572+0000","last_fullsized":"2023-11-24T06:16:33.747572+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.770377+0000","last_change":"2023-11-24T06:16:33.766405+0000","last_active":"2023-11-24T06:16:33.770377+0000","last_peered":"2023-11-24T06:16:33.770377+0000","last_clean":"2023-11-24T06:16:33.770377+0000","last_became_active":"2023-11-24T06:16:33.765503+0000","last_became_peered":"2023-11-24T06:16:33.765503+0000","last_unstale":"2023-11-24T06:16:33.770377+0000","last_undegraded":"2023-11-24T06:16:33.770377+0000","last_fullsized":"2023-11-24T06:16:33.770377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:34.797956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.771695+0000","last_change":"2023-11-24T06:16:34.771695+0000","last_active":"2023-11-24T06:16:34.771695+0000","last_peered":"2023-11-24T06:16:34.771695+0000","last_clean":"2023-11-24T06:16:34.771695+0000","last_became_active":"2023-11-24T06:16:34.771339+0000","last_became_peered":"2023-11-24T06:16:34.771339+0000","last_unstale":"2023-11-24T06:16:34.771695+0000","last_undegraded":"2023-11-24T06:16:34.771695+0000","last_fullsized":"2023-11-24T06:16:34.771695+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:59.860064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.753835+0000","last_change":"2023-11-24T06:16:33.753835+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753835+0000","last_undegraded":"2023-11-24T06:16:33.753835+0000","last_fullsized":"2023-11-24T06:16:33.753835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:06.004527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.752270+0000","last_change":"2023-11-24T06:16:33.752270+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.752270+0000","last_undegraded":"2023-11-24T06:16:33.752270+0000","last_fullsized":"2023-11-24T06:16:33.752270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.764665+0000","last_change":"2023-11-24T06:16:33.761349+0000","last_active":"2023-11-24T06:16:33.764665+0000","last_peered":"2023-11-24T06:16:33.764665+0000","last_clean":"2023-11-24T06:16:33.764665+0000","last_became_active":"2023-11-24T06:16:33.759543+0000","last_became_peered":"2023-11-24T06:16:33.759543+0000","last_unstale":"2023-11-24T06:16:33.764665+0000","last_undegraded":"2023-11-24T06:16:33.764665+0000","last_fullsized":"2023-11-24T06:16:33.764665+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:53:43.094414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751113+0000","last_change":"2023-11-24T06:16:33.751113+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751113+0000","last_undegraded":"2023-11-24T06:16:33.751113+0000","last_fullsized":"2023-11-24T06:16:33.751113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761769+0000","last_change":"2023-11-24T06:16:33.771272+0000","last_active":"2023-11-24T06:16:34.761769+0000","last_peered":"2023-11-24T06:16:34.761769+0000","last_clean":"2023-11-24T06:16:34.761769+0000","last_became_active":"2023-11-24T06:16:33.770946+0000","last_became_peered":"2023-11-24T06:16:33.770946+0000","last_unstale":"2023-11-24T06:16:34.761769+0000","last_undegraded":"2023-11-24T06:16:34.761769+0000","last_fullsized":"2023-11-24T06:16:34.761769+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:51.682060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747729+0000","last_change":"2023-11-24T06:16:33.747729+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747729+0000","last_undegraded":"2023-11-24T06:16:33.747729+0000","last_fullsized":"2023-11-24T06:16:33.747729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.757741+0000","last_change":"2023-11-24T06:16:33.757741+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.757741+0000","last_undegraded":"2023-11-24T06:16:33.757741+0000","last_fullsized":"2023-11-24T06:16:33.757741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:40.407859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748700+0000","last_change":"2023-11-24T06:16:33.748700+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748700+0000","last_undegraded":"2023-11-24T06:16:33.748700+0000","last_fullsized":"2023-11-24T06:16:33.748700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.748950+0000","last_change":"2023-11-24T06:16:33.748950+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748950+0000","last_undegraded":"2023-11-24T06:16:33.748950+0000","last_fullsized":"2023-11-24T06:16:33.748950+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.774713+0000","last_change":"2023-11-24T06:16:34.774713+0000","last_active":"2023-11-24T06:16:34.774713+0000","last_peered":"2023-11-24T06:16:34.774713+0000","last_clean":"2023-11-24T06:16:34.774713+0000","last_became_active":"2023-11-24T06:16:34.774392+0000","last_became_peered":"2023-11-24T06:16:34.774392+0000","last_unstale":"2023-11-24T06:16:34.774713+0000","last_undegraded":"2023-11-24T06:16:34.774713+0000","last_fullsized":"2023-11-24T06:16:34.774713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:33.540046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.755186+0000","last_change":"2023-11-24T06:16:33.755186+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755186+0000","last_undegraded":"2023-11-24T06:16:33.755186+0000","last_fullsized":"2023-11-24T06:16:33.755186+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:32.523748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749159+0000","last_change":"2023-11-24T06:16:33.749159+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749159+0000","last_undegraded":"2023-11-24T06:16:33.749159+0000","last_fullsized":"2023-11-24T06:16:33.749159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.763814+0000","last_change":"2023-11-24T06:16:33.771457+0000","last_active":"2023-11-24T06:16:34.763814+0000","last_peered":"2023-11-24T06:16:34.763814+0000","last_clean":"2023-11-24T06:16:34.763814+0000","last_became_active":"2023-11-24T06:16:33.771077+0000","last_became_peered":"2023-11-24T06:16:33.771077+0000","last_unstale":"2023-11-24T06:16:34.763814+0000","last_undegraded":"2023-11-24T06:16:34.763814+0000","last_fullsized":"2023-11-24T06:16:34.763814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:16.548503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.746175+0000","last_change":"2023-11-24T06:16:33.746175+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.746175+0000","last_undegraded":"2023-11-24T06:16:33.746175+0000","last_fullsized":"2023-11-24T06:16:33.746175+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.752456+0000","last_change":"2023-11-24T06:16:33.752456+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.752456+0000","last_undegraded":"2023-11-24T06:16:33.752456+0000","last_fullsized":"2023-11-24T06:16:33.752456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:00.052499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.770022+0000","last_change":"2023-11-24T06:16:34.770022+0000","last_active":"2023-11-24T06:16:34.770022+0000","last_peered":"2023-11-24T06:16:34.770022+0000","last_clean":"2023-11-24T06:16:34.770022+0000","last_became_active":"2023-11-24T06:16:34.769722+0000","last_became_peered":"2023-11-24T06:16:34.769722+0000","last_unstale":"2023-11-24T06:16:34.770022+0000","last_undegraded":"2023-11-24T06:16:34.770022+0000","last_fullsized":"2023-11-24T06:16:34.770022+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:50:42.331133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.748262+0000","last_change":"2023-11-24T06:16:33.748262+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748262+0000","last_undegraded":"2023-11-24T06:16:33.748262+0000","last_fullsized":"2023-11-24T06:16:33.748262+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754001+0000","last_change":"2023-11-24T06:16:33.754001+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754001+0000","last_undegraded":"2023-11-24T06:16:33.754001+0000","last_fullsized":"2023-11-24T06:16:33.754001+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.755961+0000","last_change":"2023-11-24T06:16:33.770996+0000","last_active":"2023-11-24T06:16:34.755961+0000","last_peered":"2023-11-24T06:16:34.755961+0000","last_clean":"2023-11-24T06:16:34.755961+0000","last_became_active":"2023-11-24T06:16:33.770413+0000","last_became_peered":"2023-11-24T06:16:33.770413+0000","last_unstale":"2023-11-24T06:16:34.755961+0000","last_undegraded":"2023-11-24T06:16:34.755961+0000","last_fullsized":"2023-11-24T06:16:34.755961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:29.010814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750870+0000","last_change":"2023-11-24T06:16:33.750870+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750870+0000","last_undegraded":"2023-11-24T06:16:33.750870+0000","last_fullsized":"2023-11-24T06:16:33.750870+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761830+0000","last_change":"2023-11-24T06:16:33.773444+0000","last_active":"2023-11-24T06:16:34.761830+0000","last_peered":"2023-11-24T06:16:34.761830+0000","last_clean":"2023-11-24T06:16:34.761830+0000","last_became_active":"2023-11-24T06:16:33.771977+0000","last_became_peered":"2023-11-24T06:16:33.771977+0000","last_unstale":"2023-11-24T06:16:34.761830+0000","last_undegraded":"2023-11-24T06:16:34.761830+0000","last_fullsized":"2023-11-24T06:16:34.761830+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:06.004527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-11-24T06:16:34.758470+0000","last_change":"2023-11-24T06:16:34.758470+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:34.758470+0000","last_undegraded":"2023-11-24T06:16:34.758470+0000","last_fullsized":"2023-11-24T06:16:34.758470+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:22.969912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.791301+0000","last_change":"2023-11-24T06:16:33.769724+0000","last_active":"2023-11-24T06:16:34.791301+0000","last_peered":"2023-11-24T06:16:34.791301+0000","last_clean":"2023-11-24T06:16:34.791301+0000","last_became_active":"2023-11-24T06:16:33.769461+0000","last_became_peered":"2023-11-24T06:16:33.769461+0000","last_unstale":"2023-11-24T06:16:34.791301+0000","last_undegraded":"2023-11-24T06:16:34.791301+0000","last_fullsized":"2023-11-24T06:16:34.791301+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:08.290535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.778377+0000","last_change":"2023-11-24T06:16:34.778377+0000","last_active":"2023-11-24T06:16:34.778377+0000","last_peered":"2023-11-24T06:16:34.778377+0000","last_clean":"2023-11-24T06:16:34.778377+0000","last_became_active":"2023-11-24T06:16:34.776011+0000","last_became_peered":"2023-11-24T06:16:34.776011+0000","last_unstale":"2023-11-24T06:16:34.778377+0000","last_undegraded":"2023-11-24T06:16:34.778377+0000","last_fullsized":"2023-11-24T06:16:34.778377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:42:27.391375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.754736+0000","last_change":"2023-11-24T06:16:33.754736+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754736+0000","last_undegraded":"2023-11-24T06:16:33.754736+0000","last_fullsized":"2023-11-24T06:16:33.754736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:51.369211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186605+0000","last_change":"2023-11-24T06:16:34.774591+0000","last_active":"2023-11-24T06:16:36.186605+0000","last_peered":"2023-11-24T06:16:36.186605+0000","last_clean":"2023-11-24T06:16:36.186605+0000","last_became_active":"2023-11-24T06:16:34.774324+0000","last_became_peered":"2023-11-24T06:16:34.774324+0000","last_unstale":"2023-11-24T06:16:36.186605+0000","last_undegraded":"2023-11-24T06:16:36.186605+0000","last_fullsized":"2023-11-24T06:16:36.186605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:02.107927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.744890+0000","last_change":"2023-11-24T06:16:33.744890+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.744890+0000","last_undegraded":"2023-11-24T06:16:33.744890+0000","last_fullsized":"2023-11-24T06:16:33.744890+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:44.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753969+0000","last_change":"2023-11-24T06:16:33.753969+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753969+0000","last_undegraded":"2023-11-24T06:16:33.753969+0000","last_fullsized":"2023-11-24T06:16:33.753969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761865+0000","last_change":"2023-11-24T06:16:33.772084+0000","last_active":"2023-11-24T06:16:34.761865+0000","last_peered":"2023-11-24T06:16:34.761865+0000","last_clean":"2023-11-24T06:16:34.761865+0000","last_became_active":"2023-11-24T06:16:33.771790+0000","last_became_peered":"2023-11-24T06:16:33.771790+0000","last_unstale":"2023-11-24T06:16:34.761865+0000","last_undegraded":"2023-11-24T06:16:34.761865+0000","last_fullsized":"2023-11-24T06:16:34.761865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:34.619640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751922+0000","last_change":"2023-11-24T06:16:33.751922+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751922+0000","last_undegraded":"2023-11-24T06:16:33.751922+0000","last_fullsized":"2023-11-24T06:16:33.751922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.756153+0000","last_change":"2023-11-24T06:16:33.770432+0000","last_active":"2023-11-24T06:16:34.756153+0000","last_peered":"2023-11-24T06:16:34.756153+0000","last_clean":"2023-11-24T06:16:34.756153+0000","last_became_active":"2023-11-24T06:16:33.770152+0000","last_became_peered":"2023-11-24T06:16:33.770152+0000","last_unstale":"2023-11-24T06:16:34.756153+0000","last_undegraded":"2023-11-24T06:16:34.756153+0000","last_fullsized":"2023-11-24T06:16:34.756153+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:20.853464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.746006+0000","last_change":"2023-11-24T06:16:33.746006+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.746006+0000","last_undegraded":"2023-11-24T06:16:33.746006+0000","last_fullsized":"2023-11-24T06:16:33.746006+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.770483+0000","last_change":"2023-11-24T06:16:33.767805+0000","last_active":"2023-11-24T06:16:33.770483+0000","last_peered":"2023-11-24T06:16:33.770483+0000","last_clean":"2023-11-24T06:16:33.770483+0000","last_became_active":"2023-11-24T06:16:33.767215+0000","last_became_peered":"2023-11-24T06:16:33.767215+0000","last_unstale":"2023-11-24T06:16:33.770483+0000","last_undegraded":"2023-11-24T06:16:33.770483+0000","last_fullsized":"2023-11-24T06:16:33.770483+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:26.932738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.182462+0000","last_change":"2023-11-24T06:16:34.778394+0000","last_active":"2023-11-24T06:16:36.182462+0000","last_peered":"2023-11-24T06:16:36.182462+0000","last_clean":"2023-11-24T06:16:36.182462+0000","last_became_active":"2023-11-24T06:16:34.778241+0000","last_became_peered":"2023-11-24T06:16:34.778241+0000","last_unstale":"2023-11-24T06:16:36.182462+0000","last_undegraded":"2023-11-24T06:16:36.182462+0000","last_fullsized":"2023-11-24T06:16:36.182462+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:41.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.757051+0000","last_change":"2023-11-24T06:16:33.770982+0000","last_active":"2023-11-24T06:16:34.757051+0000","last_peered":"2023-11-24T06:16:34.757051+0000","last_clean":"2023-11-24T06:16:34.757051+0000","last_became_active":"2023-11-24T06:16:33.770635+0000","last_became_peered":"2023-11-24T06:16:33.770635+0000","last_unstale":"2023-11-24T06:16:34.757051+0000","last_undegraded":"2023-11-24T06:16:34.757051+0000","last_fullsized":"2023-11-24T06:16:34.757051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:06:46.387683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748237+0000","last_change":"2023-11-24T06:16:33.748237+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748237+0000","last_undegraded":"2023-11-24T06:16:33.748237+0000","last_fullsized":"2023-11-24T06:16:33.748237+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.749491+0000","last_change":"2023-11-24T06:16:33.749491+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749491+0000","last_undegraded":"2023-11-24T06:16:33.749491+0000","last_fullsized":"2023-11-24T06:16:33.749491+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:51.682060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748031+0000","last_change":"2023-11-24T06:16:33.748031+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748031+0000","last_undegraded":"2023-11-24T06:16:33.748031+0000","last_fullsized":"2023-11-24T06:16:33.748031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.743067+0000","last_change":"2023-11-24T06:16:33.743067+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.743067+0000","last_undegraded":"2023-11-24T06:16:33.743067+0000","last_fullsized":"2023-11-24T06:16:33.743067+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:13.478706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":204,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:16:32.733433+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:16:32.733433+0000","last_peered":"2023-11-24T06:16:32.733433+0000","last_clean":"2023-11-24T06:16:32.733433+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:16:32.733433+0000","last_undegraded":"2023-11-24T06:16:32.733433+0000","last_fullsized":"2023-11-24T06:16:32.733433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":287897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.095,"15min":1.0589999999999999},"min":{"1min":0.85099999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.45,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.304,"5min":1.137,"15min":1.0589999999999999},"min":{"1min":0.71299999999999997,"5min":0.63,"15min":0.63},"max":{"1min":1.7549999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.599}]},{"osd":1,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1279999999999999,"15min":1.1140000000000001},"min":{"1min":0.82699999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6699999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.212},{"interface":"front","average":{"1min":1.26,"5min":1.1779999999999999,"15min":1.119},"min":{"1min":0.89600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7629999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.282}]},{"osd":2,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2090000000000001,"15min":1.1519999999999999},"min":{"1min":0.78200000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.736,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2909999999999999,"15min":1.339},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.732,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.339}]},{"osd":3,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.333,"15min":1.3109999999999999},"min":{"1min":0.90900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6830000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.367,"15min":1.345},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7869999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.659}]},{"osd":4,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.296},"min":{"1min":0.89600000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8879999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4390000000000001,"15min":1.357},"min":{"1min":0.97399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.794,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.6890000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5189999999999999,"15min":1.52},"min":{"1min":0.97999999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.861,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.494},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4810000000000001,"15min":1.4550000000000001},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.988,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.54}]},{"osd":7,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.591,"15min":1.5589999999999999},"min":{"1min":0.86799999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8899999999999999,"5min":3.262,"15min":3.262},"last":1.7989999999999999},{"interface":"front","average":{"1min":1.609,"5min":1.651,"15min":1.6830000000000001},"min":{"1min":1.169,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8480000000000001,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.762}]}]},{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":871998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.123,"15min":1.073},"min":{"1min":0.92400000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.603,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2,"15min":1.1539999999999999},"min":{"1min":0.82499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.528,"5min":1.72,"15min":1.72},"last":1.2190000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.84799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5840000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.306,"15min":1.2909999999999999},"min":{"1min":1.099,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7370000000000001,"5min":1.847,"15min":1.847},"last":0.755}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.238,"15min":1.21},"min":{"1min":0.81000000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.718,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.377,"5min":1.2949999999999999,"15min":1.2989999999999999},"min":{"1min":0.97899999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8200000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3220000000000001,"15min":1.327},"min":{"1min":1.073,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.716,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.373,"15min":1.371},"min":{"1min":0.98499999999999999,"5min":0.745,"15min":0.745},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.302}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.85999999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7709999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.569},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4570000000000001,"15min":1.425},"min":{"1min":0.96899999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8799999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.633}]},{"osd":5,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.5489999999999999,"15min":1.532},"min":{"1min":1.214,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0550000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.49},{"interface":"front","average":{"1min":1.766,"5min":1.7,"15min":1.6739999999999999},"min":{"1min":1.528,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.4780000000000002,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.7709999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.466,"15min":1.5},"min":{"1min":0.98999999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2,"5min":2.5,"15min":2.5},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.8029999999999999,"5min":1.7649999999999999,"15min":1.7410000000000001},"min":{"1min":1.377,"5min":0.875,"15min":0.875},"max":{"1min":2.6040000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.8320000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.755,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.613}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.137,"15min":1.2190000000000001},"min":{"1min":0.69799999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.579,"5min":1.619,"15min":1.619},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.329,"5min":1.2689999999999999,"15min":1.258},"min":{"1min":0.90500000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.625,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.252}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.325,"15min":1.323},"min":{"1min":0.88200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9630000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.401,"15min":1.4690000000000001},"min":{"1min":1.208,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7490000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.085}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":1.141,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.913,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.149},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.4690000000000001},"min":{"1min":0.94099999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.75,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.6619999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4339999999999999,"15min":1.482},"min":{"1min":1.0209999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.653,"5min":2.258,"15min":2.258},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.45,"15min":1.534},"min":{"1min":1.1739999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.8759999999999999,"5min":2.105,"15min":2.105},"last":1.5609999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.5649999999999999},"min":{"1min":0.85799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0379999999999998,"5min":2.319,"15min":2.319},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.619,"15min":1.655},"min":{"1min":1.268,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.899}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.665,"15min":1.6930000000000001},"min":{"1min":1.288,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.1440000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.718,"5min":1.734,"15min":1.7809999999999999},"min":{"1min":1.379,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0670000000000002,"5min":2.669,"15min":2.669},"last":1.7929999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.071,"15min":1.071},"min":{"1min":0.80400000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5940000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.0820000000000001,"15min":1.085},"min":{"1min":0.755,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.71099999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.266,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.2390000000000001,"15min":1.286},"min":{"1min":0.94699999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6259999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.214}]},{"osd":2,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.226,"15min":1.1950000000000001},"min":{"1min":0.97299999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.667,"5min":2.04,"15min":2.04},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.371,"15min":1.409},"min":{"1min":0.89800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.738,"5min":2.016,"15min":2.016},"last":1.2749999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5169999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.325,"15min":1.3520000000000001},"min":{"1min":0.997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8260000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.575}]},{"osd":5,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.369,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.7170000000000001,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.018},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.454,"15min":1.53},"min":{"1min":0.999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8620000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4339999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5269999999999999,"15min":1.579},"min":{"1min":1.103,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9259999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.5229999999999999,"15min":1.613},"min":{"1min":1.0549999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9370000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.51}]},{"osd":7,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.47,"15min":1.552},"min":{"1min":0.97499999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8029999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.704},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.657,"15min":1.7110000000000001},"min":{"1min":1.1659999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0339999999999998,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.7669999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83999999999999997,"15min":0.87},"min":{"1min":0.66000000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3480000000000001,"5min":1.607,"15min":1.607},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.42399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.4370000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.92800000000000005,"15min":0.91700000000000004},"min":{"1min":0.51800000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4910000000000001,"5min":1.796,"15min":1.796},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.1399999999999999,"15min":1.145},"min":{"1min":0.53600000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.7410000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.083,"15min":1.0589999999999999},"min":{"1min":0.71799999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.661,"5min":1.835,"15min":1.835},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.1519999999999999,"15min":1.1279999999999999},"min":{"1min":0.753,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7130000000000001,"5min":2.399,"15min":2.399},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3129999999999999,"15min":1.321},"min":{"1min":0.91500000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.944,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3080000000000001,"15min":1.2829999999999999},"min":{"1min":1.115,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.877,"5min":2.141,"15min":2.141},"last":1.3799999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.351,"15min":1.333},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.742,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.3799999999999999,"15min":1.397},"min":{"1min":1.0009999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.847,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.4059999999999999,"15min":1.3660000000000001},"min":{"1min":0.95299999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.974,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.603},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3540000000000001,"15min":1.3340000000000001},"min":{"1min":1.0009999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9570000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.069}]},{"osd":7,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.417,"15min":1.427},"min":{"1min":0.94499999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1379999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1.1439999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0379999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.099}]}]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85099999999999998,"15min":0.877},"min":{"1min":0.66800000000000004,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.399,"5min":2.552,"15min":2.552},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.93999999999999995,"15min":0.96399999999999997},"min":{"1min":0.78600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5640000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.81000000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.1850000000000001,"15min":1.141},"min":{"1min":1.01,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6990000000000001,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.125,"15min":1.129},"min":{"1min":0.90800000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6240000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.0009999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.175,"15min":1.169},"min":{"1min":0.97299999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.8220000000000001,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.98899999999999999,"15min":0.96899999999999997},"min":{"1min":0.59399999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.714,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3109999999999999,"15min":1.331},"min":{"1min":1.006,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.7909999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.373},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.486,"15min":1.502},"min":{"1min":1.327,"5min":0.755,"15min":0.755},"max":{"1min":2.0590000000000002,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.113}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.28,"15min":1.236},"min":{"1min":1.0620000000000001,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7370000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.413,"15min":1.4370000000000001},"min":{"1min":1.1419999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.7509999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.5740000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.405,"15min":1.405},"min":{"1min":1.159,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7669999999999999,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.522,"15min":1.556},"min":{"1min":1.0860000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8859999999999999,"5min":4.101,"15min":4.101},"last":1.524}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.5089999999999999,"15min":1.5069999999999999},"min":{"1min":1.23,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9179999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.496},{"interface":"front","average":{"1min":1.637,"5min":1.492,"15min":1.4970000000000001},"min":{"1min":1.2969999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2029999999999998,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.615}]}]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":871998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84999999999999998,"15min":0.83899999999999997},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.708,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.165,"5min":1.0089999999999999,"15min":0.97699999999999998},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.6819999999999999,"5min":2.161,"15min":2.161},"last":1.3049999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2649999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.742},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8420000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.88}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1439999999999999,"15min":1.2},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.7709999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8440000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.246}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.3600000000000001,"15min":1.3080000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8180000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3939999999999999},"min":{"1min":0.98799999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.659,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.6659999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:58 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.90600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.742,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":1.506},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2969999999999999,"15min":1.2509999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3779999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4470000000000001,"15min":1.4410000000000001},"min":{"1min":1.0980000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.994,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.8460000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.385,"15min":1.343},"min":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.8979999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.4630000000000001,"15min":1.4390000000000001},"min":{"1min":0.93000000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2050000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.212,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.891,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.95}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":301062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.94499999999999995},"min":{"1min":0.47499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4279999999999999,"5min":1.571,"15min":1.571},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.024,"15min":1.028},"min":{"1min":0.72099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5620000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.121}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.69099999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.097,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.123,"5min":1.1639999999999999,"15min":1.226},"min":{"1min":0.60999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.538,"5min":2.964,"15min":2.964},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.347,"15min":1.373},"min":{"1min":0.875,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.659,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.294,"15min":1.3240000000000001},"min":{"1min":0.84799999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.71,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.2270000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3480000000000001,"15min":1.3340000000000001},"min":{"1min":0.89100000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7170000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.464,"15min":1.55},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7410000000000001,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.708}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.462},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.784,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.294},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.466,"15min":1.472},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.621,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.472,"15min":1.538},"min":{"1min":0.91800000000000004,"5min":0.87,"15min":0.87},"max":{"1min":2.1499999999999999,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.536},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.55,"15min":1.548},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.704,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":1.504}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5620000000000001,"15min":1.615},"min":{"1min":1.0269999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.708,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.605},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.639,"15min":1.671},"min":{"1min":1.044,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.2679999999999998,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.6539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:39.258 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:39.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.524+0000 7f12aa213640 1 Processor -- start 2023-11-24T06:16:39.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.524+0000 7f12aa213640 1 -- start start 2023-11-24T06:16:39.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.526+0000 7f12aa213640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f12a413dfd0 0x7f12a415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.526+0000 7f12aa213640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a40cf050 0x7f12a40cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.526+0000 7f12aa213640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a40ce7c0 con 0x7f12a406c130 2023-11-24T06:16:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.526+0000 7f12aa213640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a40cfa10 con 0x7f12a413dfd0 2023-11-24T06:16:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.526+0000 7f12aa213640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4140900 con 0x7f12a40cf050 2023-11-24T06:16:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.526+0000 7f12a9a12640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f12a406c130 0x7f12a406c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38292/0 (socket says 172.21.15.22:38292) 2023-11-24T06:16:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.526+0000 7f12a9a12640 1 -- 172.21.15.22:0/1979015692 learned_addr learned my addr 172.21.15.22:0/1979015692 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f12a9211640 1 --2- 172.21.15.22:0/1979015692 >> v2:172.21.15.31:3300/0 conn(0x7f12a413dfd0 0x7f12a415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f12a8a10640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a40cf050 0x7f12a40cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031700873 0 0) 0x7f12a40ce7c0 con 0x7f12a406c130 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1290003520 con 0x7f12a406c130 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3667404516 0 0) 0x7f1290003520 con 0x7f12a406c130 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a40cf050 msgr2=0x7f12a40cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a40cf050 0x7f12a40cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 >> v2:172.21.15.31:3300/0 conn(0x7f12a413dfd0 msgr2=0x7f12a415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 --2- 172.21.15.22:0/1979015692 >> v2:172.21.15.31:3300/0 conn(0x7f12a413dfd0 0x7f12a415be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a415fa70 con 0x7f12a406c130 2023-11-24T06:16:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f129c0019f0 con 0x7f12a406c130 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 >> v1:172.21.15.22:6789/0 conn(0x7f12a406c130 legacy=0x7f12a406c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.527+0000 7f129bfff640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12900039e0 0x7f1290003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f129bfff640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12900047c0 0x7f1290004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f129bfff640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a40cf050 0x7f1290005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40cfa10 con 0x7f12900047c0 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4140900 con 0x7f12900039e0 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129000b9b0 con 0x7f12a40cf050 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f12a8a10640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12900047c0 0x7f1290004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f12a9211640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12900039e0 0x7f1290003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f12a8a10640 1 -- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a40cf050 msgr2=0x7f1290005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f12a8a10640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a40cf050 0x7f1290005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f12a8a10640 1 -- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12900039e0 msgr2=0x7f1290003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f12a8a10640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12900039e0 0x7f1290003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.528+0000 7f12a8a10640 1 -- 172.21.15.22:0/1979015692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1290003520 con 0x7f12900047c0 2023-11-24T06:16:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f12a8a10640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12900047c0 0x7f1290004c40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1294009ac0 tx=0x7f12900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e100cacaf203f6f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129402c710 con 0x7f12900047c0 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129402c870 con 0x7f12900047c0 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f129bfff640 1 -- 172.21.15.22:0/1979015692 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129402cc00 con 0x7f12900047c0 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f12aa213640 1 -- 172.21.15.22:0/1979015692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12900047c0 msgr2=0x7f1290004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f12aa213640 1 --2- 172.21.15.22:0/1979015692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12900047c0 0x7f1290004c40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1294009ac0 tx=0x7f12900057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f12a9a12640 1 -- 172.21.15.22:0/1979015692 reap_dead start 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f12aa213640 1 -- 172.21.15.22:0/1979015692 shutdown_connections 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f12aa213640 1 -- 172.21.15.22:0/1979015692 >> 172.21.15.22:0/1979015692 conn(0x7f12a406a860 msgr2=0x7f12a406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.530+0000 7f12aa213640 1 -- 172.21.15.22:0/1979015692 shutdown_connections 2023-11-24T06:16:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.531+0000 7f12aa213640 1 -- 172.21.15.22:0/1979015692 wait complete. 2023-11-24T06:16:39.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.532+0000 7f12aa213640 1 Processor -- start 2023-11-24T06:16:39.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.532+0000 7f12aa213640 1 -- start start 2023-11-24T06:16:39.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.533+0000 7f12aa213640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12900047c0 0x7f12a4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.533+0000 7f12aa213640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12a415ce30 0x7f12a415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.533+0000 7f12aa213640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a41ee840 0x7f12a41eecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.533+0000 7f12aa213640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4156120 con 0x7f12a415ce30 2023-11-24T06:16:39.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.533+0000 7f12aa213640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a41558b0 con 0x7f12900047c0 2023-11-24T06:16:39.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.533+0000 7f12aa213640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a41ef350 con 0x7f12a41ee840 2023-11-24T06:16:39.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a8a10640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12a415ce30 0x7f12a415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a8a10640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12a415ce30 0x7f12a415d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46450/0 (socket says 172.21.15.22:46450) 2023-11-24T06:16:39.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a8a10640 1 -- 172.21.15.22:0/2213333658 learned_addr learned my addr 172.21.15.22:0/2213333658 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a9211640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12900047c0 0x7f12a4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a8a10640 1 -- 172.21.15.22:0/2213333658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a41ee840 msgr2=0x7f12a41eecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a9a12640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a41ee840 0x7f12a41eecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a8a10640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a41ee840 0x7f12a41eecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a8a10640 1 -- 172.21.15.22:0/2213333658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12900047c0 msgr2=0x7f12a4155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a8a10640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12900047c0 0x7f12a4155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.534+0000 7f12a8a10640 1 -- 172.21.15.22:0/2213333658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a41ef630 con 0x7f12a415ce30 2023-11-24T06:16:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.535+0000 7f12a8a10640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12a415ce30 0x7f12a415d2b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f129402c2b0 tx=0x7f1294004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.535+0000 7f1299ffb640 1 -- 172.21.15.22:0/2213333658 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294003810 con 0x7f12a415ce30 2023-11-24T06:16:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.535+0000 7f1299ffb640 1 -- 172.21.15.22:0/2213333658 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129402de90 con 0x7f12a415ce30 2023-11-24T06:16:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.535+0000 7f1299ffb640 1 -- 172.21.15.22:0/2213333658 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294003b70 con 0x7f12a415ce30 2023-11-24T06:16:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.535+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a4155d40 con 0x7f12a415ce30 2023-11-24T06:16:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.535+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a4159400 con 0x7f12a415ce30 2023-11-24T06:16:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.536+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a41ef850 con 0x7f12a415ce30 2023-11-24T06:16:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.537+0000 7f1299ffb640 1 -- 172.21.15.22:0/2213333658 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1294003cd0 con 0x7f12a415ce30 2023-11-24T06:16:39.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.538+0000 7f1299ffb640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f128806b020 0x7f128806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.538+0000 7f1299ffb640 1 -- 172.21.15.22:0/2213333658 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12940ab720 con 0x7f12a415ce30 2023-11-24T06:16:39.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.538+0000 7f12a9211640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f128806b020 0x7f128806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.539+0000 7f12a9211640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f128806b020 0x7f128806d4e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009a90 tx=0x7f12a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.543+0000 7f1299ffb640 1 -- 172.21.15.22:0/2213333658 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1294076540 con 0x7f12a415ce30 2023-11-24T06:16:39.707 INFO:tasks.ceph.mds.d.smithi031.stderr:2023-11-24T06:16:39.704+0000 7ff6a838b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:16:39.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.732+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12a4155bc0 con 0x7f128806b020 2023-11-24T06:16:39.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.754+0000 7f1299ffb640 1 -- 172.21.15.22:0/2213333658 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281219 (secure 0 0 0) 0x7f12a0013a20 con 0x7f128806b020 2023-11-24T06:16:39.760 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:39.761 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:16:39.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f128806b020 msgr2=0x7f128806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f128806b020 0x7f128806d4e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009a90 tx=0x7f12a0008040 comp rx=0 tx=0).stop 2023-11-24T06:16:39.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12a415ce30 msgr2=0x7f12a415d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12a415ce30 0x7f12a415d2b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f129402c2b0 tx=0x7f1294004730 comp rx=0 tx=0).stop 2023-11-24T06:16:39.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 shutdown_connections 2023-11-24T06:16:39.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f128806b020 0x7f128806d4e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f12a41ee840 0x7f12a41eecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12a415ce30 0x7f12a415d2b0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 --2- 172.21.15.22:0/2213333658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12900047c0 0x7f12a4155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 >> 172.21.15.22:0/2213333658 conn(0x7f12a406a860 msgr2=0x7f12a40cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:39.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 shutdown_connections 2023-11-24T06:16:39.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:39.759+0000 7f12aa213640 1 -- 172.21.15.22:0/2213333658 wait complete. 2023-11-24T06:16:39.780 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-11-24T06:16:38.743357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":243560,"kb_used_data":6588,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731160,"statfs":{"total":773094113280,"available":772844707840,"internally_reserved":0,"allocated":6746112,"data_stored":3459475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002953"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755217+0000","last_change":"2023-11-24T06:16:33.755217+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755217+0000","last_undegraded":"2023-11-24T06:16:33.755217+0000","last_fullsized":"2023-11-24T06:16:33.755217+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748693+0000","last_change":"2023-11-24T06:16:33.748693+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748693+0000","last_undegraded":"2023-11-24T06:16:33.748693+0000","last_fullsized":"2023-11-24T06:16:33.748693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-11-24T06:16:34.757677+0000","last_change":"2023-11-24T06:16:34.757677+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:34.757677+0000","last_undegraded":"2023-11-24T06:16:34.757677+0000","last_fullsized":"2023-11-24T06:16:34.757677+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:55.062755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753321+0000","last_change":"2023-11-24T06:16:33.753321+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753321+0000","last_undegraded":"2023-11-24T06:16:33.753321+0000","last_fullsized":"2023-11-24T06:16:33.753321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751392+0000","last_change":"2023-11-24T06:16:33.751392+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751392+0000","last_undegraded":"2023-11-24T06:16:33.751392+0000","last_fullsized":"2023-11-24T06:16:33.751392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748600+0000","last_change":"2023-11-24T06:16:33.748600+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748600+0000","last_undegraded":"2023-11-24T06:16:33.748600+0000","last_fullsized":"2023-11-24T06:16:33.748600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755904+0000","last_change":"2023-11-24T06:16:33.755904+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755904+0000","last_undegraded":"2023-11-24T06:16:33.755904+0000","last_fullsized":"2023-11-24T06:16:33.755904+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187437+0000","last_change":"2023-11-24T06:16:34.781609+0000","last_active":"2023-11-24T06:16:36.187437+0000","last_peered":"2023-11-24T06:16:36.187437+0000","last_clean":"2023-11-24T06:16:36.187437+0000","last_became_active":"2023-11-24T06:16:34.778750+0000","last_became_peered":"2023-11-24T06:16:34.778750+0000","last_unstale":"2023-11-24T06:16:36.187437+0000","last_undegraded":"2023-11-24T06:16:36.187437+0000","last_fullsized":"2023-11-24T06:16:36.187437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:59:05.773308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187160+0000","last_change":"2023-11-24T06:16:34.790561+0000","last_active":"2023-11-24T06:16:36.187160+0000","last_peered":"2023-11-24T06:16:36.187160+0000","last_clean":"2023-11-24T06:16:36.187160+0000","last_became_active":"2023-11-24T06:16:34.790318+0000","last_became_peered":"2023-11-24T06:16:34.790318+0000","last_unstale":"2023-11-24T06:16:36.187160+0000","last_undegraded":"2023-11-24T06:16:36.187160+0000","last_fullsized":"2023-11-24T06:16:36.187160+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:54.298750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.771827+0000","last_change":"2023-11-24T06:16:34.771827+0000","last_active":"2023-11-24T06:16:34.771827+0000","last_peered":"2023-11-24T06:16:34.771827+0000","last_clean":"2023-11-24T06:16:34.771827+0000","last_became_active":"2023-11-24T06:16:34.769123+0000","last_became_peered":"2023-11-24T06:16:34.769123+0000","last_unstale":"2023-11-24T06:16:34.771827+0000","last_undegraded":"2023-11-24T06:16:34.771827+0000","last_fullsized":"2023-11-24T06:16:34.771827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:01.068796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754269+0000","last_change":"2023-11-24T06:16:33.754269+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754269+0000","last_undegraded":"2023-11-24T06:16:33.754269+0000","last_fullsized":"2023-11-24T06:16:33.754269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755288+0000","last_change":"2023-11-24T06:16:33.755288+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755288+0000","last_undegraded":"2023-11-24T06:16:33.755288+0000","last_fullsized":"2023-11-24T06:16:33.755288+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749954+0000","last_change":"2023-11-24T06:16:33.749954+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749954+0000","last_undegraded":"2023-11-24T06:16:33.749954+0000","last_fullsized":"2023-11-24T06:16:33.749954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750778+0000","last_change":"2023-11-24T06:16:33.750778+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750778+0000","last_undegraded":"2023-11-24T06:16:33.750778+0000","last_fullsized":"2023-11-24T06:16:33.750778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749569+0000","last_change":"2023-11-24T06:16:33.749569+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749569+0000","last_undegraded":"2023-11-24T06:16:33.749569+0000","last_fullsized":"2023-11-24T06:16:33.749569+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749861+0000","last_change":"2023-11-24T06:16:33.749861+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749861+0000","last_undegraded":"2023-11-24T06:16:33.749861+0000","last_fullsized":"2023-11-24T06:16:33.749861+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750123+0000","last_change":"2023-11-24T06:16:33.750123+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750123+0000","last_undegraded":"2023-11-24T06:16:33.750123+0000","last_fullsized":"2023-11-24T06:16:33.750123+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753167+0000","last_change":"2023-11-24T06:16:33.753167+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753167+0000","last_undegraded":"2023-11-24T06:16:33.753167+0000","last_fullsized":"2023-11-24T06:16:33.753167+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755115+0000","last_change":"2023-11-24T06:16:33.755115+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755115+0000","last_undegraded":"2023-11-24T06:16:33.755115+0000","last_fullsized":"2023-11-24T06:16:33.755115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751842+0000","last_change":"2023-11-24T06:16:33.751842+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751842+0000","last_undegraded":"2023-11-24T06:16:33.751842+0000","last_fullsized":"2023-11-24T06:16:33.751842+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751586+0000","last_change":"2023-11-24T06:16:33.751586+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751586+0000","last_undegraded":"2023-11-24T06:16:33.751586+0000","last_fullsized":"2023-11-24T06:16:33.751586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.775482+0000","last_change":"2023-11-24T06:16:34.775482+0000","last_active":"2023-11-24T06:16:34.775482+0000","last_peered":"2023-11-24T06:16:34.775482+0000","last_clean":"2023-11-24T06:16:34.775482+0000","last_became_active":"2023-11-24T06:16:34.775130+0000","last_became_peered":"2023-11-24T06:16:34.775130+0000","last_unstale":"2023-11-24T06:16:34.775482+0000","last_undegraded":"2023-11-24T06:16:34.775482+0000","last_fullsized":"2023-11-24T06:16:34.775482+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:52.385508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754884+0000","last_change":"2023-11-24T06:16:33.754884+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754884+0000","last_undegraded":"2023-11-24T06:16:33.754884+0000","last_fullsized":"2023-11-24T06:16:33.754884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.752445+0000","last_change":"2023-11-24T06:16:33.752445+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.752445+0000","last_undegraded":"2023-11-24T06:16:33.752445+0000","last_fullsized":"2023-11-24T06:16:33.752445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747147+0000","last_change":"2023-11-24T06:16:33.747147+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747147+0000","last_undegraded":"2023-11-24T06:16:33.747147+0000","last_fullsized":"2023-11-24T06:16:33.747147+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750054+0000","last_change":"2023-11-24T06:16:33.750054+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750054+0000","last_undegraded":"2023-11-24T06:16:33.750054+0000","last_fullsized":"2023-11-24T06:16:33.750054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755407+0000","last_change":"2023-11-24T06:16:33.755407+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755407+0000","last_undegraded":"2023-11-24T06:16:33.755407+0000","last_fullsized":"2023-11-24T06:16:33.755407+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.750229+0000","last_change":"2023-11-24T06:16:33.750229+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750229+0000","last_undegraded":"2023-11-24T06:16:33.750229+0000","last_fullsized":"2023-11-24T06:16:33.750229+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:58.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184656+0000","last_change":"2023-11-24T06:16:34.781959+0000","last_active":"2023-11-24T06:16:36.184656+0000","last_peered":"2023-11-24T06:16:36.184656+0000","last_clean":"2023-11-24T06:16:36.184656+0000","last_became_active":"2023-11-24T06:16:34.781005+0000","last_became_peered":"2023-11-24T06:16:34.781005+0000","last_unstale":"2023-11-24T06:16:36.184656+0000","last_undegraded":"2023-11-24T06:16:36.184656+0000","last_fullsized":"2023-11-24T06:16:36.184656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:39.144025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.755340+0000","last_change":"2023-11-24T06:16:33.755340+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755340+0000","last_undegraded":"2023-11-24T06:16:33.755340+0000","last_fullsized":"2023-11-24T06:16:33.755340+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:16.548503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753232+0000","last_change":"2023-11-24T06:16:33.753232+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753232+0000","last_undegraded":"2023-11-24T06:16:33.753232+0000","last_fullsized":"2023-11-24T06:16:33.753232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.754464+0000","last_change":"2023-11-24T06:16:33.754464+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754464+0000","last_undegraded":"2023-11-24T06:16:33.754464+0000","last_fullsized":"2023-11-24T06:16:33.754464+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:21.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754403+0000","last_change":"2023-11-24T06:16:33.754403+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754403+0000","last_undegraded":"2023-11-24T06:16:33.754403+0000","last_fullsized":"2023-11-24T06:16:33.754403+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.773550+0000","last_change":"2023-11-24T06:16:33.770950+0000","last_active":"2023-11-24T06:16:34.773550+0000","last_peered":"2023-11-24T06:16:34.773550+0000","last_clean":"2023-11-24T06:16:34.773550+0000","last_became_active":"2023-11-24T06:16:33.770565+0000","last_became_peered":"2023-11-24T06:16:33.770565+0000","last_unstale":"2023-11-24T06:16:34.773550+0000","last_undegraded":"2023-11-24T06:16:34.773550+0000","last_fullsized":"2023-11-24T06:16:34.773550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754608+0000","last_change":"2023-11-24T06:16:33.754608+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754608+0000","last_undegraded":"2023-11-24T06:16:33.754608+0000","last_fullsized":"2023-11-24T06:16:33.754608+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.775128+0000","last_change":"2023-11-24T06:16:33.772396+0000","last_active":"2023-11-24T06:16:33.775128+0000","last_peered":"2023-11-24T06:16:33.775128+0000","last_clean":"2023-11-24T06:16:33.775128+0000","last_became_active":"2023-11-24T06:16:33.771826+0000","last_became_peered":"2023-11-24T06:16:33.771826+0000","last_unstale":"2023-11-24T06:16:33.775128+0000","last_undegraded":"2023-11-24T06:16:33.775128+0000","last_fullsized":"2023-11-24T06:16:33.775128+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:53.124439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754313+0000","last_change":"2023-11-24T06:16:33.754313+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754313+0000","last_undegraded":"2023-11-24T06:16:33.754313+0000","last_fullsized":"2023-11-24T06:16:33.754313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.753234+0000","last_change":"2023-11-24T06:16:33.753234+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753234+0000","last_undegraded":"2023-11-24T06:16:33.753234+0000","last_fullsized":"2023-11-24T06:16:33.753234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:54.046458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750440+0000","last_change":"2023-11-24T06:16:33.750440+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750440+0000","last_undegraded":"2023-11-24T06:16:33.750440+0000","last_fullsized":"2023-11-24T06:16:33.750440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761610+0000","last_change":"2023-11-24T06:16:33.770060+0000","last_active":"2023-11-24T06:16:34.761610+0000","last_peered":"2023-11-24T06:16:34.761610+0000","last_clean":"2023-11-24T06:16:34.761610+0000","last_became_active":"2023-11-24T06:16:33.769764+0000","last_became_peered":"2023-11-24T06:16:33.769764+0000","last_unstale":"2023-11-24T06:16:34.761610+0000","last_undegraded":"2023-11-24T06:16:34.761610+0000","last_fullsized":"2023-11-24T06:16:34.761610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749417+0000","last_change":"2023-11-24T06:16:33.749417+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749417+0000","last_undegraded":"2023-11-24T06:16:33.749417+0000","last_fullsized":"2023-11-24T06:16:33.749417+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.772916+0000","last_change":"2023-11-24T06:16:33.769378+0000","last_active":"2023-11-24T06:16:33.772916+0000","last_peered":"2023-11-24T06:16:33.772916+0000","last_clean":"2023-11-24T06:16:33.772916+0000","last_became_active":"2023-11-24T06:16:33.768768+0000","last_became_peered":"2023-11-24T06:16:33.768768+0000","last_unstale":"2023-11-24T06:16:33.772916+0000","last_undegraded":"2023-11-24T06:16:33.772916+0000","last_fullsized":"2023-11-24T06:16:33.772916+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:40.407859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750286+0000","last_change":"2023-11-24T06:16:33.750286+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750286+0000","last_undegraded":"2023-11-24T06:16:33.750286+0000","last_fullsized":"2023-11-24T06:16:33.750286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.773310+0000","last_change":"2023-11-24T06:16:33.770422+0000","last_active":"2023-11-24T06:16:33.773310+0000","last_peered":"2023-11-24T06:16:33.773310+0000","last_clean":"2023-11-24T06:16:33.773310+0000","last_became_active":"2023-11-24T06:16:33.769391+0000","last_became_peered":"2023-11-24T06:16:33.769391+0000","last_unstale":"2023-11-24T06:16:33.773310+0000","last_undegraded":"2023-11-24T06:16:33.773310+0000","last_fullsized":"2023-11-24T06:16:33.773310+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:26.932738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747335+0000","last_change":"2023-11-24T06:16:33.747335+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747335+0000","last_undegraded":"2023-11-24T06:16:33.747335+0000","last_fullsized":"2023-11-24T06:16:33.747335+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.754241+0000","last_change":"2023-11-24T06:16:33.754241+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754241+0000","last_undegraded":"2023-11-24T06:16:33.754241+0000","last_fullsized":"2023-11-24T06:16:33.754241+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:34.619640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186420+0000","last_change":"2023-11-24T06:16:34.776486+0000","last_active":"2023-11-24T06:16:36.186420+0000","last_peered":"2023-11-24T06:16:36.186420+0000","last_clean":"2023-11-24T06:16:36.186420+0000","last_became_active":"2023-11-24T06:16:34.776078+0000","last_became_peered":"2023-11-24T06:16:34.776078+0000","last_unstale":"2023-11-24T06:16:36.186420+0000","last_undegraded":"2023-11-24T06:16:36.186420+0000","last_fullsized":"2023-11-24T06:16:36.186420+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:28.810438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.760422+0000","last_change":"2023-11-24T06:16:33.760422+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.760422+0000","last_undegraded":"2023-11-24T06:16:33.760422+0000","last_fullsized":"2023-11-24T06:16:33.760422+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:34.797956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747572+0000","last_change":"2023-11-24T06:16:33.747572+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747572+0000","last_undegraded":"2023-11-24T06:16:33.747572+0000","last_fullsized":"2023-11-24T06:16:33.747572+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.770377+0000","last_change":"2023-11-24T06:16:33.766405+0000","last_active":"2023-11-24T06:16:33.770377+0000","last_peered":"2023-11-24T06:16:33.770377+0000","last_clean":"2023-11-24T06:16:33.770377+0000","last_became_active":"2023-11-24T06:16:33.765503+0000","last_became_peered":"2023-11-24T06:16:33.765503+0000","last_unstale":"2023-11-24T06:16:33.770377+0000","last_undegraded":"2023-11-24T06:16:33.770377+0000","last_fullsized":"2023-11-24T06:16:33.770377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:34.797956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.771695+0000","last_change":"2023-11-24T06:16:34.771695+0000","last_active":"2023-11-24T06:16:34.771695+0000","last_peered":"2023-11-24T06:16:34.771695+0000","last_clean":"2023-11-24T06:16:34.771695+0000","last_became_active":"2023-11-24T06:16:34.771339+0000","last_became_peered":"2023-11-24T06:16:34.771339+0000","last_unstale":"2023-11-24T06:16:34.771695+0000","last_undegraded":"2023-11-24T06:16:34.771695+0000","last_fullsized":"2023-11-24T06:16:34.771695+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:59.860064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.753835+0000","last_change":"2023-11-24T06:16:33.753835+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753835+0000","last_undegraded":"2023-11-24T06:16:33.753835+0000","last_fullsized":"2023-11-24T06:16:33.753835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:06.004527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.752270+0000","last_change":"2023-11-24T06:16:33.752270+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.752270+0000","last_undegraded":"2023-11-24T06:16:33.752270+0000","last_fullsized":"2023-11-24T06:16:33.752270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.764665+0000","last_change":"2023-11-24T06:16:33.761349+0000","last_active":"2023-11-24T06:16:33.764665+0000","last_peered":"2023-11-24T06:16:33.764665+0000","last_clean":"2023-11-24T06:16:33.764665+0000","last_became_active":"2023-11-24T06:16:33.759543+0000","last_became_peered":"2023-11-24T06:16:33.759543+0000","last_unstale":"2023-11-24T06:16:33.764665+0000","last_undegraded":"2023-11-24T06:16:33.764665+0000","last_fullsized":"2023-11-24T06:16:33.764665+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:53:43.094414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751113+0000","last_change":"2023-11-24T06:16:33.751113+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751113+0000","last_undegraded":"2023-11-24T06:16:33.751113+0000","last_fullsized":"2023-11-24T06:16:33.751113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761769+0000","last_change":"2023-11-24T06:16:33.771272+0000","last_active":"2023-11-24T06:16:34.761769+0000","last_peered":"2023-11-24T06:16:34.761769+0000","last_clean":"2023-11-24T06:16:34.761769+0000","last_became_active":"2023-11-24T06:16:33.770946+0000","last_became_peered":"2023-11-24T06:16:33.770946+0000","last_unstale":"2023-11-24T06:16:34.761769+0000","last_undegraded":"2023-11-24T06:16:34.761769+0000","last_fullsized":"2023-11-24T06:16:34.761769+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:51.682060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747729+0000","last_change":"2023-11-24T06:16:33.747729+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747729+0000","last_undegraded":"2023-11-24T06:16:33.747729+0000","last_fullsized":"2023-11-24T06:16:33.747729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.757741+0000","last_change":"2023-11-24T06:16:33.757741+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.757741+0000","last_undegraded":"2023-11-24T06:16:33.757741+0000","last_fullsized":"2023-11-24T06:16:33.757741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:40.407859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748700+0000","last_change":"2023-11-24T06:16:33.748700+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748700+0000","last_undegraded":"2023-11-24T06:16:33.748700+0000","last_fullsized":"2023-11-24T06:16:33.748700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.748950+0000","last_change":"2023-11-24T06:16:33.748950+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748950+0000","last_undegraded":"2023-11-24T06:16:33.748950+0000","last_fullsized":"2023-11-24T06:16:33.748950+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.774713+0000","last_change":"2023-11-24T06:16:34.774713+0000","last_active":"2023-11-24T06:16:34.774713+0000","last_peered":"2023-11-24T06:16:34.774713+0000","last_clean":"2023-11-24T06:16:34.774713+0000","last_became_active":"2023-11-24T06:16:34.774392+0000","last_became_peered":"2023-11-24T06:16:34.774392+0000","last_unstale":"2023-11-24T06:16:34.774713+0000","last_undegraded":"2023-11-24T06:16:34.774713+0000","last_fullsized":"2023-11-24T06:16:34.774713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:33.540046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.755186+0000","last_change":"2023-11-24T06:16:33.755186+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755186+0000","last_undegraded":"2023-11-24T06:16:33.755186+0000","last_fullsized":"2023-11-24T06:16:33.755186+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:32.523748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749159+0000","last_change":"2023-11-24T06:16:33.749159+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749159+0000","last_undegraded":"2023-11-24T06:16:33.749159+0000","last_fullsized":"2023-11-24T06:16:33.749159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.763814+0000","last_change":"2023-11-24T06:16:33.771457+0000","last_active":"2023-11-24T06:16:34.763814+0000","last_peered":"2023-11-24T06:16:34.763814+0000","last_clean":"2023-11-24T06:16:34.763814+0000","last_became_active":"2023-11-24T06:16:33.771077+0000","last_became_peered":"2023-11-24T06:16:33.771077+0000","last_unstale":"2023-11-24T06:16:34.763814+0000","last_undegraded":"2023-11-24T06:16:34.763814+0000","last_fullsized":"2023-11-24T06:16:34.763814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:16.548503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.746175+0000","last_change":"2023-11-24T06:16:33.746175+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.746175+0000","last_undegraded":"2023-11-24T06:16:33.746175+0000","last_fullsized":"2023-11-24T06:16:33.746175+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.752456+0000","last_change":"2023-11-24T06:16:33.752456+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.752456+0000","last_undegraded":"2023-11-24T06:16:33.752456+0000","last_fullsized":"2023-11-24T06:16:33.752456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:00.052499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.770022+0000","last_change":"2023-11-24T06:16:34.770022+0000","last_active":"2023-11-24T06:16:34.770022+0000","last_peered":"2023-11-24T06:16:34.770022+0000","last_clean":"2023-11-24T06:16:34.770022+0000","last_became_active":"2023-11-24T06:16:34.769722+0000","last_became_peered":"2023-11-24T06:16:34.769722+0000","last_unstale":"2023-11-24T06:16:34.770022+0000","last_undegraded":"2023-11-24T06:16:34.770022+0000","last_fullsized":"2023-11-24T06:16:34.770022+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:50:42.331133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.748262+0000","last_change":"2023-11-24T06:16:33.748262+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748262+0000","last_undegraded":"2023-11-24T06:16:33.748262+0000","last_fullsized":"2023-11-24T06:16:33.748262+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754001+0000","last_change":"2023-11-24T06:16:33.754001+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754001+0000","last_undegraded":"2023-11-24T06:16:33.754001+0000","last_fullsized":"2023-11-24T06:16:33.754001+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.755961+0000","last_change":"2023-11-24T06:16:33.770996+0000","last_active":"2023-11-24T06:16:34.755961+0000","last_peered":"2023-11-24T06:16:34.755961+0000","last_clean":"2023-11-24T06:16:34.755961+0000","last_became_active":"2023-11-24T06:16:33.770413+0000","last_became_peered":"2023-11-24T06:16:33.770413+0000","last_unstale":"2023-11-24T06:16:34.755961+0000","last_undegraded":"2023-11-24T06:16:34.755961+0000","last_fullsized":"2023-11-24T06:16:34.755961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:29.010814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750870+0000","last_change":"2023-11-24T06:16:33.750870+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750870+0000","last_undegraded":"2023-11-24T06:16:33.750870+0000","last_fullsized":"2023-11-24T06:16:33.750870+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761830+0000","last_change":"2023-11-24T06:16:33.773444+0000","last_active":"2023-11-24T06:16:34.761830+0000","last_peered":"2023-11-24T06:16:34.761830+0000","last_clean":"2023-11-24T06:16:34.761830+0000","last_became_active":"2023-11-24T06:16:33.771977+0000","last_became_peered":"2023-11-24T06:16:33.771977+0000","last_unstale":"2023-11-24T06:16:34.761830+0000","last_undegraded":"2023-11-24T06:16:34.761830+0000","last_fullsized":"2023-11-24T06:16:34.761830+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:06.004527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-11-24T06:16:34.758470+0000","last_change":"2023-11-24T06:16:34.758470+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:34.758470+0000","last_undegraded":"2023-11-24T06:16:34.758470+0000","last_fullsized":"2023-11-24T06:16:34.758470+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:22.969912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.791301+0000","last_change":"2023-11-24T06:16:33.769724+0000","last_active":"2023-11-24T06:16:34.791301+0000","last_peered":"2023-11-24T06:16:34.791301+0000","last_clean":"2023-11-24T06:16:34.791301+0000","last_became_active":"2023-11-24T06:16:33.769461+0000","last_became_peered":"2023-11-24T06:16:33.769461+0000","last_unstale":"2023-11-24T06:16:34.791301+0000","last_undegraded":"2023-11-24T06:16:34.791301+0000","last_fullsized":"2023-11-24T06:16:34.791301+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:08.290535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.778377+0000","last_change":"2023-11-24T06:16:34.778377+0000","last_active":"2023-11-24T06:16:34.778377+0000","last_peered":"2023-11-24T06:16:34.778377+0000","last_clean":"2023-11-24T06:16:34.778377+0000","last_became_active":"2023-11-24T06:16:34.776011+0000","last_became_peered":"2023-11-24T06:16:34.776011+0000","last_unstale":"2023-11-24T06:16:34.778377+0000","last_undegraded":"2023-11-24T06:16:34.778377+0000","last_fullsized":"2023-11-24T06:16:34.778377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:42:27.391375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.754736+0000","last_change":"2023-11-24T06:16:33.754736+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754736+0000","last_undegraded":"2023-11-24T06:16:33.754736+0000","last_fullsized":"2023-11-24T06:16:33.754736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:51.369211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186605+0000","last_change":"2023-11-24T06:16:34.774591+0000","last_active":"2023-11-24T06:16:36.186605+0000","last_peered":"2023-11-24T06:16:36.186605+0000","last_clean":"2023-11-24T06:16:36.186605+0000","last_became_active":"2023-11-24T06:16:34.774324+0000","last_became_peered":"2023-11-24T06:16:34.774324+0000","last_unstale":"2023-11-24T06:16:36.186605+0000","last_undegraded":"2023-11-24T06:16:36.186605+0000","last_fullsized":"2023-11-24T06:16:36.186605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:02.107927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.744890+0000","last_change":"2023-11-24T06:16:33.744890+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.744890+0000","last_undegraded":"2023-11-24T06:16:33.744890+0000","last_fullsized":"2023-11-24T06:16:33.744890+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:44.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753969+0000","last_change":"2023-11-24T06:16:33.753969+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753969+0000","last_undegraded":"2023-11-24T06:16:33.753969+0000","last_fullsized":"2023-11-24T06:16:33.753969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761865+0000","last_change":"2023-11-24T06:16:33.772084+0000","last_active":"2023-11-24T06:16:34.761865+0000","last_peered":"2023-11-24T06:16:34.761865+0000","last_clean":"2023-11-24T06:16:34.761865+0000","last_became_active":"2023-11-24T06:16:33.771790+0000","last_became_peered":"2023-11-24T06:16:33.771790+0000","last_unstale":"2023-11-24T06:16:34.761865+0000","last_undegraded":"2023-11-24T06:16:34.761865+0000","last_fullsized":"2023-11-24T06:16:34.761865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:34.619640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751922+0000","last_change":"2023-11-24T06:16:33.751922+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751922+0000","last_undegraded":"2023-11-24T06:16:33.751922+0000","last_fullsized":"2023-11-24T06:16:33.751922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.756153+0000","last_change":"2023-11-24T06:16:33.770432+0000","last_active":"2023-11-24T06:16:34.756153+0000","last_peered":"2023-11-24T06:16:34.756153+0000","last_clean":"2023-11-24T06:16:34.756153+0000","last_became_active":"2023-11-24T06:16:33.770152+0000","last_became_peered":"2023-11-24T06:16:33.770152+0000","last_unstale":"2023-11-24T06:16:34.756153+0000","last_undegraded":"2023-11-24T06:16:34.756153+0000","last_fullsized":"2023-11-24T06:16:34.756153+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:20.853464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.746006+0000","last_change":"2023-11-24T06:16:33.746006+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.746006+0000","last_undegraded":"2023-11-24T06:16:33.746006+0000","last_fullsized":"2023-11-24T06:16:33.746006+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.770483+0000","last_change":"2023-11-24T06:16:33.767805+0000","last_active":"2023-11-24T06:16:33.770483+0000","last_peered":"2023-11-24T06:16:33.770483+0000","last_clean":"2023-11-24T06:16:33.770483+0000","last_became_active":"2023-11-24T06:16:33.767215+0000","last_became_peered":"2023-11-24T06:16:33.767215+0000","last_unstale":"2023-11-24T06:16:33.770483+0000","last_undegraded":"2023-11-24T06:16:33.770483+0000","last_fullsized":"2023-11-24T06:16:33.770483+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:26.932738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.182462+0000","last_change":"2023-11-24T06:16:34.778394+0000","last_active":"2023-11-24T06:16:36.182462+0000","last_peered":"2023-11-24T06:16:36.182462+0000","last_clean":"2023-11-24T06:16:36.182462+0000","last_became_active":"2023-11-24T06:16:34.778241+0000","last_became_peered":"2023-11-24T06:16:34.778241+0000","last_unstale":"2023-11-24T06:16:36.182462+0000","last_undegraded":"2023-11-24T06:16:36.182462+0000","last_fullsized":"2023-11-24T06:16:36.182462+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:41.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.757051+0000","last_change":"2023-11-24T06:16:33.770982+0000","last_active":"2023-11-24T06:16:34.757051+0000","last_peered":"2023-11-24T06:16:34.757051+0000","last_clean":"2023-11-24T06:16:34.757051+0000","last_became_active":"2023-11-24T06:16:33.770635+0000","last_became_peered":"2023-11-24T06:16:33.770635+0000","last_unstale":"2023-11-24T06:16:34.757051+0000","last_undegraded":"2023-11-24T06:16:34.757051+0000","last_fullsized":"2023-11-24T06:16:34.757051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:06:46.387683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748237+0000","last_change":"2023-11-24T06:16:33.748237+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748237+0000","last_undegraded":"2023-11-24T06:16:33.748237+0000","last_fullsized":"2023-11-24T06:16:33.748237+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.749491+0000","last_change":"2023-11-24T06:16:33.749491+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749491+0000","last_undegraded":"2023-11-24T06:16:33.749491+0000","last_fullsized":"2023-11-24T06:16:33.749491+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:51.682060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748031+0000","last_change":"2023-11-24T06:16:33.748031+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748031+0000","last_undegraded":"2023-11-24T06:16:33.748031+0000","last_fullsized":"2023-11-24T06:16:33.748031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.743067+0000","last_change":"2023-11-24T06:16:33.743067+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.743067+0000","last_undegraded":"2023-11-24T06:16:33.743067+0000","last_fullsized":"2023-11-24T06:16:33.743067+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:13.478706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":204,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:16:32.733433+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:16:32.733433+0000","last_peered":"2023-11-24T06:16:32.733433+0000","last_clean":"2023-11-24T06:16:32.733433+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:16:32.733433+0000","last_undegraded":"2023-11-24T06:16:32.733433+0000","last_fullsized":"2023-11-24T06:16:32.733433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":287897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.095,"15min":1.0589999999999999},"min":{"1min":0.85099999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.45,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.304,"5min":1.137,"15min":1.0589999999999999},"min":{"1min":0.71299999999999997,"5min":0.63,"15min":0.63},"max":{"1min":1.7549999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.599}]},{"osd":1,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1279999999999999,"15min":1.1140000000000001},"min":{"1min":0.82699999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6699999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.212},{"interface":"front","average":{"1min":1.26,"5min":1.1779999999999999,"15min":1.119},"min":{"1min":0.89600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7629999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.282}]},{"osd":2,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2090000000000001,"15min":1.1519999999999999},"min":{"1min":0.78200000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.736,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2909999999999999,"15min":1.339},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.732,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.339}]},{"osd":3,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.333,"15min":1.3109999999999999},"min":{"1min":0.90900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6830000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.367,"15min":1.345},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7869999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.659}]},{"osd":4,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.296},"min":{"1min":0.89600000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8879999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4390000000000001,"15min":1.357},"min":{"1min":0.97399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.794,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.6890000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5189999999999999,"15min":1.52},"min":{"1min":0.97999999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.861,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.494},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4810000000000001,"15min":1.4550000000000001},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.988,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.54}]},{"osd":7,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.591,"15min":1.5589999999999999},"min":{"1min":0.86799999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8899999999999999,"5min":3.262,"15min":3.262},"last":1.7989999999999999},{"interface":"front","average":{"1min":1.609,"5min":1.651,"15min":1.6830000000000001},"min":{"1min":1.169,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8480000000000001,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.762}]}]},{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":871998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.123,"15min":1.073},"min":{"1min":0.92400000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.603,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2,"15min":1.1539999999999999},"min":{"1min":0.82499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.528,"5min":1.72,"15min":1.72},"last":1.2190000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.84799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5840000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.306,"15min":1.2909999999999999},"min":{"1min":1.099,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7370000000000001,"5min":1.847,"15min":1.847},"last":0.755}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.238,"15min":1.21},"min":{"1min":0.81000000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.718,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.377,"5min":1.2949999999999999,"15min":1.2989999999999999},"min":{"1min":0.97899999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8200000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3220000000000001,"15min":1.327},"min":{"1min":1.073,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.716,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.373,"15min":1.371},"min":{"1min":0.98499999999999999,"5min":0.745,"15min":0.745},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.302}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.85999999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7709999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.569},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4570000000000001,"15min":1.425},"min":{"1min":0.96899999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8799999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.633}]},{"osd":5,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.5489999999999999,"15min":1.532},"min":{"1min":1.214,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0550000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.49},{"interface":"front","average":{"1min":1.766,"5min":1.7,"15min":1.6739999999999999},"min":{"1min":1.528,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.4780000000000002,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.7709999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.466,"15min":1.5},"min":{"1min":0.98999999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2,"5min":2.5,"15min":2.5},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.8029999999999999,"5min":1.7649999999999999,"15min":1.7410000000000001},"min":{"1min":1.377,"5min":0.875,"15min":0.875},"max":{"1min":2.6040000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.8320000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.755,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.613}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.137,"15min":1.2190000000000001},"min":{"1min":0.69799999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.579,"5min":1.619,"15min":1.619},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.329,"5min":1.2689999999999999,"15min":1.258},"min":{"1min":0.90500000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.625,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.252}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.325,"15min":1.323},"min":{"1min":0.88200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9630000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.401,"15min":1.4690000000000001},"min":{"1min":1.208,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7490000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.085}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":1.141,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.913,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.149},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.4690000000000001},"min":{"1min":0.94099999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.75,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.6619999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4339999999999999,"15min":1.482},"min":{"1min":1.0209999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.653,"5min":2.258,"15min":2.258},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.45,"15min":1.534},"min":{"1min":1.1739999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.8759999999999999,"5min":2.105,"15min":2.105},"last":1.5609999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.5649999999999999},"min":{"1min":0.85799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0379999999999998,"5min":2.319,"15min":2.319},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.619,"15min":1.655},"min":{"1min":1.268,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.899}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.665,"15min":1.6930000000000001},"min":{"1min":1.288,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.1440000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.718,"5min":1.734,"15min":1.7809999999999999},"min":{"1min":1.379,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0670000000000002,"5min":2.669,"15min":2.669},"last":1.7929999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.071,"15min":1.071},"min":{"1min":0.80400000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5940000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.0820000000000001,"15min":1.085},"min":{"1min":0.755,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.71099999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.266,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.2390000000000001,"15min":1.286},"min":{"1min":0.94699999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6259999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.214}]},{"osd":2,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.226,"15min":1.1950000000000001},"min":{"1min":0.97299999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.667,"5min":2.04,"15min":2.04},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.371,"15min":1.409},"min":{"1min":0.89800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.738,"5min":2.016,"15min":2.016},"last":1.2749999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5169999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.325,"15min":1.3520000000000001},"min":{"1min":0.997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8260000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.575}]},{"osd":5,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.369,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.7170000000000001,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.018},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.454,"15min":1.53},"min":{"1min":0.999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8620000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4339999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5269999999999999,"15min":1.579},"min":{"1min":1.103,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9259999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.5229999999999999,"15min":1.613},"min":{"1min":1.0549999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9370000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.51}]},{"osd":7,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.47,"15min":1.552},"min":{"1min":0.97499999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8029999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.704},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.657,"15min":1.7110000000000001},"min":{"1min":1.1659999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0339999999999998,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.7669999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83999999999999997,"15min":0.87},"min":{"1min":0.66000000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3480000000000001,"5min":1.607,"15min":1.607},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.42399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.4370000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.92800000000000005,"15min":0.91700000000000004},"min":{"1min":0.51800000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4910000000000001,"5min":1.796,"15min":1.796},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.1399999999999999,"15min":1.145},"min":{"1min":0.53600000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.7410000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.083,"15min":1.0589999999999999},"min":{"1min":0.71799999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.661,"5min":1.835,"15min":1.835},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.1519999999999999,"15min":1.1279999999999999},"min":{"1min":0.753,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7130000000000001,"5min":2.399,"15min":2.399},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3129999999999999,"15min":1.321},"min":{"1min":0.91500000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.944,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3080000000000001,"15min":1.2829999999999999},"min":{"1min":1.115,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.877,"5min":2.141,"15min":2.141},"last":1.3799999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.351,"15min":1.333},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.742,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.3799999999999999,"15min":1.397},"min":{"1min":1.0009999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.847,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.4059999999999999,"15min":1.3660000000000001},"min":{"1min":0.95299999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.974,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.603},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3540000000000001,"15min":1.3340000000000001},"min":{"1min":1.0009999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9570000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.069}]},{"osd":7,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.417,"15min":1.427},"min":{"1min":0.94499999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1379999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1.1439999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0379999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.099}]}]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85099999999999998,"15min":0.877},"min":{"1min":0.66800000000000004,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.399,"5min":2.552,"15min":2.552},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.93999999999999995,"15min":0.96399999999999997},"min":{"1min":0.78600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5640000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.81000000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.1850000000000001,"15min":1.141},"min":{"1min":1.01,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6990000000000001,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.125,"15min":1.129},"min":{"1min":0.90800000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6240000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.0009999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.175,"15min":1.169},"min":{"1min":0.97299999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.8220000000000001,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.98899999999999999,"15min":0.96899999999999997},"min":{"1min":0.59399999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.714,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3109999999999999,"15min":1.331},"min":{"1min":1.006,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.7909999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.373},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.486,"15min":1.502},"min":{"1min":1.327,"5min":0.755,"15min":0.755},"max":{"1min":2.0590000000000002,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.113}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.28,"15min":1.236},"min":{"1min":1.0620000000000001,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7370000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.413,"15min":1.4370000000000001},"min":{"1min":1.1419999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.7509999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.5740000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.405,"15min":1.405},"min":{"1min":1.159,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7669999999999999,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.522,"15min":1.556},"min":{"1min":1.0860000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8859999999999999,"5min":4.101,"15min":4.101},"last":1.524}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.5089999999999999,"15min":1.5069999999999999},"min":{"1min":1.23,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9179999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.496},{"interface":"front","average":{"1min":1.637,"5min":1.492,"15min":1.4970000000000001},"min":{"1min":1.2969999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2029999999999998,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.615}]}]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":871998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84999999999999998,"15min":0.83899999999999997},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.708,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.165,"5min":1.0089999999999999,"15min":0.97699999999999998},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.6819999999999999,"5min":2.161,"15min":2.161},"last":1.3049999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2649999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.742},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8420000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.88}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1439999999999999,"15min":1.2},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.7709999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8440000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.246}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.3600000000000001,"15min":1.3080000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8180000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3939999999999999},"min":{"1min":0.98799999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.659,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.6659999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:58 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.90600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.742,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":1.506},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2969999999999999,"15min":1.2509999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3779999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4470000000000001,"15min":1.4410000000000001},"min":{"1min":1.0980000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.994,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.8460000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.385,"15min":1.343},"min":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.8979999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.4630000000000001,"15min":1.4390000000000001},"min":{"1min":0.93000000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2050000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.212,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.891,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.95}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":301062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.94499999999999995},"min":{"1min":0.47499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4279999999999999,"5min":1.571,"15min":1.571},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.024,"15min":1.028},"min":{"1min":0.72099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5620000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.121}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.69099999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.097,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.123,"5min":1.1639999999999999,"15min":1.226},"min":{"1min":0.60999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.538,"5min":2.964,"15min":2.964},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.347,"15min":1.373},"min":{"1min":0.875,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.659,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.294,"15min":1.3240000000000001},"min":{"1min":0.84799999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.71,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.2270000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3480000000000001,"15min":1.3340000000000001},"min":{"1min":0.89100000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7170000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.464,"15min":1.55},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7410000000000001,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.708}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.462},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.784,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.294},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.466,"15min":1.472},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.621,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.472,"15min":1.538},"min":{"1min":0.91800000000000004,"5min":0.87,"15min":0.87},"max":{"1min":2.1499999999999999,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.536},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.55,"15min":1.548},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.704,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":1.504}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5620000000000001,"15min":1.615},"min":{"1min":1.0269999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.708,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.605},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.639,"15min":1.671},"min":{"1min":1.044,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.2679999999999998,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.6539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:39.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:40.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.049+0000 7ff924d78640 1 Processor -- start 2023-11-24T06:16:40.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.049+0000 7ff924d78640 1 -- start start 2023-11-24T06:16:40.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.050+0000 7ff924d78640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff92015a100 0x7ff9200b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.050+0000 7ff924d78640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9200abff0 0x7ff9200b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff924d78640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92013da30 con 0x7ff9200ae7e0 2023-11-24T06:16:40.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff924d78640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9200ac840 con 0x7ff9200abff0 2023-11-24T06:16:40.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff924d78640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9200ac560 con 0x7ff92015a100 2023-11-24T06:16:40.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff91dd9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9200abff0 0x7ff9200b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff91dd9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9200abff0 0x7ff9200b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46466/0 (socket says 172.21.15.22:46466) 2023-11-24T06:16:40.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff91dd9b640 1 -- 172.21.15.22:0/2903265316 learned_addr learned my addr 172.21.15.22:0/2903265316 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:40.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff91e59c640 1 --2- 172.21.15.22:0/2903265316 >> v2:172.21.15.31:3300/0 conn(0x7ff92015a100 0x7ff9200b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff91dd9b640 1 -- 172.21.15.22:0/2903265316 >> v2:172.21.15.31:3300/0 conn(0x7ff92015a100 msgr2=0x7ff9200b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:40.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff91dd9b640 1 --2- 172.21.15.22:0/2903265316 >> v2:172.21.15.31:3300/0 conn(0x7ff92015a100 0x7ff9200b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff91dd9b640 1 -- 172.21.15.22:0/2903265316 >> v1:172.21.15.31:6789/0 conn(0x7ff9200ae7e0 legacy=0x7ff92006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:40.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.051+0000 7ff91dd9b640 1 -- 172.21.15.22:0/2903265316 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920070650 con 0x7ff9200abff0 2023-11-24T06:16:40.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.053+0000 7ff91dd9b640 1 --2- 172.21.15.22:0/2903265316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9200abff0 0x7ff9200b37d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff92006bc90 tx=0x7ff91402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528389b9a981175b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:40.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.053+0000 7ff91d59a640 1 -- 172.21.15.22:0/2903265316 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91402ca80 con 0x7ff9200abff0 2023-11-24T06:16:40.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.053+0000 7ff91d59a640 1 -- 172.21.15.22:0/2903265316 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91402cbe0 con 0x7ff9200abff0 2023-11-24T06:16:40.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.053+0000 7ff91d59a640 1 -- 172.21.15.22:0/2903265316 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9140343f0 con 0x7ff9200abff0 2023-11-24T06:16:40.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.053+0000 7ff924d78640 1 -- 172.21.15.22:0/2903265316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9200abff0 msgr2=0x7ff9200b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.053+0000 7ff924d78640 1 --2- 172.21.15.22:0/2903265316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9200abff0 0x7ff9200b37d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff92006bc90 tx=0x7ff91402bee0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.054+0000 7ff924d78640 1 -- 172.21.15.22:0/2903265316 shutdown_connections 2023-11-24T06:16:40.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.054+0000 7ff924d78640 1 --2- 172.21.15.22:0/2903265316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9200abff0 0x7ff9200b37d0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.054+0000 7ff924d78640 1 --2- 172.21.15.22:0/2903265316 >> v2:172.21.15.31:3300/0 conn(0x7ff92015a100 0x7ff9200b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.054+0000 7ff924d78640 1 -- 172.21.15.22:0/2903265316 >> 172.21.15.22:0/2903265316 conn(0x7ff9200b0d80 msgr2=0x7ff9200b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:40.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.054+0000 7ff924d78640 1 -- 172.21.15.22:0/2903265316 shutdown_connections 2023-11-24T06:16:40.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.054+0000 7ff924d78640 1 -- 172.21.15.22:0/2903265316 wait complete. 2023-11-24T06:16:40.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.056+0000 7ff924d78640 1 Processor -- start 2023-11-24T06:16:40.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.056+0000 7ff924d78640 1 -- start start 2023-11-24T06:16:40.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.057+0000 7ff924d78640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9200abff0 0x7ff9200cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.057+0000 7ff924d78640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9200ae7e0 0x7ff9200c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.057+0000 7ff924d78640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92015a100 0x7ff920155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.057+0000 7ff924d78640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200cde10 con 0x7ff92015a100 2023-11-24T06:16:40.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.057+0000 7ff924d78640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200cd290 con 0x7ff9200ae7e0 2023-11-24T06:16:40.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.057+0000 7ff924d78640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200cd570 con 0x7ff9200abff0 2023-11-24T06:16:40.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.057+0000 7ff91ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92015a100 0x7ff920155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.057+0000 7ff91ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92015a100 0x7ff920155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46476/0 (socket says 172.21.15.22:46476) 2023-11-24T06:16:40.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.057+0000 7ff91ed9d640 1 -- 172.21.15.22:0/2153140794 learned_addr learned my addr 172.21.15.22:0/2153140794 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:40.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff91dd9b640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9200ae7e0 0x7ff9200c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff91e59c640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9200abff0 0x7ff9200cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff91ed9d640 1 -- 172.21.15.22:0/2153140794 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9200abff0 msgr2=0x7ff9200cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff91ed9d640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9200abff0 0x7ff9200cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff91ed9d640 1 -- 172.21.15.22:0/2153140794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9200ae7e0 msgr2=0x7ff9200c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff91ed9d640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9200ae7e0 0x7ff9200c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff91ed9d640 1 -- 172.21.15.22:0/2153140794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff914009b30 con 0x7ff92015a100 2023-11-24T06:16:40.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff91ed9d640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92015a100 0x7ff920155be0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff91800b410 tx=0x7ff91800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:40.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff90effd640 1 -- 172.21.15.22:0/2153140794 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918004020 con 0x7ff92015a100 2023-11-24T06:16:40.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff90effd640 1 -- 172.21.15.22:0/2153140794 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918004180 con 0x7ff92015a100 2023-11-24T06:16:40.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff90effd640 1 -- 172.21.15.22:0/2153140794 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918011630 con 0x7ff92015a100 2023-11-24T06:16:40.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.058+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9200cd850 con 0x7ff92015a100 2023-11-24T06:16:40.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.059+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9200ccf60 con 0x7ff92015a100 2023-11-24T06:16:40.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.060+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff920067960 con 0x7ff92015a100 2023-11-24T06:16:40.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.061+0000 7ff90effd640 1 -- 172.21.15.22:0/2153140794 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff918011790 con 0x7ff92015a100 2023-11-24T06:16:40.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.062+0000 7ff90effd640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff90006aff0 0x7ff90006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.062+0000 7ff90effd640 1 -- 172.21.15.22:0/2153140794 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff918089650 con 0x7ff92015a100 2023-11-24T06:16:40.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.062+0000 7ff91e59c640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff90006aff0 0x7ff90006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.063+0000 7ff91e59c640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff90006aff0 0x7ff90006d4b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff910006fd0 tx=0x7ff910008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:40.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.066+0000 7ff90effd640 1 -- 172.21.15.22:0/2153140794 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff918054470 con 0x7ff92015a100 2023-11-24T06:16:40.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.255+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9200cd6e0 con 0x7ff90006aff0 2023-11-24T06:16:40.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.268+0000 7ff90effd640 1 -- 172.21.15.22:0/2153140794 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281219 (secure 0 0 0) 0x7ff9200cd6e0 con 0x7ff90006aff0 2023-11-24T06:16:40.271 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:40.276 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:16:40.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff90006aff0 msgr2=0x7ff90006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff90006aff0 0x7ff90006d4b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff910006fd0 tx=0x7ff910008040 comp rx=0 tx=0).stop 2023-11-24T06:16:40.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92015a100 msgr2=0x7ff920155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92015a100 0x7ff920155be0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff91800b410 tx=0x7ff91800b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 shutdown_connections 2023-11-24T06:16:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff90006aff0 0x7ff90006d4b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92015a100 0x7ff920155be0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9200ae7e0 0x7ff9200c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 --2- 172.21.15.22:0/2153140794 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9200abff0 0x7ff9200cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 >> 172.21.15.22:0/2153140794 conn(0x7ff9200b0d80 msgr2=0x7ff920159310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 shutdown_connections 2023-11-24T06:16:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.275+0000 7ff924d78640 1 -- 172.21.15.22:0/2153140794 wait complete. 2023-11-24T06:16:40.298 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-11-24T06:16:38.743357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":243560,"kb_used_data":6588,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731160,"statfs":{"total":773094113280,"available":772844707840,"internally_reserved":0,"allocated":6746112,"data_stored":3459475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002953"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755217+0000","last_change":"2023-11-24T06:16:33.755217+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755217+0000","last_undegraded":"2023-11-24T06:16:33.755217+0000","last_fullsized":"2023-11-24T06:16:33.755217+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748693+0000","last_change":"2023-11-24T06:16:33.748693+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748693+0000","last_undegraded":"2023-11-24T06:16:33.748693+0000","last_fullsized":"2023-11-24T06:16:33.748693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-11-24T06:16:34.757677+0000","last_change":"2023-11-24T06:16:34.757677+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:34.757677+0000","last_undegraded":"2023-11-24T06:16:34.757677+0000","last_fullsized":"2023-11-24T06:16:34.757677+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:55.062755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753321+0000","last_change":"2023-11-24T06:16:33.753321+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753321+0000","last_undegraded":"2023-11-24T06:16:33.753321+0000","last_fullsized":"2023-11-24T06:16:33.753321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751392+0000","last_change":"2023-11-24T06:16:33.751392+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751392+0000","last_undegraded":"2023-11-24T06:16:33.751392+0000","last_fullsized":"2023-11-24T06:16:33.751392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748600+0000","last_change":"2023-11-24T06:16:33.748600+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748600+0000","last_undegraded":"2023-11-24T06:16:33.748600+0000","last_fullsized":"2023-11-24T06:16:33.748600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755904+0000","last_change":"2023-11-24T06:16:33.755904+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755904+0000","last_undegraded":"2023-11-24T06:16:33.755904+0000","last_fullsized":"2023-11-24T06:16:33.755904+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187437+0000","last_change":"2023-11-24T06:16:34.781609+0000","last_active":"2023-11-24T06:16:36.187437+0000","last_peered":"2023-11-24T06:16:36.187437+0000","last_clean":"2023-11-24T06:16:36.187437+0000","last_became_active":"2023-11-24T06:16:34.778750+0000","last_became_peered":"2023-11-24T06:16:34.778750+0000","last_unstale":"2023-11-24T06:16:36.187437+0000","last_undegraded":"2023-11-24T06:16:36.187437+0000","last_fullsized":"2023-11-24T06:16:36.187437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:59:05.773308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187160+0000","last_change":"2023-11-24T06:16:34.790561+0000","last_active":"2023-11-24T06:16:36.187160+0000","last_peered":"2023-11-24T06:16:36.187160+0000","last_clean":"2023-11-24T06:16:36.187160+0000","last_became_active":"2023-11-24T06:16:34.790318+0000","last_became_peered":"2023-11-24T06:16:34.790318+0000","last_unstale":"2023-11-24T06:16:36.187160+0000","last_undegraded":"2023-11-24T06:16:36.187160+0000","last_fullsized":"2023-11-24T06:16:36.187160+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:54.298750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.771827+0000","last_change":"2023-11-24T06:16:34.771827+0000","last_active":"2023-11-24T06:16:34.771827+0000","last_peered":"2023-11-24T06:16:34.771827+0000","last_clean":"2023-11-24T06:16:34.771827+0000","last_became_active":"2023-11-24T06:16:34.769123+0000","last_became_peered":"2023-11-24T06:16:34.769123+0000","last_unstale":"2023-11-24T06:16:34.771827+0000","last_undegraded":"2023-11-24T06:16:34.771827+0000","last_fullsized":"2023-11-24T06:16:34.771827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:01.068796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754269+0000","last_change":"2023-11-24T06:16:33.754269+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754269+0000","last_undegraded":"2023-11-24T06:16:33.754269+0000","last_fullsized":"2023-11-24T06:16:33.754269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755288+0000","last_change":"2023-11-24T06:16:33.755288+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755288+0000","last_undegraded":"2023-11-24T06:16:33.755288+0000","last_fullsized":"2023-11-24T06:16:33.755288+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749954+0000","last_change":"2023-11-24T06:16:33.749954+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749954+0000","last_undegraded":"2023-11-24T06:16:33.749954+0000","last_fullsized":"2023-11-24T06:16:33.749954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750778+0000","last_change":"2023-11-24T06:16:33.750778+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750778+0000","last_undegraded":"2023-11-24T06:16:33.750778+0000","last_fullsized":"2023-11-24T06:16:33.750778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749569+0000","last_change":"2023-11-24T06:16:33.749569+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749569+0000","last_undegraded":"2023-11-24T06:16:33.749569+0000","last_fullsized":"2023-11-24T06:16:33.749569+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749861+0000","last_change":"2023-11-24T06:16:33.749861+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749861+0000","last_undegraded":"2023-11-24T06:16:33.749861+0000","last_fullsized":"2023-11-24T06:16:33.749861+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750123+0000","last_change":"2023-11-24T06:16:33.750123+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750123+0000","last_undegraded":"2023-11-24T06:16:33.750123+0000","last_fullsized":"2023-11-24T06:16:33.750123+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753167+0000","last_change":"2023-11-24T06:16:33.753167+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753167+0000","last_undegraded":"2023-11-24T06:16:33.753167+0000","last_fullsized":"2023-11-24T06:16:33.753167+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755115+0000","last_change":"2023-11-24T06:16:33.755115+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755115+0000","last_undegraded":"2023-11-24T06:16:33.755115+0000","last_fullsized":"2023-11-24T06:16:33.755115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751842+0000","last_change":"2023-11-24T06:16:33.751842+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751842+0000","last_undegraded":"2023-11-24T06:16:33.751842+0000","last_fullsized":"2023-11-24T06:16:33.751842+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751586+0000","last_change":"2023-11-24T06:16:33.751586+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751586+0000","last_undegraded":"2023-11-24T06:16:33.751586+0000","last_fullsized":"2023-11-24T06:16:33.751586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.775482+0000","last_change":"2023-11-24T06:16:34.775482+0000","last_active":"2023-11-24T06:16:34.775482+0000","last_peered":"2023-11-24T06:16:34.775482+0000","last_clean":"2023-11-24T06:16:34.775482+0000","last_became_active":"2023-11-24T06:16:34.775130+0000","last_became_peered":"2023-11-24T06:16:34.775130+0000","last_unstale":"2023-11-24T06:16:34.775482+0000","last_undegraded":"2023-11-24T06:16:34.775482+0000","last_fullsized":"2023-11-24T06:16:34.775482+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:52.385508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754884+0000","last_change":"2023-11-24T06:16:33.754884+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754884+0000","last_undegraded":"2023-11-24T06:16:33.754884+0000","last_fullsized":"2023-11-24T06:16:33.754884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.752445+0000","last_change":"2023-11-24T06:16:33.752445+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.752445+0000","last_undegraded":"2023-11-24T06:16:33.752445+0000","last_fullsized":"2023-11-24T06:16:33.752445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747147+0000","last_change":"2023-11-24T06:16:33.747147+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747147+0000","last_undegraded":"2023-11-24T06:16:33.747147+0000","last_fullsized":"2023-11-24T06:16:33.747147+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T06:16:33.723132+0000","last_change":"2023-11-24T06:16:33.723132+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.723132+0000","last_undegraded":"2023-11-24T06:16:33.723132+0000","last_fullsized":"2023-11-24T06:16:33.723132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750054+0000","last_change":"2023-11-24T06:16:33.750054+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750054+0000","last_undegraded":"2023-11-24T06:16:33.750054+0000","last_fullsized":"2023-11-24T06:16:33.750054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.755407+0000","last_change":"2023-11-24T06:16:33.755407+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755407+0000","last_undegraded":"2023-11-24T06:16:33.755407+0000","last_fullsized":"2023-11-24T06:16:33.755407+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.750229+0000","last_change":"2023-11-24T06:16:33.750229+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750229+0000","last_undegraded":"2023-11-24T06:16:33.750229+0000","last_fullsized":"2023-11-24T06:16:33.750229+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:58.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184656+0000","last_change":"2023-11-24T06:16:34.781959+0000","last_active":"2023-11-24T06:16:36.184656+0000","last_peered":"2023-11-24T06:16:36.184656+0000","last_clean":"2023-11-24T06:16:36.184656+0000","last_became_active":"2023-11-24T06:16:34.781005+0000","last_became_peered":"2023-11-24T06:16:34.781005+0000","last_unstale":"2023-11-24T06:16:36.184656+0000","last_undegraded":"2023-11-24T06:16:36.184656+0000","last_fullsized":"2023-11-24T06:16:36.184656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:39.144025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.755340+0000","last_change":"2023-11-24T06:16:33.755340+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755340+0000","last_undegraded":"2023-11-24T06:16:33.755340+0000","last_fullsized":"2023-11-24T06:16:33.755340+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:16.548503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753232+0000","last_change":"2023-11-24T06:16:33.753232+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753232+0000","last_undegraded":"2023-11-24T06:16:33.753232+0000","last_fullsized":"2023-11-24T06:16:33.753232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.754464+0000","last_change":"2023-11-24T06:16:33.754464+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754464+0000","last_undegraded":"2023-11-24T06:16:33.754464+0000","last_fullsized":"2023-11-24T06:16:33.754464+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:21.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754403+0000","last_change":"2023-11-24T06:16:33.754403+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754403+0000","last_undegraded":"2023-11-24T06:16:33.754403+0000","last_fullsized":"2023-11-24T06:16:33.754403+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.773550+0000","last_change":"2023-11-24T06:16:33.770950+0000","last_active":"2023-11-24T06:16:34.773550+0000","last_peered":"2023-11-24T06:16:34.773550+0000","last_clean":"2023-11-24T06:16:34.773550+0000","last_became_active":"2023-11-24T06:16:33.770565+0000","last_became_peered":"2023-11-24T06:16:33.770565+0000","last_unstale":"2023-11-24T06:16:34.773550+0000","last_undegraded":"2023-11-24T06:16:34.773550+0000","last_fullsized":"2023-11-24T06:16:34.773550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754608+0000","last_change":"2023-11-24T06:16:33.754608+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754608+0000","last_undegraded":"2023-11-24T06:16:33.754608+0000","last_fullsized":"2023-11-24T06:16:33.754608+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.775128+0000","last_change":"2023-11-24T06:16:33.772396+0000","last_active":"2023-11-24T06:16:33.775128+0000","last_peered":"2023-11-24T06:16:33.775128+0000","last_clean":"2023-11-24T06:16:33.775128+0000","last_became_active":"2023-11-24T06:16:33.771826+0000","last_became_peered":"2023-11-24T06:16:33.771826+0000","last_unstale":"2023-11-24T06:16:33.775128+0000","last_undegraded":"2023-11-24T06:16:33.775128+0000","last_fullsized":"2023-11-24T06:16:33.775128+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:53.124439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754313+0000","last_change":"2023-11-24T06:16:33.754313+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754313+0000","last_undegraded":"2023-11-24T06:16:33.754313+0000","last_fullsized":"2023-11-24T06:16:33.754313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.753234+0000","last_change":"2023-11-24T06:16:33.753234+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753234+0000","last_undegraded":"2023-11-24T06:16:33.753234+0000","last_fullsized":"2023-11-24T06:16:33.753234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:54.046458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750440+0000","last_change":"2023-11-24T06:16:33.750440+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750440+0000","last_undegraded":"2023-11-24T06:16:33.750440+0000","last_fullsized":"2023-11-24T06:16:33.750440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761610+0000","last_change":"2023-11-24T06:16:33.770060+0000","last_active":"2023-11-24T06:16:34.761610+0000","last_peered":"2023-11-24T06:16:34.761610+0000","last_clean":"2023-11-24T06:16:34.761610+0000","last_became_active":"2023-11-24T06:16:33.769764+0000","last_became_peered":"2023-11-24T06:16:33.769764+0000","last_unstale":"2023-11-24T06:16:34.761610+0000","last_undegraded":"2023-11-24T06:16:34.761610+0000","last_fullsized":"2023-11-24T06:16:34.761610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749417+0000","last_change":"2023-11-24T06:16:33.749417+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749417+0000","last_undegraded":"2023-11-24T06:16:33.749417+0000","last_fullsized":"2023-11-24T06:16:33.749417+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.772916+0000","last_change":"2023-11-24T06:16:33.769378+0000","last_active":"2023-11-24T06:16:33.772916+0000","last_peered":"2023-11-24T06:16:33.772916+0000","last_clean":"2023-11-24T06:16:33.772916+0000","last_became_active":"2023-11-24T06:16:33.768768+0000","last_became_peered":"2023-11-24T06:16:33.768768+0000","last_unstale":"2023-11-24T06:16:33.772916+0000","last_undegraded":"2023-11-24T06:16:33.772916+0000","last_fullsized":"2023-11-24T06:16:33.772916+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:40.407859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750286+0000","last_change":"2023-11-24T06:16:33.750286+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750286+0000","last_undegraded":"2023-11-24T06:16:33.750286+0000","last_fullsized":"2023-11-24T06:16:33.750286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.773310+0000","last_change":"2023-11-24T06:16:33.770422+0000","last_active":"2023-11-24T06:16:33.773310+0000","last_peered":"2023-11-24T06:16:33.773310+0000","last_clean":"2023-11-24T06:16:33.773310+0000","last_became_active":"2023-11-24T06:16:33.769391+0000","last_became_peered":"2023-11-24T06:16:33.769391+0000","last_unstale":"2023-11-24T06:16:33.773310+0000","last_undegraded":"2023-11-24T06:16:33.773310+0000","last_fullsized":"2023-11-24T06:16:33.773310+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:26.932738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747335+0000","last_change":"2023-11-24T06:16:33.747335+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747335+0000","last_undegraded":"2023-11-24T06:16:33.747335+0000","last_fullsized":"2023-11-24T06:16:33.747335+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.754241+0000","last_change":"2023-11-24T06:16:33.754241+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754241+0000","last_undegraded":"2023-11-24T06:16:33.754241+0000","last_fullsized":"2023-11-24T06:16:33.754241+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:34.619640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186420+0000","last_change":"2023-11-24T06:16:34.776486+0000","last_active":"2023-11-24T06:16:36.186420+0000","last_peered":"2023-11-24T06:16:36.186420+0000","last_clean":"2023-11-24T06:16:36.186420+0000","last_became_active":"2023-11-24T06:16:34.776078+0000","last_became_peered":"2023-11-24T06:16:34.776078+0000","last_unstale":"2023-11-24T06:16:36.186420+0000","last_undegraded":"2023-11-24T06:16:36.186420+0000","last_fullsized":"2023-11-24T06:16:36.186420+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:28.810438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.760422+0000","last_change":"2023-11-24T06:16:33.760422+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.760422+0000","last_undegraded":"2023-11-24T06:16:33.760422+0000","last_fullsized":"2023-11-24T06:16:33.760422+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:34.797956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747572+0000","last_change":"2023-11-24T06:16:33.747572+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747572+0000","last_undegraded":"2023-11-24T06:16:33.747572+0000","last_fullsized":"2023-11-24T06:16:33.747572+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.770377+0000","last_change":"2023-11-24T06:16:33.766405+0000","last_active":"2023-11-24T06:16:33.770377+0000","last_peered":"2023-11-24T06:16:33.770377+0000","last_clean":"2023-11-24T06:16:33.770377+0000","last_became_active":"2023-11-24T06:16:33.765503+0000","last_became_peered":"2023-11-24T06:16:33.765503+0000","last_unstale":"2023-11-24T06:16:33.770377+0000","last_undegraded":"2023-11-24T06:16:33.770377+0000","last_fullsized":"2023-11-24T06:16:33.770377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:34.797956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.771695+0000","last_change":"2023-11-24T06:16:34.771695+0000","last_active":"2023-11-24T06:16:34.771695+0000","last_peered":"2023-11-24T06:16:34.771695+0000","last_clean":"2023-11-24T06:16:34.771695+0000","last_became_active":"2023-11-24T06:16:34.771339+0000","last_became_peered":"2023-11-24T06:16:34.771339+0000","last_unstale":"2023-11-24T06:16:34.771695+0000","last_undegraded":"2023-11-24T06:16:34.771695+0000","last_fullsized":"2023-11-24T06:16:34.771695+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:59.860064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.753835+0000","last_change":"2023-11-24T06:16:33.753835+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753835+0000","last_undegraded":"2023-11-24T06:16:33.753835+0000","last_fullsized":"2023-11-24T06:16:33.753835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:06.004527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.752270+0000","last_change":"2023-11-24T06:16:33.752270+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.752270+0000","last_undegraded":"2023-11-24T06:16:33.752270+0000","last_fullsized":"2023-11-24T06:16:33.752270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.764665+0000","last_change":"2023-11-24T06:16:33.761349+0000","last_active":"2023-11-24T06:16:33.764665+0000","last_peered":"2023-11-24T06:16:33.764665+0000","last_clean":"2023-11-24T06:16:33.764665+0000","last_became_active":"2023-11-24T06:16:33.759543+0000","last_became_peered":"2023-11-24T06:16:33.759543+0000","last_unstale":"2023-11-24T06:16:33.764665+0000","last_undegraded":"2023-11-24T06:16:33.764665+0000","last_fullsized":"2023-11-24T06:16:33.764665+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:53:43.094414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751113+0000","last_change":"2023-11-24T06:16:33.751113+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751113+0000","last_undegraded":"2023-11-24T06:16:33.751113+0000","last_fullsized":"2023-11-24T06:16:33.751113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761769+0000","last_change":"2023-11-24T06:16:33.771272+0000","last_active":"2023-11-24T06:16:34.761769+0000","last_peered":"2023-11-24T06:16:34.761769+0000","last_clean":"2023-11-24T06:16:34.761769+0000","last_became_active":"2023-11-24T06:16:33.770946+0000","last_became_peered":"2023-11-24T06:16:33.770946+0000","last_unstale":"2023-11-24T06:16:34.761769+0000","last_undegraded":"2023-11-24T06:16:34.761769+0000","last_fullsized":"2023-11-24T06:16:34.761769+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:51.682060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.747729+0000","last_change":"2023-11-24T06:16:33.747729+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.747729+0000","last_undegraded":"2023-11-24T06:16:33.747729+0000","last_fullsized":"2023-11-24T06:16:33.747729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.757741+0000","last_change":"2023-11-24T06:16:33.757741+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.757741+0000","last_undegraded":"2023-11-24T06:16:33.757741+0000","last_fullsized":"2023-11-24T06:16:33.757741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:40.407859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748700+0000","last_change":"2023-11-24T06:16:33.748700+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748700+0000","last_undegraded":"2023-11-24T06:16:33.748700+0000","last_fullsized":"2023-11-24T06:16:33.748700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.748950+0000","last_change":"2023-11-24T06:16:33.748950+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748950+0000","last_undegraded":"2023-11-24T06:16:33.748950+0000","last_fullsized":"2023-11-24T06:16:33.748950+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.774713+0000","last_change":"2023-11-24T06:16:34.774713+0000","last_active":"2023-11-24T06:16:34.774713+0000","last_peered":"2023-11-24T06:16:34.774713+0000","last_clean":"2023-11-24T06:16:34.774713+0000","last_became_active":"2023-11-24T06:16:34.774392+0000","last_became_peered":"2023-11-24T06:16:34.774392+0000","last_unstale":"2023-11-24T06:16:34.774713+0000","last_undegraded":"2023-11-24T06:16:34.774713+0000","last_fullsized":"2023-11-24T06:16:34.774713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:33.540046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.755186+0000","last_change":"2023-11-24T06:16:33.755186+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.755186+0000","last_undegraded":"2023-11-24T06:16:33.755186+0000","last_fullsized":"2023-11-24T06:16:33.755186+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:32.523748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.749159+0000","last_change":"2023-11-24T06:16:33.749159+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749159+0000","last_undegraded":"2023-11-24T06:16:33.749159+0000","last_fullsized":"2023-11-24T06:16:33.749159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.763814+0000","last_change":"2023-11-24T06:16:33.771457+0000","last_active":"2023-11-24T06:16:34.763814+0000","last_peered":"2023-11-24T06:16:34.763814+0000","last_clean":"2023-11-24T06:16:34.763814+0000","last_became_active":"2023-11-24T06:16:33.771077+0000","last_became_peered":"2023-11-24T06:16:33.771077+0000","last_unstale":"2023-11-24T06:16:34.763814+0000","last_undegraded":"2023-11-24T06:16:34.763814+0000","last_fullsized":"2023-11-24T06:16:34.763814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:16.548503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.746175+0000","last_change":"2023-11-24T06:16:33.746175+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.746175+0000","last_undegraded":"2023-11-24T06:16:33.746175+0000","last_fullsized":"2023-11-24T06:16:33.746175+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.752456+0000","last_change":"2023-11-24T06:16:33.752456+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.752456+0000","last_undegraded":"2023-11-24T06:16:33.752456+0000","last_fullsized":"2023-11-24T06:16:33.752456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:00.052499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.770022+0000","last_change":"2023-11-24T06:16:34.770022+0000","last_active":"2023-11-24T06:16:34.770022+0000","last_peered":"2023-11-24T06:16:34.770022+0000","last_clean":"2023-11-24T06:16:34.770022+0000","last_became_active":"2023-11-24T06:16:34.769722+0000","last_became_peered":"2023-11-24T06:16:34.769722+0000","last_unstale":"2023-11-24T06:16:34.770022+0000","last_undegraded":"2023-11-24T06:16:34.770022+0000","last_fullsized":"2023-11-24T06:16:34.770022+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:50:42.331133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.748262+0000","last_change":"2023-11-24T06:16:33.748262+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748262+0000","last_undegraded":"2023-11-24T06:16:33.748262+0000","last_fullsized":"2023-11-24T06:16:33.748262+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.754001+0000","last_change":"2023-11-24T06:16:33.754001+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754001+0000","last_undegraded":"2023-11-24T06:16:33.754001+0000","last_fullsized":"2023-11-24T06:16:33.754001+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.755961+0000","last_change":"2023-11-24T06:16:33.770996+0000","last_active":"2023-11-24T06:16:34.755961+0000","last_peered":"2023-11-24T06:16:34.755961+0000","last_clean":"2023-11-24T06:16:34.755961+0000","last_became_active":"2023-11-24T06:16:33.770413+0000","last_became_peered":"2023-11-24T06:16:33.770413+0000","last_unstale":"2023-11-24T06:16:34.755961+0000","last_undegraded":"2023-11-24T06:16:34.755961+0000","last_fullsized":"2023-11-24T06:16:34.755961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:29.010814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.750870+0000","last_change":"2023-11-24T06:16:33.750870+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.750870+0000","last_undegraded":"2023-11-24T06:16:33.750870+0000","last_fullsized":"2023-11-24T06:16:33.750870+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761830+0000","last_change":"2023-11-24T06:16:33.773444+0000","last_active":"2023-11-24T06:16:34.761830+0000","last_peered":"2023-11-24T06:16:34.761830+0000","last_clean":"2023-11-24T06:16:34.761830+0000","last_became_active":"2023-11-24T06:16:33.771977+0000","last_became_peered":"2023-11-24T06:16:33.771977+0000","last_unstale":"2023-11-24T06:16:34.761830+0000","last_undegraded":"2023-11-24T06:16:34.761830+0000","last_fullsized":"2023-11-24T06:16:34.761830+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:06.004527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-11-24T06:16:34.758470+0000","last_change":"2023-11-24T06:16:34.758470+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:34.758470+0000","last_undegraded":"2023-11-24T06:16:34.758470+0000","last_fullsized":"2023-11-24T06:16:34.758470+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:22.969912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.791301+0000","last_change":"2023-11-24T06:16:33.769724+0000","last_active":"2023-11-24T06:16:34.791301+0000","last_peered":"2023-11-24T06:16:34.791301+0000","last_clean":"2023-11-24T06:16:34.791301+0000","last_became_active":"2023-11-24T06:16:33.769461+0000","last_became_peered":"2023-11-24T06:16:33.769461+0000","last_unstale":"2023-11-24T06:16:34.791301+0000","last_undegraded":"2023-11-24T06:16:34.791301+0000","last_fullsized":"2023-11-24T06:16:34.791301+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:08.290535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.778377+0000","last_change":"2023-11-24T06:16:34.778377+0000","last_active":"2023-11-24T06:16:34.778377+0000","last_peered":"2023-11-24T06:16:34.778377+0000","last_clean":"2023-11-24T06:16:34.778377+0000","last_became_active":"2023-11-24T06:16:34.776011+0000","last_became_peered":"2023-11-24T06:16:34.776011+0000","last_unstale":"2023-11-24T06:16:34.778377+0000","last_undegraded":"2023-11-24T06:16:34.778377+0000","last_fullsized":"2023-11-24T06:16:34.778377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:42:27.391375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.754736+0000","last_change":"2023-11-24T06:16:33.754736+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.754736+0000","last_undegraded":"2023-11-24T06:16:33.754736+0000","last_fullsized":"2023-11-24T06:16:33.754736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:51.369211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186605+0000","last_change":"2023-11-24T06:16:34.774591+0000","last_active":"2023-11-24T06:16:36.186605+0000","last_peered":"2023-11-24T06:16:36.186605+0000","last_clean":"2023-11-24T06:16:36.186605+0000","last_became_active":"2023-11-24T06:16:34.774324+0000","last_became_peered":"2023-11-24T06:16:34.774324+0000","last_unstale":"2023-11-24T06:16:36.186605+0000","last_undegraded":"2023-11-24T06:16:36.186605+0000","last_fullsized":"2023-11-24T06:16:36.186605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:02.107927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.744890+0000","last_change":"2023-11-24T06:16:33.744890+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.744890+0000","last_undegraded":"2023-11-24T06:16:33.744890+0000","last_fullsized":"2023-11-24T06:16:33.744890+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:38:44.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.753969+0000","last_change":"2023-11-24T06:16:33.753969+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.753969+0000","last_undegraded":"2023-11-24T06:16:33.753969+0000","last_fullsized":"2023-11-24T06:16:33.753969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761865+0000","last_change":"2023-11-24T06:16:33.772084+0000","last_active":"2023-11-24T06:16:34.761865+0000","last_peered":"2023-11-24T06:16:34.761865+0000","last_clean":"2023-11-24T06:16:34.761865+0000","last_became_active":"2023-11-24T06:16:33.771790+0000","last_became_peered":"2023-11-24T06:16:33.771790+0000","last_unstale":"2023-11-24T06:16:34.761865+0000","last_undegraded":"2023-11-24T06:16:34.761865+0000","last_fullsized":"2023-11-24T06:16:34.761865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:34.619640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.751922+0000","last_change":"2023-11-24T06:16:33.751922+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.751922+0000","last_undegraded":"2023-11-24T06:16:33.751922+0000","last_fullsized":"2023-11-24T06:16:33.751922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.756153+0000","last_change":"2023-11-24T06:16:33.770432+0000","last_active":"2023-11-24T06:16:34.756153+0000","last_peered":"2023-11-24T06:16:34.756153+0000","last_clean":"2023-11-24T06:16:34.756153+0000","last_became_active":"2023-11-24T06:16:33.770152+0000","last_became_peered":"2023-11-24T06:16:33.770152+0000","last_unstale":"2023-11-24T06:16:34.756153+0000","last_undegraded":"2023-11-24T06:16:34.756153+0000","last_fullsized":"2023-11-24T06:16:34.756153+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:20.853464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.746006+0000","last_change":"2023-11-24T06:16:33.746006+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.746006+0000","last_undegraded":"2023-11-24T06:16:33.746006+0000","last_fullsized":"2023-11-24T06:16:33.746006+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T06:16:33.770483+0000","last_change":"2023-11-24T06:16:33.767805+0000","last_active":"2023-11-24T06:16:33.770483+0000","last_peered":"2023-11-24T06:16:33.770483+0000","last_clean":"2023-11-24T06:16:33.770483+0000","last_became_active":"2023-11-24T06:16:33.767215+0000","last_became_peered":"2023-11-24T06:16:33.767215+0000","last_unstale":"2023-11-24T06:16:33.770483+0000","last_undegraded":"2023-11-24T06:16:33.770483+0000","last_fullsized":"2023-11-24T06:16:33.770483+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:26.932738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.182462+0000","last_change":"2023-11-24T06:16:34.778394+0000","last_active":"2023-11-24T06:16:36.182462+0000","last_peered":"2023-11-24T06:16:36.182462+0000","last_clean":"2023-11-24T06:16:36.182462+0000","last_became_active":"2023-11-24T06:16:34.778241+0000","last_became_peered":"2023-11-24T06:16:34.778241+0000","last_unstale":"2023-11-24T06:16:36.182462+0000","last_undegraded":"2023-11-24T06:16:36.182462+0000","last_fullsized":"2023-11-24T06:16:36.182462+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:41.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.757051+0000","last_change":"2023-11-24T06:16:33.770982+0000","last_active":"2023-11-24T06:16:34.757051+0000","last_peered":"2023-11-24T06:16:34.757051+0000","last_clean":"2023-11-24T06:16:34.757051+0000","last_became_active":"2023-11-24T06:16:33.770635+0000","last_became_peered":"2023-11-24T06:16:33.770635+0000","last_unstale":"2023-11-24T06:16:34.757051+0000","last_undegraded":"2023-11-24T06:16:34.757051+0000","last_fullsized":"2023-11-24T06:16:34.757051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:06:46.387683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748237+0000","last_change":"2023-11-24T06:16:33.748237+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748237+0000","last_undegraded":"2023-11-24T06:16:33.748237+0000","last_fullsized":"2023-11-24T06:16:33.748237+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.749491+0000","last_change":"2023-11-24T06:16:33.749491+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.749491+0000","last_undegraded":"2023-11-24T06:16:33.749491+0000","last_fullsized":"2023-11-24T06:16:33.749491+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:51.682060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-11-24T06:16:33.748031+0000","last_change":"2023-11-24T06:16:33.748031+0000","last_active":"2023-11-24T06:16:33.723132+0000","last_peered":"2023-11-24T06:16:33.723132+0000","last_clean":"2023-11-24T06:16:33.723132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.748031+0000","last_undegraded":"2023-11-24T06:16:33.748031+0000","last_fullsized":"2023-11-24T06:16:33.748031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2023-11-24T06:16:33.743067+0000","last_change":"2023-11-24T06:16:33.743067+0000","last_active":"2023-11-24T06:16:32.706835+0000","last_peered":"2023-11-24T06:16:32.706835+0000","last_clean":"2023-11-24T06:16:32.706835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:33.743067+0000","last_undegraded":"2023-11-24T06:16:33.743067+0000","last_fullsized":"2023-11-24T06:16:33.743067+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:13.478706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":204,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-24T06:16:32.733433+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:16:32.733433+0000","last_peered":"2023-11-24T06:16:32.733433+0000","last_clean":"2023-11-24T06:16:32.733433+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:16:32.733433+0000","last_undegraded":"2023-11-24T06:16:32.733433+0000","last_fullsized":"2023-11-24T06:16:32.733433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":287897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.095,"15min":1.0589999999999999},"min":{"1min":0.85099999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.45,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.304,"5min":1.137,"15min":1.0589999999999999},"min":{"1min":0.71299999999999997,"5min":0.63,"15min":0.63},"max":{"1min":1.7549999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.599}]},{"osd":1,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1279999999999999,"15min":1.1140000000000001},"min":{"1min":0.82699999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6699999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.212},{"interface":"front","average":{"1min":1.26,"5min":1.1779999999999999,"15min":1.119},"min":{"1min":0.89600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7629999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.282}]},{"osd":2,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2090000000000001,"15min":1.1519999999999999},"min":{"1min":0.78200000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.736,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2909999999999999,"15min":1.339},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.732,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.339}]},{"osd":3,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.333,"15min":1.3109999999999999},"min":{"1min":0.90900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6830000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.367,"15min":1.345},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7869999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.659}]},{"osd":4,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.296},"min":{"1min":0.89600000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8879999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4390000000000001,"15min":1.357},"min":{"1min":0.97399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.794,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.6890000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5189999999999999,"15min":1.52},"min":{"1min":0.97999999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.861,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.494},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4810000000000001,"15min":1.4550000000000001},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.988,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.54}]},{"osd":7,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.591,"15min":1.5589999999999999},"min":{"1min":0.86799999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8899999999999999,"5min":3.262,"15min":3.262},"last":1.7989999999999999},{"interface":"front","average":{"1min":1.609,"5min":1.651,"15min":1.6830000000000001},"min":{"1min":1.169,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8480000000000001,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.762}]}]},{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":871998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.123,"15min":1.073},"min":{"1min":0.92400000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.603,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2,"15min":1.1539999999999999},"min":{"1min":0.82499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.528,"5min":1.72,"15min":1.72},"last":1.2190000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.84799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5840000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.306,"15min":1.2909999999999999},"min":{"1min":1.099,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7370000000000001,"5min":1.847,"15min":1.847},"last":0.755}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.238,"15min":1.21},"min":{"1min":0.81000000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.718,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.377,"5min":1.2949999999999999,"15min":1.2989999999999999},"min":{"1min":0.97899999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8200000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3220000000000001,"15min":1.327},"min":{"1min":1.073,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.716,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.373,"15min":1.371},"min":{"1min":0.98499999999999999,"5min":0.745,"15min":0.745},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.302}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.85999999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7709999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.569},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4570000000000001,"15min":1.425},"min":{"1min":0.96899999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8799999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.633}]},{"osd":5,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.5489999999999999,"15min":1.532},"min":{"1min":1.214,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0550000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.49},{"interface":"front","average":{"1min":1.766,"5min":1.7,"15min":1.6739999999999999},"min":{"1min":1.528,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.4780000000000002,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.7709999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.466,"15min":1.5},"min":{"1min":0.98999999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2,"5min":2.5,"15min":2.5},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.8029999999999999,"5min":1.7649999999999999,"15min":1.7410000000000001},"min":{"1min":1.377,"5min":0.875,"15min":0.875},"max":{"1min":2.6040000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.8320000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.755,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.613}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.137,"15min":1.2190000000000001},"min":{"1min":0.69799999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.579,"5min":1.619,"15min":1.619},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.329,"5min":1.2689999999999999,"15min":1.258},"min":{"1min":0.90500000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.625,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.252}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.325,"15min":1.323},"min":{"1min":0.88200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9630000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.401,"15min":1.4690000000000001},"min":{"1min":1.208,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7490000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.085}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":1.141,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.913,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.149},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.4690000000000001},"min":{"1min":0.94099999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.75,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.6619999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4339999999999999,"15min":1.482},"min":{"1min":1.0209999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.653,"5min":2.258,"15min":2.258},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.45,"15min":1.534},"min":{"1min":1.1739999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.8759999999999999,"5min":2.105,"15min":2.105},"last":1.5609999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.5649999999999999},"min":{"1min":0.85799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0379999999999998,"5min":2.319,"15min":2.319},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.619,"15min":1.655},"min":{"1min":1.268,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.899}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.665,"15min":1.6930000000000001},"min":{"1min":1.288,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.1440000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.718,"5min":1.734,"15min":1.7809999999999999},"min":{"1min":1.379,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0670000000000002,"5min":2.669,"15min":2.669},"last":1.7929999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.071,"15min":1.071},"min":{"1min":0.80400000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5940000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.0820000000000001,"15min":1.085},"min":{"1min":0.755,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.71099999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.266,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.2390000000000001,"15min":1.286},"min":{"1min":0.94699999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6259999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.214}]},{"osd":2,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.226,"15min":1.1950000000000001},"min":{"1min":0.97299999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.667,"5min":2.04,"15min":2.04},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.371,"15min":1.409},"min":{"1min":0.89800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.738,"5min":2.016,"15min":2.016},"last":1.2749999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5169999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.325,"15min":1.3520000000000001},"min":{"1min":0.997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8260000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.575}]},{"osd":5,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.369,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.7170000000000001,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.018},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.454,"15min":1.53},"min":{"1min":0.999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8620000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4339999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5269999999999999,"15min":1.579},"min":{"1min":1.103,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9259999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.5229999999999999,"15min":1.613},"min":{"1min":1.0549999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9370000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.51}]},{"osd":7,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.47,"15min":1.552},"min":{"1min":0.97499999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8029999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.704},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.657,"15min":1.7110000000000001},"min":{"1min":1.1659999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0339999999999998,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.7669999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83999999999999997,"15min":0.87},"min":{"1min":0.66000000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3480000000000001,"5min":1.607,"15min":1.607},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.42399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.4370000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.92800000000000005,"15min":0.91700000000000004},"min":{"1min":0.51800000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4910000000000001,"5min":1.796,"15min":1.796},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.1399999999999999,"15min":1.145},"min":{"1min":0.53600000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.7410000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.083,"15min":1.0589999999999999},"min":{"1min":0.71799999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.661,"5min":1.835,"15min":1.835},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.1519999999999999,"15min":1.1279999999999999},"min":{"1min":0.753,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7130000000000001,"5min":2.399,"15min":2.399},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3129999999999999,"15min":1.321},"min":{"1min":0.91500000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.944,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3080000000000001,"15min":1.2829999999999999},"min":{"1min":1.115,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.877,"5min":2.141,"15min":2.141},"last":1.3799999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.351,"15min":1.333},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.742,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.3799999999999999,"15min":1.397},"min":{"1min":1.0009999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.847,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.4059999999999999,"15min":1.3660000000000001},"min":{"1min":0.95299999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.974,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.603},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3540000000000001,"15min":1.3340000000000001},"min":{"1min":1.0009999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9570000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.069}]},{"osd":7,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.417,"15min":1.427},"min":{"1min":0.94499999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1379999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1.1439999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0379999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.099}]}]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":281630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85099999999999998,"15min":0.877},"min":{"1min":0.66800000000000004,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.399,"5min":2.552,"15min":2.552},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.93999999999999995,"15min":0.96399999999999997},"min":{"1min":0.78600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5640000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.81000000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.1850000000000001,"15min":1.141},"min":{"1min":1.01,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6990000000000001,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.125,"15min":1.129},"min":{"1min":0.90800000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6240000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.0009999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.175,"15min":1.169},"min":{"1min":0.97299999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.8220000000000001,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.98899999999999999,"15min":0.96899999999999997},"min":{"1min":0.59399999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.714,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3109999999999999,"15min":1.331},"min":{"1min":1.006,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.7909999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.373},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.486,"15min":1.502},"min":{"1min":1.327,"5min":0.755,"15min":0.755},"max":{"1min":2.0590000000000002,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.113}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.28,"15min":1.236},"min":{"1min":1.0620000000000001,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7370000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.413,"15min":1.4370000000000001},"min":{"1min":1.1419999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.7509999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.5740000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.405,"15min":1.405},"min":{"1min":1.159,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7669999999999999,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.522,"15min":1.556},"min":{"1min":1.0860000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8859999999999999,"5min":4.101,"15min":4.101},"last":1.524}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.5089999999999999,"15min":1.5069999999999999},"min":{"1min":1.23,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9179999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.496},{"interface":"front","average":{"1min":1.637,"5min":1.492,"15min":1.4970000000000001},"min":{"1min":1.2969999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2029999999999998,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.615}]}]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":871998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84999999999999998,"15min":0.83899999999999997},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.708,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.165,"5min":1.0089999999999999,"15min":0.97699999999999998},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.6819999999999999,"5min":2.161,"15min":2.161},"last":1.3049999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2649999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.742},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8420000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.88}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1439999999999999,"15min":1.2},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.7709999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8440000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.246}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.3600000000000001,"15min":1.3080000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8180000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3939999999999999},"min":{"1min":0.98799999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.659,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.6659999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:58 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.90600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.742,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":1.506},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2969999999999999,"15min":1.2509999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3779999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4470000000000001,"15min":1.4410000000000001},"min":{"1min":1.0980000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.994,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.8460000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.385,"15min":1.343},"min":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.8979999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.4630000000000001,"15min":1.4390000000000001},"min":{"1min":0.93000000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2050000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.212,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.891,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.95}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":301062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.94499999999999995},"min":{"1min":0.47499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4279999999999999,"5min":1.571,"15min":1.571},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.024,"15min":1.028},"min":{"1min":0.72099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5620000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.121}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.69099999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.097,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.123,"5min":1.1639999999999999,"15min":1.226},"min":{"1min":0.60999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.538,"5min":2.964,"15min":2.964},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.347,"15min":1.373},"min":{"1min":0.875,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.659,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.294,"15min":1.3240000000000001},"min":{"1min":0.84799999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.71,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.2270000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3480000000000001,"15min":1.3340000000000001},"min":{"1min":0.89100000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7170000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.464,"15min":1.55},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7410000000000001,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.708}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.462},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.784,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.294},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.466,"15min":1.472},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.621,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.472,"15min":1.538},"min":{"1min":0.91800000000000004,"5min":0.87,"15min":0.87},"max":{"1min":2.1499999999999999,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.536},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.55,"15min":1.548},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.704,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":1.504}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5620000000000001,"15min":1.615},"min":{"1min":1.0269999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.708,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.605},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.639,"15min":1.671},"min":{"1min":1.044,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.2679999999999998,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.6539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:40.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-11-24T06:16:40.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:16:33.723132+0000', 'last_change': '2023-11-24T06:16:33.723132+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.723132+0000', 'last_undegraded': '2023-11-24T06:16:33.723132+0000', 'last_fullsized': '2023-11-24T06:16:33.723132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:16:40.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-11-24T06:16:40.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.755217+0000', 'last_change': '2023-11-24T06:16:33.755217+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.755217+0000', 'last_undegraded': '2023-11-24T06:16:33.755217+0000', 'last_fullsized': '2023-11-24T06:16:33.755217+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-11-24T06:16:40.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.748693+0000', 'last_change': '2023-11-24T06:16:33.748693+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.748693+0000', 'last_undegraded': '2023-11-24T06:16:33.748693+0000', 'last_fullsized': '2023-11-24T06:16:33.748693+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-11-24T06:16:40.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 60, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:34.757677+0000', 'last_change': '2023-11-24T06:16:34.757677+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:34.757677+0000', 'last_undegraded': '2023-11-24T06:16:34.757677+0000', 'last_fullsized': '2023-11-24T06:16:34.757677+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T09:49:55.062755+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:40.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-11-24T06:16:40.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:16:33.723132+0000', 'last_change': '2023-11-24T06:16:33.723132+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.723132+0000', 'last_undegraded': '2023-11-24T06:16:33.723132+0000', 'last_fullsized': '2023-11-24T06:16:33.723132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:16:40.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.753321+0000', 'last_change': '2023-11-24T06:16:33.753321+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.753321+0000', 'last_undegraded': '2023-11-24T06:16:33.753321+0000', 'last_fullsized': '2023-11-24T06:16:33.753321+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.751392+0000', 'last_change': '2023-11-24T06:16:33.751392+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.751392+0000', 'last_undegraded': '2023-11-24T06:16:33.751392+0000', 'last_fullsized': '2023-11-24T06:16:33.751392+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.748600+0000', 'last_change': '2023-11-24T06:16:33.748600+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.748600+0000', 'last_undegraded': '2023-11-24T06:16:33.748600+0000', 'last_fullsized': '2023-11-24T06:16:33.748600+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.755904+0000', 'last_change': '2023-11-24T06:16:33.755904+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.755904+0000', 'last_undegraded': '2023-11-24T06:16:33.755904+0000', 'last_fullsized': '2023-11-24T06:16:33.755904+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.754269+0000', 'last_change': '2023-11-24T06:16:33.754269+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.754269+0000', 'last_undegraded': '2023-11-24T06:16:33.754269+0000', 'last_fullsized': '2023-11-24T06:16:33.754269+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-24T06:16:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.755288+0000', 'last_change': '2023-11-24T06:16:33.755288+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.755288+0000', 'last_undegraded': '2023-11-24T06:16:33.755288+0000', 'last_fullsized': '2023-11-24T06:16:33.755288+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.749954+0000', 'last_change': '2023-11-24T06:16:33.749954+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.749954+0000', 'last_undegraded': '2023-11-24T06:16:33.749954+0000', 'last_fullsized': '2023-11-24T06:16:33.749954+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.750778+0000', 'last_change': '2023-11-24T06:16:33.750778+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.750778+0000', 'last_undegraded': '2023-11-24T06:16:33.750778+0000', 'last_fullsized': '2023-11-24T06:16:33.750778+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.749569+0000', 'last_change': '2023-11-24T06:16:33.749569+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.749569+0000', 'last_undegraded': '2023-11-24T06:16:33.749569+0000', 'last_fullsized': '2023-11-24T06:16:33.749569+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.749861+0000', 'last_change': '2023-11-24T06:16:33.749861+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.749861+0000', 'last_undegraded': '2023-11-24T06:16:33.749861+0000', 'last_fullsized': '2023-11-24T06:16:33.749861+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-11-24T06:16:40.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:16:33.723132+0000', 'last_change': '2023-11-24T06:16:33.723132+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.723132+0000', 'last_undegraded': '2023-11-24T06:16:33.723132+0000', 'last_fullsized': '2023-11-24T06:16:33.723132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.750123+0000', 'last_change': '2023-11-24T06:16:33.750123+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.750123+0000', 'last_undegraded': '2023-11-24T06:16:33.750123+0000', 'last_fullsized': '2023-11-24T06:16:33.750123+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.753167+0000', 'last_change': '2023-11-24T06:16:33.753167+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.753167+0000', 'last_undegraded': '2023-11-24T06:16:33.753167+0000', 'last_fullsized': '2023-11-24T06:16:33.753167+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.755115+0000', 'last_change': '2023-11-24T06:16:33.755115+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.755115+0000', 'last_undegraded': '2023-11-24T06:16:33.755115+0000', 'last_fullsized': '2023-11-24T06:16:33.755115+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.751842+0000', 'last_change': '2023-11-24T06:16:33.751842+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.751842+0000', 'last_undegraded': '2023-11-24T06:16:33.751842+0000', 'last_fullsized': '2023-11-24T06:16:33.751842+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-11-24T06:16:40.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.751586+0000', 'last_change': '2023-11-24T06:16:33.751586+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.751586+0000', 'last_undegraded': '2023-11-24T06:16:33.751586+0000', 'last_fullsized': '2023-11-24T06:16:33.751586+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:16:33.723132+0000', 'last_change': '2023-11-24T06:16:33.723132+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.723132+0000', 'last_undegraded': '2023-11-24T06:16:33.723132+0000', 'last_fullsized': '2023-11-24T06:16:33.723132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.754884+0000', 'last_change': '2023-11-24T06:16:33.754884+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.754884+0000', 'last_undegraded': '2023-11-24T06:16:33.754884+0000', 'last_fullsized': '2023-11-24T06:16:33.754884+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:16:33.723132+0000', 'last_change': '2023-11-24T06:16:33.723132+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.723132+0000', 'last_undegraded': '2023-11-24T06:16:33.723132+0000', 'last_fullsized': '2023-11-24T06:16:33.723132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.752445+0000', 'last_change': '2023-11-24T06:16:33.752445+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.752445+0000', 'last_undegraded': '2023-11-24T06:16:33.752445+0000', 'last_fullsized': '2023-11-24T06:16:33.752445+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-11-24T06:16:40.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.747147+0000', 'last_change': '2023-11-24T06:16:33.747147+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.747147+0000', 'last_undegraded': '2023-11-24T06:16:33.747147+0000', 'last_fullsized': '2023-11-24T06:16:33.747147+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-24T06:16:33.723132+0000', 'last_change': '2023-11-24T06:16:33.723132+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.723132+0000', 'last_undegraded': '2023-11-24T06:16:33.723132+0000', 'last_fullsized': '2023-11-24T06:16:33.723132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.750054+0000', 'last_change': '2023-11-24T06:16:33.750054+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.750054+0000', 'last_undegraded': '2023-11-24T06:16:33.750054+0000', 'last_fullsized': '2023-11-24T06:16:33.750054+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.755407+0000', 'last_change': '2023-11-24T06:16:33.755407+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.755407+0000', 'last_undegraded': '2023-11-24T06:16:33.755407+0000', 'last_fullsized': '2023-11-24T06:16:33.755407+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.750229+0000', 'last_change': '2023-11-24T06:16:33.750229+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.750229+0000', 'last_undegraded': '2023-11-24T06:16:33.750229+0000', 'last_fullsized': '2023-11-24T06:16:33.750229+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T10:37:58.843767+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-11-24T06:16:40.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.755340+0000', 'last_change': '2023-11-24T06:16:33.755340+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.755340+0000', 'last_undegraded': '2023-11-24T06:16:33.755340+0000', 'last_fullsized': '2023-11-24T06:16:33.755340+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T07:07:16.548503+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.753232+0000', 'last_change': '2023-11-24T06:16:33.753232+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.753232+0000', 'last_undegraded': '2023-11-24T06:16:33.753232+0000', 'last_fullsized': '2023-11-24T06:16:33.753232+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.754464+0000', 'last_change': '2023-11-24T06:16:33.754464+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.754464+0000', 'last_undegraded': '2023-11-24T06:16:33.754464+0000', 'last_fullsized': '2023-11-24T06:16:33.754464+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T09:37:21.953615+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.754403+0000', 'last_change': '2023-11-24T06:16:33.754403+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.754403+0000', 'last_undegraded': '2023-11-24T06:16:33.754403+0000', 'last_fullsized': '2023-11-24T06:16:33.754403+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.754608+0000', 'last_change': '2023-11-24T06:16:33.754608+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.754608+0000', 'last_undegraded': '2023-11-24T06:16:33.754608+0000', 'last_fullsized': '2023-11-24T06:16:33.754608+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-11-24T06:16:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.754313+0000', 'last_change': '2023-11-24T06:16:33.754313+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.754313+0000', 'last_undegraded': '2023-11-24T06:16:33.754313+0000', 'last_fullsized': '2023-11-24T06:16:33.754313+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.753234+0000', 'last_change': '2023-11-24T06:16:33.753234+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.753234+0000', 'last_undegraded': '2023-11-24T06:16:33.753234+0000', 'last_fullsized': '2023-11-24T06:16:33.753234+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T09:49:54.046458+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.750440+0000', 'last_change': '2023-11-24T06:16:33.750440+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.750440+0000', 'last_undegraded': '2023-11-24T06:16:33.750440+0000', 'last_fullsized': '2023-11-24T06:16:33.750440+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.749417+0000', 'last_change': '2023-11-24T06:16:33.749417+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.749417+0000', 'last_undegraded': '2023-11-24T06:16:33.749417+0000', 'last_fullsized': '2023-11-24T06:16:33.749417+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.750286+0000', 'last_change': '2023-11-24T06:16:33.750286+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.750286+0000', 'last_undegraded': '2023-11-24T06:16:33.750286+0000', 'last_fullsized': '2023-11-24T06:16:33.750286+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.747335+0000', 'last_change': '2023-11-24T06:16:33.747335+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.747335+0000', 'last_undegraded': '2023-11-24T06:16:33.747335+0000', 'last_fullsized': '2023-11-24T06:16:33.747335+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.754241+0000', 'last_change': '2023-11-24T06:16:33.754241+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.754241+0000', 'last_undegraded': '2023-11-24T06:16:33.754241+0000', 'last_fullsized': '2023-11-24T06:16:33.754241+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T14:06:34.619640+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.760422+0000', 'last_change': '2023-11-24T06:16:33.760422+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.760422+0000', 'last_undegraded': '2023-11-24T06:16:33.760422+0000', 'last_fullsized': '2023-11-24T06:16:33.760422+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T11:21:34.797956+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.747572+0000', 'last_change': '2023-11-24T06:16:33.747572+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.747572+0000', 'last_undegraded': '2023-11-24T06:16:33.747572+0000', 'last_fullsized': '2023-11-24T06:16:33.747572+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.753835+0000', 'last_change': '2023-11-24T06:16:33.753835+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.753835+0000', 'last_undegraded': '2023-11-24T06:16:33.753835+0000', 'last_fullsized': '2023-11-24T06:16:33.753835+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T09:51:06.004527+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.752270+0000', 'last_change': '2023-11-24T06:16:33.752270+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.752270+0000', 'last_undegraded': '2023-11-24T06:16:33.752270+0000', 'last_fullsized': '2023-11-24T06:16:33.752270+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-11-24T06:16:40.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.751113+0000', 'last_change': '2023-11-24T06:16:33.751113+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.751113+0000', 'last_undegraded': '2023-11-24T06:16:33.751113+0000', 'last_fullsized': '2023-11-24T06:16:33.751113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.747729+0000', 'last_change': '2023-11-24T06:16:33.747729+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.747729+0000', 'last_undegraded': '2023-11-24T06:16:33.747729+0000', 'last_fullsized': '2023-11-24T06:16:33.747729+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.757741+0000', 'last_change': '2023-11-24T06:16:33.757741+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.757741+0000', 'last_undegraded': '2023-11-24T06:16:33.757741+0000', 'last_fullsized': '2023-11-24T06:16:33.757741+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T16:51:40.407859+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.748700+0000', 'last_change': '2023-11-24T06:16:33.748700+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.748700+0000', 'last_undegraded': '2023-11-24T06:16:33.748700+0000', 'last_fullsized': '2023-11-24T06:16:33.748700+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.748950+0000', 'last_change': '2023-11-24T06:16:33.748950+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.748950+0000', 'last_undegraded': '2023-11-24T06:16:33.748950+0000', 'last_fullsized': '2023-11-24T06:16:33.748950+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-11-24T06:16:40.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.755186+0000', 'last_change': '2023-11-24T06:16:33.755186+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.755186+0000', 'last_undegraded': '2023-11-24T06:16:33.755186+0000', 'last_fullsized': '2023-11-24T06:16:33.755186+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T13:51:32.523748+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.749159+0000', 'last_change': '2023-11-24T06:16:33.749159+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.749159+0000', 'last_undegraded': '2023-11-24T06:16:33.749159+0000', 'last_fullsized': '2023-11-24T06:16:33.749159+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.746175+0000', 'last_change': '2023-11-24T06:16:33.746175+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.746175+0000', 'last_undegraded': '2023-11-24T06:16:33.746175+0000', 'last_fullsized': '2023-11-24T06:16:33.746175+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.752456+0000', 'last_change': '2023-11-24T06:16:33.752456+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.752456+0000', 'last_undegraded': '2023-11-24T06:16:33.752456+0000', 'last_fullsized': '2023-11-24T06:16:33.752456+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T15:42:00.052499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.748262+0000', 'last_change': '2023-11-24T06:16:33.748262+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.748262+0000', 'last_undegraded': '2023-11-24T06:16:33.748262+0000', 'last_fullsized': '2023-11-24T06:16:33.748262+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-11-24T06:16:40.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.754001+0000', 'last_change': '2023-11-24T06:16:33.754001+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.754001+0000', 'last_undegraded': '2023-11-24T06:16:33.754001+0000', 'last_fullsized': '2023-11-24T06:16:33.754001+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-11-24T06:16:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.750870+0000', 'last_change': '2023-11-24T06:16:33.750870+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.750870+0000', 'last_undegraded': '2023-11-24T06:16:33.750870+0000', 'last_fullsized': '2023-11-24T06:16:33.750870+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-11-24T06:16:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 60, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:34.758470+0000', 'last_change': '2023-11-24T06:16:34.758470+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:34.758470+0000', 'last_undegraded': '2023-11-24T06:16:34.758470+0000', 'last_fullsized': '2023-11-24T06:16:34.758470+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T09:37:22.969912+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-11-24T06:16:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.754736+0000', 'last_change': '2023-11-24T06:16:33.754736+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.754736+0000', 'last_undegraded': '2023-11-24T06:16:33.754736+0000', 'last_fullsized': '2023-11-24T06:16:33.754736+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T15:50:51.369211+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-11-24T06:16:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.744890+0000', 'last_change': '2023-11-24T06:16:33.744890+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.744890+0000', 'last_undegraded': '2023-11-24T06:16:33.744890+0000', 'last_fullsized': '2023-11-24T06:16:33.744890+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T07:38:44.941420+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-24T06:16:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.753969+0000', 'last_change': '2023-11-24T06:16:33.753969+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.753969+0000', 'last_undegraded': '2023-11-24T06:16:33.753969+0000', 'last_fullsized': '2023-11-24T06:16:33.753969+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.751922+0000', 'last_change': '2023-11-24T06:16:33.751922+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.751922+0000', 'last_undegraded': '2023-11-24T06:16:33.751922+0000', 'last_fullsized': '2023-11-24T06:16:33.751922+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.746006+0000', 'last_change': '2023-11-24T06:16:33.746006+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.746006+0000', 'last_undegraded': '2023-11-24T06:16:33.746006+0000', 'last_fullsized': '2023-11-24T06:16:33.746006+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.748237+0000', 'last_change': '2023-11-24T06:16:33.748237+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.748237+0000', 'last_undegraded': '2023-11-24T06:16:33.748237+0000', 'last_fullsized': '2023-11-24T06:16:33.748237+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.749491+0000', 'last_change': '2023-11-24T06:16:33.749491+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.749491+0000', 'last_undegraded': '2023-11-24T06:16:33.749491+0000', 'last_fullsized': '2023-11-24T06:16:33.749491+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T07:15:51.682060+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': ['3', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-11-24T06:16:40.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:33.748031+0000', 'last_change': '2023-11-24T06:16:33.748031+0000', 'last_active': '2023-11-24T06:16:33.723132+0000', 'last_peered': '2023-11-24T06:16:33.723132+0000', 'last_clean': '2023-11-24T06:16:33.723132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.748031+0000', 'last_undegraded': '2023-11-24T06:16:33.748031+0000', 'last_fullsized': '2023-11-24T06:16:33.748031+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:33.723132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:40.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-11-24T06:16:40.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 59, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:33.743067+0000', 'last_change': '2023-11-24T06:16:33.743067+0000', 'last_active': '2023-11-24T06:16:32.706835+0000', 'last_peered': '2023-11-24T06:16:32.706835+0000', 'last_clean': '2023-11-24T06:16:32.706835+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:33.743067+0000', 'last_undegraded': '2023-11-24T06:16:33.743067+0000', 'last_fullsized': '2023-11-24T06:16:33.743067+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:32.706835+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T06:47:13.478706+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': ['6', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-24T06:16:40.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-24T06:16:40.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.565+0000 7f0e41a78640 1 Processor -- start 2023-11-24T06:16:40.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.565+0000 7f0e41a78640 1 -- start start 2023-11-24T06:16:40.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.567+0000 7f0e41a78640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e3c143570 0x7f0e3c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.567+0000 7f0e41a78640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c071700 con 0x7f0e3c143950 2023-11-24T06:16:40.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.567+0000 7f0e41a78640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c15b410 con 0x7f0e3c15e6b0 2023-11-24T06:16:40.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.567+0000 7f0e41a78640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c15b130 con 0x7f0e3c143570 2023-11-24T06:16:40.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.568+0000 7f0e3bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0e3c143950 0x7f0e3c15a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38304/0 (socket says 172.21.15.22:38304) 2023-11-24T06:16:40.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.568+0000 7f0e3bfff640 1 -- 172.21.15.22:0/492079383 learned_addr learned my addr 172.21.15.22:0/492079383 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:40.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.568+0000 7f0e40a76640 1 --2- 172.21.15.22:0/492079383 >> v2:172.21.15.31:3300/0 conn(0x7f0e3c143570 0x7f0e3c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.568+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868672364 0 0) 0x7f0e28001110 con 0x7f0e3c143950 2023-11-24T06:16:40.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.568+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e2c003520 con 0x7f0e3c143950 2023-11-24T06:16:40.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.568+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 846486372 0 0) 0x7f0e2c003520 con 0x7f0e3c143950 2023-11-24T06:16:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.568+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 >> v2:172.21.15.31:3300/0 conn(0x7f0e3c143570 msgr2=0x7f0e3c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.568+0000 7f0e3b7fe640 1 --2- 172.21.15.22:0/492079383 >> v2:172.21.15.31:3300/0 conn(0x7f0e3c143570 0x7f0e3c0cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.568+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 >> v1:172.21.15.31:6789/0 conn(0x7f0e3c15e6b0 legacy=0x7f0e3c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c15dbd0 con 0x7f0e3c143950 2023-11-24T06:16:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f0e28001800 con 0x7f0e3c143950 2023-11-24T06:16:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 >> v1:172.21.15.22:6789/0 conn(0x7f0e3c143950 legacy=0x7f0e3c15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3b7fe640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e2c0039e0 0x7f0e2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3b7fe640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2c0047c0 0x7f0e2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3b7fe640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e2c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c15b130 con 0x7f0e2c0051f0 2023-11-24T06:16:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c00c150 con 0x7f0e2c0039e0 2023-11-24T06:16:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c00c310 con 0x7f0e2c0047c0 2023-11-24T06:16:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e41277640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e2c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e3bfff640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2c0047c0 0x7f0e2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e41277640 1 -- 172.21.15.22:0/492079383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2c0047c0 msgr2=0x7f0e2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:40.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e40a76640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e2c0039e0 0x7f0e2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e41277640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e2c0047c0 0x7f0e2c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.569+0000 7f0e41277640 1 -- 172.21.15.22:0/492079383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e2c0039e0 msgr2=0x7f0e2c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:40.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.570+0000 7f0e41277640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e2c0039e0 0x7f0e2c003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.570+0000 7f0e41277640 1 -- 172.21.15.22:0/492079383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c003520 con 0x7f0e2c0051f0 2023-11-24T06:16:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.570+0000 7f0e41277640 1 -- 172.21.15.22:0/492079383 reap_dead start 2023-11-24T06:16:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.571+0000 7f0e41277640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e2c00b980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0e34001e50 tx=0x7f0e2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7d6d08ab0ee78b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.571+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34003b70 con 0x7f0e2c0051f0 2023-11-24T06:16:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.571+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e34003cf0 con 0x7f0e2c0051f0 2023-11-24T06:16:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.571+0000 7f0e3b7fe640 1 -- 172.21.15.22:0/492079383 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34005310 con 0x7f0e2c0051f0 2023-11-24T06:16:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.571+0000 7f0e41a78640 1 -- 172.21.15.22:0/492079383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 msgr2=0x7f0e2c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.571+0000 7f0e41a78640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e2c00b980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0e34001e50 tx=0x7f0e2c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.572+0000 7f0e41a78640 1 -- 172.21.15.22:0/492079383 shutdown_connections 2023-11-24T06:16:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.572+0000 7f0e41a78640 1 --2- 172.21.15.22:0/492079383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e2c00b980 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.572+0000 7f0e41a78640 1 -- 172.21.15.22:0/492079383 >> 172.21.15.22:0/492079383 conn(0x7f0e3c06a860 msgr2=0x7f0e3c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.572+0000 7f0e41a78640 1 -- 172.21.15.22:0/492079383 shutdown_connections 2023-11-24T06:16:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.572+0000 7f0e41a78640 1 -- 172.21.15.22:0/492079383 wait complete. 2023-11-24T06:16:40.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.573+0000 7f0e41a78640 1 Processor -- start 2023-11-24T06:16:40.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.574+0000 7f0e41a78640 1 -- start start 2023-11-24T06:16:40.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.574+0000 7f0e41a78640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e3c148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.574+0000 7f0e41a78640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3c13f8e0 0x7f0e3c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.574+0000 7f0e41a78640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3c1482f0 0x7f0e3c148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.574+0000 7f0e41a78640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c13d610 con 0x7f0e2c0051f0 2023-11-24T06:16:40.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.574+0000 7f0e41a78640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1e38c0 con 0x7f0e3c1482f0 2023-11-24T06:16:40.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.574+0000 7f0e41a78640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c13fd60 con 0x7f0e3c13f8e0 2023-11-24T06:16:40.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.575+0000 7f0e40a76640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e3c148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.575+0000 7f0e40a76640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e3c148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46488/0 (socket says 172.21.15.22:46488) 2023-11-24T06:16:40.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.575+0000 7f0e40a76640 1 -- 172.21.15.22:0/4159246882 learned_addr learned my addr 172.21.15.22:0/4159246882 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:40.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.575+0000 7f0e40a76640 1 -- 172.21.15.22:0/4159246882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3c13f8e0 msgr2=0x7f0e3c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.575+0000 7f0e40a76640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3c13f8e0 0x7f0e3c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.575+0000 7f0e40a76640 1 -- 172.21.15.22:0/4159246882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3c1482f0 msgr2=0x7f0e3c148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.575+0000 7f0e40a76640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3c1482f0 0x7f0e3c148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.575+0000 7f0e40a76640 1 -- 172.21.15.22:0/4159246882 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c148cc0 con 0x7f0e2c0051f0 2023-11-24T06:16:40.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.575+0000 7f0e40a76640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e3c148f30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0e30010860 tx=0x7f0e30010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:40.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.576+0000 7f0e397fa640 1 -- 172.21.15.22:0/4159246882 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30009610 con 0x7f0e2c0051f0 2023-11-24T06:16:40.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.576+0000 7f0e397fa640 1 -- 172.21.15.22:0/4159246882 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000eb60 con 0x7f0e2c0051f0 2023-11-24T06:16:40.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.576+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c139250 con 0x7f0e2c0051f0 2023-11-24T06:16:40.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.576+0000 7f0e397fa640 1 -- 172.21.15.22:0/4159246882 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3001c400 con 0x7f0e2c0051f0 2023-11-24T06:16:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.576+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c1e3df0 con 0x7f0e2c0051f0 2023-11-24T06:16:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.577+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c04e840 con 0x7f0e2c0051f0 2023-11-24T06:16:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.578+0000 7f0e397fa640 1 -- 172.21.15.22:0/4159246882 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0e3001c560 con 0x7f0e2c0051f0 2023-11-24T06:16:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.579+0000 7f0e397fa640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0e2006aff0 0x7f0e2006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.579+0000 7f0e397fa640 1 -- 172.21.15.22:0/4159246882 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e30089f40 con 0x7f0e2c0051f0 2023-11-24T06:16:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.580+0000 7f0e3bfff640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0e2006aff0 0x7f0e2006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.580+0000 7f0e3bfff640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0e2006aff0 0x7f0e2006d4b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0e28001eb0 tx=0x7f0e28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.584+0000 7f0e397fa640 1 -- 172.21.15.22:0/4159246882 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0e30054dc0 con 0x7f0e2c0051f0 2023-11-24T06:16:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.849+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0e3c1462c0 con 0x7f0e2c0051f0 2023-11-24T06:16:40.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.849+0000 7f0e397fa640 1 -- 172.21.15.22:0/4159246882 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1221 (secure 0 0 0) 0x7f0e300583e0 con 0x7f0e2c0051f0 2023-11-24T06:16:40.852 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:40.852 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":305,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":61,"num_osds":8,"num_up_osds":8,"osd_up_since":1700806309,"num_in_osds":8,"osd_in_since":1700806299,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":44},{"state_name":"active+clean","count":29},{"state_name":"creating+activating","count":18},{"state_name":"unknown","count":6}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590438,"bytes_used":249405440,"bytes_avail":772844707840,"bytes_total":773094113280,"unknown_pgs_ratio":0.061855670064687729,"inactive_pgs_ratio":0.63917523622512817,"write_bytes_sec":170,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":34,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6435}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-11-24T06:15:22.714659+0000","services":{}},"progress_events":{}} 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0e2006aff0 msgr2=0x7f0e2006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0e2006aff0 0x7f0e2006d4b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0e28001eb0 tx=0x7f0e28009040 comp rx=0 tx=0).stop 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 msgr2=0x7f0e3c148f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e3c148f30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0e30010860 tx=0x7f0e30010d20 comp rx=0 tx=0).stop 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 shutdown_connections 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0e2006aff0 0x7f0e2006d4b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3c1482f0 0x7f0e3c148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3c13f8e0 0x7f0e3c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 --2- 172.21.15.22:0/4159246882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e2c0051f0 0x7f0e3c148f30 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 >> 172.21.15.22:0/4159246882 conn(0x7f0e3c06a860 msgr2=0x7f0e3c0b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 shutdown_connections 2023-11-24T06:16:40.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:40.852+0000 7f0e41a78640 1 -- 172.21.15.22:0/4159246882 wait complete. 2023-11-24T06:16:40.875 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-24T06:16:40.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.096+0000 7fd224e67640 1 Processor -- start 2023-11-24T06:16:43.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.096+0000 7fd224e67640 1 -- start start 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.098+0000 7fd224e67640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd220157770 0x7fd22006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.098+0000 7fd224e67640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd22006d080 0x7fd22015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.098+0000 7fd224e67640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd220161670 con 0x7fd22015ddb0 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.098+0000 7fd224e67640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22006d500 con 0x7fd22006d080 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.098+0000 7fd224e67640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd220071730 con 0x7fd220157770 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd21ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd22015ddb0 0x7fd2200ac870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45656/0 (socket says 172.21.15.22:45656) 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd21ffff640 1 -- 172.21.15.22:0/1133908634 learned_addr learned my addr 172.21.15.22:0/1133908634 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd217fff640 1 --2- 172.21.15.22:0/1133908634 >> v2:172.21.15.22:3300/0 conn(0x7fd22006d080 0x7fd22015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd21f7fe640 1 --2- 172.21.15.22:0/1133908634 >> v2:172.21.15.31:3300/0 conn(0x7fd220157770 0x7fd22006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:43.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd21effd640 1 -- 172.21.15.22:0/1133908634 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358656636 0 0) 0x7fd220161670 con 0x7fd22015ddb0 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd21effd640 1 -- 172.21.15.22:0/1133908634 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd20c003520 con 0x7fd22015ddb0 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd217fff640 1 -- 172.21.15.22:0/1133908634 >> v2:172.21.15.31:3300/0 conn(0x7fd220157770 msgr2=0x7fd22006cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd217fff640 1 --2- 172.21.15.22:0/1133908634 >> v2:172.21.15.31:3300/0 conn(0x7fd220157770 0x7fd22006cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd217fff640 1 -- 172.21.15.22:0/1133908634 >> v1:172.21.15.22:6789/0 conn(0x7fd22015ddb0 legacy=0x7fd2200ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.099+0000 7fd217fff640 1 -- 172.21.15.22:0/1133908634 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22015e610 con 0x7fd22006d080 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.100+0000 7fd217fff640 1 --2- 172.21.15.22:0/1133908634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22006d080 0x7fd22015d870 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd2200adb70 tx=0x7fd20802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85442e5fe9729a58 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd21effd640 1 -- 172.21.15.22:0/1133908634 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208031830 con 0x7fd22006d080 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd21effd640 1 -- 172.21.15.22:0/1133908634 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208031990 con 0x7fd22006d080 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd21effd640 1 -- 172.21.15.22:0/1133908634 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208031d20 con 0x7fd22006d080 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd224e67640 1 -- 172.21.15.22:0/1133908634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22006d080 msgr2=0x7fd22015d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd224e67640 1 --2- 172.21.15.22:0/1133908634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22006d080 0x7fd22015d870 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd2200adb70 tx=0x7fd20802b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd224e67640 1 -- 172.21.15.22:0/1133908634 shutdown_connections 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd224e67640 1 --2- 172.21.15.22:0/1133908634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22006d080 0x7fd22015d870 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd224e67640 1 --2- 172.21.15.22:0/1133908634 >> v2:172.21.15.31:3300/0 conn(0x7fd220157770 0x7fd22006cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd224e67640 1 -- 172.21.15.22:0/1133908634 >> 172.21.15.22:0/1133908634 conn(0x7fd22006a860 msgr2=0x7fd22006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.101+0000 7fd224e67640 1 -- 172.21.15.22:0/1133908634 shutdown_connections 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.102+0000 7fd224e67640 1 -- 172.21.15.22:0/1133908634 wait complete. 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.103+0000 7fd224e67640 1 Processor -- start 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.103+0000 7fd224e67640 1 -- start start 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.104+0000 7fd224e67640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd22006d080 0x7fd2201f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.104+0000 7fd224e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd220157770 0x7fd220154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.104+0000 7fd224e67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd22015ddb0 0x7fd2201f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.104+0000 7fd224e67640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22014bf80 con 0x7fd220157770 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd224e67640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22014ca90 con 0x7fd22015ddb0 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd224e67640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200caea0 con 0x7fd22006d080 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd217fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd220157770 0x7fd220154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd217fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd220157770 0x7fd220154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39970/0 (socket says 172.21.15.22:39970) 2023-11-24T06:16:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd217fff640 1 -- 172.21.15.22:0/2624416934 learned_addr learned my addr 172.21.15.22:0/2624416934 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd217fff640 1 -- 172.21.15.22:0/2624416934 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd22006d080 msgr2=0x7fd2201f68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd217fff640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd22006d080 0x7fd2201f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd217fff640 1 -- 172.21.15.22:0/2624416934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd22015ddb0 msgr2=0x7fd2201f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd217fff640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd22015ddb0 0x7fd2201f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.105+0000 7fd217fff640 1 -- 172.21.15.22:0/2624416934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd208009400 con 0x7fd220157770 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.106+0000 7fd217fff640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd220157770 0x7fd220154280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.106+0000 7fd21cff9640 1 -- 172.21.15.22:0/2624416934 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20803a8f0 con 0x7fd220157770 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.106+0000 7fd21cff9640 1 -- 172.21.15.22:0/2624416934 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20803aa70 con 0x7fd220157770 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.106+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2200cb160 con 0x7fd220157770 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.106+0000 7fd21cff9640 1 -- 172.21.15.22:0/2624416934 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20803ae20 con 0x7fd220157770 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.106+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2200cb720 con 0x7fd220157770 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.107+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22004e840 con 0x7fd220157770 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.108+0000 7fd21cff9640 1 -- 172.21.15.22:0/2624416934 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd20804d450 con 0x7fd220157770 2023-11-24T06:16:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.109+0000 7fd21cff9640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd20006aff0 0x7fd20006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:43.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.109+0000 7fd21cff9640 1 -- 172.21.15.22:0/2624416934 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2080abae0 con 0x7fd220157770 2023-11-24T06:16:43.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.109+0000 7fd21f7fe640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd20006aff0 0x7fd20006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:43.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.110+0000 7fd21f7fe640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd20006aff0 0x7fd20006d4b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd2100098f0 tx=0x7fd210008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:43.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.113+0000 7fd21cff9640 1 -- 172.21.15.22:0/2624416934 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2080767f0 con 0x7fd220157770 2023-11-24T06:16:43.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.307+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd220161300 con 0x7fd20006aff0 2023-11-24T06:16:43.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.329+0000 7fd21cff9640 1 -- 172.21.15.22:0/2624416934 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286628 (secure 0 0 0) 0x7fd210009e70 con 0x7fd20006aff0 2023-11-24T06:16:43.824 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:43.825 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:16:43.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd20006aff0 msgr2=0x7fd20006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:43.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd20006aff0 0x7fd20006d4b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd2100098f0 tx=0x7fd210008040 comp rx=0 tx=0).stop 2023-11-24T06:16:43.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd220157770 msgr2=0x7fd220154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:43.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd220157770 0x7fd220154280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd2080046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 shutdown_connections 2023-11-24T06:16:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd20006aff0 0x7fd20006d4b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd22015ddb0 0x7fd2201f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd220157770 0x7fd220154280 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 --2- 172.21.15.22:0/2624416934 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd22006d080 0x7fd2201f68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 >> 172.21.15.22:0/2624416934 conn(0x7fd22006a860 msgr2=0x7fd220156960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 shutdown_connections 2023-11-24T06:16:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:41.335+0000 7fd224e67640 1 -- 172.21.15.22:0/2624416934 wait complete. 2023-11-24T06:16:43.844 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2023-11-24T06:16:40.744171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243868,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730852,"statfs":{"total":773094113280,"available":772844392448,"internally_reserved":0,"allocated":7053312,"data_stored":3593332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.006576"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777816+0000","last_change":"2023-11-24T06:16:34.784922+0000","last_active":"2023-11-24T06:16:35.777816+0000","last_peered":"2023-11-24T06:16:35.777816+0000","last_clean":"2023-11-24T06:16:35.777816+0000","last_became_active":"2023-11-24T06:16:34.784637+0000","last_became_peered":"2023-11-24T06:16:34.784637+0000","last_unstale":"2023-11-24T06:16:35.777816+0000","last_undegraded":"2023-11-24T06:16:35.777816+0000","last_fullsized":"2023-11-24T06:16:35.777816+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:20.213211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184204+0000","last_change":"2023-11-24T06:16:34.785684+0000","last_active":"2023-11-24T06:16:36.184204+0000","last_peered":"2023-11-24T06:16:36.184204+0000","last_clean":"2023-11-24T06:16:36.184204+0000","last_became_active":"2023-11-24T06:16:34.785429+0000","last_became_peered":"2023-11-24T06:16:34.785429+0000","last_unstale":"2023-11-24T06:16:36.184204+0000","last_undegraded":"2023-11-24T06:16:36.184204+0000","last_fullsized":"2023-11-24T06:16:36.184204+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:40.578781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778421+0000","last_change":"2023-11-24T06:16:34.775651+0000","last_active":"2023-11-24T06:16:35.778421+0000","last_peered":"2023-11-24T06:16:35.778421+0000","last_clean":"2023-11-24T06:16:35.778421+0000","last_became_active":"2023-11-24T06:16:34.775056+0000","last_became_peered":"2023-11-24T06:16:34.775056+0000","last_unstale":"2023-11-24T06:16:35.778421+0000","last_undegraded":"2023-11-24T06:16:35.778421+0000","last_fullsized":"2023-11-24T06:16:35.778421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:41.438416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777708+0000","last_change":"2023-11-24T06:16:34.778339+0000","last_active":"2023-11-24T06:16:35.777708+0000","last_peered":"2023-11-24T06:16:35.777708+0000","last_clean":"2023-11-24T06:16:35.777708+0000","last_became_active":"2023-11-24T06:16:34.777884+0000","last_became_peered":"2023-11-24T06:16:34.777884+0000","last_unstale":"2023-11-24T06:16:35.777708+0000","last_undegraded":"2023-11-24T06:16:35.777708+0000","last_fullsized":"2023-11-24T06:16:35.777708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:52:16.086487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777384+0000","last_change":"2023-11-24T06:16:34.770802+0000","last_active":"2023-11-24T06:16:35.777384+0000","last_peered":"2023-11-24T06:16:35.777384+0000","last_clean":"2023-11-24T06:16:35.777384+0000","last_became_active":"2023-11-24T06:16:34.768995+0000","last_became_peered":"2023-11-24T06:16:34.768995+0000","last_unstale":"2023-11-24T06:16:35.777384+0000","last_undegraded":"2023-11-24T06:16:35.777384+0000","last_fullsized":"2023-11-24T06:16:35.777384+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:38.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185447+0000","last_change":"2023-11-24T06:16:34.760436+0000","last_active":"2023-11-24T06:16:36.185447+0000","last_peered":"2023-11-24T06:16:36.185447+0000","last_clean":"2023-11-24T06:16:36.185447+0000","last_became_active":"2023-11-24T06:16:34.759986+0000","last_became_peered":"2023-11-24T06:16:34.759986+0000","last_unstale":"2023-11-24T06:16:36.185447+0000","last_undegraded":"2023-11-24T06:16:36.185447+0000","last_fullsized":"2023-11-24T06:16:36.185447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:22:17.558080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183040+0000","last_change":"2023-11-24T06:16:34.776349+0000","last_active":"2023-11-24T06:16:36.183040+0000","last_peered":"2023-11-24T06:16:36.183040+0000","last_clean":"2023-11-24T06:16:36.183040+0000","last_became_active":"2023-11-24T06:16:34.776058+0000","last_became_peered":"2023-11-24T06:16:34.776058+0000","last_unstale":"2023-11-24T06:16:36.183040+0000","last_undegraded":"2023-11-24T06:16:36.183040+0000","last_fullsized":"2023-11-24T06:16:36.183040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:52.698358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183386+0000","last_change":"2023-11-24T06:16:34.778255+0000","last_active":"2023-11-24T06:16:36.183386+0000","last_peered":"2023-11-24T06:16:36.183386+0000","last_clean":"2023-11-24T06:16:36.183386+0000","last_became_active":"2023-11-24T06:16:34.777987+0000","last_became_peered":"2023-11-24T06:16:34.777987+0000","last_unstale":"2023-11-24T06:16:36.183386+0000","last_undegraded":"2023-11-24T06:16:36.183386+0000","last_fullsized":"2023-11-24T06:16:36.183386+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:39.825253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184556+0000","last_change":"2023-11-24T06:16:34.767975+0000","last_active":"2023-11-24T06:16:36.184556+0000","last_peered":"2023-11-24T06:16:36.184556+0000","last_clean":"2023-11-24T06:16:36.184556+0000","last_became_active":"2023-11-24T06:16:34.767633+0000","last_became_peered":"2023-11-24T06:16:34.767633+0000","last_unstale":"2023-11-24T06:16:36.184556+0000","last_undegraded":"2023-11-24T06:16:36.184556+0000","last_fullsized":"2023-11-24T06:16:36.184556+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:37.802170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187437+0000","last_change":"2023-11-24T06:16:34.781609+0000","last_active":"2023-11-24T06:16:36.187437+0000","last_peered":"2023-11-24T06:16:36.187437+0000","last_clean":"2023-11-24T06:16:36.187437+0000","last_became_active":"2023-11-24T06:16:34.778750+0000","last_became_peered":"2023-11-24T06:16:34.778750+0000","last_unstale":"2023-11-24T06:16:36.187437+0000","last_undegraded":"2023-11-24T06:16:36.187437+0000","last_fullsized":"2023-11-24T06:16:36.187437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:59:05.773308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187160+0000","last_change":"2023-11-24T06:16:34.790561+0000","last_active":"2023-11-24T06:16:36.187160+0000","last_peered":"2023-11-24T06:16:36.187160+0000","last_clean":"2023-11-24T06:16:36.187160+0000","last_became_active":"2023-11-24T06:16:34.790318+0000","last_became_peered":"2023-11-24T06:16:34.790318+0000","last_unstale":"2023-11-24T06:16:36.187160+0000","last_undegraded":"2023-11-24T06:16:36.187160+0000","last_fullsized":"2023-11-24T06:16:36.187160+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:54.298750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778929+0000","last_change":"2023-11-24T06:16:34.771827+0000","last_active":"2023-11-24T06:16:35.778929+0000","last_peered":"2023-11-24T06:16:35.778929+0000","last_clean":"2023-11-24T06:16:35.778929+0000","last_became_active":"2023-11-24T06:16:34.769123+0000","last_became_peered":"2023-11-24T06:16:34.769123+0000","last_unstale":"2023-11-24T06:16:35.778929+0000","last_undegraded":"2023-11-24T06:16:35.778929+0000","last_fullsized":"2023-11-24T06:16:35.778929+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:18.574041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185380+0000","last_change":"2023-11-24T06:16:34.783962+0000","last_active":"2023-11-24T06:16:36.185380+0000","last_peered":"2023-11-24T06:16:36.185380+0000","last_clean":"2023-11-24T06:16:36.185380+0000","last_became_active":"2023-11-24T06:16:34.783653+0000","last_became_peered":"2023-11-24T06:16:34.783653+0000","last_unstale":"2023-11-24T06:16:36.185380+0000","last_undegraded":"2023-11-24T06:16:36.185380+0000","last_fullsized":"2023-11-24T06:16:36.185380+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:35.814253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183543+0000","last_change":"2023-11-24T06:16:34.769071+0000","last_active":"2023-11-24T06:16:36.183543+0000","last_peered":"2023-11-24T06:16:36.183543+0000","last_clean":"2023-11-24T06:16:36.183543+0000","last_became_active":"2023-11-24T06:16:34.768724+0000","last_became_peered":"2023-11-24T06:16:34.768724+0000","last_unstale":"2023-11-24T06:16:36.183543+0000","last_undegraded":"2023-11-24T06:16:36.183543+0000","last_fullsized":"2023-11-24T06:16:36.183543+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:35.635938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183094+0000","last_change":"2023-11-24T06:16:34.768910+0000","last_active":"2023-11-24T06:16:36.183094+0000","last_peered":"2023-11-24T06:16:36.183094+0000","last_clean":"2023-11-24T06:16:36.183094+0000","last_became_active":"2023-11-24T06:16:34.768605+0000","last_became_peered":"2023-11-24T06:16:34.768605+0000","last_unstale":"2023-11-24T06:16:36.183094+0000","last_undegraded":"2023-11-24T06:16:36.183094+0000","last_fullsized":"2023-11-24T06:16:36.183094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:07.020824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.182780+0000","last_change":"2023-11-24T06:16:34.777347+0000","last_active":"2023-11-24T06:16:36.182780+0000","last_peered":"2023-11-24T06:16:36.182780+0000","last_clean":"2023-11-24T06:16:36.182780+0000","last_became_active":"2023-11-24T06:16:34.776772+0000","last_became_peered":"2023-11-24T06:16:34.776772+0000","last_unstale":"2023-11-24T06:16:36.182780+0000","last_undegraded":"2023-11-24T06:16:36.182780+0000","last_fullsized":"2023-11-24T06:16:36.182780+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:47:09.857056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184951+0000","last_change":"2023-11-24T06:16:34.779286+0000","last_active":"2023-11-24T06:16:36.184951+0000","last_peered":"2023-11-24T06:16:36.184951+0000","last_clean":"2023-11-24T06:16:36.184951+0000","last_became_active":"2023-11-24T06:16:34.779018+0000","last_became_peered":"2023-11-24T06:16:34.779018+0000","last_unstale":"2023-11-24T06:16:36.184951+0000","last_undegraded":"2023-11-24T06:16:36.184951+0000","last_fullsized":"2023-11-24T06:16:36.184951+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:50.206831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780045+0000","last_change":"2023-11-24T06:16:34.780696+0000","last_active":"2023-11-24T06:16:35.780045+0000","last_peered":"2023-11-24T06:16:35.780045+0000","last_clean":"2023-11-24T06:16:35.780045+0000","last_became_active":"2023-11-24T06:16:34.780375+0000","last_became_peered":"2023-11-24T06:16:34.780375+0000","last_unstale":"2023-11-24T06:16:35.780045+0000","last_undegraded":"2023-11-24T06:16:35.780045+0000","last_fullsized":"2023-11-24T06:16:35.780045+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:52:01.960585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777477+0000","last_change":"2023-11-24T06:16:34.788647+0000","last_active":"2023-11-24T06:16:35.777477+0000","last_peered":"2023-11-24T06:16:35.777477+0000","last_clean":"2023-11-24T06:16:35.777477+0000","last_became_active":"2023-11-24T06:16:34.788382+0000","last_became_peered":"2023-11-24T06:16:34.788382+0000","last_unstale":"2023-11-24T06:16:35.777477+0000","last_undegraded":"2023-11-24T06:16:35.777477+0000","last_fullsized":"2023-11-24T06:16:35.777477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:34.842812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184202+0000","last_change":"2023-11-24T06:16:34.786581+0000","last_active":"2023-11-24T06:16:36.184202+0000","last_peered":"2023-11-24T06:16:36.184202+0000","last_clean":"2023-11-24T06:16:36.184202+0000","last_became_active":"2023-11-24T06:16:34.786316+0000","last_became_peered":"2023-11-24T06:16:34.786316+0000","last_unstale":"2023-11-24T06:16:36.184202+0000","last_undegraded":"2023-11-24T06:16:36.184202+0000","last_fullsized":"2023-11-24T06:16:36.184202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:21.500872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779698+0000","last_change":"2023-11-24T06:16:34.776589+0000","last_active":"2023-11-24T06:16:35.779698+0000","last_peered":"2023-11-24T06:16:35.779698+0000","last_clean":"2023-11-24T06:16:35.779698+0000","last_became_active":"2023-11-24T06:16:34.775025+0000","last_became_peered":"2023-11-24T06:16:34.775025+0000","last_unstale":"2023-11-24T06:16:35.779698+0000","last_undegraded":"2023-11-24T06:16:35.779698+0000","last_fullsized":"2023-11-24T06:16:35.779698+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:28.321073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183965+0000","last_change":"2023-11-24T06:16:34.777937+0000","last_active":"2023-11-24T06:16:36.183965+0000","last_peered":"2023-11-24T06:16:36.183965+0000","last_clean":"2023-11-24T06:16:36.183965+0000","last_became_active":"2023-11-24T06:16:34.775338+0000","last_became_peered":"2023-11-24T06:16:34.775338+0000","last_unstale":"2023-11-24T06:16:36.183965+0000","last_undegraded":"2023-11-24T06:16:36.183965+0000","last_fullsized":"2023-11-24T06:16:36.183965+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:59:02.525646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778261+0000","last_change":"2023-11-24T06:16:34.772905+0000","last_active":"2023-11-24T06:16:35.778261+0000","last_peered":"2023-11-24T06:16:35.778261+0000","last_clean":"2023-11-24T06:16:35.778261+0000","last_became_active":"2023-11-24T06:16:34.772569+0000","last_became_peered":"2023-11-24T06:16:34.772569+0000","last_unstale":"2023-11-24T06:16:35.778261+0000","last_undegraded":"2023-11-24T06:16:35.778261+0000","last_fullsized":"2023-11-24T06:16:35.778261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:37.802170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184391+0000","last_change":"2023-11-24T06:16:34.772992+0000","last_active":"2023-11-24T06:16:36.184391+0000","last_peered":"2023-11-24T06:16:36.184391+0000","last_clean":"2023-11-24T06:16:36.184391+0000","last_became_active":"2023-11-24T06:16:34.770371+0000","last_became_peered":"2023-11-24T06:16:34.770371+0000","last_unstale":"2023-11-24T06:16:36.184391+0000","last_undegraded":"2023-11-24T06:16:36.184391+0000","last_fullsized":"2023-11-24T06:16:36.184391+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:54.140736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777725+0000","last_change":"2023-11-24T06:16:34.767766+0000","last_active":"2023-11-24T06:16:35.777725+0000","last_peered":"2023-11-24T06:16:35.777725+0000","last_clean":"2023-11-24T06:16:35.777725+0000","last_became_active":"2023-11-24T06:16:34.767474+0000","last_became_peered":"2023-11-24T06:16:34.767474+0000","last_unstale":"2023-11-24T06:16:35.777725+0000","last_undegraded":"2023-11-24T06:16:35.777725+0000","last_fullsized":"2023-11-24T06:16:35.777725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:49:59.030135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780345+0000","last_change":"2023-11-24T06:16:34.775482+0000","last_active":"2023-11-24T06:16:35.780345+0000","last_peered":"2023-11-24T06:16:35.780345+0000","last_clean":"2023-11-24T06:16:35.780345+0000","last_became_active":"2023-11-24T06:16:34.775130+0000","last_became_peered":"2023-11-24T06:16:34.775130+0000","last_unstale":"2023-11-24T06:16:35.780345+0000","last_undegraded":"2023-11-24T06:16:35.780345+0000","last_fullsized":"2023-11-24T06:16:35.780345+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:52:01.960585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185559+0000","last_change":"2023-11-24T06:16:34.771647+0000","last_active":"2023-11-24T06:16:36.185559+0000","last_peered":"2023-11-24T06:16:36.185559+0000","last_clean":"2023-11-24T06:16:36.185559+0000","last_became_active":"2023-11-24T06:16:34.771391+0000","last_became_peered":"2023-11-24T06:16:34.771391+0000","last_unstale":"2023-11-24T06:16:36.185559+0000","last_undegraded":"2023-11-24T06:16:36.185559+0000","last_fullsized":"2023-11-24T06:16:36.185559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:09.877627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777428+0000","last_change":"2023-11-24T06:16:34.777315+0000","last_active":"2023-11-24T06:16:35.777428+0000","last_peered":"2023-11-24T06:16:35.777428+0000","last_clean":"2023-11-24T06:16:35.777428+0000","last_became_active":"2023-11-24T06:16:34.777075+0000","last_became_peered":"2023-11-24T06:16:34.777075+0000","last_unstale":"2023-11-24T06:16:35.777428+0000","last_undegraded":"2023-11-24T06:16:35.777428+0000","last_fullsized":"2023-11-24T06:16:35.777428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:35:01.868389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184059+0000","last_change":"2023-11-24T06:16:34.789803+0000","last_active":"2023-11-24T06:16:36.184059+0000","last_peered":"2023-11-24T06:16:36.184059+0000","last_clean":"2023-11-24T06:16:36.184059+0000","last_became_active":"2023-11-24T06:16:34.784408+0000","last_became_peered":"2023-11-24T06:16:34.784408+0000","last_unstale":"2023-11-24T06:16:36.184059+0000","last_undegraded":"2023-11-24T06:16:36.184059+0000","last_fullsized":"2023-11-24T06:16:36.184059+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:09:21.389235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778654+0000","last_change":"2023-11-24T06:16:34.772866+0000","last_active":"2023-11-24T06:16:35.778654+0000","last_peered":"2023-11-24T06:16:35.778654+0000","last_clean":"2023-11-24T06:16:35.778654+0000","last_became_active":"2023-11-24T06:16:34.772336+0000","last_became_peered":"2023-11-24T06:16:34.772336+0000","last_unstale":"2023-11-24T06:16:35.778654+0000","last_undegraded":"2023-11-24T06:16:35.778654+0000","last_fullsized":"2023-11-24T06:16:35.778654+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:18.574041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.776644+0000","last_change":"2023-11-24T06:16:34.764398+0000","last_active":"2023-11-24T06:16:35.776644+0000","last_peered":"2023-11-24T06:16:35.776644+0000","last_clean":"2023-11-24T06:16:35.776644+0000","last_became_active":"2023-11-24T06:16:34.764118+0000","last_became_peered":"2023-11-24T06:16:34.764118+0000","last_unstale":"2023-11-24T06:16:35.776644+0000","last_undegraded":"2023-11-24T06:16:35.776644+0000","last_fullsized":"2023-11-24T06:16:35.776644+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:18:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183173+0000","last_change":"2023-11-24T06:16:34.788736+0000","last_active":"2023-11-24T06:16:36.183173+0000","last_peered":"2023-11-24T06:16:36.183173+0000","last_clean":"2023-11-24T06:16:36.183173+0000","last_became_active":"2023-11-24T06:16:34.788121+0000","last_became_peered":"2023-11-24T06:16:34.788121+0000","last_unstale":"2023-11-24T06:16:36.183173+0000","last_undegraded":"2023-11-24T06:16:36.183173+0000","last_fullsized":"2023-11-24T06:16:36.183173+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:57:07.786526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185929+0000","last_change":"2023-11-24T06:16:34.769288+0000","last_active":"2023-11-24T06:16:36.185929+0000","last_peered":"2023-11-24T06:16:36.185929+0000","last_clean":"2023-11-24T06:16:36.185929+0000","last_became_active":"2023-11-24T06:16:34.768971+0000","last_became_peered":"2023-11-24T06:16:34.768971+0000","last_unstale":"2023-11-24T06:16:36.185929+0000","last_undegraded":"2023-11-24T06:16:36.185929+0000","last_fullsized":"2023-11-24T06:16:36.185929+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:16:48.573601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.783489+0000","last_change":"2023-11-24T06:16:33.764034+0000","last_active":"2023-11-24T06:16:34.783489+0000","last_peered":"2023-11-24T06:16:34.783489+0000","last_clean":"2023-11-24T06:16:34.783489+0000","last_became_active":"2023-11-24T06:16:33.763717+0000","last_became_peered":"2023-11-24T06:16:33.763717+0000","last_unstale":"2023-11-24T06:16:34.783489+0000","last_undegraded":"2023-11-24T06:16:34.783489+0000","last_fullsized":"2023-11-24T06:16:34.783489+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:51.749535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184656+0000","last_change":"2023-11-24T06:16:34.781959+0000","last_active":"2023-11-24T06:16:36.184656+0000","last_peered":"2023-11-24T06:16:36.184656+0000","last_clean":"2023-11-24T06:16:36.184656+0000","last_became_active":"2023-11-24T06:16:34.781005+0000","last_became_peered":"2023-11-24T06:16:34.781005+0000","last_unstale":"2023-11-24T06:16:36.184656+0000","last_undegraded":"2023-11-24T06:16:36.184656+0000","last_fullsized":"2023-11-24T06:16:36.184656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:39.144025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.788060+0000","last_change":"2023-11-24T06:16:33.775735+0000","last_active":"2023-11-24T06:16:34.788060+0000","last_peered":"2023-11-24T06:16:34.788060+0000","last_clean":"2023-11-24T06:16:34.788060+0000","last_became_active":"2023-11-24T06:16:33.775158+0000","last_became_peered":"2023-11-24T06:16:33.775158+0000","last_unstale":"2023-11-24T06:16:34.788060+0000","last_undegraded":"2023-11-24T06:16:34.788060+0000","last_fullsized":"2023-11-24T06:16:34.788060+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:22:16.541783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186916+0000","last_change":"2023-11-24T06:16:34.781354+0000","last_active":"2023-11-24T06:16:36.186916+0000","last_peered":"2023-11-24T06:16:36.186916+0000","last_clean":"2023-11-24T06:16:36.186916+0000","last_became_active":"2023-11-24T06:16:34.774187+0000","last_became_peered":"2023-11-24T06:16:34.774187+0000","last_unstale":"2023-11-24T06:16:36.186916+0000","last_undegraded":"2023-11-24T06:16:36.186916+0000","last_fullsized":"2023-11-24T06:16:36.186916+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:15.919265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.780874+0000","last_change":"2023-11-24T06:16:33.777399+0000","last_active":"2023-11-24T06:16:34.780874+0000","last_peered":"2023-11-24T06:16:34.780874+0000","last_clean":"2023-11-24T06:16:34.780874+0000","last_became_active":"2023-11-24T06:16:33.777098+0000","last_became_peered":"2023-11-24T06:16:33.777098+0000","last_unstale":"2023-11-24T06:16:34.780874+0000","last_undegraded":"2023-11-24T06:16:34.780874+0000","last_fullsized":"2023-11-24T06:16:34.780874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:17.557744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185948+0000","last_change":"2023-11-24T06:16:34.777959+0000","last_active":"2023-11-24T06:16:36.185948+0000","last_peered":"2023-11-24T06:16:36.185948+0000","last_clean":"2023-11-24T06:16:36.185948+0000","last_became_active":"2023-11-24T06:16:34.777669+0000","last_became_peered":"2023-11-24T06:16:34.777669+0000","last_unstale":"2023-11-24T06:16:36.185948+0000","last_undegraded":"2023-11-24T06:16:36.185948+0000","last_fullsized":"2023-11-24T06:16:36.185948+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:18.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.781680+0000","last_change":"2023-11-24T06:16:33.770950+0000","last_active":"2023-11-24T06:16:34.781680+0000","last_peered":"2023-11-24T06:16:34.781680+0000","last_clean":"2023-11-24T06:16:34.781680+0000","last_became_active":"2023-11-24T06:16:33.770565+0000","last_became_peered":"2023-11-24T06:16:33.770565+0000","last_unstale":"2023-11-24T06:16:34.781680+0000","last_undegraded":"2023-11-24T06:16:34.781680+0000","last_fullsized":"2023-11-24T06:16:34.781680+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184355+0000","last_change":"2023-11-24T06:16:34.772227+0000","last_active":"2023-11-24T06:16:36.184355+0000","last_peered":"2023-11-24T06:16:36.184355+0000","last_clean":"2023-11-24T06:16:36.184355+0000","last_became_active":"2023-11-24T06:16:34.770666+0000","last_became_peered":"2023-11-24T06:16:34.770666+0000","last_unstale":"2023-11-24T06:16:36.184355+0000","last_undegraded":"2023-11-24T06:16:36.184355+0000","last_fullsized":"2023-11-24T06:16:36.184355+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:54.686947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.776880+0000","last_change":"2023-11-24T06:16:33.772396+0000","last_active":"2023-11-24T06:16:34.776880+0000","last_peered":"2023-11-24T06:16:34.776880+0000","last_clean":"2023-11-24T06:16:34.776880+0000","last_became_active":"2023-11-24T06:16:33.771826+0000","last_became_peered":"2023-11-24T06:16:33.771826+0000","last_unstale":"2023-11-24T06:16:34.776880+0000","last_undegraded":"2023-11-24T06:16:34.776880+0000","last_fullsized":"2023-11-24T06:16:34.776880+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:21.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183905+0000","last_change":"2023-11-24T06:16:34.790827+0000","last_active":"2023-11-24T06:16:36.183905+0000","last_peered":"2023-11-24T06:16:36.183905+0000","last_clean":"2023-11-24T06:16:36.183905+0000","last_became_active":"2023-11-24T06:16:34.790304+0000","last_became_peered":"2023-11-24T06:16:34.790304+0000","last_unstale":"2023-11-24T06:16:36.183905+0000","last_undegraded":"2023-11-24T06:16:36.183905+0000","last_fullsized":"2023-11-24T06:16:36.183905+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:39.642187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.776702+0000","last_change":"2023-11-24T06:16:33.767335+0000","last_active":"2023-11-24T06:16:34.776702+0000","last_peered":"2023-11-24T06:16:34.776702+0000","last_clean":"2023-11-24T06:16:34.776702+0000","last_became_active":"2023-11-24T06:16:33.767085+0000","last_became_peered":"2023-11-24T06:16:33.767085+0000","last_unstale":"2023-11-24T06:16:34.776702+0000","last_undegraded":"2023-11-24T06:16:34.776702+0000","last_fullsized":"2023-11-24T06:16:34.776702+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:52:15.070190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184474+0000","last_change":"2023-11-24T06:16:34.774370+0000","last_active":"2023-11-24T06:16:36.184474+0000","last_peered":"2023-11-24T06:16:36.184474+0000","last_clean":"2023-11-24T06:16:36.184474+0000","last_became_active":"2023-11-24T06:16:34.771220+0000","last_became_peered":"2023-11-24T06:16:34.771220+0000","last_unstale":"2023-11-24T06:16:36.184474+0000","last_undegraded":"2023-11-24T06:16:36.184474+0000","last_fullsized":"2023-11-24T06:16:36.184474+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:41.424156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.775972+0000","last_change":"2023-11-24T06:16:33.770060+0000","last_active":"2023-11-24T06:16:34.775972+0000","last_peered":"2023-11-24T06:16:34.775972+0000","last_clean":"2023-11-24T06:16:34.775972+0000","last_became_active":"2023-11-24T06:16:33.769764+0000","last_became_peered":"2023-11-24T06:16:33.769764+0000","last_unstale":"2023-11-24T06:16:34.775972+0000","last_undegraded":"2023-11-24T06:16:34.775972+0000","last_fullsized":"2023-11-24T06:16:34.775972+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183603+0000","last_change":"2023-11-24T06:16:34.777384+0000","last_active":"2023-11-24T06:16:36.183603+0000","last_peered":"2023-11-24T06:16:36.183603+0000","last_clean":"2023-11-24T06:16:36.183603+0000","last_became_active":"2023-11-24T06:16:34.775239+0000","last_became_peered":"2023-11-24T06:16:34.775239+0000","last_unstale":"2023-11-24T06:16:36.183603+0000","last_undegraded":"2023-11-24T06:16:36.183603+0000","last_fullsized":"2023-11-24T06:16:36.183603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:16:34.581621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.750651+0000","last_change":"2023-11-24T06:16:33.769378+0000","last_active":"2023-11-24T06:16:34.750651+0000","last_peered":"2023-11-24T06:16:34.750651+0000","last_clean":"2023-11-24T06:16:34.750651+0000","last_became_active":"2023-11-24T06:16:33.768768+0000","last_became_peered":"2023-11-24T06:16:33.768768+0000","last_unstale":"2023-11-24T06:16:34.750651+0000","last_undegraded":"2023-11-24T06:16:34.750651+0000","last_fullsized":"2023-11-24T06:16:34.750651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:50:41.314836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184213+0000","last_change":"2023-11-24T06:16:34.767771+0000","last_active":"2023-11-24T06:16:36.184213+0000","last_peered":"2023-11-24T06:16:36.184213+0000","last_clean":"2023-11-24T06:16:36.184213+0000","last_became_active":"2023-11-24T06:16:34.767377+0000","last_became_peered":"2023-11-24T06:16:34.767377+0000","last_unstale":"2023-11-24T06:16:36.184213+0000","last_undegraded":"2023-11-24T06:16:36.184213+0000","last_fullsized":"2023-11-24T06:16:36.184213+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:17.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.752146+0000","last_change":"2023-11-24T06:16:33.770422+0000","last_active":"2023-11-24T06:16:34.752146+0000","last_peered":"2023-11-24T06:16:34.752146+0000","last_clean":"2023-11-24T06:16:34.752146+0000","last_became_active":"2023-11-24T06:16:33.769391+0000","last_became_peered":"2023-11-24T06:16:33.769391+0000","last_unstale":"2023-11-24T06:16:34.752146+0000","last_undegraded":"2023-11-24T06:16:34.752146+0000","last_fullsized":"2023-11-24T06:16:34.752146+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:51.369211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780478+0000","last_change":"2023-11-24T06:16:34.772067+0000","last_active":"2023-11-24T06:16:35.780478+0000","last_peered":"2023-11-24T06:16:35.780478+0000","last_clean":"2023-11-24T06:16:35.780478+0000","last_became_active":"2023-11-24T06:16:34.770191+0000","last_became_peered":"2023-11-24T06:16:34.770191+0000","last_unstale":"2023-11-24T06:16:35.780478+0000","last_undegraded":"2023-11-24T06:16:35.780478+0000","last_fullsized":"2023-11-24T06:16:35.780478+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:57:07.786526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.766754+0000","last_change":"2023-11-24T06:16:33.775471+0000","last_active":"2023-11-24T06:16:34.766754+0000","last_peered":"2023-11-24T06:16:34.766754+0000","last_clean":"2023-11-24T06:16:34.766754+0000","last_became_active":"2023-11-24T06:16:33.774435+0000","last_became_peered":"2023-11-24T06:16:33.774435+0000","last_unstale":"2023-11-24T06:16:34.766754+0000","last_undegraded":"2023-11-24T06:16:34.766754+0000","last_fullsized":"2023-11-24T06:16:34.766754+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:52.457393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186420+0000","last_change":"2023-11-24T06:16:34.776486+0000","last_active":"2023-11-24T06:16:36.186420+0000","last_peered":"2023-11-24T06:16:36.186420+0000","last_clean":"2023-11-24T06:16:36.186420+0000","last_became_active":"2023-11-24T06:16:34.776078+0000","last_became_peered":"2023-11-24T06:16:34.776078+0000","last_unstale":"2023-11-24T06:16:36.186420+0000","last_undegraded":"2023-11-24T06:16:36.186420+0000","last_fullsized":"2023-11-24T06:16:36.186420+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:28.810438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.792232+0000","last_change":"2023-11-24T06:16:33.776539+0000","last_active":"2023-11-24T06:16:34.792232+0000","last_peered":"2023-11-24T06:16:34.792232+0000","last_clean":"2023-11-24T06:16:34.792232+0000","last_became_active":"2023-11-24T06:16:33.775258+0000","last_became_peered":"2023-11-24T06:16:33.775258+0000","last_unstale":"2023-11-24T06:16:34.792232+0000","last_undegraded":"2023-11-24T06:16:34.792232+0000","last_fullsized":"2023-11-24T06:16:34.792232+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779897+0000","last_change":"2023-11-24T06:16:34.767100+0000","last_active":"2023-11-24T06:16:35.779897+0000","last_peered":"2023-11-24T06:16:35.779897+0000","last_clean":"2023-11-24T06:16:35.779897+0000","last_became_active":"2023-11-24T06:16:34.766824+0000","last_became_peered":"2023-11-24T06:16:34.766824+0000","last_unstale":"2023-11-24T06:16:35.779897+0000","last_undegraded":"2023-11-24T06:16:35.779897+0000","last_fullsized":"2023-11-24T06:16:35.779897+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:06.873688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.788987+0000","last_change":"2023-11-24T06:16:33.766405+0000","last_active":"2023-11-24T06:16:34.788987+0000","last_peered":"2023-11-24T06:16:34.788987+0000","last_clean":"2023-11-24T06:16:34.788987+0000","last_became_active":"2023-11-24T06:16:33.765503+0000","last_became_peered":"2023-11-24T06:16:33.765503+0000","last_unstale":"2023-11-24T06:16:34.788987+0000","last_undegraded":"2023-11-24T06:16:34.788987+0000","last_fullsized":"2023-11-24T06:16:34.788987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:54.046458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777046+0000","last_change":"2023-11-24T06:16:34.771695+0000","last_active":"2023-11-24T06:16:35.777046+0000","last_peered":"2023-11-24T06:16:35.777046+0000","last_clean":"2023-11-24T06:16:35.777046+0000","last_became_active":"2023-11-24T06:16:34.771339+0000","last_became_peered":"2023-11-24T06:16:34.771339+0000","last_unstale":"2023-11-24T06:16:35.777046+0000","last_undegraded":"2023-11-24T06:16:35.777046+0000","last_fullsized":"2023-11-24T06:16:35.777046+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:37.802170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.790653+0000","last_change":"2023-11-24T06:16:33.770601+0000","last_active":"2023-11-24T06:16:34.790653+0000","last_peered":"2023-11-24T06:16:34.790653+0000","last_clean":"2023-11-24T06:16:34.790653+0000","last_became_active":"2023-11-24T06:16:33.770320+0000","last_became_peered":"2023-11-24T06:16:33.770320+0000","last_unstale":"2023-11-24T06:16:34.790653+0000","last_undegraded":"2023-11-24T06:16:34.790653+0000","last_fullsized":"2023-11-24T06:16:34.790653+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:16:47.557304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779658+0000","last_change":"2023-11-24T06:16:34.778641+0000","last_active":"2023-11-24T06:16:35.779658+0000","last_peered":"2023-11-24T06:16:35.779658+0000","last_clean":"2023-11-24T06:16:35.779658+0000","last_became_active":"2023-11-24T06:16:34.775519+0000","last_became_peered":"2023-11-24T06:16:34.775519+0000","last_unstale":"2023-11-24T06:16:35.779658+0000","last_undegraded":"2023-11-24T06:16:35.779658+0000","last_fullsized":"2023-11-24T06:16:35.779658+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:57:51.825976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.757907+0000","last_change":"2023-11-24T06:16:33.761349+0000","last_active":"2023-11-24T06:16:34.757907+0000","last_peered":"2023-11-24T06:16:34.757907+0000","last_clean":"2023-11-24T06:16:34.757907+0000","last_became_active":"2023-11-24T06:16:33.759543+0000","last_became_peered":"2023-11-24T06:16:33.759543+0000","last_unstale":"2023-11-24T06:16:34.757907+0000","last_undegraded":"2023-11-24T06:16:34.757907+0000","last_fullsized":"2023-11-24T06:16:34.757907+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:49:04.663349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.182778+0000","last_change":"2023-11-24T06:16:34.764141+0000","last_active":"2023-11-24T06:16:36.182778+0000","last_peered":"2023-11-24T06:16:36.182778+0000","last_clean":"2023-11-24T06:16:36.182778+0000","last_became_active":"2023-11-24T06:16:34.763846+0000","last_became_peered":"2023-11-24T06:16:34.763846+0000","last_unstale":"2023-11-24T06:16:36.182778+0000","last_undegraded":"2023-11-24T06:16:36.182778+0000","last_fullsized":"2023-11-24T06:16:36.182778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:34.659726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.775991+0000","last_change":"2023-11-24T06:16:33.771272+0000","last_active":"2023-11-24T06:16:34.775991+0000","last_peered":"2023-11-24T06:16:34.775991+0000","last_clean":"2023-11-24T06:16:34.775991+0000","last_became_active":"2023-11-24T06:16:33.770946+0000","last_became_peered":"2023-11-24T06:16:33.770946+0000","last_unstale":"2023-11-24T06:16:34.775991+0000","last_undegraded":"2023-11-24T06:16:34.775991+0000","last_fullsized":"2023-11-24T06:16:34.775991+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:51.682060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778533+0000","last_change":"2023-11-24T06:16:34.772951+0000","last_active":"2023-11-24T06:16:35.778533+0000","last_peered":"2023-11-24T06:16:35.778533+0000","last_clean":"2023-11-24T06:16:35.778533+0000","last_became_active":"2023-11-24T06:16:34.772648+0000","last_became_peered":"2023-11-24T06:16:34.772648+0000","last_unstale":"2023-11-24T06:16:35.778533+0000","last_undegraded":"2023-11-24T06:16:35.778533+0000","last_fullsized":"2023-11-24T06:16:35.778533+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:52:16.086487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.791216+0000","last_change":"2023-11-24T06:16:33.776193+0000","last_active":"2023-11-24T06:16:34.791216+0000","last_peered":"2023-11-24T06:16:34.791216+0000","last_clean":"2023-11-24T06:16:34.791216+0000","last_became_active":"2023-11-24T06:16:33.775699+0000","last_became_peered":"2023-11-24T06:16:33.775699+0000","last_unstale":"2023-11-24T06:16:34.791216+0000","last_undegraded":"2023-11-24T06:16:34.791216+0000","last_fullsized":"2023-11-24T06:16:34.791216+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:50:41.314836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780170+0000","last_change":"2023-11-24T06:16:34.771017+0000","last_active":"2023-11-24T06:16:35.780170+0000","last_peered":"2023-11-24T06:16:35.780170+0000","last_clean":"2023-11-24T06:16:35.780170+0000","last_became_active":"2023-11-24T06:16:34.770480+0000","last_became_peered":"2023-11-24T06:16:34.770480+0000","last_unstale":"2023-11-24T06:16:35.780170+0000","last_undegraded":"2023-11-24T06:16:35.780170+0000","last_fullsized":"2023-11-24T06:16:35.780170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:47:09.857056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.788776+0000","last_change":"2023-11-24T06:16:33.773132+0000","last_active":"2023-11-24T06:16:34.788776+0000","last_peered":"2023-11-24T06:16:34.788776+0000","last_clean":"2023-11-24T06:16:34.788776+0000","last_became_active":"2023-11-24T06:16:33.772817+0000","last_became_peered":"2023-11-24T06:16:33.772817+0000","last_unstale":"2023-11-24T06:16:34.788776+0000","last_undegraded":"2023-11-24T06:16:34.788776+0000","last_fullsized":"2023-11-24T06:16:34.788776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:12:18.594305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779416+0000","last_change":"2023-11-24T06:16:34.774713+0000","last_active":"2023-11-24T06:16:35.779416+0000","last_peered":"2023-11-24T06:16:35.779416+0000","last_clean":"2023-11-24T06:16:35.779416+0000","last_became_active":"2023-11-24T06:16:34.774392+0000","last_became_peered":"2023-11-24T06:16:34.774392+0000","last_unstale":"2023-11-24T06:16:35.779416+0000","last_undegraded":"2023-11-24T06:16:35.779416+0000","last_fullsized":"2023-11-24T06:16:35.779416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:28.321073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.777467+0000","last_change":"2023-11-24T06:16:33.774189+0000","last_active":"2023-11-24T06:16:34.777467+0000","last_peered":"2023-11-24T06:16:34.777467+0000","last_clean":"2023-11-24T06:16:34.777467+0000","last_became_active":"2023-11-24T06:16:33.773781+0000","last_became_peered":"2023-11-24T06:16:33.773781+0000","last_unstale":"2023-11-24T06:16:34.777467+0000","last_undegraded":"2023-11-24T06:16:34.777467+0000","last_fullsized":"2023-11-24T06:16:34.777467+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:27.304775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184406+0000","last_change":"2023-11-24T06:16:34.786557+0000","last_active":"2023-11-24T06:16:36.184406+0000","last_peered":"2023-11-24T06:16:36.184406+0000","last_clean":"2023-11-24T06:16:36.184406+0000","last_became_active":"2023-11-24T06:16:34.786291+0000","last_became_peered":"2023-11-24T06:16:34.786291+0000","last_unstale":"2023-11-24T06:16:36.184406+0000","last_undegraded":"2023-11-24T06:16:36.184406+0000","last_fullsized":"2023-11-24T06:16:36.184406+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:42.491567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.785762+0000","last_change":"2023-11-24T06:16:33.771457+0000","last_active":"2023-11-24T06:16:34.785762+0000","last_peered":"2023-11-24T06:16:34.785762+0000","last_clean":"2023-11-24T06:16:34.785762+0000","last_became_active":"2023-11-24T06:16:33.771077+0000","last_became_peered":"2023-11-24T06:16:33.771077+0000","last_unstale":"2023-11-24T06:16:34.785762+0000","last_undegraded":"2023-11-24T06:16:34.785762+0000","last_fullsized":"2023-11-24T06:16:34.785762+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:16.548503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780100+0000","last_change":"2023-11-24T06:16:34.775437+0000","last_active":"2023-11-24T06:16:35.780100+0000","last_peered":"2023-11-24T06:16:35.780100+0000","last_clean":"2023-11-24T06:16:35.780100+0000","last_became_active":"2023-11-24T06:16:34.769419+0000","last_became_peered":"2023-11-24T06:16:34.769419+0000","last_unstale":"2023-11-24T06:16:35.780100+0000","last_undegraded":"2023-11-24T06:16:35.780100+0000","last_fullsized":"2023-11-24T06:16:35.780100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:23:38.830182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.755028+0000","last_change":"2023-11-24T06:16:33.769608+0000","last_active":"2023-11-24T06:16:34.755028+0000","last_peered":"2023-11-24T06:16:34.755028+0000","last_clean":"2023-11-24T06:16:34.755028+0000","last_became_active":"2023-11-24T06:16:33.769353+0000","last_became_peered":"2023-11-24T06:16:33.769353+0000","last_unstale":"2023-11-24T06:16:34.755028+0000","last_undegraded":"2023-11-24T06:16:34.755028+0000","last_fullsized":"2023-11-24T06:16:34.755028+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:57:50.809679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777278+0000","last_change":"2023-11-24T06:16:34.770022+0000","last_active":"2023-11-24T06:16:35.777278+0000","last_peered":"2023-11-24T06:16:35.777278+0000","last_clean":"2023-11-24T06:16:35.777278+0000","last_became_active":"2023-11-24T06:16:34.769722+0000","last_became_peered":"2023-11-24T06:16:34.769722+0000","last_unstale":"2023-11-24T06:16:35.777278+0000","last_undegraded":"2023-11-24T06:16:35.777278+0000","last_fullsized":"2023-11-24T06:16:35.777278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:41.438416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.791271+0000","last_change":"2023-11-24T06:16:33.771682+0000","last_active":"2023-11-24T06:16:34.791271+0000","last_peered":"2023-11-24T06:16:34.791271+0000","last_clean":"2023-11-24T06:16:34.791271+0000","last_became_active":"2023-11-24T06:16:33.770297+0000","last_became_peered":"2023-11-24T06:16:33.770297+0000","last_unstale":"2023-11-24T06:16:34.791271+0000","last_undegraded":"2023-11-24T06:16:34.791271+0000","last_fullsized":"2023-11-24T06:16:34.791271+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:17.469352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185878+0000","last_change":"2023-11-24T06:16:34.777121+0000","last_active":"2023-11-24T06:16:36.185878+0000","last_peered":"2023-11-24T06:16:36.185878+0000","last_clean":"2023-11-24T06:16:36.185878+0000","last_became_active":"2023-11-24T06:16:34.776723+0000","last_became_peered":"2023-11-24T06:16:34.776723+0000","last_unstale":"2023-11-24T06:16:36.185878+0000","last_undegraded":"2023-11-24T06:16:36.185878+0000","last_fullsized":"2023-11-24T06:16:36.185878+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:53.473690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.755961+0000","last_change":"2023-11-24T06:16:33.770996+0000","last_active":"2023-11-24T06:16:34.755961+0000","last_peered":"2023-11-24T06:16:34.755961+0000","last_clean":"2023-11-24T06:16:34.755961+0000","last_became_active":"2023-11-24T06:16:33.770413+0000","last_became_peered":"2023-11-24T06:16:33.770413+0000","last_unstale":"2023-11-24T06:16:34.755961+0000","last_undegraded":"2023-11-24T06:16:34.755961+0000","last_fullsized":"2023-11-24T06:16:34.755961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:29.010814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183235+0000","last_change":"2023-11-24T06:16:34.763805+0000","last_active":"2023-11-24T06:16:36.183235+0000","last_peered":"2023-11-24T06:16:36.183235+0000","last_clean":"2023-11-24T06:16:36.183235+0000","last_became_active":"2023-11-24T06:16:34.763527+0000","last_became_peered":"2023-11-24T06:16:34.763527+0000","last_unstale":"2023-11-24T06:16:36.183235+0000","last_undegraded":"2023-11-24T06:16:36.183235+0000","last_fullsized":"2023-11-24T06:16:36.183235+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:59.247787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.775949+0000","last_change":"2023-11-24T06:16:33.773444+0000","last_active":"2023-11-24T06:16:34.775949+0000","last_peered":"2023-11-24T06:16:34.775949+0000","last_clean":"2023-11-24T06:16:34.775949+0000","last_became_active":"2023-11-24T06:16:33.771977+0000","last_became_peered":"2023-11-24T06:16:33.771977+0000","last_unstale":"2023-11-24T06:16:34.775949+0000","last_undegraded":"2023-11-24T06:16:34.775949+0000","last_fullsized":"2023-11-24T06:16:34.775949+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:06.004527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779248+0000","last_change":"2023-11-24T06:16:34.783806+0000","last_active":"2023-11-24T06:16:35.779248+0000","last_peered":"2023-11-24T06:16:35.779248+0000","last_clean":"2023-11-24T06:16:35.779248+0000","last_became_active":"2023-11-24T06:16:34.782249+0000","last_became_peered":"2023-11-24T06:16:34.782249+0000","last_unstale":"2023-11-24T06:16:35.779248+0000","last_undegraded":"2023-11-24T06:16:35.779248+0000","last_fullsized":"2023-11-24T06:16:35.779248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:57:51.825976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.791301+0000","last_change":"2023-11-24T06:16:33.769724+0000","last_active":"2023-11-24T06:16:34.791301+0000","last_peered":"2023-11-24T06:16:34.791301+0000","last_clean":"2023-11-24T06:16:34.791301+0000","last_became_active":"2023-11-24T06:16:33.769461+0000","last_became_peered":"2023-11-24T06:16:33.769461+0000","last_unstale":"2023-11-24T06:16:34.791301+0000","last_undegraded":"2023-11-24T06:16:34.791301+0000","last_fullsized":"2023-11-24T06:16:34.791301+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:08.290535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779845+0000","last_change":"2023-11-24T06:16:34.778377+0000","last_active":"2023-11-24T06:16:35.779845+0000","last_peered":"2023-11-24T06:16:35.779845+0000","last_clean":"2023-11-24T06:16:35.779845+0000","last_became_active":"2023-11-24T06:16:34.776011+0000","last_became_peered":"2023-11-24T06:16:34.776011+0000","last_unstale":"2023-11-24T06:16:35.779845+0000","last_undegraded":"2023-11-24T06:16:35.779845+0000","last_fullsized":"2023-11-24T06:16:35.779845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:06.873688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186527+0000","last_change":"2023-11-24T06:16:33.766967+0000","last_active":"2023-11-24T06:16:36.186527+0000","last_peered":"2023-11-24T06:16:36.186527+0000","last_clean":"2023-11-24T06:16:36.186527+0000","last_became_active":"2023-11-24T06:16:33.766515+0000","last_became_peered":"2023-11-24T06:16:33.766515+0000","last_unstale":"2023-11-24T06:16:36.186527+0000","last_undegraded":"2023-11-24T06:16:36.186527+0000","last_fullsized":"2023-11-24T06:16:36.186527+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:05.857391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186605+0000","last_change":"2023-11-24T06:16:34.774591+0000","last_active":"2023-11-24T06:16:36.186605+0000","last_peered":"2023-11-24T06:16:36.186605+0000","last_clean":"2023-11-24T06:16:36.186605+0000","last_became_active":"2023-11-24T06:16:34.774324+0000","last_became_peered":"2023-11-24T06:16:34.774324+0000","last_unstale":"2023-11-24T06:16:36.186605+0000","last_undegraded":"2023-11-24T06:16:36.186605+0000","last_fullsized":"2023-11-24T06:16:36.186605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:02.107927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.757843+0000","last_change":"2023-11-24T06:16:33.767824+0000","last_active":"2023-11-24T06:16:34.757843+0000","last_peered":"2023-11-24T06:16:34.757843+0000","last_clean":"2023-11-24T06:16:34.757843+0000","last_became_active":"2023-11-24T06:16:33.767469+0000","last_became_peered":"2023-11-24T06:16:33.767469+0000","last_unstale":"2023-11-24T06:16:34.757843+0000","last_undegraded":"2023-11-24T06:16:34.757843+0000","last_fullsized":"2023-11-24T06:16:34.757843+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:48:57.151594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186289+0000","last_change":"2023-11-24T06:16:34.773290+0000","last_active":"2023-11-24T06:16:36.186289+0000","last_peered":"2023-11-24T06:16:36.186289+0000","last_clean":"2023-11-24T06:16:36.186289+0000","last_became_active":"2023-11-24T06:16:34.772406+0000","last_became_peered":"2023-11-24T06:16:34.772406+0000","last_unstale":"2023-11-24T06:16:36.186289+0000","last_undegraded":"2023-11-24T06:16:36.186289+0000","last_fullsized":"2023-11-24T06:16:36.186289+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:12:19.610603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.776143+0000","last_change":"2023-11-24T06:16:33.772084+0000","last_active":"2023-11-24T06:16:34.776143+0000","last_peered":"2023-11-24T06:16:34.776143+0000","last_clean":"2023-11-24T06:16:34.776143+0000","last_became_active":"2023-11-24T06:16:33.771790+0000","last_became_peered":"2023-11-24T06:16:33.771790+0000","last_unstale":"2023-11-24T06:16:34.776143+0000","last_undegraded":"2023-11-24T06:16:34.776143+0000","last_fullsized":"2023-11-24T06:16:34.776143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:34.619640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184722+0000","last_change":"2023-11-24T06:16:34.784937+0000","last_active":"2023-11-24T06:16:36.184722+0000","last_peered":"2023-11-24T06:16:36.184722+0000","last_clean":"2023-11-24T06:16:36.184722+0000","last_became_active":"2023-11-24T06:16:34.784434+0000","last_became_peered":"2023-11-24T06:16:34.784434+0000","last_unstale":"2023-11-24T06:16:36.184722+0000","last_undegraded":"2023-11-24T06:16:36.184722+0000","last_fullsized":"2023-11-24T06:16:36.184722+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:05.342541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.756153+0000","last_change":"2023-11-24T06:16:33.770432+0000","last_active":"2023-11-24T06:16:34.756153+0000","last_peered":"2023-11-24T06:16:34.756153+0000","last_clean":"2023-11-24T06:16:34.756153+0000","last_became_active":"2023-11-24T06:16:33.770152+0000","last_became_peered":"2023-11-24T06:16:33.770152+0000","last_unstale":"2023-11-24T06:16:34.756153+0000","last_undegraded":"2023-11-24T06:16:34.756153+0000","last_fullsized":"2023-11-24T06:16:34.756153+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:20.853464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780067+0000","last_change":"2023-11-24T06:16:34.779236+0000","last_active":"2023-11-24T06:16:35.780067+0000","last_peered":"2023-11-24T06:16:35.780067+0000","last_clean":"2023-11-24T06:16:35.780067+0000","last_became_active":"2023-11-24T06:16:34.778924+0000","last_became_peered":"2023-11-24T06:16:34.778924+0000","last_unstale":"2023-11-24T06:16:35.780067+0000","last_undegraded":"2023-11-24T06:16:35.780067+0000","last_fullsized":"2023-11-24T06:16:35.780067+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:52.765833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.758740+0000","last_change":"2023-11-24T06:16:33.767805+0000","last_active":"2023-11-24T06:16:34.758740+0000","last_peered":"2023-11-24T06:16:34.758740+0000","last_clean":"2023-11-24T06:16:34.758740+0000","last_became_active":"2023-11-24T06:16:33.767215+0000","last_became_peered":"2023-11-24T06:16:33.767215+0000","last_unstale":"2023-11-24T06:16:34.758740+0000","last_undegraded":"2023-11-24T06:16:34.758740+0000","last_fullsized":"2023-11-24T06:16:34.758740+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.182462+0000","last_change":"2023-11-24T06:16:34.778394+0000","last_active":"2023-11-24T06:16:36.182462+0000","last_peered":"2023-11-24T06:16:36.182462+0000","last_clean":"2023-11-24T06:16:36.182462+0000","last_became_active":"2023-11-24T06:16:34.778241+0000","last_became_peered":"2023-11-24T06:16:34.778241+0000","last_unstale":"2023-11-24T06:16:36.182462+0000","last_undegraded":"2023-11-24T06:16:36.182462+0000","last_fullsized":"2023-11-24T06:16:36.182462+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:41.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.757051+0000","last_change":"2023-11-24T06:16:33.770982+0000","last_active":"2023-11-24T06:16:34.757051+0000","last_peered":"2023-11-24T06:16:34.757051+0000","last_clean":"2023-11-24T06:16:34.757051+0000","last_became_active":"2023-11-24T06:16:33.770635+0000","last_became_peered":"2023-11-24T06:16:33.770635+0000","last_unstale":"2023-11-24T06:16:34.757051+0000","last_undegraded":"2023-11-24T06:16:34.757051+0000","last_fullsized":"2023-11-24T06:16:34.757051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:06:46.387683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184847+0000","last_change":"2023-11-24T06:16:34.779425+0000","last_active":"2023-11-24T06:16:36.184847+0000","last_peered":"2023-11-24T06:16:36.184847+0000","last_clean":"2023-11-24T06:16:36.184847+0000","last_became_active":"2023-11-24T06:16:34.777788+0000","last_became_peered":"2023-11-24T06:16:34.777788+0000","last_unstale":"2023-11-24T06:16:36.184847+0000","last_undegraded":"2023-11-24T06:16:36.184847+0000","last_fullsized":"2023-11-24T06:16:36.184847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:16:58.765965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.766631+0000","last_change":"2023-11-24T06:16:33.766109+0000","last_active":"2023-11-24T06:16:34.766631+0000","last_peered":"2023-11-24T06:16:34.766631+0000","last_clean":"2023-11-24T06:16:34.766631+0000","last_became_active":"2023-11-24T06:16:33.765841+0000","last_became_peered":"2023-11-24T06:16:33.765841+0000","last_unstale":"2023-11-24T06:16:34.766631+0000","last_undegraded":"2023-11-24T06:16:34.766631+0000","last_fullsized":"2023-11-24T06:16:34.766631+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:08.861330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183576+0000","last_change":"2023-11-24T06:16:34.788979+0000","last_active":"2023-11-24T06:16:36.183576+0000","last_peered":"2023-11-24T06:16:36.183576+0000","last_clean":"2023-11-24T06:16:36.183576+0000","last_became_active":"2023-11-24T06:16:34.785940+0000","last_became_peered":"2023-11-24T06:16:34.785940+0000","last_unstale":"2023-11-24T06:16:36.183576+0000","last_undegraded":"2023-11-24T06:16:36.183576+0000","last_fullsized":"2023-11-24T06:16:36.183576+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:33:08.857383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761143+0000","last_change":"2023-11-24T06:16:33.769803+0000","last_active":"2023-11-24T06:16:34.761143+0000","last_peered":"2023-11-24T06:16:34.761143+0000","last_clean":"2023-11-24T06:16:34.761143+0000","last_became_active":"2023-11-24T06:16:33.769286+0000","last_became_peered":"2023-11-24T06:16:33.769286+0000","last_unstale":"2023-11-24T06:16:34.761143+0000","last_undegraded":"2023-11-24T06:16:34.761143+0000","last_fullsized":"2023-11-24T06:16:34.761143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:26:47.727508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":206,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.749357+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:16:34.749357+0000","last_peered":"2023-11-24T06:16:34.749357+0000","last_clean":"2023-11-24T06:16:34.749357+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:16:34.749357+0000","last_undegraded":"2023-11-24T06:16:34.749357+0000","last_fullsized":"2023-11-24T06:16:34.749357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476797,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":301624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.095,"15min":1.0589999999999999},"min":{"1min":0.85099999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.45,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":2.149},{"interface":"front","average":{"1min":1.304,"5min":1.137,"15min":1.0589999999999999},"min":{"1min":0.71299999999999997,"5min":0.63,"15min":0.63},"max":{"1min":1.7549999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.3320000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1279999999999999,"15min":1.1140000000000001},"min":{"1min":0.82699999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6699999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.155},{"interface":"front","average":{"1min":1.26,"5min":1.1779999999999999,"15min":1.119},"min":{"1min":0.89600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7629999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.958}]},{"osd":2,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2090000000000001,"15min":1.1519999999999999},"min":{"1min":0.78200000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.736,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2909999999999999,"15min":1.339},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.732,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.0369999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.333,"15min":1.3109999999999999},"min":{"1min":0.90900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6830000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.367,"15min":1.345},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7869999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":2.0819999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.296},"min":{"1min":0.89600000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8879999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4390000000000001,"15min":1.357},"min":{"1min":0.97399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.794,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.837}]},{"osd":6,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5189999999999999,"15min":1.52},"min":{"1min":0.97999999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.861,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.782},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4810000000000001,"15min":1.4550000000000001},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.988,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.474}]},{"osd":7,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.591,"15min":1.5589999999999999},"min":{"1min":0.86799999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8899999999999999,"5min":3.262,"15min":3.262},"last":2.028},{"interface":"front","average":{"1min":1.609,"5min":1.651,"15min":1.6830000000000001},"min":{"1min":1.169,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8480000000000001,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":2.206}]}]},{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1327104,"data_stored":891500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.123,"15min":1.073},"min":{"1min":0.92400000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.603,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2,"15min":1.1539999999999999},"min":{"1min":0.82499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.528,"5min":1.72,"15min":1.72},"last":1.1499999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.84799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5840000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.306,"15min":1.2909999999999999},"min":{"1min":1.099,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7370000000000001,"5min":1.847,"15min":1.847},"last":1.4199999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.238,"15min":1.21},"min":{"1min":0.81000000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.718,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.2949999999999999,"15min":1.2989999999999999},"min":{"1min":0.97899999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8200000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.5649999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3220000000000001,"15min":1.327},"min":{"1min":1.073,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.716,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.373,"15min":1.371},"min":{"1min":0.98499999999999999,"5min":0.745,"15min":0.745},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.2509999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.85999999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7709999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4570000000000001,"15min":1.425},"min":{"1min":0.96899999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8799999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.3680000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.5489999999999999,"15min":1.532},"min":{"1min":1.214,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0550000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.518},{"interface":"front","average":{"1min":1.766,"5min":1.7,"15min":1.6739999999999999},"min":{"1min":1.528,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.4780000000000002,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.589}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.466,"15min":1.5},"min":{"1min":0.98999999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2,"5min":2.5,"15min":2.5},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.8029999999999999,"5min":1.7649999999999999,"15min":1.7410000000000001},"min":{"1min":1.377,"5min":0.875,"15min":0.875},"max":{"1min":2.6040000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.641}]}]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":300972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.755},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.755,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.137,"15min":1.2190000000000001},"min":{"1min":0.69799999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.579,"5min":1.619,"15min":1.619},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.2689999999999999,"15min":1.258},"min":{"1min":0.90500000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.625,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.47}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.325,"15min":1.323},"min":{"1min":0.88200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9630000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.466,"5min":1.401,"15min":1.4690000000000001},"min":{"1min":1.208,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7490000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.99199999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":1.141,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.913,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.4690000000000001},"min":{"1min":0.94099999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.75,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.82099999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4339999999999999,"15min":1.482},"min":{"1min":1.0209999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.653,"5min":2.258,"15min":2.258},"last":1.046},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.45,"15min":1.534},"min":{"1min":1.1739999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.8759999999999999,"5min":2.105,"15min":2.105},"last":1.403}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.5649999999999999},"min":{"1min":0.85799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0379999999999998,"5min":2.319,"15min":2.319},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.619,"15min":1.655},"min":{"1min":1.268,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.1240000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.665,"15min":1.6930000000000001},"min":{"1min":1.288,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.1440000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.716},{"interface":"front","average":{"1min":1.718,"5min":1.734,"15min":1.7809999999999999},"min":{"1min":1.379,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0670000000000002,"5min":2.669,"15min":2.669},"last":1.3120000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":302584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.071,"15min":1.071},"min":{"1min":0.80400000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5940000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.234,"5min":1.0820000000000001,"15min":1.085},"min":{"1min":0.755,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.266,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.23,"5min":1.2390000000000001,"15min":1.286},"min":{"1min":0.94699999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6259999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.226,"15min":1.1950000000000001},"min":{"1min":0.97299999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.667,"5min":2.04,"15min":2.04},"last":1.147},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.371,"15min":1.409},"min":{"1min":0.89800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.738,"5min":2.016,"15min":2.016},"last":1.052}]},{"osd":3,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5169999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.325,"15min":1.3520000000000001},"min":{"1min":0.997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8260000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.2789999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.369,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.7170000000000001,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.454,"15min":1.53},"min":{"1min":0.999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8620000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4379999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5269999999999999,"15min":1.579},"min":{"1min":1.103,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9259999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.5229999999999999,"15min":1.613},"min":{"1min":1.0549999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9370000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.383}]},{"osd":7,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.47,"15min":1.552},"min":{"1min":0.97499999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8029999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.081},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.657,"15min":1.7110000000000001},"min":{"1min":1.1659999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0339999999999998,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.6439999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":301028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83999999999999997,"15min":0.87},"min":{"1min":0.66000000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3480000000000001,"5min":1.607,"15min":1.607},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.42399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.4370000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.92800000000000005,"15min":0.91700000000000004},"min":{"1min":0.51800000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4910000000000001,"5min":1.796,"15min":1.796},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.1399999999999999,"15min":1.145},"min":{"1min":0.53600000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.7410000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.083,"15min":1.0589999999999999},"min":{"1min":0.71799999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.661,"5min":1.835,"15min":1.835},"last":1.49},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.1519999999999999,"15min":1.1279999999999999},"min":{"1min":0.753,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7130000000000001,"5min":2.399,"15min":2.399},"last":1.4299999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3129999999999999,"15min":1.321},"min":{"1min":0.91500000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.944,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.044},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3080000000000001,"15min":1.2829999999999999},"min":{"1min":1.115,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.877,"5min":2.141,"15min":2.141},"last":1.6850000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.351,"15min":1.333},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.742,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.3799999999999999,"15min":1.397},"min":{"1min":1.0009999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.847,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.1579999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.4059999999999999,"15min":1.3660000000000001},"min":{"1min":0.95299999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.974,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.827},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3540000000000001,"15min":1.3340000000000001},"min":{"1min":1.0009999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9570000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.587}]},{"osd":7,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.417,"15min":1.427},"min":{"1min":0.94499999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1379999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.647},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1.1439999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0379999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.292}]}]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":301028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85099999999999998,"15min":0.877},"min":{"1min":0.66800000000000004,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.399,"5min":2.552,"15min":2.552},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.93999999999999995,"15min":0.96399999999999997},"min":{"1min":0.78600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5640000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.81000000000000005}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.1850000000000001,"15min":1.141},"min":{"1min":1.01,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6990000000000001,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.125,"15min":1.129},"min":{"1min":0.90800000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6240000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.0009999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.175,"15min":1.169},"min":{"1min":0.97299999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.8220000000000001,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.98899999999999999,"15min":0.96899999999999997},"min":{"1min":0.59399999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.714,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3109999999999999,"15min":1.331},"min":{"1min":1.006,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.7909999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.373},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.486,"15min":1.502},"min":{"1min":1.327,"5min":0.755,"15min":0.755},"max":{"1min":2.0590000000000002,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.113}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.28,"15min":1.236},"min":{"1min":1.0620000000000001,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7370000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.413,"15min":1.4370000000000001},"min":{"1min":1.1419999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.7509999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.5740000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.405,"15min":1.405},"min":{"1min":1.159,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7669999999999999,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.522,"15min":1.556},"min":{"1min":1.0860000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8859999999999999,"5min":4.101,"15min":4.101},"last":1.524}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.5089999999999999,"15min":1.5069999999999999},"min":{"1min":1.23,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9179999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.496},{"interface":"front","average":{"1min":1.637,"5min":1.492,"15min":1.4970000000000001},"min":{"1min":1.2969999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2029999999999998,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.615}]}]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1335296,"data_stored":893534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84999999999999998,"15min":0.83899999999999997},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.708,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.165,"5min":1.0089999999999999,"15min":0.97699999999999998},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.6819999999999999,"5min":2.161,"15min":2.161},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2649999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8420000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.442}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1439999999999999,"15min":1.2},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.7709999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8440000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.3600000000000001,"15min":1.3080000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8180000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3939999999999999},"min":{"1min":0.98799999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.659,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.1539999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:58 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.90600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.742,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2969999999999999,"15min":1.2509999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.0329999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4470000000000001,"15min":1.4410000000000001},"min":{"1min":1.0980000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.994,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.115},{"interface":"front","average":{"1min":1.401,"5min":1.385,"15min":1.343},"min":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.228}]},{"osd":7,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.4630000000000001,"15min":1.4390000000000001},"min":{"1min":0.93000000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2050000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.212,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.891,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.294}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":301062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.94499999999999995},"min":{"1min":0.47499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4279999999999999,"5min":1.571,"15min":1.571},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.024,"15min":1.028},"min":{"1min":0.72099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5620000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.121}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.69099999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.097,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.123,"5min":1.1639999999999999,"15min":1.226},"min":{"1min":0.60999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.538,"5min":2.964,"15min":2.964},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.347,"15min":1.373},"min":{"1min":0.875,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.659,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.294,"15min":1.3240000000000001},"min":{"1min":0.84799999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.71,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.2270000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3480000000000001,"15min":1.3340000000000001},"min":{"1min":0.89100000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7170000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.464,"15min":1.55},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7410000000000001,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.708}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.462},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.784,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.294},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.466,"15min":1.472},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.621,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.472,"15min":1.538},"min":{"1min":0.91800000000000004,"5min":0.87,"15min":0.87},"max":{"1min":2.1499999999999999,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.536},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.55,"15min":1.548},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.704,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":1.504}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5620000000000001,"15min":1.615},"min":{"1min":1.0269999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.708,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.605},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.639,"15min":1.671},"min":{"1min":1.044,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.2679999999999998,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.6539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:46.850 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.086+0000 7f88b27db640 1 Processor -- start 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.087+0000 7f88b27db640 1 -- start start 2023-11-24T06:16:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.088+0000 7f88b27db640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac0cf050 0x7f88ac0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.088+0000 7f88b27db640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f88ac0cd7b0 0x7f88ac0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.088+0000 7f88b27db640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ac15fa70 con 0x7f88ac13dfd0 2023-11-24T06:16:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.088+0000 7f88b27db640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac15c580 con 0x7f88ac0cd7b0 2023-11-24T06:16:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.088+0000 7f88b27db640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0cfa10 con 0x7f88ac0cf050 2023-11-24T06:16:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.089+0000 7f88b17d9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f88ac13dfd0 0x7f88ac15be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45660/0 (socket says 172.21.15.22:45660) 2023-11-24T06:16:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.089+0000 7f88b17d9640 1 -- 172.21.15.22:0/3705162207 learned_addr learned my addr 172.21.15.22:0/3705162207 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.089+0000 7f88b1fda640 1 --2- 172.21.15.22:0/3705162207 >> v2:172.21.15.31:3300/0 conn(0x7f88ac0cd7b0 0x7f88ac0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.089+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401654954 0 0) 0x7f88ac15fa70 con 0x7f88ac13dfd0 2023-11-24T06:16:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.089+0000 7f88b0fd8640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac0cf050 0x7f88ac0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.089+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8898003520 con 0x7f88ac13dfd0 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 257595502 0 0) 0x7f8898003520 con 0x7f88ac13dfd0 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac0cf050 msgr2=0x7f88ac0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac0cf050 0x7f88ac0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 >> v2:172.21.15.31:3300/0 conn(0x7f88ac0cd7b0 msgr2=0x7f88ac0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 --2- 172.21.15.22:0/3705162207 >> v2:172.21.15.31:3300/0 conn(0x7f88ac0cd7b0 0x7f88ac0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac140900 con 0x7f88ac13dfd0 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f88a8001670 con 0x7f88ac13dfd0 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88b0fd8640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac0cf050 0x7f88ac0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 >> v1:172.21.15.22:6789/0 conn(0x7f88ac13dfd0 legacy=0x7f88ac15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac0cf050 0x7f88980039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8898003f20 0x7f88980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8898004d00 0x7f8898005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac15c580 con 0x7f8898003f20 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0cfa10 con 0x7f8898004d00 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889800ba00 con 0x7f88ac0cf050 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.090+0000 7f88b0fd8640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8898003f20 0x7f88980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.091+0000 7f88b17d9640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac0cf050 0x7f88980039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.091+0000 7f88b1fda640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8898004d00 0x7f8898005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.091+0000 7f88b0fd8640 1 -- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac0cf050 msgr2=0x7f88980039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.091+0000 7f88b0fd8640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac0cf050 0x7f88980039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.091+0000 7f88b0fd8640 1 -- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8898004d00 msgr2=0x7f8898005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.091+0000 7f88b0fd8640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8898004d00 0x7f8898005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.091+0000 7f88b0fd8640 1 -- 172.21.15.22:0/3705162207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898003520 con 0x7f8898003f20 2023-11-24T06:16:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.092+0000 7f88b0fd8640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8898003f20 0x7f88980047c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f889c0098a0 tx=0x7f88980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5391f5bbd8f198aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.092+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c004230 con 0x7f8898003f20 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.092+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c004390 con 0x7f8898003f20 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.092+0000 7f88a3fff640 1 -- 172.21.15.22:0/3705162207 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c003830 con 0x7f8898003f20 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.093+0000 7f88b27db640 1 -- 172.21.15.22:0/3705162207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8898003f20 msgr2=0x7f88980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.093+0000 7f88b27db640 1 --2- 172.21.15.22:0/3705162207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8898003f20 0x7f88980047c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f889c0098a0 tx=0x7f88980057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.093+0000 7f88b1fda640 1 -- 172.21.15.22:0/3705162207 reap_dead start 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.093+0000 7f88b27db640 1 -- 172.21.15.22:0/3705162207 shutdown_connections 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.093+0000 7f88b27db640 1 -- 172.21.15.22:0/3705162207 >> 172.21.15.22:0/3705162207 conn(0x7f88ac06a860 msgr2=0x7f88ac06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.093+0000 7f88b27db640 1 -- 172.21.15.22:0/3705162207 shutdown_connections 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.093+0000 7f88b27db640 1 -- 172.21.15.22:0/3705162207 wait complete. 2023-11-24T06:16:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.095+0000 7f88b27db640 1 Processor -- start 2023-11-24T06:16:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.095+0000 7f88b27db640 1 -- start start 2023-11-24T06:16:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.096+0000 7f88b27db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8898003f20 0x7f88ac156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.096+0000 7f88b27db640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac158300 0x7f88ac13af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.096+0000 7f88b27db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac158e60 0x7f88ac159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.096+0000 7f88b27db640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac13b460 con 0x7f88ac158e60 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.096+0000 7f88b27db640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac157260 con 0x7f8898003f20 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.096+0000 7f88b27db640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac157540 con 0x7f88ac158300 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b1fda640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac158e60 0x7f88ac159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b1fda640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac158e60 0x7f88ac159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39980/0 (socket says 172.21.15.22:39980) 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b1fda640 1 -- 172.21.15.22:0/1870491686 learned_addr learned my addr 172.21.15.22:0/1870491686 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b0fd8640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac158300 0x7f88ac13af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b17d9640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8898003f20 0x7f88ac156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b1fda640 1 -- 172.21.15.22:0/1870491686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac158300 msgr2=0x7f88ac13af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b1fda640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac158300 0x7f88ac13af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b1fda640 1 -- 172.21.15.22:0/1870491686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8898003f20 msgr2=0x7f88ac156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b1fda640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8898003f20 0x7f88ac156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b1fda640 1 -- 172.21.15.22:0/1870491686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac157820 con 0x7f88ac158e60 2023-11-24T06:16:47.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.097+0000 7f88b1fda640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac158e60 0x7f88ac159310 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0cfd30 tx=0x7f88a40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:47.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.098+0000 7f88a1ffb640 1 -- 172.21.15.22:0/1870491686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a400e070 con 0x7f88ac158e60 2023-11-24T06:16:47.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.098+0000 7f88a1ffb640 1 -- 172.21.15.22:0/1870491686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a4011e10 con 0x7f88ac158e60 2023-11-24T06:16:47.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.098+0000 7f88a1ffb640 1 -- 172.21.15.22:0/1870491686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4003990 con 0x7f88ac158e60 2023-11-24T06:16:47.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.098+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac157b00 con 0x7f88ac158e60 2023-11-24T06:16:47.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.098+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac159850 con 0x7f88ac158e60 2023-11-24T06:16:47.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.099+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac158020 con 0x7f88ac158e60 2023-11-24T06:16:47.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.100+0000 7f88a1ffb640 1 -- 172.21.15.22:0/1870491686 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f88a4003af0 con 0x7f88ac158e60 2023-11-24T06:16:47.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.101+0000 7f88a1ffb640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f889006aff0 0x7f889006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.101+0000 7f88a1ffb640 1 -- 172.21.15.22:0/1870491686 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88a408a170 con 0x7f88ac158e60 2023-11-24T06:16:47.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.101+0000 7f88b17d9640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f889006aff0 0x7f889006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.102+0000 7f88b17d9640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f889006aff0 0x7f889006d4b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f88a8001eb0 tx=0x7f88a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:47.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.106+0000 7f88a1ffb640 1 -- 172.21.15.22:0/1870491686 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88ac158020 con 0x7f88ac158e60 2023-11-24T06:16:47.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.299+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88ac1576b0 con 0x7f889006aff0 2023-11-24T06:16:47.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.309+0000 7f88a1ffb640 1 -- 172.21.15.22:0/1870491686 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286538 (secure 0 0 0) 0x7f88ac1576b0 con 0x7f889006aff0 2023-11-24T06:16:47.315 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:47.316 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:16:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.314+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f889006aff0 msgr2=0x7f889006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.314+0000 7f88b27db640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f889006aff0 0x7f889006d4b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f88a8001eb0 tx=0x7f88a8009040 comp rx=0 tx=0).stop 2023-11-24T06:16:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.314+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac158e60 msgr2=0x7f88ac159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.314+0000 7f88b27db640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac158e60 0x7f88ac159310 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0cfd30 tx=0x7f88a40115a0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.315+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 shutdown_connections 2023-11-24T06:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.315+0000 7f88b27db640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f889006aff0 0x7f889006d4b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.315+0000 7f88b27db640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac158e60 0x7f88ac159310 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.315+0000 7f88b27db640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f88ac158300 0x7f88ac13af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.315+0000 7f88b27db640 1 --2- 172.21.15.22:0/1870491686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8898003f20 0x7f88ac156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.315+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 >> 172.21.15.22:0/1870491686 conn(0x7f88ac06a860 msgr2=0x7f88ac0af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.315+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 shutdown_connections 2023-11-24T06:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.315+0000 7f88b27db640 1 -- 172.21.15.22:0/1870491686 wait complete. 2023-11-24T06:16:47.336 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2023-11-24T06:16:46.746772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243868,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730852,"statfs":{"total":773094113280,"available":772844392448,"internally_reserved":0,"allocated":7053312,"data_stored":3593332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.974398"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777816+0000","last_change":"2023-11-24T06:16:34.784922+0000","last_active":"2023-11-24T06:16:35.777816+0000","last_peered":"2023-11-24T06:16:35.777816+0000","last_clean":"2023-11-24T06:16:35.777816+0000","last_became_active":"2023-11-24T06:16:34.784637+0000","last_became_peered":"2023-11-24T06:16:34.784637+0000","last_unstale":"2023-11-24T06:16:35.777816+0000","last_undegraded":"2023-11-24T06:16:35.777816+0000","last_fullsized":"2023-11-24T06:16:35.777816+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:20.213211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184204+0000","last_change":"2023-11-24T06:16:34.785684+0000","last_active":"2023-11-24T06:16:36.184204+0000","last_peered":"2023-11-24T06:16:36.184204+0000","last_clean":"2023-11-24T06:16:36.184204+0000","last_became_active":"2023-11-24T06:16:34.785429+0000","last_became_peered":"2023-11-24T06:16:34.785429+0000","last_unstale":"2023-11-24T06:16:36.184204+0000","last_undegraded":"2023-11-24T06:16:36.184204+0000","last_fullsized":"2023-11-24T06:16:36.184204+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:40.578781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778421+0000","last_change":"2023-11-24T06:16:34.775651+0000","last_active":"2023-11-24T06:16:35.778421+0000","last_peered":"2023-11-24T06:16:35.778421+0000","last_clean":"2023-11-24T06:16:35.778421+0000","last_became_active":"2023-11-24T06:16:34.775056+0000","last_became_peered":"2023-11-24T06:16:34.775056+0000","last_unstale":"2023-11-24T06:16:35.778421+0000","last_undegraded":"2023-11-24T06:16:35.778421+0000","last_fullsized":"2023-11-24T06:16:35.778421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:41.438416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777708+0000","last_change":"2023-11-24T06:16:34.778339+0000","last_active":"2023-11-24T06:16:35.777708+0000","last_peered":"2023-11-24T06:16:35.777708+0000","last_clean":"2023-11-24T06:16:35.777708+0000","last_became_active":"2023-11-24T06:16:34.777884+0000","last_became_peered":"2023-11-24T06:16:34.777884+0000","last_unstale":"2023-11-24T06:16:35.777708+0000","last_undegraded":"2023-11-24T06:16:35.777708+0000","last_fullsized":"2023-11-24T06:16:35.777708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:52:16.086487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777384+0000","last_change":"2023-11-24T06:16:34.770802+0000","last_active":"2023-11-24T06:16:35.777384+0000","last_peered":"2023-11-24T06:16:35.777384+0000","last_clean":"2023-11-24T06:16:35.777384+0000","last_became_active":"2023-11-24T06:16:34.768995+0000","last_became_peered":"2023-11-24T06:16:34.768995+0000","last_unstale":"2023-11-24T06:16:35.777384+0000","last_undegraded":"2023-11-24T06:16:35.777384+0000","last_fullsized":"2023-11-24T06:16:35.777384+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:38.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185447+0000","last_change":"2023-11-24T06:16:34.760436+0000","last_active":"2023-11-24T06:16:36.185447+0000","last_peered":"2023-11-24T06:16:36.185447+0000","last_clean":"2023-11-24T06:16:36.185447+0000","last_became_active":"2023-11-24T06:16:34.759986+0000","last_became_peered":"2023-11-24T06:16:34.759986+0000","last_unstale":"2023-11-24T06:16:36.185447+0000","last_undegraded":"2023-11-24T06:16:36.185447+0000","last_fullsized":"2023-11-24T06:16:36.185447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:22:17.558080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183040+0000","last_change":"2023-11-24T06:16:34.776349+0000","last_active":"2023-11-24T06:16:36.183040+0000","last_peered":"2023-11-24T06:16:36.183040+0000","last_clean":"2023-11-24T06:16:36.183040+0000","last_became_active":"2023-11-24T06:16:34.776058+0000","last_became_peered":"2023-11-24T06:16:34.776058+0000","last_unstale":"2023-11-24T06:16:36.183040+0000","last_undegraded":"2023-11-24T06:16:36.183040+0000","last_fullsized":"2023-11-24T06:16:36.183040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:52.698358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183386+0000","last_change":"2023-11-24T06:16:34.778255+0000","last_active":"2023-11-24T06:16:36.183386+0000","last_peered":"2023-11-24T06:16:36.183386+0000","last_clean":"2023-11-24T06:16:36.183386+0000","last_became_active":"2023-11-24T06:16:34.777987+0000","last_became_peered":"2023-11-24T06:16:34.777987+0000","last_unstale":"2023-11-24T06:16:36.183386+0000","last_undegraded":"2023-11-24T06:16:36.183386+0000","last_fullsized":"2023-11-24T06:16:36.183386+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:09:39.825253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184556+0000","last_change":"2023-11-24T06:16:34.767975+0000","last_active":"2023-11-24T06:16:36.184556+0000","last_peered":"2023-11-24T06:16:36.184556+0000","last_clean":"2023-11-24T06:16:36.184556+0000","last_became_active":"2023-11-24T06:16:34.767633+0000","last_became_peered":"2023-11-24T06:16:34.767633+0000","last_unstale":"2023-11-24T06:16:36.184556+0000","last_undegraded":"2023-11-24T06:16:36.184556+0000","last_fullsized":"2023-11-24T06:16:36.184556+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:37.802170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187437+0000","last_change":"2023-11-24T06:16:34.781609+0000","last_active":"2023-11-24T06:16:36.187437+0000","last_peered":"2023-11-24T06:16:36.187437+0000","last_clean":"2023-11-24T06:16:36.187437+0000","last_became_active":"2023-11-24T06:16:34.778750+0000","last_became_peered":"2023-11-24T06:16:34.778750+0000","last_unstale":"2023-11-24T06:16:36.187437+0000","last_undegraded":"2023-11-24T06:16:36.187437+0000","last_fullsized":"2023-11-24T06:16:36.187437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:59:05.773308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.187160+0000","last_change":"2023-11-24T06:16:34.790561+0000","last_active":"2023-11-24T06:16:36.187160+0000","last_peered":"2023-11-24T06:16:36.187160+0000","last_clean":"2023-11-24T06:16:36.187160+0000","last_became_active":"2023-11-24T06:16:34.790318+0000","last_became_peered":"2023-11-24T06:16:34.790318+0000","last_unstale":"2023-11-24T06:16:36.187160+0000","last_undegraded":"2023-11-24T06:16:36.187160+0000","last_fullsized":"2023-11-24T06:16:36.187160+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:54.298750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778929+0000","last_change":"2023-11-24T06:16:34.771827+0000","last_active":"2023-11-24T06:16:35.778929+0000","last_peered":"2023-11-24T06:16:35.778929+0000","last_clean":"2023-11-24T06:16:35.778929+0000","last_became_active":"2023-11-24T06:16:34.769123+0000","last_became_peered":"2023-11-24T06:16:34.769123+0000","last_unstale":"2023-11-24T06:16:35.778929+0000","last_undegraded":"2023-11-24T06:16:35.778929+0000","last_fullsized":"2023-11-24T06:16:35.778929+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:18.574041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185380+0000","last_change":"2023-11-24T06:16:34.783962+0000","last_active":"2023-11-24T06:16:36.185380+0000","last_peered":"2023-11-24T06:16:36.185380+0000","last_clean":"2023-11-24T06:16:36.185380+0000","last_became_active":"2023-11-24T06:16:34.783653+0000","last_became_peered":"2023-11-24T06:16:34.783653+0000","last_unstale":"2023-11-24T06:16:36.185380+0000","last_undegraded":"2023-11-24T06:16:36.185380+0000","last_fullsized":"2023-11-24T06:16:36.185380+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:21:35.814253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183543+0000","last_change":"2023-11-24T06:16:34.769071+0000","last_active":"2023-11-24T06:16:36.183543+0000","last_peered":"2023-11-24T06:16:36.183543+0000","last_clean":"2023-11-24T06:16:36.183543+0000","last_became_active":"2023-11-24T06:16:34.768724+0000","last_became_peered":"2023-11-24T06:16:34.768724+0000","last_unstale":"2023-11-24T06:16:36.183543+0000","last_undegraded":"2023-11-24T06:16:36.183543+0000","last_fullsized":"2023-11-24T06:16:36.183543+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:35.635938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183094+0000","last_change":"2023-11-24T06:16:34.768910+0000","last_active":"2023-11-24T06:16:36.183094+0000","last_peered":"2023-11-24T06:16:36.183094+0000","last_clean":"2023-11-24T06:16:36.183094+0000","last_became_active":"2023-11-24T06:16:34.768605+0000","last_became_peered":"2023-11-24T06:16:34.768605+0000","last_unstale":"2023-11-24T06:16:36.183094+0000","last_undegraded":"2023-11-24T06:16:36.183094+0000","last_fullsized":"2023-11-24T06:16:36.183094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:07.020824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.182780+0000","last_change":"2023-11-24T06:16:34.777347+0000","last_active":"2023-11-24T06:16:36.182780+0000","last_peered":"2023-11-24T06:16:36.182780+0000","last_clean":"2023-11-24T06:16:36.182780+0000","last_became_active":"2023-11-24T06:16:34.776772+0000","last_became_peered":"2023-11-24T06:16:34.776772+0000","last_unstale":"2023-11-24T06:16:36.182780+0000","last_undegraded":"2023-11-24T06:16:36.182780+0000","last_fullsized":"2023-11-24T06:16:36.182780+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:47:09.857056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184951+0000","last_change":"2023-11-24T06:16:34.779286+0000","last_active":"2023-11-24T06:16:36.184951+0000","last_peered":"2023-11-24T06:16:36.184951+0000","last_clean":"2023-11-24T06:16:36.184951+0000","last_became_active":"2023-11-24T06:16:34.779018+0000","last_became_peered":"2023-11-24T06:16:34.779018+0000","last_unstale":"2023-11-24T06:16:36.184951+0000","last_undegraded":"2023-11-24T06:16:36.184951+0000","last_fullsized":"2023-11-24T06:16:36.184951+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:50.206831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780045+0000","last_change":"2023-11-24T06:16:34.780696+0000","last_active":"2023-11-24T06:16:35.780045+0000","last_peered":"2023-11-24T06:16:35.780045+0000","last_clean":"2023-11-24T06:16:35.780045+0000","last_became_active":"2023-11-24T06:16:34.780375+0000","last_became_peered":"2023-11-24T06:16:34.780375+0000","last_unstale":"2023-11-24T06:16:35.780045+0000","last_undegraded":"2023-11-24T06:16:35.780045+0000","last_fullsized":"2023-11-24T06:16:35.780045+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:52:01.960585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777477+0000","last_change":"2023-11-24T06:16:34.788647+0000","last_active":"2023-11-24T06:16:35.777477+0000","last_peered":"2023-11-24T06:16:35.777477+0000","last_clean":"2023-11-24T06:16:35.777477+0000","last_became_active":"2023-11-24T06:16:34.788382+0000","last_became_peered":"2023-11-24T06:16:34.788382+0000","last_unstale":"2023-11-24T06:16:35.777477+0000","last_undegraded":"2023-11-24T06:16:35.777477+0000","last_fullsized":"2023-11-24T06:16:35.777477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:34.842812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184202+0000","last_change":"2023-11-24T06:16:34.786581+0000","last_active":"2023-11-24T06:16:36.184202+0000","last_peered":"2023-11-24T06:16:36.184202+0000","last_clean":"2023-11-24T06:16:36.184202+0000","last_became_active":"2023-11-24T06:16:34.786316+0000","last_became_peered":"2023-11-24T06:16:34.786316+0000","last_unstale":"2023-11-24T06:16:36.184202+0000","last_undegraded":"2023-11-24T06:16:36.184202+0000","last_fullsized":"2023-11-24T06:16:36.184202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:21.500872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779698+0000","last_change":"2023-11-24T06:16:34.776589+0000","last_active":"2023-11-24T06:16:35.779698+0000","last_peered":"2023-11-24T06:16:35.779698+0000","last_clean":"2023-11-24T06:16:35.779698+0000","last_became_active":"2023-11-24T06:16:34.775025+0000","last_became_peered":"2023-11-24T06:16:34.775025+0000","last_unstale":"2023-11-24T06:16:35.779698+0000","last_undegraded":"2023-11-24T06:16:35.779698+0000","last_fullsized":"2023-11-24T06:16:35.779698+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:28.321073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183965+0000","last_change":"2023-11-24T06:16:34.777937+0000","last_active":"2023-11-24T06:16:36.183965+0000","last_peered":"2023-11-24T06:16:36.183965+0000","last_clean":"2023-11-24T06:16:36.183965+0000","last_became_active":"2023-11-24T06:16:34.775338+0000","last_became_peered":"2023-11-24T06:16:34.775338+0000","last_unstale":"2023-11-24T06:16:36.183965+0000","last_undegraded":"2023-11-24T06:16:36.183965+0000","last_fullsized":"2023-11-24T06:16:36.183965+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:59:02.525646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778261+0000","last_change":"2023-11-24T06:16:34.772905+0000","last_active":"2023-11-24T06:16:35.778261+0000","last_peered":"2023-11-24T06:16:35.778261+0000","last_clean":"2023-11-24T06:16:35.778261+0000","last_became_active":"2023-11-24T06:16:34.772569+0000","last_became_peered":"2023-11-24T06:16:34.772569+0000","last_unstale":"2023-11-24T06:16:35.778261+0000","last_undegraded":"2023-11-24T06:16:35.778261+0000","last_fullsized":"2023-11-24T06:16:35.778261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:37.802170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184391+0000","last_change":"2023-11-24T06:16:34.772992+0000","last_active":"2023-11-24T06:16:36.184391+0000","last_peered":"2023-11-24T06:16:36.184391+0000","last_clean":"2023-11-24T06:16:36.184391+0000","last_became_active":"2023-11-24T06:16:34.770371+0000","last_became_peered":"2023-11-24T06:16:34.770371+0000","last_unstale":"2023-11-24T06:16:36.184391+0000","last_undegraded":"2023-11-24T06:16:36.184391+0000","last_fullsized":"2023-11-24T06:16:36.184391+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:54.140736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777725+0000","last_change":"2023-11-24T06:16:34.767766+0000","last_active":"2023-11-24T06:16:35.777725+0000","last_peered":"2023-11-24T06:16:35.777725+0000","last_clean":"2023-11-24T06:16:35.777725+0000","last_became_active":"2023-11-24T06:16:34.767474+0000","last_became_peered":"2023-11-24T06:16:34.767474+0000","last_unstale":"2023-11-24T06:16:35.777725+0000","last_undegraded":"2023-11-24T06:16:35.777725+0000","last_fullsized":"2023-11-24T06:16:35.777725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:49:59.030135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780345+0000","last_change":"2023-11-24T06:16:34.775482+0000","last_active":"2023-11-24T06:16:35.780345+0000","last_peered":"2023-11-24T06:16:35.780345+0000","last_clean":"2023-11-24T06:16:35.780345+0000","last_became_active":"2023-11-24T06:16:34.775130+0000","last_became_peered":"2023-11-24T06:16:34.775130+0000","last_unstale":"2023-11-24T06:16:35.780345+0000","last_undegraded":"2023-11-24T06:16:35.780345+0000","last_fullsized":"2023-11-24T06:16:35.780345+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:52:01.960585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185559+0000","last_change":"2023-11-24T06:16:34.771647+0000","last_active":"2023-11-24T06:16:36.185559+0000","last_peered":"2023-11-24T06:16:36.185559+0000","last_clean":"2023-11-24T06:16:36.185559+0000","last_became_active":"2023-11-24T06:16:34.771391+0000","last_became_peered":"2023-11-24T06:16:34.771391+0000","last_unstale":"2023-11-24T06:16:36.185559+0000","last_undegraded":"2023-11-24T06:16:36.185559+0000","last_fullsized":"2023-11-24T06:16:36.185559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:09.877627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777428+0000","last_change":"2023-11-24T06:16:34.777315+0000","last_active":"2023-11-24T06:16:35.777428+0000","last_peered":"2023-11-24T06:16:35.777428+0000","last_clean":"2023-11-24T06:16:35.777428+0000","last_became_active":"2023-11-24T06:16:34.777075+0000","last_became_peered":"2023-11-24T06:16:34.777075+0000","last_unstale":"2023-11-24T06:16:35.777428+0000","last_undegraded":"2023-11-24T06:16:35.777428+0000","last_fullsized":"2023-11-24T06:16:35.777428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:35:01.868389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184059+0000","last_change":"2023-11-24T06:16:34.789803+0000","last_active":"2023-11-24T06:16:36.184059+0000","last_peered":"2023-11-24T06:16:36.184059+0000","last_clean":"2023-11-24T06:16:36.184059+0000","last_became_active":"2023-11-24T06:16:34.784408+0000","last_became_peered":"2023-11-24T06:16:34.784408+0000","last_unstale":"2023-11-24T06:16:36.184059+0000","last_undegraded":"2023-11-24T06:16:36.184059+0000","last_fullsized":"2023-11-24T06:16:36.184059+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:09:21.389235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778654+0000","last_change":"2023-11-24T06:16:34.772866+0000","last_active":"2023-11-24T06:16:35.778654+0000","last_peered":"2023-11-24T06:16:35.778654+0000","last_clean":"2023-11-24T06:16:35.778654+0000","last_became_active":"2023-11-24T06:16:34.772336+0000","last_became_peered":"2023-11-24T06:16:34.772336+0000","last_unstale":"2023-11-24T06:16:35.778654+0000","last_undegraded":"2023-11-24T06:16:35.778654+0000","last_fullsized":"2023-11-24T06:16:35.778654+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:18.574041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.776644+0000","last_change":"2023-11-24T06:16:34.764398+0000","last_active":"2023-11-24T06:16:35.776644+0000","last_peered":"2023-11-24T06:16:35.776644+0000","last_clean":"2023-11-24T06:16:35.776644+0000","last_became_active":"2023-11-24T06:16:34.764118+0000","last_became_peered":"2023-11-24T06:16:34.764118+0000","last_unstale":"2023-11-24T06:16:35.776644+0000","last_undegraded":"2023-11-24T06:16:35.776644+0000","last_fullsized":"2023-11-24T06:16:35.776644+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:18:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183173+0000","last_change":"2023-11-24T06:16:34.788736+0000","last_active":"2023-11-24T06:16:36.183173+0000","last_peered":"2023-11-24T06:16:36.183173+0000","last_clean":"2023-11-24T06:16:36.183173+0000","last_became_active":"2023-11-24T06:16:34.788121+0000","last_became_peered":"2023-11-24T06:16:34.788121+0000","last_unstale":"2023-11-24T06:16:36.183173+0000","last_undegraded":"2023-11-24T06:16:36.183173+0000","last_fullsized":"2023-11-24T06:16:36.183173+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:57:07.786526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185929+0000","last_change":"2023-11-24T06:16:34.769288+0000","last_active":"2023-11-24T06:16:36.185929+0000","last_peered":"2023-11-24T06:16:36.185929+0000","last_clean":"2023-11-24T06:16:36.185929+0000","last_became_active":"2023-11-24T06:16:34.768971+0000","last_became_peered":"2023-11-24T06:16:34.768971+0000","last_unstale":"2023-11-24T06:16:36.185929+0000","last_undegraded":"2023-11-24T06:16:36.185929+0000","last_fullsized":"2023-11-24T06:16:36.185929+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:16:48.573601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.783489+0000","last_change":"2023-11-24T06:16:33.764034+0000","last_active":"2023-11-24T06:16:34.783489+0000","last_peered":"2023-11-24T06:16:34.783489+0000","last_clean":"2023-11-24T06:16:34.783489+0000","last_became_active":"2023-11-24T06:16:33.763717+0000","last_became_peered":"2023-11-24T06:16:33.763717+0000","last_unstale":"2023-11-24T06:16:34.783489+0000","last_undegraded":"2023-11-24T06:16:34.783489+0000","last_fullsized":"2023-11-24T06:16:34.783489+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:51.749535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184656+0000","last_change":"2023-11-24T06:16:34.781959+0000","last_active":"2023-11-24T06:16:36.184656+0000","last_peered":"2023-11-24T06:16:36.184656+0000","last_clean":"2023-11-24T06:16:36.184656+0000","last_became_active":"2023-11-24T06:16:34.781005+0000","last_became_peered":"2023-11-24T06:16:34.781005+0000","last_unstale":"2023-11-24T06:16:36.184656+0000","last_undegraded":"2023-11-24T06:16:36.184656+0000","last_fullsized":"2023-11-24T06:16:36.184656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:39.144025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.788060+0000","last_change":"2023-11-24T06:16:33.775735+0000","last_active":"2023-11-24T06:16:34.788060+0000","last_peered":"2023-11-24T06:16:34.788060+0000","last_clean":"2023-11-24T06:16:34.788060+0000","last_became_active":"2023-11-24T06:16:33.775158+0000","last_became_peered":"2023-11-24T06:16:33.775158+0000","last_unstale":"2023-11-24T06:16:34.788060+0000","last_undegraded":"2023-11-24T06:16:34.788060+0000","last_fullsized":"2023-11-24T06:16:34.788060+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:22:16.541783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186916+0000","last_change":"2023-11-24T06:16:34.781354+0000","last_active":"2023-11-24T06:16:36.186916+0000","last_peered":"2023-11-24T06:16:36.186916+0000","last_clean":"2023-11-24T06:16:36.186916+0000","last_became_active":"2023-11-24T06:16:34.774187+0000","last_became_peered":"2023-11-24T06:16:34.774187+0000","last_unstale":"2023-11-24T06:16:36.186916+0000","last_undegraded":"2023-11-24T06:16:36.186916+0000","last_fullsized":"2023-11-24T06:16:36.186916+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:15.919265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.780874+0000","last_change":"2023-11-24T06:16:33.777399+0000","last_active":"2023-11-24T06:16:34.780874+0000","last_peered":"2023-11-24T06:16:34.780874+0000","last_clean":"2023-11-24T06:16:34.780874+0000","last_became_active":"2023-11-24T06:16:33.777098+0000","last_became_peered":"2023-11-24T06:16:33.777098+0000","last_unstale":"2023-11-24T06:16:34.780874+0000","last_undegraded":"2023-11-24T06:16:34.780874+0000","last_fullsized":"2023-11-24T06:16:34.780874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:17.557744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185948+0000","last_change":"2023-11-24T06:16:34.777959+0000","last_active":"2023-11-24T06:16:36.185948+0000","last_peered":"2023-11-24T06:16:36.185948+0000","last_clean":"2023-11-24T06:16:36.185948+0000","last_became_active":"2023-11-24T06:16:34.777669+0000","last_became_peered":"2023-11-24T06:16:34.777669+0000","last_unstale":"2023-11-24T06:16:36.185948+0000","last_undegraded":"2023-11-24T06:16:36.185948+0000","last_fullsized":"2023-11-24T06:16:36.185948+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:18.485649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.781680+0000","last_change":"2023-11-24T06:16:33.770950+0000","last_active":"2023-11-24T06:16:34.781680+0000","last_peered":"2023-11-24T06:16:34.781680+0000","last_clean":"2023-11-24T06:16:34.781680+0000","last_became_active":"2023-11-24T06:16:33.770565+0000","last_became_peered":"2023-11-24T06:16:33.770565+0000","last_unstale":"2023-11-24T06:16:34.781680+0000","last_undegraded":"2023-11-24T06:16:34.781680+0000","last_fullsized":"2023-11-24T06:16:34.781680+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184355+0000","last_change":"2023-11-24T06:16:34.772227+0000","last_active":"2023-11-24T06:16:36.184355+0000","last_peered":"2023-11-24T06:16:36.184355+0000","last_clean":"2023-11-24T06:16:36.184355+0000","last_became_active":"2023-11-24T06:16:34.770666+0000","last_became_peered":"2023-11-24T06:16:34.770666+0000","last_unstale":"2023-11-24T06:16:36.184355+0000","last_undegraded":"2023-11-24T06:16:36.184355+0000","last_fullsized":"2023-11-24T06:16:36.184355+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:54.686947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.776880+0000","last_change":"2023-11-24T06:16:33.772396+0000","last_active":"2023-11-24T06:16:34.776880+0000","last_peered":"2023-11-24T06:16:34.776880+0000","last_clean":"2023-11-24T06:16:34.776880+0000","last_became_active":"2023-11-24T06:16:33.771826+0000","last_became_peered":"2023-11-24T06:16:33.771826+0000","last_unstale":"2023-11-24T06:16:34.776880+0000","last_undegraded":"2023-11-24T06:16:34.776880+0000","last_fullsized":"2023-11-24T06:16:34.776880+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:21.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183905+0000","last_change":"2023-11-24T06:16:34.790827+0000","last_active":"2023-11-24T06:16:36.183905+0000","last_peered":"2023-11-24T06:16:36.183905+0000","last_clean":"2023-11-24T06:16:36.183905+0000","last_became_active":"2023-11-24T06:16:34.790304+0000","last_became_peered":"2023-11-24T06:16:34.790304+0000","last_unstale":"2023-11-24T06:16:36.183905+0000","last_undegraded":"2023-11-24T06:16:36.183905+0000","last_fullsized":"2023-11-24T06:16:36.183905+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:39.642187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.776702+0000","last_change":"2023-11-24T06:16:33.767335+0000","last_active":"2023-11-24T06:16:34.776702+0000","last_peered":"2023-11-24T06:16:34.776702+0000","last_clean":"2023-11-24T06:16:34.776702+0000","last_became_active":"2023-11-24T06:16:33.767085+0000","last_became_peered":"2023-11-24T06:16:33.767085+0000","last_unstale":"2023-11-24T06:16:34.776702+0000","last_undegraded":"2023-11-24T06:16:34.776702+0000","last_fullsized":"2023-11-24T06:16:34.776702+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:52:15.070190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184474+0000","last_change":"2023-11-24T06:16:34.774370+0000","last_active":"2023-11-24T06:16:36.184474+0000","last_peered":"2023-11-24T06:16:36.184474+0000","last_clean":"2023-11-24T06:16:36.184474+0000","last_became_active":"2023-11-24T06:16:34.771220+0000","last_became_peered":"2023-11-24T06:16:34.771220+0000","last_unstale":"2023-11-24T06:16:36.184474+0000","last_undegraded":"2023-11-24T06:16:36.184474+0000","last_fullsized":"2023-11-24T06:16:36.184474+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:41.424156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.775972+0000","last_change":"2023-11-24T06:16:33.770060+0000","last_active":"2023-11-24T06:16:34.775972+0000","last_peered":"2023-11-24T06:16:34.775972+0000","last_clean":"2023-11-24T06:16:34.775972+0000","last_became_active":"2023-11-24T06:16:33.769764+0000","last_became_peered":"2023-11-24T06:16:33.769764+0000","last_unstale":"2023-11-24T06:16:34.775972+0000","last_undegraded":"2023-11-24T06:16:34.775972+0000","last_fullsized":"2023-11-24T06:16:34.775972+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183603+0000","last_change":"2023-11-24T06:16:34.777384+0000","last_active":"2023-11-24T06:16:36.183603+0000","last_peered":"2023-11-24T06:16:36.183603+0000","last_clean":"2023-11-24T06:16:36.183603+0000","last_became_active":"2023-11-24T06:16:34.775239+0000","last_became_peered":"2023-11-24T06:16:34.775239+0000","last_unstale":"2023-11-24T06:16:36.183603+0000","last_undegraded":"2023-11-24T06:16:36.183603+0000","last_fullsized":"2023-11-24T06:16:36.183603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:16:34.581621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.750651+0000","last_change":"2023-11-24T06:16:33.769378+0000","last_active":"2023-11-24T06:16:34.750651+0000","last_peered":"2023-11-24T06:16:34.750651+0000","last_clean":"2023-11-24T06:16:34.750651+0000","last_became_active":"2023-11-24T06:16:33.768768+0000","last_became_peered":"2023-11-24T06:16:33.768768+0000","last_unstale":"2023-11-24T06:16:34.750651+0000","last_undegraded":"2023-11-24T06:16:34.750651+0000","last_fullsized":"2023-11-24T06:16:34.750651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:50:41.314836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184213+0000","last_change":"2023-11-24T06:16:34.767771+0000","last_active":"2023-11-24T06:16:36.184213+0000","last_peered":"2023-11-24T06:16:36.184213+0000","last_clean":"2023-11-24T06:16:36.184213+0000","last_became_active":"2023-11-24T06:16:34.767377+0000","last_became_peered":"2023-11-24T06:16:34.767377+0000","last_unstale":"2023-11-24T06:16:36.184213+0000","last_undegraded":"2023-11-24T06:16:36.184213+0000","last_fullsized":"2023-11-24T06:16:36.184213+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:17.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.752146+0000","last_change":"2023-11-24T06:16:33.770422+0000","last_active":"2023-11-24T06:16:34.752146+0000","last_peered":"2023-11-24T06:16:34.752146+0000","last_clean":"2023-11-24T06:16:34.752146+0000","last_became_active":"2023-11-24T06:16:33.769391+0000","last_became_peered":"2023-11-24T06:16:33.769391+0000","last_unstale":"2023-11-24T06:16:34.752146+0000","last_undegraded":"2023-11-24T06:16:34.752146+0000","last_fullsized":"2023-11-24T06:16:34.752146+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:51.369211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780478+0000","last_change":"2023-11-24T06:16:34.772067+0000","last_active":"2023-11-24T06:16:35.780478+0000","last_peered":"2023-11-24T06:16:35.780478+0000","last_clean":"2023-11-24T06:16:35.780478+0000","last_became_active":"2023-11-24T06:16:34.770191+0000","last_became_peered":"2023-11-24T06:16:34.770191+0000","last_unstale":"2023-11-24T06:16:35.780478+0000","last_undegraded":"2023-11-24T06:16:35.780478+0000","last_fullsized":"2023-11-24T06:16:35.780478+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:57:07.786526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.766754+0000","last_change":"2023-11-24T06:16:33.775471+0000","last_active":"2023-11-24T06:16:34.766754+0000","last_peered":"2023-11-24T06:16:34.766754+0000","last_clean":"2023-11-24T06:16:34.766754+0000","last_became_active":"2023-11-24T06:16:33.774435+0000","last_became_peered":"2023-11-24T06:16:33.774435+0000","last_unstale":"2023-11-24T06:16:34.766754+0000","last_undegraded":"2023-11-24T06:16:34.766754+0000","last_fullsized":"2023-11-24T06:16:34.766754+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:52.457393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186420+0000","last_change":"2023-11-24T06:16:34.776486+0000","last_active":"2023-11-24T06:16:36.186420+0000","last_peered":"2023-11-24T06:16:36.186420+0000","last_clean":"2023-11-24T06:16:36.186420+0000","last_became_active":"2023-11-24T06:16:34.776078+0000","last_became_peered":"2023-11-24T06:16:34.776078+0000","last_unstale":"2023-11-24T06:16:36.186420+0000","last_undegraded":"2023-11-24T06:16:36.186420+0000","last_fullsized":"2023-11-24T06:16:36.186420+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:28.810438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.792232+0000","last_change":"2023-11-24T06:16:33.776539+0000","last_active":"2023-11-24T06:16:34.792232+0000","last_peered":"2023-11-24T06:16:34.792232+0000","last_clean":"2023-11-24T06:16:34.792232+0000","last_became_active":"2023-11-24T06:16:33.775258+0000","last_became_peered":"2023-11-24T06:16:33.775258+0000","last_unstale":"2023-11-24T06:16:34.792232+0000","last_undegraded":"2023-11-24T06:16:34.792232+0000","last_fullsized":"2023-11-24T06:16:34.792232+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:33.643429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779897+0000","last_change":"2023-11-24T06:16:34.767100+0000","last_active":"2023-11-24T06:16:35.779897+0000","last_peered":"2023-11-24T06:16:35.779897+0000","last_clean":"2023-11-24T06:16:35.779897+0000","last_became_active":"2023-11-24T06:16:34.766824+0000","last_became_peered":"2023-11-24T06:16:34.766824+0000","last_unstale":"2023-11-24T06:16:35.779897+0000","last_undegraded":"2023-11-24T06:16:35.779897+0000","last_fullsized":"2023-11-24T06:16:35.779897+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:06.873688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.788987+0000","last_change":"2023-11-24T06:16:33.766405+0000","last_active":"2023-11-24T06:16:34.788987+0000","last_peered":"2023-11-24T06:16:34.788987+0000","last_clean":"2023-11-24T06:16:34.788987+0000","last_became_active":"2023-11-24T06:16:33.765503+0000","last_became_peered":"2023-11-24T06:16:33.765503+0000","last_unstale":"2023-11-24T06:16:34.788987+0000","last_undegraded":"2023-11-24T06:16:34.788987+0000","last_fullsized":"2023-11-24T06:16:34.788987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:54.046458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777046+0000","last_change":"2023-11-24T06:16:34.771695+0000","last_active":"2023-11-24T06:16:35.777046+0000","last_peered":"2023-11-24T06:16:35.777046+0000","last_clean":"2023-11-24T06:16:35.777046+0000","last_became_active":"2023-11-24T06:16:34.771339+0000","last_became_peered":"2023-11-24T06:16:34.771339+0000","last_unstale":"2023-11-24T06:16:35.777046+0000","last_undegraded":"2023-11-24T06:16:35.777046+0000","last_fullsized":"2023-11-24T06:16:35.777046+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:37.802170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.790653+0000","last_change":"2023-11-24T06:16:33.770601+0000","last_active":"2023-11-24T06:16:34.790653+0000","last_peered":"2023-11-24T06:16:34.790653+0000","last_clean":"2023-11-24T06:16:34.790653+0000","last_became_active":"2023-11-24T06:16:33.770320+0000","last_became_peered":"2023-11-24T06:16:33.770320+0000","last_unstale":"2023-11-24T06:16:34.790653+0000","last_undegraded":"2023-11-24T06:16:34.790653+0000","last_fullsized":"2023-11-24T06:16:34.790653+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:16:47.557304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779658+0000","last_change":"2023-11-24T06:16:34.778641+0000","last_active":"2023-11-24T06:16:35.779658+0000","last_peered":"2023-11-24T06:16:35.779658+0000","last_clean":"2023-11-24T06:16:35.779658+0000","last_became_active":"2023-11-24T06:16:34.775519+0000","last_became_peered":"2023-11-24T06:16:34.775519+0000","last_unstale":"2023-11-24T06:16:35.779658+0000","last_undegraded":"2023-11-24T06:16:35.779658+0000","last_fullsized":"2023-11-24T06:16:35.779658+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:57:51.825976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.757907+0000","last_change":"2023-11-24T06:16:33.761349+0000","last_active":"2023-11-24T06:16:34.757907+0000","last_peered":"2023-11-24T06:16:34.757907+0000","last_clean":"2023-11-24T06:16:34.757907+0000","last_became_active":"2023-11-24T06:16:33.759543+0000","last_became_peered":"2023-11-24T06:16:33.759543+0000","last_unstale":"2023-11-24T06:16:34.757907+0000","last_undegraded":"2023-11-24T06:16:34.757907+0000","last_fullsized":"2023-11-24T06:16:34.757907+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:49:04.663349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.182778+0000","last_change":"2023-11-24T06:16:34.764141+0000","last_active":"2023-11-24T06:16:36.182778+0000","last_peered":"2023-11-24T06:16:36.182778+0000","last_clean":"2023-11-24T06:16:36.182778+0000","last_became_active":"2023-11-24T06:16:34.763846+0000","last_became_peered":"2023-11-24T06:16:34.763846+0000","last_unstale":"2023-11-24T06:16:36.182778+0000","last_undegraded":"2023-11-24T06:16:36.182778+0000","last_fullsized":"2023-11-24T06:16:36.182778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:34.659726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.775991+0000","last_change":"2023-11-24T06:16:33.771272+0000","last_active":"2023-11-24T06:16:34.775991+0000","last_peered":"2023-11-24T06:16:34.775991+0000","last_clean":"2023-11-24T06:16:34.775991+0000","last_became_active":"2023-11-24T06:16:33.770946+0000","last_became_peered":"2023-11-24T06:16:33.770946+0000","last_unstale":"2023-11-24T06:16:34.775991+0000","last_undegraded":"2023-11-24T06:16:34.775991+0000","last_fullsized":"2023-11-24T06:16:34.775991+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:15:51.682060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.778533+0000","last_change":"2023-11-24T06:16:34.772951+0000","last_active":"2023-11-24T06:16:35.778533+0000","last_peered":"2023-11-24T06:16:35.778533+0000","last_clean":"2023-11-24T06:16:35.778533+0000","last_became_active":"2023-11-24T06:16:34.772648+0000","last_became_peered":"2023-11-24T06:16:34.772648+0000","last_unstale":"2023-11-24T06:16:35.778533+0000","last_undegraded":"2023-11-24T06:16:35.778533+0000","last_fullsized":"2023-11-24T06:16:35.778533+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:52:16.086487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.791216+0000","last_change":"2023-11-24T06:16:33.776193+0000","last_active":"2023-11-24T06:16:34.791216+0000","last_peered":"2023-11-24T06:16:34.791216+0000","last_clean":"2023-11-24T06:16:34.791216+0000","last_became_active":"2023-11-24T06:16:33.775699+0000","last_became_peered":"2023-11-24T06:16:33.775699+0000","last_unstale":"2023-11-24T06:16:34.791216+0000","last_undegraded":"2023-11-24T06:16:34.791216+0000","last_fullsized":"2023-11-24T06:16:34.791216+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:50:41.314836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780170+0000","last_change":"2023-11-24T06:16:34.771017+0000","last_active":"2023-11-24T06:16:35.780170+0000","last_peered":"2023-11-24T06:16:35.780170+0000","last_clean":"2023-11-24T06:16:35.780170+0000","last_became_active":"2023-11-24T06:16:34.770480+0000","last_became_peered":"2023-11-24T06:16:34.770480+0000","last_unstale":"2023-11-24T06:16:35.780170+0000","last_undegraded":"2023-11-24T06:16:35.780170+0000","last_fullsized":"2023-11-24T06:16:35.780170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:47:09.857056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.788776+0000","last_change":"2023-11-24T06:16:33.773132+0000","last_active":"2023-11-24T06:16:34.788776+0000","last_peered":"2023-11-24T06:16:34.788776+0000","last_clean":"2023-11-24T06:16:34.788776+0000","last_became_active":"2023-11-24T06:16:33.772817+0000","last_became_peered":"2023-11-24T06:16:33.772817+0000","last_unstale":"2023-11-24T06:16:34.788776+0000","last_undegraded":"2023-11-24T06:16:34.788776+0000","last_fullsized":"2023-11-24T06:16:34.788776+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:12:18.594305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779416+0000","last_change":"2023-11-24T06:16:34.774713+0000","last_active":"2023-11-24T06:16:35.779416+0000","last_peered":"2023-11-24T06:16:35.779416+0000","last_clean":"2023-11-24T06:16:35.779416+0000","last_became_active":"2023-11-24T06:16:34.774392+0000","last_became_peered":"2023-11-24T06:16:34.774392+0000","last_unstale":"2023-11-24T06:16:35.779416+0000","last_undegraded":"2023-11-24T06:16:35.779416+0000","last_fullsized":"2023-11-24T06:16:35.779416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:28.321073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.777467+0000","last_change":"2023-11-24T06:16:33.774189+0000","last_active":"2023-11-24T06:16:34.777467+0000","last_peered":"2023-11-24T06:16:34.777467+0000","last_clean":"2023-11-24T06:16:34.777467+0000","last_became_active":"2023-11-24T06:16:33.773781+0000","last_became_peered":"2023-11-24T06:16:33.773781+0000","last_unstale":"2023-11-24T06:16:34.777467+0000","last_undegraded":"2023-11-24T06:16:34.777467+0000","last_fullsized":"2023-11-24T06:16:34.777467+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:27.304775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184406+0000","last_change":"2023-11-24T06:16:34.786557+0000","last_active":"2023-11-24T06:16:36.184406+0000","last_peered":"2023-11-24T06:16:36.184406+0000","last_clean":"2023-11-24T06:16:36.184406+0000","last_became_active":"2023-11-24T06:16:34.786291+0000","last_became_peered":"2023-11-24T06:16:34.786291+0000","last_unstale":"2023-11-24T06:16:36.184406+0000","last_undegraded":"2023-11-24T06:16:36.184406+0000","last_fullsized":"2023-11-24T06:16:36.184406+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:42.491567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.785762+0000","last_change":"2023-11-24T06:16:33.771457+0000","last_active":"2023-11-24T06:16:34.785762+0000","last_peered":"2023-11-24T06:16:34.785762+0000","last_clean":"2023-11-24T06:16:34.785762+0000","last_became_active":"2023-11-24T06:16:33.771077+0000","last_became_peered":"2023-11-24T06:16:33.771077+0000","last_unstale":"2023-11-24T06:16:34.785762+0000","last_undegraded":"2023-11-24T06:16:34.785762+0000","last_fullsized":"2023-11-24T06:16:34.785762+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:07:16.548503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780100+0000","last_change":"2023-11-24T06:16:34.775437+0000","last_active":"2023-11-24T06:16:35.780100+0000","last_peered":"2023-11-24T06:16:35.780100+0000","last_clean":"2023-11-24T06:16:35.780100+0000","last_became_active":"2023-11-24T06:16:34.769419+0000","last_became_peered":"2023-11-24T06:16:34.769419+0000","last_unstale":"2023-11-24T06:16:35.780100+0000","last_undegraded":"2023-11-24T06:16:35.780100+0000","last_fullsized":"2023-11-24T06:16:35.780100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:23:38.830182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.755028+0000","last_change":"2023-11-24T06:16:33.769608+0000","last_active":"2023-11-24T06:16:34.755028+0000","last_peered":"2023-11-24T06:16:34.755028+0000","last_clean":"2023-11-24T06:16:34.755028+0000","last_became_active":"2023-11-24T06:16:33.769353+0000","last_became_peered":"2023-11-24T06:16:33.769353+0000","last_unstale":"2023-11-24T06:16:34.755028+0000","last_undegraded":"2023-11-24T06:16:34.755028+0000","last_fullsized":"2023-11-24T06:16:34.755028+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:57:50.809679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.777278+0000","last_change":"2023-11-24T06:16:34.770022+0000","last_active":"2023-11-24T06:16:35.777278+0000","last_peered":"2023-11-24T06:16:35.777278+0000","last_clean":"2023-11-24T06:16:35.777278+0000","last_became_active":"2023-11-24T06:16:34.769722+0000","last_became_peered":"2023-11-24T06:16:34.769722+0000","last_unstale":"2023-11-24T06:16:35.777278+0000","last_undegraded":"2023-11-24T06:16:35.777278+0000","last_fullsized":"2023-11-24T06:16:35.777278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:20:41.438416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.791271+0000","last_change":"2023-11-24T06:16:33.771682+0000","last_active":"2023-11-24T06:16:34.791271+0000","last_peered":"2023-11-24T06:16:34.791271+0000","last_clean":"2023-11-24T06:16:34.791271+0000","last_became_active":"2023-11-24T06:16:33.770297+0000","last_became_peered":"2023-11-24T06:16:33.770297+0000","last_unstale":"2023-11-24T06:16:34.791271+0000","last_undegraded":"2023-11-24T06:16:34.791271+0000","last_fullsized":"2023-11-24T06:16:34.791271+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:17.469352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.185878+0000","last_change":"2023-11-24T06:16:34.777121+0000","last_active":"2023-11-24T06:16:36.185878+0000","last_peered":"2023-11-24T06:16:36.185878+0000","last_clean":"2023-11-24T06:16:36.185878+0000","last_became_active":"2023-11-24T06:16:34.776723+0000","last_became_peered":"2023-11-24T06:16:34.776723+0000","last_unstale":"2023-11-24T06:16:36.185878+0000","last_undegraded":"2023-11-24T06:16:36.185878+0000","last_fullsized":"2023-11-24T06:16:36.185878+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:53.473690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.755961+0000","last_change":"2023-11-24T06:16:33.770996+0000","last_active":"2023-11-24T06:16:34.755961+0000","last_peered":"2023-11-24T06:16:34.755961+0000","last_clean":"2023-11-24T06:16:34.755961+0000","last_became_active":"2023-11-24T06:16:33.770413+0000","last_became_peered":"2023-11-24T06:16:33.770413+0000","last_unstale":"2023-11-24T06:16:34.755961+0000","last_undegraded":"2023-11-24T06:16:34.755961+0000","last_fullsized":"2023-11-24T06:16:34.755961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:29.010814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183235+0000","last_change":"2023-11-24T06:16:34.763805+0000","last_active":"2023-11-24T06:16:36.183235+0000","last_peered":"2023-11-24T06:16:36.183235+0000","last_clean":"2023-11-24T06:16:36.183235+0000","last_became_active":"2023-11-24T06:16:34.763527+0000","last_became_peered":"2023-11-24T06:16:34.763527+0000","last_unstale":"2023-11-24T06:16:36.183235+0000","last_undegraded":"2023-11-24T06:16:36.183235+0000","last_fullsized":"2023-11-24T06:16:36.183235+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:36:59.247787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.775949+0000","last_change":"2023-11-24T06:16:33.773444+0000","last_active":"2023-11-24T06:16:34.775949+0000","last_peered":"2023-11-24T06:16:34.775949+0000","last_clean":"2023-11-24T06:16:34.775949+0000","last_became_active":"2023-11-24T06:16:33.771977+0000","last_became_peered":"2023-11-24T06:16:33.771977+0000","last_unstale":"2023-11-24T06:16:34.775949+0000","last_undegraded":"2023-11-24T06:16:34.775949+0000","last_fullsized":"2023-11-24T06:16:34.775949+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:06.004527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779248+0000","last_change":"2023-11-24T06:16:34.783806+0000","last_active":"2023-11-24T06:16:35.779248+0000","last_peered":"2023-11-24T06:16:35.779248+0000","last_clean":"2023-11-24T06:16:35.779248+0000","last_became_active":"2023-11-24T06:16:34.782249+0000","last_became_peered":"2023-11-24T06:16:34.782249+0000","last_unstale":"2023-11-24T06:16:35.779248+0000","last_undegraded":"2023-11-24T06:16:35.779248+0000","last_fullsized":"2023-11-24T06:16:35.779248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:57:51.825976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.791301+0000","last_change":"2023-11-24T06:16:33.769724+0000","last_active":"2023-11-24T06:16:34.791301+0000","last_peered":"2023-11-24T06:16:34.791301+0000","last_clean":"2023-11-24T06:16:34.791301+0000","last_became_active":"2023-11-24T06:16:33.769461+0000","last_became_peered":"2023-11-24T06:16:33.769461+0000","last_unstale":"2023-11-24T06:16:34.791301+0000","last_undegraded":"2023-11-24T06:16:34.791301+0000","last_fullsized":"2023-11-24T06:16:34.791301+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:08.290535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.779845+0000","last_change":"2023-11-24T06:16:34.778377+0000","last_active":"2023-11-24T06:16:35.779845+0000","last_peered":"2023-11-24T06:16:35.779845+0000","last_clean":"2023-11-24T06:16:35.779845+0000","last_became_active":"2023-11-24T06:16:34.776011+0000","last_became_peered":"2023-11-24T06:16:34.776011+0000","last_unstale":"2023-11-24T06:16:35.779845+0000","last_undegraded":"2023-11-24T06:16:35.779845+0000","last_fullsized":"2023-11-24T06:16:35.779845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:06.873688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186527+0000","last_change":"2023-11-24T06:16:33.766967+0000","last_active":"2023-11-24T06:16:36.186527+0000","last_peered":"2023-11-24T06:16:36.186527+0000","last_clean":"2023-11-24T06:16:36.186527+0000","last_became_active":"2023-11-24T06:16:33.766515+0000","last_became_peered":"2023-11-24T06:16:33.766515+0000","last_unstale":"2023-11-24T06:16:36.186527+0000","last_undegraded":"2023-11-24T06:16:36.186527+0000","last_fullsized":"2023-11-24T06:16:36.186527+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:05.857391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186605+0000","last_change":"2023-11-24T06:16:34.774591+0000","last_active":"2023-11-24T06:16:36.186605+0000","last_peered":"2023-11-24T06:16:36.186605+0000","last_clean":"2023-11-24T06:16:36.186605+0000","last_became_active":"2023-11-24T06:16:34.774324+0000","last_became_peered":"2023-11-24T06:16:34.774324+0000","last_unstale":"2023-11-24T06:16:36.186605+0000","last_undegraded":"2023-11-24T06:16:36.186605+0000","last_fullsized":"2023-11-24T06:16:36.186605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:02.107927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.757843+0000","last_change":"2023-11-24T06:16:33.767824+0000","last_active":"2023-11-24T06:16:34.757843+0000","last_peered":"2023-11-24T06:16:34.757843+0000","last_clean":"2023-11-24T06:16:34.757843+0000","last_became_active":"2023-11-24T06:16:33.767469+0000","last_became_peered":"2023-11-24T06:16:33.767469+0000","last_unstale":"2023-11-24T06:16:34.757843+0000","last_undegraded":"2023-11-24T06:16:34.757843+0000","last_fullsized":"2023-11-24T06:16:34.757843+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:48:57.151594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.186289+0000","last_change":"2023-11-24T06:16:34.773290+0000","last_active":"2023-11-24T06:16:36.186289+0000","last_peered":"2023-11-24T06:16:36.186289+0000","last_clean":"2023-11-24T06:16:36.186289+0000","last_became_active":"2023-11-24T06:16:34.772406+0000","last_became_peered":"2023-11-24T06:16:34.772406+0000","last_unstale":"2023-11-24T06:16:36.186289+0000","last_undegraded":"2023-11-24T06:16:36.186289+0000","last_fullsized":"2023-11-24T06:16:36.186289+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:12:19.610603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.776143+0000","last_change":"2023-11-24T06:16:33.772084+0000","last_active":"2023-11-24T06:16:34.776143+0000","last_peered":"2023-11-24T06:16:34.776143+0000","last_clean":"2023-11-24T06:16:34.776143+0000","last_became_active":"2023-11-24T06:16:33.771790+0000","last_became_peered":"2023-11-24T06:16:33.771790+0000","last_unstale":"2023-11-24T06:16:34.776143+0000","last_undegraded":"2023-11-24T06:16:34.776143+0000","last_fullsized":"2023-11-24T06:16:34.776143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:34.619640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184722+0000","last_change":"2023-11-24T06:16:34.784937+0000","last_active":"2023-11-24T06:16:36.184722+0000","last_peered":"2023-11-24T06:16:36.184722+0000","last_clean":"2023-11-24T06:16:36.184722+0000","last_became_active":"2023-11-24T06:16:34.784434+0000","last_became_peered":"2023-11-24T06:16:34.784434+0000","last_unstale":"2023-11-24T06:16:36.184722+0000","last_undegraded":"2023-11-24T06:16:36.184722+0000","last_fullsized":"2023-11-24T06:16:36.184722+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:05.342541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.756153+0000","last_change":"2023-11-24T06:16:33.770432+0000","last_active":"2023-11-24T06:16:34.756153+0000","last_peered":"2023-11-24T06:16:34.756153+0000","last_clean":"2023-11-24T06:16:34.756153+0000","last_became_active":"2023-11-24T06:16:33.770152+0000","last_became_peered":"2023-11-24T06:16:33.770152+0000","last_unstale":"2023-11-24T06:16:34.756153+0000","last_undegraded":"2023-11-24T06:16:34.756153+0000","last_fullsized":"2023-11-24T06:16:34.756153+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:51:20.853464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:35.780067+0000","last_change":"2023-11-24T06:16:34.779236+0000","last_active":"2023-11-24T06:16:35.780067+0000","last_peered":"2023-11-24T06:16:35.780067+0000","last_clean":"2023-11-24T06:16:35.780067+0000","last_became_active":"2023-11-24T06:16:34.778924+0000","last_became_peered":"2023-11-24T06:16:34.778924+0000","last_unstale":"2023-11-24T06:16:35.780067+0000","last_undegraded":"2023-11-24T06:16:35.780067+0000","last_fullsized":"2023-11-24T06:16:35.780067+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:52.765833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.758740+0000","last_change":"2023-11-24T06:16:33.767805+0000","last_active":"2023-11-24T06:16:34.758740+0000","last_peered":"2023-11-24T06:16:34.758740+0000","last_clean":"2023-11-24T06:16:34.758740+0000","last_became_active":"2023-11-24T06:16:33.767215+0000","last_became_peered":"2023-11-24T06:16:33.767215+0000","last_unstale":"2023-11-24T06:16:34.758740+0000","last_undegraded":"2023-11-24T06:16:34.758740+0000","last_fullsized":"2023-11-24T06:16:34.758740+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:19.514468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.182462+0000","last_change":"2023-11-24T06:16:34.778394+0000","last_active":"2023-11-24T06:16:36.182462+0000","last_peered":"2023-11-24T06:16:36.182462+0000","last_clean":"2023-11-24T06:16:36.182462+0000","last_became_active":"2023-11-24T06:16:34.778241+0000","last_became_peered":"2023-11-24T06:16:34.778241+0000","last_unstale":"2023-11-24T06:16:36.182462+0000","last_undegraded":"2023-11-24T06:16:36.182462+0000","last_fullsized":"2023-11-24T06:16:36.182462+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:05:41.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.757051+0000","last_change":"2023-11-24T06:16:33.770982+0000","last_active":"2023-11-24T06:16:34.757051+0000","last_peered":"2023-11-24T06:16:34.757051+0000","last_clean":"2023-11-24T06:16:34.757051+0000","last_became_active":"2023-11-24T06:16:33.770635+0000","last_became_peered":"2023-11-24T06:16:33.770635+0000","last_unstale":"2023-11-24T06:16:34.757051+0000","last_undegraded":"2023-11-24T06:16:34.757051+0000","last_fullsized":"2023-11-24T06:16:34.757051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:06:46.387683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.184847+0000","last_change":"2023-11-24T06:16:34.779425+0000","last_active":"2023-11-24T06:16:36.184847+0000","last_peered":"2023-11-24T06:16:36.184847+0000","last_clean":"2023-11-24T06:16:36.184847+0000","last_became_active":"2023-11-24T06:16:34.777788+0000","last_became_peered":"2023-11-24T06:16:34.777788+0000","last_unstale":"2023-11-24T06:16:36.184847+0000","last_undegraded":"2023-11-24T06:16:36.184847+0000","last_fullsized":"2023-11-24T06:16:36.184847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:16:58.765965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.766631+0000","last_change":"2023-11-24T06:16:33.766109+0000","last_active":"2023-11-24T06:16:34.766631+0000","last_peered":"2023-11-24T06:16:34.766631+0000","last_clean":"2023-11-24T06:16:34.766631+0000","last_became_active":"2023-11-24T06:16:33.765841+0000","last_became_peered":"2023-11-24T06:16:33.765841+0000","last_unstale":"2023-11-24T06:16:34.766631+0000","last_undegraded":"2023-11-24T06:16:34.766631+0000","last_fullsized":"2023-11-24T06:16:34.766631+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:08.861330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T06:16:36.183576+0000","last_change":"2023-11-24T06:16:34.788979+0000","last_active":"2023-11-24T06:16:36.183576+0000","last_peered":"2023-11-24T06:16:36.183576+0000","last_clean":"2023-11-24T06:16:36.183576+0000","last_became_active":"2023-11-24T06:16:34.785940+0000","last_became_peered":"2023-11-24T06:16:34.785940+0000","last_unstale":"2023-11-24T06:16:36.183576+0000","last_undegraded":"2023-11-24T06:16:36.183576+0000","last_fullsized":"2023-11-24T06:16:36.183576+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:33.723132+0000","last_clean_scrub_stamp":"2023-11-24T06:16:33.723132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:33:08.857383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.761143+0000","last_change":"2023-11-24T06:16:33.769803+0000","last_active":"2023-11-24T06:16:34.761143+0000","last_peered":"2023-11-24T06:16:34.761143+0000","last_clean":"2023-11-24T06:16:34.761143+0000","last_became_active":"2023-11-24T06:16:33.769286+0000","last_became_peered":"2023-11-24T06:16:33.769286+0000","last_unstale":"2023-11-24T06:16:34.761143+0000","last_undegraded":"2023-11-24T06:16:34.761143+0000","last_fullsized":"2023-11-24T06:16:34.761143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:32.706835+0000","last_clean_scrub_stamp":"2023-11-24T06:16:32.706835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:26:47.727508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":206,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T06:16:34.749357+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:16:34.749357+0000","last_peered":"2023-11-24T06:16:34.749357+0000","last_clean":"2023-11-24T06:16:34.749357+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:16:34.749357+0000","last_undegraded":"2023-11-24T06:16:34.749357+0000","last_fullsized":"2023-11-24T06:16:34.749357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476798,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":301624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.095,"15min":1.0589999999999999},"min":{"1min":0.85099999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.45,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.137,"15min":1.0589999999999999},"min":{"1min":0.71299999999999997,"5min":0.63,"15min":0.63},"max":{"1min":1.7549999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.155}]},{"osd":1,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1279999999999999,"15min":1.1140000000000001},"min":{"1min":0.82699999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6699999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.1779999999999999,"15min":1.119},"min":{"1min":0.89600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7629999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2090000000000001,"15min":1.1519999999999999},"min":{"1min":0.78200000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.736,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2909999999999999,"15min":1.339},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.732,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.095}]},{"osd":3,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.333,"15min":1.3109999999999999},"min":{"1min":0.90900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6830000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.367,"15min":1.345},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7869999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.2350000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.296},"min":{"1min":0.89600000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8879999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4390000000000001,"15min":1.357},"min":{"1min":0.97399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.794,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.52}]},{"osd":6,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5189999999999999,"15min":1.52},"min":{"1min":0.97999999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.861,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4810000000000001,"15min":1.4550000000000001},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.988,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.4750000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:16:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.591,"15min":1.5589999999999999},"min":{"1min":0.86799999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8899999999999999,"5min":3.262,"15min":3.262},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.609,"5min":1.651,"15min":1.6830000000000001},"min":{"1min":1.169,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8480000000000001,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.6919999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1327104,"data_stored":891500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.123,"15min":1.073},"min":{"1min":0.92400000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.603,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2,"15min":1.1539999999999999},"min":{"1min":0.82499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.528,"5min":1.72,"15min":1.72},"last":1.1499999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.1879999999999999,"15min":1.1970000000000001},"min":{"1min":0.84799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5840000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.306,"15min":1.2909999999999999},"min":{"1min":1.099,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7370000000000001,"5min":1.847,"15min":1.847},"last":1.4199999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.238,"15min":1.21},"min":{"1min":0.81000000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.718,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.2949999999999999,"15min":1.2989999999999999},"min":{"1min":0.97899999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8200000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.5649999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3220000000000001,"15min":1.327},"min":{"1min":1.073,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.716,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.373,"15min":1.371},"min":{"1min":0.98499999999999999,"5min":0.745,"15min":0.745},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.2509999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.85999999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7709999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4570000000000001,"15min":1.425},"min":{"1min":0.96899999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8799999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.3680000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.5489999999999999,"15min":1.532},"min":{"1min":1.214,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0550000000000002,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.518},{"interface":"front","average":{"1min":1.766,"5min":1.7,"15min":1.6739999999999999},"min":{"1min":1.528,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.4780000000000002,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.589}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.466,"15min":1.5},"min":{"1min":0.98999999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2,"5min":2.5,"15min":2.5},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.8029999999999999,"5min":1.7649999999999999,"15min":1.7410000000000001},"min":{"1min":1.377,"5min":0.875,"15min":0.875},"max":{"1min":2.6040000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.641}]}]},{"osd":6,"up_from":15,"seq":64424509501,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":300972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.755,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.0249999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.137,"15min":1.2190000000000001},"min":{"1min":0.69799999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.579,"5min":1.619,"15min":1.619},"last":0.997},{"interface":"front","average":{"1min":1.329,"5min":1.2689999999999999,"15min":1.258},"min":{"1min":0.90500000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.625,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.1870000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.325,"15min":1.323},"min":{"1min":0.88200000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9630000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.466,"5min":1.401,"15min":1.4690000000000001},"min":{"1min":1.208,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7490000000000001,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.86499999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":1.141,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.913,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.474},{"interface":"front","average":{"1min":1.347,"5min":1.385,"15min":1.4690000000000001},"min":{"1min":0.94099999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.75,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.746}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.4339999999999999,"15min":1.482},"min":{"1min":1.0209999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.653,"5min":2.258,"15min":2.258},"last":1.111},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.45,"15min":1.534},"min":{"1min":1.1739999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.8759999999999999,"5min":2.105,"15min":2.105},"last":1.546}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.5649999999999999},"min":{"1min":0.85799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0379999999999998,"5min":2.319,"15min":2.319},"last":1.357},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.619,"15min":1.655},"min":{"1min":1.268,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9370000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.401}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.665,"15min":1.6930000000000001},"min":{"1min":1.288,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.1440000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.718,"5min":1.734,"15min":1.7809999999999999},"min":{"1min":1.379,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0670000000000002,"5min":2.669,"15min":2.669},"last":1.3009999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":302584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.071,"15min":1.071},"min":{"1min":0.80400000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5940000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.234,"5min":1.0820000000000001,"15min":1.085},"min":{"1min":0.755,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.2969999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.266,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.125},{"interface":"front","average":{"1min":1.23,"5min":1.2390000000000001,"15min":1.286},"min":{"1min":0.94699999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6259999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.3600000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.226,"15min":1.1950000000000001},"min":{"1min":0.97299999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.667,"5min":2.04,"15min":2.04},"last":1.022},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.371,"15min":1.409},"min":{"1min":0.89800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.738,"5min":2.016,"15min":2.016},"last":1.573}]},{"osd":3,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.246,"15min":1.2869999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5169999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.325,"15min":1.3520000000000001},"min":{"1min":0.997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8260000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.4390000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.369,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.7170000000000001,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.454,"15min":1.53},"min":{"1min":0.999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.8620000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.3420000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5269999999999999,"15min":1.579},"min":{"1min":1.103,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9259999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.236},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.5229999999999999,"15min":1.613},"min":{"1min":1.0549999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9370000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.639}]},{"osd":7,"last update":"Fri Nov 24 06:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.47,"15min":1.552},"min":{"1min":0.97499999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8029999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.657,"15min":1.7110000000000001},"min":{"1min":1.1659999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.0339999999999998,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":0.80100000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":301028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83999999999999997,"15min":0.87},"min":{"1min":0.66000000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3480000000000001,"5min":1.607,"15min":1.607},"last":0.877},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.42399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.4370000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2769999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.92800000000000005,"15min":0.91700000000000004},"min":{"1min":0.51800000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4910000000000001,"5min":1.796,"15min":1.796},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.1399999999999999,"15min":1.145},"min":{"1min":0.53600000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.7410000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.2130000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.083,"15min":1.0589999999999999},"min":{"1min":0.71799999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.661,"5min":1.835,"15min":1.835},"last":1.946},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.1519999999999999,"15min":1.1279999999999999},"min":{"1min":0.753,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7130000000000001,"5min":2.399,"15min":2.399},"last":1.4339999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3129999999999999,"15min":1.321},"min":{"1min":0.91500000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.944,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.615},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3080000000000001,"15min":1.2829999999999999},"min":{"1min":1.115,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.877,"5min":2.141,"15min":2.141},"last":1.5409999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.351,"15min":1.333},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.742,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.849},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.3799999999999999,"15min":1.397},"min":{"1min":1.0009999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.847,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.484}]},{"osd":6,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.4059999999999999,"15min":1.3660000000000001},"min":{"1min":0.95299999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.974,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3540000000000001,"15min":1.3340000000000001},"min":{"1min":1.0009999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9570000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.417,"15min":1.427},"min":{"1min":0.94499999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1379999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.665},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":1.1439999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0379999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.1020000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509501,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":301028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85099999999999998,"15min":0.877},"min":{"1min":0.66800000000000004,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.399,"5min":2.552,"15min":2.552},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.93999999999999995,"15min":0.96399999999999997},"min":{"1min":0.78600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5640000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.98099999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.1850000000000001,"15min":1.141},"min":{"1min":1.01,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6990000000000001,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.125,"15min":1.129},"min":{"1min":0.90800000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6240000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.175,"15min":1.169},"min":{"1min":0.97299999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.8220000000000001,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.98899999999999999,"15min":0.96899999999999997},"min":{"1min":0.59399999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.714,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.256}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3109999999999999,"15min":1.331},"min":{"1min":1.006,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.7909999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.401},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.486,"15min":1.502},"min":{"1min":1.327,"5min":0.755,"15min":0.755},"max":{"1min":2.0590000000000002,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.51}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.28,"15min":1.236},"min":{"1min":1.0620000000000001,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7370000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.413,"15min":1.4370000000000001},"min":{"1min":1.1419999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.7509999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.3140000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.405,"15min":1.405},"min":{"1min":1.159,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7669999999999999,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.123},{"interface":"front","average":{"1min":1.554,"5min":1.522,"15min":1.556},"min":{"1min":1.0860000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8859999999999999,"5min":4.101,"15min":4.101},"last":1.462}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.5089999999999999,"15min":1.5069999999999999},"min":{"1min":1.23,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.9179999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.637,"5min":1.492,"15min":1.4970000000000001},"min":{"1min":1.2969999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2029999999999998,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.5660000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1335296,"data_stored":893534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84999999999999998,"15min":0.83899999999999997},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.708,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.165,"5min":1.0089999999999999,"15min":0.97699999999999998},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.6819999999999999,"5min":2.161,"15min":2.161},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.98599999999999999,"15min":1.022},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2649999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.486},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8420000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.423}]},{"osd":3,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1439999999999999,"15min":1.2},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.7709999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.202,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8440000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.302}]},{"osd":4,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.3600000000000001,"15min":1.3080000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8180000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3939999999999999},"min":{"1min":0.98799999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.659,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.468}]},{"osd":5,"last update":"Fri Nov 24 06:15:58 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3169999999999999,"15min":1.2849999999999999},"min":{"1min":0.90600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.742,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":1.139},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2969999999999999,"15min":1.2509999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.5629999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4470000000000001,"15min":1.4410000000000001},"min":{"1min":1.0980000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.994,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.385,"15min":1.343},"min":{"1min":0.82099999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.6299999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.4630000000000001,"15min":1.4390000000000001},"min":{"1min":0.93000000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2050000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.173},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.212,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.891,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.538}]}]},{"osd":1,"up_from":14,"seq":60129542206,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":301062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.94499999999999995},"min":{"1min":0.47499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4279999999999999,"5min":1.571,"15min":1.571},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.024,"15min":1.028},"min":{"1min":0.72099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5620000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.84199999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.69099999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.097,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":1.004},{"interface":"front","average":{"1min":1.123,"5min":1.1639999999999999,"15min":1.226},"min":{"1min":0.60999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.538,"5min":2.964,"15min":2.964},"last":0.92000000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.347,"15min":1.373},"min":{"1min":0.875,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.659,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.294,"15min":1.3240000000000001},"min":{"1min":0.84799999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.71,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3480000000000001,"15min":1.3340000000000001},"min":{"1min":0.89100000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7170000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.464,"15min":1.55},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7410000000000001,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.1020000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.462},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.784,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.466,"15min":1.472},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.621,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.486}]},{"osd":6,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.472,"15min":1.538},"min":{"1min":0.91800000000000004,"5min":0.87,"15min":0.87},"max":{"1min":2.1499999999999999,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.55,"15min":1.548},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.704,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":1.593}]},{"osd":7,"last update":"Fri Nov 24 06:15:59 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5620000000000001,"15min":1.615},"min":{"1min":1.0269999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.708,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.639,"15min":1.671},"min":{"1min":1.044,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.2679999999999998,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.5529999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:47.340 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:16:47.340 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:16:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.618+0000 7fa58932e640 1 Processor -- start 2023-11-24T06:16:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.618+0000 7fa58932e640 1 -- start start 2023-11-24T06:16:47.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.620+0000 7fa58932e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5840d1fd0 0x7fa5840ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.620+0000 7fa58932e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5840b33d0 0x7fa5840b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.620+0000 7fa58932e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5840b2980 con 0x7fa5840cfa30 2023-11-24T06:16:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.620+0000 7fa58932e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5840cf220 con 0x7fa5840d1fd0 2023-11-24T06:16:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.620+0000 7fa58932e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840cf500 con 0x7fa5840b33d0 2023-11-24T06:16:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.620+0000 7fa583fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa5840cfa30 0x7fa5840cfe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45664/0 (socket says 172.21.15.22:45664) 2023-11-24T06:16:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.620+0000 7fa583fff640 1 -- 172.21.15.22:0/3393702144 learned_addr learned my addr 172.21.15.22:0/3393702144 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa588b2d640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5840b33d0 0x7fa5840b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa5837fe640 1 --2- 172.21.15.22:0/3393702144 >> v2:172.21.15.31:3300/0 conn(0x7fa5840d1fd0 0x7fa5840ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537729922 0 0) 0x7fa5840b2980 con 0x7fa5840cfa30 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa56c003520 con 0x7fa5840cfa30 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4240179868 0 0) 0x7fa56c003520 con 0x7fa5840cfa30 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5840b33d0 msgr2=0x7fa5840b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5840b33d0 0x7fa5840b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 >> v2:172.21.15.31:3300/0 conn(0x7fa5840d1fd0 msgr2=0x7fa5840ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 --2- 172.21.15.22:0/3393702144 >> v2:172.21.15.31:3300/0 conn(0x7fa5840d1fd0 0x7fa5840ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5840b2bd0 con 0x7fa5840cfa30 2023-11-24T06:16:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fa574001670 con 0x7fa5840cfa30 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 >> v1:172.21.15.22:6789/0 conn(0x7fa5840cfa30 legacy=0x7fa5840cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5840b33d0 0x7fa56c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa56c003fb0 0x7fa56c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa56c004d00 0x7fa56c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840cf220 con 0x7fa56c003fb0 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840cf500 con 0x7fa56c004d00 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.621+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c00ba00 con 0x7fa5840b33d0 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.622+0000 7fa5837fe640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa56c003fb0 0x7fa56c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.622+0000 7fa583fff640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5840b33d0 0x7fa56c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.622+0000 7fa5837fe640 1 -- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5840b33d0 msgr2=0x7fa56c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.622+0000 7fa5837fe640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5840b33d0 0x7fa56c0039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.622+0000 7fa5837fe640 1 -- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa56c004d00 msgr2=0x7fa56c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.622+0000 7fa5837fe640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa56c004d00 0x7fa56c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.622+0000 7fa5837fe640 1 -- 172.21.15.22:0/3393702144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c003520 con 0x7fa56c003fb0 2023-11-24T06:16:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.623+0000 7fa5837fe640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa56c003fb0 0x7fa56c0047c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa578009ac0 tx=0x7fa56c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f546994406ff167 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57802c710 con 0x7fa56c003fb0 2023-11-24T06:16:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57802c870 con 0x7fa56c003fb0 2023-11-24T06:16:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa582ffd640 1 -- 172.21.15.22:0/3393702144 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57802cc00 con 0x7fa56c003fb0 2023-11-24T06:16:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa58932e640 1 -- 172.21.15.22:0/3393702144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa56c003fb0 msgr2=0x7fa56c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa58932e640 1 --2- 172.21.15.22:0/3393702144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa56c003fb0 0x7fa56c0047c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa578009ac0 tx=0x7fa56c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa588b2d640 1 -- 172.21.15.22:0/3393702144 reap_dead start 2023-11-24T06:16:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa58932e640 1 -- 172.21.15.22:0/3393702144 shutdown_connections 2023-11-24T06:16:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa58932e640 1 -- 172.21.15.22:0/3393702144 >> 172.21.15.22:0/3393702144 conn(0x7fa5840d3020 msgr2=0x7fa5840d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa58932e640 1 -- 172.21.15.22:0/3393702144 shutdown_connections 2023-11-24T06:16:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.624+0000 7fa58932e640 1 -- 172.21.15.22:0/3393702144 wait complete. 2023-11-24T06:16:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.626+0000 7fa58932e640 1 Processor -- start 2023-11-24T06:16:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.626+0000 7fa58932e640 1 -- start start 2023-11-24T06:16:47.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.627+0000 7fa58932e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa56c003fb0 0x7fa5840c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.627+0000 7fa58932e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5840ccb30 0x7fa584157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.627+0000 7fa58932e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa58415fc20 0x7fa5841600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.627+0000 7fa58932e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840c9250 con 0x7fa58415fc20 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.627+0000 7fa58932e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841605e0 con 0x7fa5840ccb30 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.627+0000 7fa58932e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840c8c90 con 0x7fa56c003fb0 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa588b2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa58415fc20 0x7fa5841600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa588b2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa58415fc20 0x7fa5841600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39992/0 (socket says 172.21.15.22:39992) 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa588b2d640 1 -- 172.21.15.22:0/4093646021 learned_addr learned my addr 172.21.15.22:0/4093646021 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa583fff640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa56c003fb0 0x7fa5840c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa5837fe640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5840ccb30 0x7fa584157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa588b2d640 1 -- 172.21.15.22:0/4093646021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa56c003fb0 msgr2=0x7fa5840c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa588b2d640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa56c003fb0 0x7fa5840c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa588b2d640 1 -- 172.21.15.22:0/4093646021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5840ccb30 msgr2=0x7fa584157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa588b2d640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5840ccb30 0x7fa584157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.628+0000 7fa588b2d640 1 -- 172.21.15.22:0/4093646021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5840c8f70 con 0x7fa58415fc20 2023-11-24T06:16:47.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.629+0000 7fa588b2d640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa58415fc20 0x7fa5841600a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa584067e30 tx=0x7fa57c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:47.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.629+0000 7fa580ff9640 1 -- 172.21.15.22:0/4093646021 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c010040 con 0x7fa58415fc20 2023-11-24T06:16:47.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.629+0000 7fa580ff9640 1 -- 172.21.15.22:0/4093646021 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c00bce0 con 0x7fa58415fc20 2023-11-24T06:16:47.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.629+0000 7fa580ff9640 1 -- 172.21.15.22:0/4093646021 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c014640 con 0x7fa58415fc20 2023-11-24T06:16:47.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.629+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5840ca290 con 0x7fa58415fc20 2023-11-24T06:16:47.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.629+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5840ccfb0 con 0x7fa58415fc20 2023-11-24T06:16:47.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.630+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5840d0a40 con 0x7fa58415fc20 2023-11-24T06:16:47.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.631+0000 7fa580ff9640 1 -- 172.21.15.22:0/4093646021 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa57c0147a0 con 0x7fa58415fc20 2023-11-24T06:16:47.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.632+0000 7fa580ff9640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa57006b020 0x7fa57006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.632+0000 7fa580ff9640 1 -- 172.21.15.22:0/4093646021 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa57c08a160 con 0x7fa58415fc20 2023-11-24T06:16:47.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.632+0000 7fa583fff640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa57006b020 0x7fa57006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.633+0000 7fa583fff640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa57006b020 0x7fa57006d4e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa5740078d0 tx=0x7fa574009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:47.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.637+0000 7fa580ff9640 1 -- 172.21.15.22:0/4093646021 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa57c054e70 con 0x7fa58415fc20 2023-11-24T06:16:47.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.904+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa5840ca0f0 con 0x7fa58415fc20 2023-11-24T06:16:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.910+0000 7fa580ff9640 1 -- 172.21.15.22:0/4093646021 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa5840ca0f0 con 0x7fa58415fc20 2023-11-24T06:16:47.913 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2023-11-24T06:16:47.913 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBvPmBlp6jYJxAA527jQJV49tBf9Am4wak0NA== 2023-11-24T06:16:47.913 INFO:teuthology.orchestra.run.smithi022.stdout: caps mds = "allow" 2023-11-24T06:16:47.913 INFO:teuthology.orchestra.run.smithi022.stdout: caps mon = "allow r" 2023-11-24T06:16:47.913 INFO:teuthology.orchestra.run.smithi022.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:16:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-11-24T06:16:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.912+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa57006b020 msgr2=0x7fa57006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.912+0000 7fa58932e640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa57006b020 0x7fa57006d4e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa5740078d0 tx=0x7fa574009040 comp rx=0 tx=0).stop 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.912+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa58415fc20 msgr2=0x7fa5841600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.912+0000 7fa58932e640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa58415fc20 0x7fa5841600a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa584067e30 tx=0x7fa57c00b480 comp rx=0 tx=0).stop 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.913+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 shutdown_connections 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.913+0000 7fa58932e640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa57006b020 0x7fa57006d4e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.913+0000 7fa58932e640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa58415fc20 0x7fa5841600a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.913+0000 7fa58932e640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5840ccb30 0x7fa584157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.913+0000 7fa58932e640 1 --2- 172.21.15.22:0/4093646021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa56c003fb0 0x7fa5840c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.913+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 >> 172.21.15.22:0/4093646021 conn(0x7fa5840d3020 msgr2=0x7fa58406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.913+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 shutdown_connections 2023-11-24T06:16:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:47.913+0000 7fa58932e640 1 -- 172.21.15.22:0/4093646021 wait complete. 2023-11-24T06:16:47.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.152+0000 7f57eb851640 1 Processor -- start 2023-11-24T06:16:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.152+0000 7f57eb851640 1 -- start start 2023-11-24T06:16:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.154+0000 7f57eb851640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57e406d520 0x7f57e406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.154+0000 7f57eb851640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57e40ad720 0x7f57e415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.154+0000 7f57eb851640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e415c360 con 0x7f57e40abff0 2023-11-24T06:16:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.154+0000 7f57eb851640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e40b41a0 con 0x7f57e40ad720 2023-11-24T06:16:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.154+0000 7f57eb851640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e406de40 con 0x7f57e406d520 2023-11-24T06:16:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.154+0000 7f57e9dee640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f57e40abff0 0x7f57e415f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45668/0 (socket says 172.21.15.22:45668) 2023-11-24T06:16:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.154+0000 7f57e9dee640 1 -- 172.21.15.22:0/4129112802 learned_addr learned my addr 172.21.15.22:0/4129112802 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57e95ed640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57e406d520 0x7f57e406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57e8dec640 1 --2- 172.21.15.22:0/4129112802 >> v2:172.21.15.31:3300/0 conn(0x7f57e40ad720 0x7f57e415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858773781 0 0) 0x7f57e415c360 con 0x7f57e40abff0 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57d0003520 con 0x7f57e40abff0 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 975378857 0 0) 0x7f57d0003520 con 0x7f57e40abff0 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57e406d520 msgr2=0x7f57e406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57e406d520 0x7f57e406d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 >> v2:172.21.15.31:3300/0 conn(0x7f57e40ad720 msgr2=0x7f57e415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 --2- 172.21.15.22:0/4129112802 >> v2:172.21.15.31:3300/0 conn(0x7f57e40ad720 0x7f57e415ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e415ba30 con 0x7f57e40abff0 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f57dc0019f0 con 0x7f57e40abff0 2023-11-24T06:16:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 >> v1:172.21.15.22:6789/0 conn(0x7f57e40abff0 legacy=0x7f57e415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d0003970 0x7f57d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57e406d520 0x7f57d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d0004d00 0x7f57d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e406de40 con 0x7f57d0003970 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d000ba30 con 0x7f57d0004d00 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d000bb70 con 0x7f57e406d520 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.155+0000 7f57e95ed640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d0003970 0x7f57d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.156+0000 7f57e95ed640 1 -- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57e406d520 msgr2=0x7f57d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.156+0000 7f57e95ed640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57e406d520 0x7f57d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.156+0000 7f57e95ed640 1 -- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d0004d00 msgr2=0x7f57d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.156+0000 7f57e9dee640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d0004d00 0x7f57d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.156+0000 7f57e95ed640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d0004d00 0x7f57d0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.156+0000 7f57e95ed640 1 -- 172.21.15.22:0/4129112802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d0003520 con 0x7f57d0003970 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.157+0000 7f57e95ed640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d0003970 0x7f57d0003d90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f57e000ba60 tx=0x7f57d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51cfd00cfdbbe52 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.157+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0032680 con 0x7f57d0003970 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.157+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e00327e0 con 0x7f57d0003970 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.157+0000 7f57dbfff640 1 -- 172.21.15.22:0/4129112802 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0032b70 con 0x7f57d0003970 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.158+0000 7f57eb851640 1 -- 172.21.15.22:0/4129112802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d0003970 msgr2=0x7f57d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.158+0000 7f57eb851640 1 --2- 172.21.15.22:0/4129112802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d0003970 0x7f57d0003d90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f57e000ba60 tx=0x7f57d00057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.158+0000 7f57e9dee640 1 -- 172.21.15.22:0/4129112802 reap_dead start 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.158+0000 7f57eb851640 1 -- 172.21.15.22:0/4129112802 shutdown_connections 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.158+0000 7f57eb851640 1 -- 172.21.15.22:0/4129112802 >> 172.21.15.22:0/4129112802 conn(0x7f57e40b0d80 msgr2=0x7f57e40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.158+0000 7f57eb851640 1 -- 172.21.15.22:0/4129112802 shutdown_connections 2023-11-24T06:16:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.158+0000 7f57eb851640 1 -- 172.21.15.22:0/4129112802 wait complete. 2023-11-24T06:16:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.160+0000 7f57eb851640 1 Processor -- start 2023-11-24T06:16:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.160+0000 7f57eb851640 1 -- start start 2023-11-24T06:16:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.161+0000 7f57eb851640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57d0003970 0x7f57e40cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.161+0000 7f57eb851640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e40c9640 0x7f57e41569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.161+0000 7f57eb851640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57e41f3290 0x7f57e4149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.161+0000 7f57eb851640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40cda80 con 0x7f57e40c9640 2023-11-24T06:16:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.161+0000 7f57eb851640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40ce2a0 con 0x7f57e41f3290 2023-11-24T06:16:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.161+0000 7f57eb851640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e41f3840 con 0x7f57d0003970 2023-11-24T06:16:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.161+0000 7f57e8dec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e40c9640 0x7f57e41569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.161+0000 7f57e8dec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e40c9640 0x7f57e41569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40008/0 (socket says 172.21.15.22:40008) 2023-11-24T06:16:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.161+0000 7f57e8dec640 1 -- 172.21.15.22:0/4051141083 learned_addr learned my addr 172.21.15.22:0/4051141083 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.162+0000 7f57e95ed640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57d0003970 0x7f57e40cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.162+0000 7f57e9dee640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57e41f3290 0x7f57e4149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.162+0000 7f57e8dec640 1 -- 172.21.15.22:0/4051141083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57d0003970 msgr2=0x7f57e40cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.162+0000 7f57e8dec640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57d0003970 0x7f57e40cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.162+0000 7f57e8dec640 1 -- 172.21.15.22:0/4051141083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57e41f3290 msgr2=0x7f57e4149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.162+0000 7f57e8dec640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57e41f3290 0x7f57e4149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.162+0000 7f57e8dec640 1 -- 172.21.15.22:0/4051141083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e41f3b20 con 0x7f57e40c9640 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.162+0000 7f57e8dec640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e40c9640 0x7f57e41569d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f57d400d7d0 tx=0x7f57d400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.162+0000 7f57d9ffb640 1 -- 172.21.15.22:0/4051141083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400b660 con 0x7f57e40c9640 2023-11-24T06:16:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.163+0000 7f57d9ffb640 1 -- 172.21.15.22:0/4051141083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d400b800 con 0x7f57e40c9640 2023-11-24T06:16:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.163+0000 7f57d9ffb640 1 -- 172.21.15.22:0/4051141083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400bbb0 con 0x7f57e40c9640 2023-11-24T06:16:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.163+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e41f3e00 con 0x7f57e40c9640 2023-11-24T06:16:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.163+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e4156f10 con 0x7f57e40c9640 2023-11-24T06:16:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.164+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e4157100 con 0x7f57e40c9640 2023-11-24T06:16:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.165+0000 7f57d9ffb640 1 -- 172.21.15.22:0/4051141083 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f57d400bd10 con 0x7f57e40c9640 2023-11-24T06:16:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.166+0000 7f57d9ffb640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f57c806aff0 0x7f57c806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.166+0000 7f57d9ffb640 1 -- 172.21.15.22:0/4051141083 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57d4089dc0 con 0x7f57e40c9640 2023-11-24T06:16:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.166+0000 7f57e95ed640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f57c806aff0 0x7f57c806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.167+0000 7f57e95ed640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f57c806aff0 0x7f57c806d4b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f57e000ba30 tx=0x7f57e003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.170+0000 7f57d9ffb640 1 -- 172.21.15.22:0/4051141083 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f57d4054bf0 con 0x7f57e40c9640 2023-11-24T06:16:48.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.405+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57e4074770 con 0x7f57e40c9640 2023-11-24T06:16:48.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.407+0000 7f57d9ffb640 1 -- 172.21.15.22:0/4051141083 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f57d40073e0 con 0x7f57e40c9640 2023-11-24T06:16:48.409 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:48.410 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3364238617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3364238617},{"type":"v1","addr":"172.21.15.31:6835","nonce":3364238617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6420,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/1299665813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1299665813},{"type":"v1","addr":"172.21.15.22:6836","nonce":1299665813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1568499503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1568499503},{"type":"v1","addr":"172.21.15.22:6837","nonce":1568499503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:34.218301+0000","modified":"2023-11-24T06:16:37.280807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6435":{"gid":6435,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2376501260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2376501260},{"type":"v1","addr":"172.21.15.31:6834","nonce":2376501260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:16:48.410 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 34 2023-11-24T06:16:48.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f57c806aff0 msgr2=0x7f57c806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f57c806aff0 0x7f57c806d4b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f57e000ba30 tx=0x7f57e003d040 comp rx=0 tx=0).stop 2023-11-24T06:16:48.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e40c9640 msgr2=0x7f57e41569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e40c9640 0x7f57e41569d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f57d400d7d0 tx=0x7f57d400dc90 comp rx=0 tx=0).stop 2023-11-24T06:16:48.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 shutdown_connections 2023-11-24T06:16:48.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f57c806aff0 0x7f57c806d4b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57e41f3290 0x7f57e4149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e40c9640 0x7f57e41569d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 --2- 172.21.15.22:0/4051141083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f57d0003970 0x7f57e40cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.409+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 >> 172.21.15.22:0/4051141083 conn(0x7f57e40b0d80 msgr2=0x7f57e40acc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:48.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.410+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 shutdown_connections 2023-11-24T06:16:48.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:48.410+0000 7f57eb851640 1 -- 172.21.15.22:0/4051141083 wait complete. 2023-11-24T06:16:48.834 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:16:34.218301+0000', 'modified': '2023-11-24T06:16:37.280807+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6435}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6435': {'gid': 6435, 'name': 'd', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6834/2376501260', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6832', 'nonce': 2376501260}, {'type': 'v1', 'addr': '172.21.15.31:6834', 'nonce': 2376501260}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:16:48.834 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:16:48.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-24T06:16:49.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.065+0000 7efec359e640 1 Processor -- start 2023-11-24T06:16:49.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.066+0000 7efec359e640 1 -- start start 2023-11-24T06:16:49.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.067+0000 7efec359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efec41416f0 0x7efec415ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.068+0000 7efec359e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec4070bf0 con 0x7efec406d230 2023-11-24T06:16:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.068+0000 7efec359e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec406d850 con 0x7efec4141e80 2023-11-24T06:16:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.068+0000 7efec359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec406db30 con 0x7efec41416f0 2023-11-24T06:16:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.068+0000 7efec2d9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efec406d230 0x7efec40cd620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45672/0 (socket says 172.21.15.22:45672) 2023-11-24T06:16:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.068+0000 7efec2d9d640 1 -- 172.21.15.22:0/915300909 learned_addr learned my addr 172.21.15.22:0/915300909 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.068+0000 7efec259c640 1 --2- 172.21.15.22:0/915300909 >> v2:172.21.15.31:3300/0 conn(0x7efec41416f0 0x7efec415ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.068+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430502082 0 0) 0x7efec4070bf0 con 0x7efec406d230 2023-11-24T06:16:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.068+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb0003520 con 0x7efec406d230 2023-11-24T06:16:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2563392761 0 0) 0x7efeb0003520 con 0x7efec406d230 2023-11-24T06:16:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 >> v2:172.21.15.31:3300/0 conn(0x7efec41416f0 msgr2=0x7efec415ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 --2- 172.21.15.22:0/915300909 >> v2:172.21.15.31:3300/0 conn(0x7efec41416f0 0x7efec415ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 >> v1:172.21.15.31:6789/0 conn(0x7efec4141e80 legacy=0x7efec406cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40705a0 con 0x7efec406d230 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7efebc0019f0 con 0x7efec406d230 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 >> v1:172.21.15.22:6789/0 conn(0x7efec406d230 legacy=0x7efec40cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb00039e0 0x7efeb0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efeb00047c0 0x7efeb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb0005180 0x7efeb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec406db30 con 0x7efeb0005180 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb000c080 con 0x7efeb00039e0 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb000c240 con 0x7efeb00047c0 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.069+0000 7efec2d9d640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb0005180 0x7efeb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.070+0000 7efec259c640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb00039e0 0x7efeb0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.070+0000 7efec2d9d640 1 -- 172.21.15.22:0/915300909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efeb00047c0 msgr2=0x7efeb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.070+0000 7efec2d9d640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efeb00047c0 0x7efeb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.070+0000 7efec2d9d640 1 -- 172.21.15.22:0/915300909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb00039e0 msgr2=0x7efeb0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.070+0000 7efec2d9d640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb00039e0 0x7efeb0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.070+0000 7efec2d9d640 1 -- 172.21.15.22:0/915300909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0003520 con 0x7efeb0005180 2023-11-24T06:16:49.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.071+0000 7efec2d9d640 1 -- 172.21.15.22:0/915300909 reap_dead start 2023-11-24T06:16:49.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.071+0000 7efec2d9d640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb0005180 0x7efeb000b980 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7efebc00a830 tx=0x7efeb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cbcfe5444d4145 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.071+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc02cea0 con 0x7efeb0005180 2023-11-24T06:16:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.071+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc02f070 con 0x7efeb0005180 2023-11-24T06:16:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.071+0000 7efec1d9b640 1 -- 172.21.15.22:0/915300909 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc034890 con 0x7efeb0005180 2023-11-24T06:16:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.072+0000 7efec359e640 1 -- 172.21.15.22:0/915300909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb0005180 msgr2=0x7efeb000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.072+0000 7efec359e640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb0005180 0x7efeb000b980 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7efebc00a830 tx=0x7efeb00057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.072+0000 7efec359e640 1 -- 172.21.15.22:0/915300909 shutdown_connections 2023-11-24T06:16:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.072+0000 7efec359e640 1 --2- 172.21.15.22:0/915300909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb0005180 0x7efeb000b980 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.072+0000 7efec359e640 1 -- 172.21.15.22:0/915300909 >> 172.21.15.22:0/915300909 conn(0x7efec40b0840 msgr2=0x7efec40b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.072+0000 7efec359e640 1 -- 172.21.15.22:0/915300909 shutdown_connections 2023-11-24T06:16:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.072+0000 7efec359e640 1 -- 172.21.15.22:0/915300909 wait complete. 2023-11-24T06:16:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.074+0000 7efec359e640 1 Processor -- start 2023-11-24T06:16:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.074+0000 7efec359e640 1 -- start start 2023-11-24T06:16:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.075+0000 7efec359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb0005180 0x7efec413c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.075+0000 7efec359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efec415e340 0x7efec4143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.075+0000 7efec359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec41442b0 0x7efec414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.075+0000 7efec359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec4143950 con 0x7efec41442b0 2023-11-24T06:16:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.075+0000 7efec359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec415b9b0 con 0x7efeb0005180 2023-11-24T06:16:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.075+0000 7efec359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec4142cd0 con 0x7efec415e340 2023-11-24T06:16:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.075+0000 7efec2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec41442b0 0x7efec414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.075+0000 7efec2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec41442b0 0x7efec414b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40034/0 (socket says 172.21.15.22:40034) 2023-11-24T06:16:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.075+0000 7efec2d9d640 1 -- 172.21.15.22:0/3204418988 learned_addr learned my addr 172.21.15.22:0/3204418988 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.076+0000 7efec259c640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb0005180 0x7efec413c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.076+0000 7efebbfff640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efec415e340 0x7efec4143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.076+0000 7efec2d9d640 1 -- 172.21.15.22:0/3204418988 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efec415e340 msgr2=0x7efec4143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.076+0000 7efec2d9d640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efec415e340 0x7efec4143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.076+0000 7efec2d9d640 1 -- 172.21.15.22:0/3204418988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb0005180 msgr2=0x7efec413c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.076+0000 7efec2d9d640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb0005180 0x7efec413c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.076+0000 7efec2d9d640 1 -- 172.21.15.22:0/3204418988 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4142fb0 con 0x7efec41442b0 2023-11-24T06:16:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.076+0000 7efec2d9d640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec41442b0 0x7efec414b1d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efebc002230 tx=0x7efebc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.076+0000 7efebaffd640 1 -- 172.21.15.22:0/3204418988 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc004d60 con 0x7efec41442b0 2023-11-24T06:16:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.077+0000 7efebaffd640 1 -- 172.21.15.22:0/3204418988 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc02cea0 con 0x7efec41442b0 2023-11-24T06:16:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.077+0000 7efec359e640 1 -- 172.21.15.22:0/3204418988 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec4143290 con 0x7efec41442b0 2023-11-24T06:16:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.077+0000 7efebaffd640 1 -- 172.21.15.22:0/3204418988 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc03f6b0 con 0x7efec41442b0 2023-11-24T06:16:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.077+0000 7efec359e640 1 -- 172.21.15.22:0/3204418988 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec4142910 con 0x7efec41442b0 2023-11-24T06:16:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.079+0000 7efebaffd640 1 -- 172.21.15.22:0/3204418988 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7efebc031030 con 0x7efec41442b0 2023-11-24T06:16:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.080+0000 7efebaffd640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efea406aff0 0x7efea406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.080+0000 7efebaffd640 1 -- 172.21.15.22:0/3204418988 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efebc0aaee0 con 0x7efec41442b0 2023-11-24T06:16:49.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.081+0000 7efec259c640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efea406aff0 0x7efea406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.081+0000 7efecb400740 1 Processor -- start 2023-11-24T06:16:49.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.081+0000 7efecb400740 1 -- start start 2023-11-24T06:16:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.081+0000 7efec259c640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efea406aff0 0x7efea406d4b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009990 tx=0x7efeb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.082+0000 7efecb400740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 0x5571b7e8d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.082+0000 7efecb400740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7e8c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.082+0000 7efecb400740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 0x5571b7ed0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.082+0000 7efecb400740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7deb880 con 0x5571b7e87d70 2023-11-24T06:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.082+0000 7efecb400740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7dfaae0 con 0x5571b7e8c7b0 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.082+0000 7efecb400740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571b7df81d0 con 0x5571b7e8d070 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.082+0000 7efebbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7e8c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.082+0000 7efebbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7e8c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40042/0 (socket says 172.21.15.22:40042) 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.082+0000 7efebbfff640 1 -- 172.21.15.22:0/3135565169 learned_addr learned my addr 172.21.15.22:0/3135565169 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efec2d9d640 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 0x5571b7ed0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efec259c640 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 0x5571b7e8d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efebbfff640 1 -- 172.21.15.22:0/3135565169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 msgr2=0x5571b7e8d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efebbfff640 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 0x5571b7e8d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efebbfff640 1 -- 172.21.15.22:0/3135565169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 msgr2=0x5571b7ed0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efebbfff640 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 0x5571b7ed0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efebbfff640 1 -- 172.21.15.22:0/3135565169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571b7dbb860 con 0x5571b7e87d70 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efec2d9d640 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 0x5571b7ed0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efebbfff640 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7e8c270 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7efeac003d40 tx=0x7efeac004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ffd6b00ed3e109 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efea3fff640 1 -- 172.21.15.22:0/3135565169 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac004450 con 0x5571b7e87d70 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efea3fff640 1 -- 172.21.15.22:0/3135565169 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac007240 con 0x5571b7e87d70 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.083+0000 7efea3fff640 1 -- 172.21.15.22:0/3135565169 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac0075f0 con 0x5571b7e87d70 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.084+0000 7efecb400740 1 -- 172.21.15.22:0/3135565169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 msgr2=0x5571b7e8c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.084+0000 7efecb400740 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7e8c270 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7efeac003d40 tx=0x7efeac004200 comp rx=0 tx=0).stop 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.084+0000 7efecb400740 1 -- 172.21.15.22:0/3135565169 shutdown_connections 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.084+0000 7efecb400740 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 0x5571b7ed0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.084+0000 7efecb400740 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7e8c270 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.084+0000 7efecb400740 1 --2- 172.21.15.22:0/3135565169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 0x5571b7e8d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.084+0000 7efecb400740 1 -- 172.21.15.22:0/3135565169 >> 172.21.15.22:0/3135565169 conn(0x5571b7e4ec70 msgr2=0x5571b7ed2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.084+0000 7efecb400740 1 -- 172.21.15.22:0/3135565169 shutdown_connections 2023-11-24T06:16:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.084+0000 7efecb400740 1 -- 172.21.15.22:0/3135565169 wait complete. 2023-11-24T06:16:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.085+0000 7efecb400740 1 -- start start 2023-11-24T06:16:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.085+0000 7efecb400740 1 Processor -- start 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efecb400740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7ea4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efecb400740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 0x5571b7eca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efecb400740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 0x5571b7eca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efecb400740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7df3ac0 con 0x5571b7e87d70 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efecb400740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7d902f0 con 0x5571b7e8c7b0 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efecb400740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571b7dadc70 con 0x5571b7e8d070 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efecb400740 10 client.0 _ll_register_callbacks cb 0x5571b7db23b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efec259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7ea4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efec259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7ea4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40046/0 (socket says 172.21.15.22:40046) 2023-11-24T06:16:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.086+0000 7efec259c640 1 -- 172.21.15.22:0/1018144054 learned_addr learned my addr 172.21.15.22:0/1018144054 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efebbfff640 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 0x5571b7eca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efec2d9d640 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 0x5571b7eca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efec259c640 1 -- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 msgr2=0x5571b7eca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efec259c640 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 0x5571b7eca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efec259c640 1 -- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 msgr2=0x5571b7eca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efec259c640 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 0x5571b7eca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efec259c640 1 -- 172.21.15.22:0/1018144054 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac00f040 con 0x5571b7e87d70 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efec2d9d640 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 0x5571b7eca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efec259c640 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7ea4100 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7efeb4013e80 tx=0x7efeb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7badb4092358ae5b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.087+0000 7efea17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efea17fa640 1 -- 172.21.15.22:0/1018144054 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4023820 con 0x5571b7e87d70 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efea17fa640 1 -- 172.21.15.22:0/1018144054 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efeb4023980 con 0x5571b7e87d70 2023-11-24T06:16:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efecb400740 1 -- 172.21.15.22:0/1018144054 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571b7decaa0 con 0x5571b7e87d70 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efea17fa640 1 -- 172.21.15.22:0/1018144054 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efeb4016e70 con 0x5571b7e87d70 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efecb400740 10 client.6603 fetch_fsmap learned FSMap version 34 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efecb400740 1 -- 172.21.15.22:0/1018144054 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x5571b7df2140 con 0x5571b7e87d70 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efea17fa640 1 -- 172.21.15.22:0/1018144054 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5571b7decaa0 con 0x5571b7e87d70 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efea17fa640 1 -- 172.21.15.22:0/1018144054 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efeb4023b40 con 0x5571b7e87d70 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efecb400740 10 client.6603 fetch_fsmap finished waiting for FSMap version 34 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efecb400740 10 client.6603 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efecb400740 20 client.6603 populate_metadata read hostname 'smithi022' 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efecb400740 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] conn(0x5571b7ee38f0 0x5571b7eefd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efecb400740 4 client.6603 mds_command: new command op to 6435 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.088+0000 7efecb400740 1 -- 172.21.15.22:0/1018144054 --> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571b7dec7c0 con 0x5571b7ee38f0 2023-11-24T06:16:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.089+0000 7efebbfff640 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] conn(0x5571b7ee38f0 0x5571b7eefd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.090+0000 7efebbfff640 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] conn(0x5571b7ee38f0 0x5571b7eefd70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faad1a9d0aabdba6 server_cookie=265e32a2cb247520 in_seq=0 out_seq=0 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.090+0000 7efea17fa640 10 client.6603 ms_handle_connect on v2:172.21.15.31:6832/2376501260 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.092+0000 7efea17fa640 1 -- 172.21.15.22:0/1018144054 <== mds.0 v2:172.21.15.31:6832/2376501260 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5571b7dec7c0 con 0x5571b7ee38f0 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.092+0000 7efea17fa640 10 client.6603 handle_command_reply: tid=0 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.092+0000 7efecb400740 1 client.6603 shutdown 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.092+0000 7efecb400740 1 -- 172.21.15.22:0/1018144054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 msgr2=0x5571b7ea4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.092+0000 7efecb400740 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7ea4100 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7efeb4013e80 tx=0x7efeb4004730 comp rx=0 tx=0).stop 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.092+0000 7efecb400740 1 -- 172.21.15.22:0/1018144054 shutdown_connections 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.092+0000 7efecb400740 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e8d070 0x5571b7eca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.092+0000 7efecb400740 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] conn(0x5571b7ee38f0 0x5571b7eefd70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.093+0000 7efea17fa640 0 client.6603 ms_handle_reset on v2:172.21.15.31:6832/2376501260 2023-11-24T06:16:49.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.093+0000 7efecb400740 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8c7b0 0x5571b7eca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.093+0000 7efecb400740 1 --2- 172.21.15.22:0/1018144054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e87d70 0x5571b7ea4100 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.093+0000 7efecb400740 1 -- 172.21.15.22:0/1018144054 >> 172.21.15.22:0/1018144054 conn(0x5571b7e4ec70 msgr2=0x5571b7e86dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.093+0000 7efecb400740 1 -- 172.21.15.22:0/1018144054 shutdown_connections 2023-11-24T06:16:49.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.093+0000 7efecb400740 1 -- 172.21.15.22:0/1018144054 wait complete. 2023-11-24T06:16:49.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.093+0000 7efecb400740 20 client.6603 trim_cache size 0 max 16384 2023-11-24T06:16:49.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.110+0000 7efecb400740 1 Processor -- start 2023-11-24T06:16:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.110+0000 7efecb400740 1 -- start start 2023-11-24T06:16:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.111+0000 7efecb400740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e87d70 0x5571b7ef4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.111+0000 7efecb400740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.111+0000 7efecb400740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 0x5571b7e87310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.111+0000 7efecb400740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7b56f20 con 0x5571b7e8c7b0 2023-11-24T06:16:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.111+0000 7efecb400740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7d77520 con 0x5571b7e8d070 2023-11-24T06:16:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.111+0000 7efecb400740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571b7da7e30 con 0x5571b7e87d70 2023-11-24T06:16:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.111+0000 7efebbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.111+0000 7efebbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40050/0 (socket says 172.21.15.22:40050) 2023-11-24T06:16:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.111+0000 7efebbfff640 1 -- 172.21.15.22:0/3595725261 learned_addr learned my addr 172.21.15.22:0/3595725261 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.112+0000 7efebbfff640 1 -- 172.21.15.22:0/3595725261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e87d70 msgr2=0x5571b7ef4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.112+0000 7efebbfff640 1 --2- 172.21.15.22:0/3595725261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e87d70 0x5571b7ef4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.112+0000 7efebbfff640 1 -- 172.21.15.22:0/3595725261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 msgr2=0x5571b7e87310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.112+0000 7efebbfff640 1 --2- 172.21.15.22:0/3595725261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 0x5571b7e87310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.112+0000 7efebbfff640 1 -- 172.21.15.22:0/3595725261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571b7d8fb80 con 0x5571b7e8c7b0 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.112+0000 7efebbfff640 1 --2- 172.21.15.22:0/3595725261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7efeac003d10 tx=0x7efeac00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9d7a58db224e53 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.112+0000 7efeb8ff9640 1 -- 172.21.15.22:0/3595725261 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac024070 con 0x5571b7e8c7b0 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.112+0000 7efeb8ff9640 1 -- 172.21.15.22:0/3595725261 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac007c30 con 0x5571b7e8c7b0 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.112+0000 7efeb8ff9640 1 -- 172.21.15.22:0/3595725261 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac026b00 con 0x5571b7e8c7b0 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.113+0000 7efecb400740 1 -- 172.21.15.22:0/3595725261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 msgr2=0x5571b7e86dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.113+0000 7efecb400740 1 --2- 172.21.15.22:0/3595725261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7efeac003d10 tx=0x7efeac00c000 comp rx=0 tx=0).stop 2023-11-24T06:16:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.113+0000 7efecb400740 1 -- 172.21.15.22:0/3595725261 shutdown_connections 2023-11-24T06:16:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.113+0000 7efecb400740 1 --2- 172.21.15.22:0/3595725261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 0x5571b7e87310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.113+0000 7efecb400740 1 --2- 172.21.15.22:0/3595725261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.113+0000 7efecb400740 1 --2- 172.21.15.22:0/3595725261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e87d70 0x5571b7ef4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.113+0000 7efecb400740 1 -- 172.21.15.22:0/3595725261 >> 172.21.15.22:0/3595725261 conn(0x5571b7e4ec70 msgr2=0x5571b7ed9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.113+0000 7efecb400740 1 -- 172.21.15.22:0/3595725261 shutdown_connections 2023-11-24T06:16:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.113+0000 7efecb400740 1 -- 172.21.15.22:0/3595725261 wait complete. 2023-11-24T06:16:49.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.114+0000 7efecb400740 1 -- start start 2023-11-24T06:16:49.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.114+0000 7efecb400740 1 Processor -- start 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efecb400740 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e87d70 0x5571b7f3b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efecb400740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efecb400740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 0x5571b7e87310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efecb400740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7f3be90 con 0x5571b7e8c7b0 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efecb400740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7eebf40 con 0x5571b7e8d070 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efecb400740 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571b7ec8d70 con 0x5571b7e87d70 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efecb400740 10 client.0 _ll_register_callbacks cb 0x7efeb4013b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efebbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efebbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40052/0 (socket says 172.21.15.22:40052) 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.115+0000 7efebbfff640 1 -- 172.21.15.22:0/2353446614 learned_addr learned my addr 172.21.15.22:0/2353446614 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efec259c640 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e87d70 0x5571b7f3b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efec2d9d640 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 0x5571b7e87310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efebbfff640 1 -- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e87d70 msgr2=0x5571b7f3b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efebbfff640 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e87d70 0x5571b7f3b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efebbfff640 1 -- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 msgr2=0x5571b7e87310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efebbfff640 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 0x5571b7e87310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efebbfff640 1 -- 172.21.15.22:0/2353446614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571b7dbb860 con 0x5571b7e8c7b0 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efec2d9d640 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 0x5571b7e87310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efebbfff640 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7efeac021040 tx=0x7efeac003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba27d85a33645ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efea17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efea17fa640 1 -- 172.21.15.22:0/2353446614 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00b040 con 0x5571b7e8c7b0 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efea17fa640 1 -- 172.21.15.22:0/2353446614 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efeac026e10 con 0x5571b7e8c7b0 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efecb400740 1 -- 172.21.15.22:0/2353446614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571b7ee2fe0 con 0x5571b7e8c7b0 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.116+0000 7efea17fa640 1 -- 172.21.15.22:0/2353446614 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efeac005030 con 0x5571b7e8c7b0 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efecb400740 10 client.6609 fetch_fsmap learned FSMap version 34 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efecb400740 1 -- 172.21.15.22:0/2353446614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x5571b7db5170 con 0x5571b7e8c7b0 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efea17fa640 1 -- 172.21.15.22:0/2353446614 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5571b7ee2fe0 con 0x5571b7e8c7b0 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efea17fa640 1 -- 172.21.15.22:0/2353446614 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efeac005190 con 0x5571b7e8c7b0 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efecb400740 10 client.6609 fetch_fsmap finished waiting for FSMap version 34 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efecb400740 10 client.6609 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efecb400740 20 client.6609 populate_metadata read hostname 'smithi022' 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efecb400740 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] conn(0x5571b7eeb100 0x5571b7eeb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efecb400740 4 client.6609 mds_command: new command op to 6435 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.117+0000 7efecb400740 1 -- 172.21.15.22:0/2353446614 --> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7efeac007240 con 0x5571b7eeb100 2023-11-24T06:16:49.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.118+0000 7efec259c640 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] conn(0x5571b7eeb100 0x5571b7eeb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.118+0000 7efec259c640 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] conn(0x5571b7eeb100 0x5571b7eeb4e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d3d6e8b6355c3a8 server_cookie=2fbcfb0d0118ed06 in_seq=0 out_seq=0 2023-11-24T06:16:49.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.118+0000 7efea17fa640 10 client.6609 ms_handle_connect on v2:172.21.15.31:6832/2376501260 2023-11-24T06:16:49.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efea17fa640 1 -- 172.21.15.22:0/2353446614 <== mds.0 v2:172.21.15.31:6832/2376501260 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7efeac007240 con 0x5571b7eeb100 2023-11-24T06:16:49.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efea17fa640 10 client.6609 handle_command_reply: tid=0 2023-11-24T06:16:49.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efecb400740 1 client.6609 shutdown 2023-11-24T06:16:49.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efecb400740 1 -- 172.21.15.22:0/2353446614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 msgr2=0x5571b7e86dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efecb400740 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7efeac021040 tx=0x7efeac003760 comp rx=0 tx=0).stop 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efecb400740 1 -- 172.21.15.22:0/2353446614 shutdown_connections 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efecb400740 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:6832/2376501260,v1:172.21.15.31:6834/2376501260] conn(0x5571b7eeb100 0x5571b7eeb4e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efecb400740 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5571b7e8d070 0x5571b7e87310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efecb400740 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5571b7e8c7b0 0x5571b7e86dd0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efea17fa640 0 client.6609 ms_handle_reset on v2:172.21.15.31:6832/2376501260 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efecb400740 1 --2- 172.21.15.22:0/2353446614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5571b7e87d70 0x5571b7f3b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.119+0000 7efecb400740 1 -- 172.21.15.22:0/2353446614 >> 172.21.15.22:0/2353446614 conn(0x5571b7e4ec70 msgr2=0x5571b7ed1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efecb400740 1 -- 172.21.15.22:0/2353446614 shutdown_connections 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efecb400740 1 -- 172.21.15.22:0/2353446614 wait complete. 2023-11-24T06:16:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efecb400740 20 client.6609 trim_cache size 0 max 16384 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d0664f6f-6758-42fa-85ad-04f9384b4bc8", 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 6435, 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 14.376918334000001, 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 34, 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 61, 2023-11-24T06:16:49.126 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 61, 2023-11-24T06:16:49.127 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 20.689205907000002 2023-11-24T06:16:49.127 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:16:49.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 -- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efea406aff0 msgr2=0x7efea406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efea406aff0 0x7efea406d4b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009990 tx=0x7efeb4008040 comp rx=0 tx=0).stop 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 -- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec41442b0 msgr2=0x7efec414b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec41442b0 0x7efec414b1d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efebc002230 tx=0x7efebc001d80 comp rx=0 tx=0).stop 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 -- 172.21.15.22:0/3204418988 shutdown_connections 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efea406aff0 0x7efea406d4b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec41442b0 0x7efec414b1d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efec415e340 0x7efec4143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 --2- 172.21.15.22:0/3204418988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb0005180 0x7efec413c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.120+0000 7efec359e640 1 -- 172.21.15.22:0/3204418988 >> 172.21.15.22:0/3204418988 conn(0x7efec40b0840 msgr2=0x7efec415ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.121+0000 7efec359e640 1 -- 172.21.15.22:0/3204418988 shutdown_connections 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.121+0000 7efec359e640 1 -- 172.21.15.22:0/3204418988 wait complete. 2023-11-24T06:16:49.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:16:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.358+0000 7f72c17e9640 1 Processor -- start 2023-11-24T06:16:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.358+0000 7f72c17e9640 1 -- start start 2023-11-24T06:16:49.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.360+0000 7f72c17e9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72bc162670 0x7f72bc0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.360+0000 7f72c17e9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 0x7f72bc06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.360+0000 7f72c17e9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0cf9d0 con 0x7f72bc14b1c0 2023-11-24T06:16:49.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.360+0000 7f72c17e9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc165ca0 con 0x7f72bc162670 2023-11-24T06:16:49.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.360+0000 7f72c17e9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc165f80 con 0x7f72bc0cf590 2023-11-24T06:16:49.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.361+0000 7f72bb7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72bc162670 0x7f72bc0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.361+0000 7f72bb7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72bc162670 0x7f72bc0cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40056/0 (socket says 172.21.15.22:40056) 2023-11-24T06:16:49.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.361+0000 7f72bb7fe640 1 -- 172.21.15.22:0/3900507009 learned_addr learned my addr 172.21.15.22:0/3900507009 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:49.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.361+0000 7f72c0fe8640 1 --2- 172.21.15.22:0/3900507009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 0x7f72bc06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.361+0000 7f72bb7fe640 1 -- 172.21.15.22:0/3900507009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 msgr2=0x7f72bc06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.361+0000 7f72bb7fe640 1 --2- 172.21.15.22:0/3900507009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 0x7f72bc06c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.361+0000 7f72bb7fe640 1 -- 172.21.15.22:0/3900507009 >> v1:172.21.15.31:6789/0 conn(0x7f72bc14b1c0 legacy=0x7f72bc1651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.361+0000 7f72bb7fe640 1 -- 172.21.15.22:0/3900507009 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc161e70 con 0x7f72bc162670 2023-11-24T06:16:49.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.362+0000 7f72bb7fe640 1 --2- 172.21.15.22:0/3900507009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc162670 0x7f72bc0cf050 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009870 tx=0x7f72b002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdca09363f205d1f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.363+0000 7f72baffd640 1 -- 172.21.15.22:0/3900507009 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00317c0 con 0x7f72bc162670 2023-11-24T06:16:49.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.363+0000 7f72baffd640 1 -- 172.21.15.22:0/3900507009 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0031920 con 0x7f72bc162670 2023-11-24T06:16:49.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.363+0000 7f72baffd640 1 -- 172.21.15.22:0/3900507009 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0031cb0 con 0x7f72bc162670 2023-11-24T06:16:49.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.363+0000 7f72c17e9640 1 -- 172.21.15.22:0/3900507009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc162670 msgr2=0x7f72bc0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.363+0000 7f72c17e9640 1 --2- 172.21.15.22:0/3900507009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc162670 0x7f72bc0cf050 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009870 tx=0x7f72b002b860 comp rx=0 tx=0).stop 2023-11-24T06:16:49.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.363+0000 7f72c17e9640 1 -- 172.21.15.22:0/3900507009 shutdown_connections 2023-11-24T06:16:49.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.364+0000 7f72c17e9640 1 --2- 172.21.15.22:0/3900507009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 0x7f72bc06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.364+0000 7f72c17e9640 1 --2- 172.21.15.22:0/3900507009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc162670 0x7f72bc0cf050 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.364+0000 7f72c17e9640 1 -- 172.21.15.22:0/3900507009 >> 172.21.15.22:0/3900507009 conn(0x7f72bc06a860 msgr2=0x7f72bc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.364+0000 7f72c17e9640 1 -- 172.21.15.22:0/3900507009 shutdown_connections 2023-11-24T06:16:49.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.364+0000 7f72c17e9640 1 -- 172.21.15.22:0/3900507009 wait complete. 2023-11-24T06:16:49.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.365+0000 7f72c17e9640 1 Processor -- start 2023-11-24T06:16:49.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.366+0000 7f72c17e9640 1 -- start start 2023-11-24T06:16:49.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.366+0000 7f72c17e9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 0x7f72bc1409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.366+0000 7f72c17e9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc14b1c0 0x7f72bc1ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.366+0000 7f72c17e9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72bc162670 0x7f72bc06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72c17e9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc1ec7e0 con 0x7f72bc14b1c0 2023-11-24T06:16:49.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72c17e9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc1613c0 con 0x7f72bc162670 2023-11-24T06:16:49.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72c17e9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0cba10 con 0x7f72bc0cf590 2023-11-24T06:16:49.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc14b1c0 0x7f72bc1ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc14b1c0 0x7f72bc1ed7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40062/0 (socket says 172.21.15.22:40062) 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bb7fe640 1 -- 172.21.15.22:0/460823772 learned_addr learned my addr 172.21.15.22:0/460823772 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72c0fe8640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72bc162670 0x7f72bc06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bbfff640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 0x7f72bc1409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bb7fe640 1 -- 172.21.15.22:0/460823772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 msgr2=0x7f72bc1409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bb7fe640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 0x7f72bc1409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bb7fe640 1 -- 172.21.15.22:0/460823772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72bc162670 msgr2=0x7f72bc06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bb7fe640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72bc162670 0x7f72bc06cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bb7fe640 1 -- 172.21.15.22:0/460823772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00094d0 con 0x7f72bc14b1c0 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.367+0000 7f72bbfff640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 0x7f72bc1409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.368+0000 7f72bb7fe640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc14b1c0 0x7f72bc1ed7f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f72b0000c00 tx=0x7f72b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.368+0000 7f72b8ff9640 1 -- 172.21.15.22:0/460823772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0032860 con 0x7f72bc14b1c0 2023-11-24T06:16:49.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.368+0000 7f72b8ff9640 1 -- 172.21.15.22:0/460823772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b00329c0 con 0x7f72bc14b1c0 2023-11-24T06:16:49.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.368+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc0cc870 con 0x7f72bc14b1c0 2023-11-24T06:16:49.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.368+0000 7f72b8ff9640 1 -- 172.21.15.22:0/460823772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0032d70 con 0x7f72bc14b1c0 2023-11-24T06:16:49.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.368+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc0cbf40 con 0x7f72bc14b1c0 2023-11-24T06:16:49.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.369+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc0cca00 con 0x7f72bc14b1c0 2023-11-24T06:16:49.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.371+0000 7f72b8ff9640 1 -- 172.21.15.22:0/460823772 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f72b004e450 con 0x7f72bc14b1c0 2023-11-24T06:16:49.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.372+0000 7f72b8ff9640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72a806aff0 0x7f72a806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.372+0000 7f72b8ff9640 1 -- 172.21.15.22:0/460823772 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72b00abbd0 con 0x7f72bc14b1c0 2023-11-24T06:16:49.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.372+0000 7f72bbfff640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72a806aff0 0x7f72a806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.373+0000 7f72bbfff640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72a806aff0 0x7f72a806d4b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0b1560 tx=0x7f72ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.376+0000 7f72b8ff9640 1 -- 172.21.15.22:0/460823772 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72b0076960 con 0x7f72bc14b1c0 2023-11-24T06:16:49.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.615+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72bc06ded0 con 0x7f72bc14b1c0 2023-11-24T06:16:49.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.615+0000 7f72b8ff9640 1 -- 172.21.15.22:0/460823772 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f72b0079f80 con 0x7f72bc14b1c0 2023-11-24T06:16:49.618 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:16:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72a806aff0 msgr2=0x7f72a806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72a806aff0 0x7f72a806d4b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0b1560 tx=0x7f72ac008040 comp rx=0 tx=0).stop 2023-11-24T06:16:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc14b1c0 msgr2=0x7f72bc1ed7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc14b1c0 0x7f72bc1ed7f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f72b0000c00 tx=0x7f72b00046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 shutdown_connections 2023-11-24T06:16:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f72a806aff0 0x7f72a806d4b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72bc162670 0x7f72bc06cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72bc14b1c0 0x7f72bc1ed7f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 --2- 172.21.15.22:0/460823772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72bc0cf590 0x7f72bc1409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.618+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 >> 172.21.15.22:0/460823772 conn(0x7f72bc06a860 msgr2=0x7f72bc06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.619+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 shutdown_connections 2023-11-24T06:16:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:49.619+0000 7f72c17e9640 1 -- 172.21.15.22:0/460823772 wait complete. 2023-11-24T06:16:49.641 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:16:49.641 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:16:49.641 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-11-24T06:16:49.641 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:16:49.641 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:49.641 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:16:49.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:16:49.641 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:16:49.642 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:16:49.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:49.642 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-11-24T06:16:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:49.699 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42001sec preferred_lft 42001sec 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:49.700 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-11-24T06:16:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:16:49.701 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 12:91:dd:4c:3b:77 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:49.701 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:16:49.701 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:49.701 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::5c65:45ff:fef2:bf3b/64 scope link 2023-11-24T06:16:49.701 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:16:49.702 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 42:17:0d:d1:91:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:16:49.702 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::4017:dff:fed1:9132/64 scope link 2023-11-24T06:16:49.702 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:16:49.702 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 12:91:dd:4c:3b:77 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:16:49.702 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::1091:ddff:fe4c:3b77/64 scope link 2023-11-24T06:16:49.702 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:49.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:49.703 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:16:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-11-24T06:16:49.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:49.810 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-11-24T06:16:49.856 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-11-24T06:16:49.856 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:16:49.856 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:16:49.856 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:16:49.857 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:16:49.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:49.857 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-11-24T06:16:49.857 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-11-24T06:16:49.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:16:49.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:16:49.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:16:49.858 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-11-24T06:16:50.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:50.093 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-11-24T06:16:50.149 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:16:50.149 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:16:50.150 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:16:50.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:50.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-11-24T06:16:50.254 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T06:16:50.254 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:16:50.254 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:16:50.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:16:50.316 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:50.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:16:50.478 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:16:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:16:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:16:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:16:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:16:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:16:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:16:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:16:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:16:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:16:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:16:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:16:50.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:50.543 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:16:50.599 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T06:16:50.599 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T06:16:50.604 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-11-24T06:16:50.684 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:16:50.728 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2023-11-24T06:16:50.728 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2023-11-24T06:16:50.728 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2023-11-24T06:16:50.728 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2023-11-24T06:16:50.728 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2023-11-24T06:16:50.728 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:16:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2023-11-24T06:16:50.730 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:16:50.731 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:16:50.731 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:16:50.731 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:16:50.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:50.732 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-11-24T06:16:50.807 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:2023-11-24T06:16:50.805+0000 7fbb9ec0f480 -1 init, newargv = 0x555f13effbb0 newargc=15 2023-11-24T06:16:50.807 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[109788]: starting ceph client 2023-11-24T06:16:50.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[109788]: starting fuse 2023-11-24T06:16:50.828 INFO:teuthology.orchestra.run.smithi022.stdout:41 2023-11-24T06:16:50.829 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T06:16:50.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:16:50.829 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2023-11-24T06:16:50.829 DEBUG:teuthology.orchestra.run.smithi022:> import re 2023-11-24T06:16:50.829 DEBUG:teuthology.orchestra.run.smithi022:> import os 2023-11-24T06:16:50.829 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2023-11-24T06:16:50.829 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:16:50.829 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2023-11-24T06:16:50.829 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T06:16:50.829 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:16:50.830 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2023-11-24T06:16:50.831 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2023-11-24T06:16:50.831 DEBUG:teuthology.orchestra.run.smithi022:> return f 2023-11-24T06:16:50.831 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:16:50.831 DEBUG:teuthology.orchestra.run.smithi022:> 2023-11-24T06:16:50.831 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.0")) 2023-11-24T06:16:50.831 DEBUG:teuthology.orchestra.run.smithi022:> ' 2023-11-24T06:16:51.034 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.0.109788.asok 2023-11-24T06:16:51.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:16:51.052 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.109788.asok 2023-11-24T06:16:51.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:51.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.109788.asok status 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "0", 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "109788", 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/" 2023-11-24T06:16:51.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 6621, 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 6621 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1895321219 2023-11-24T06:16:51.305 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1895321219 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.6621 192.168.0.1:0/1895321219", 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.1:0/1895321219", 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 1, 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 34, 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 61, 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:16:51.306 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2023-11-24T06:16:51.307 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2023-11-24T06:16:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:16:51.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:51.320 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2023-11-24T06:16:51.320 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2023-11-24T06:16:51.383 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:51.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:51.384 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:51.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:16:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.707+0000 7f96bb4ad640 1 Processor -- start 2023-11-24T06:16:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.708+0000 7f96bb4ad640 1 -- start start 2023-11-24T06:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.709+0000 7f96bb4ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f96b40d1900 0x7f96b40b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.709+0000 7f96bb4ad640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b40cf0c0 con 0x7f96b415d5b0 2023-11-24T06:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.709+0000 7f96bb4ad640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b40b01b0 con 0x7f96b40d14a0 2023-11-24T06:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.709+0000 7f96bb4ad640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b415d990 con 0x7f96b40d1900 2023-11-24T06:16:51.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.710+0000 7f96ba4ab640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f96b415d5b0 0x7f96b40d3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46364/0 (socket says 172.21.15.22:46364) 2023-11-24T06:16:51.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.710+0000 7f96ba4ab640 1 -- 172.21.15.22:0/2372594311 learned_addr learned my addr 172.21.15.22:0/2372594311 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.710+0000 7f96bacac640 1 --2- 172.21.15.22:0/2372594311 >> v2:172.21.15.31:3300/0 conn(0x7f96b40d1900 0x7f96b40b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.710+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787208112 0 0) 0x7f96b40cf0c0 con 0x7f96b415d5b0 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.710+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a0003520 con 0x7f96b415d5b0 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3383014017 0 0) 0x7f96a0003520 con 0x7f96b415d5b0 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 >> v2:172.21.15.31:3300/0 conn(0x7f96b40d1900 msgr2=0x7f96b40b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 --2- 172.21.15.22:0/2372594311 >> v2:172.21.15.31:3300/0 conn(0x7f96b40d1900 0x7f96b40b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 >> v1:172.21.15.31:6789/0 conn(0x7f96b40d14a0 legacy=0x7f96b40b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b40ceb00 con 0x7f96b415d5b0 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f96b0001670 con 0x7f96b415d5b0 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 >> v1:172.21.15.22:6789/0 conn(0x7f96b415d5b0 legacy=0x7f96b40d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96a0003a30 0x7f96a0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a00047c0 0x7f96a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96a00051d0 0x7f96a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b415d990 con 0x7f96a00051d0 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a000c100 con 0x7f96a00047c0 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a000c2c0 con 0x7f96a0003a30 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.711+0000 7f96bacac640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96a00051d0 0x7f96a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.712+0000 7f96b9caa640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a00047c0 0x7f96a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.712+0000 7f96ba4ab640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96a0003a30 0x7f96a0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.712+0000 7f96bacac640 1 -- 172.21.15.22:0/2372594311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96a0003a30 msgr2=0x7f96a0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.712+0000 7f96bacac640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96a0003a30 0x7f96a0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.712+0000 7f96bacac640 1 -- 172.21.15.22:0/2372594311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a00047c0 msgr2=0x7f96a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.712+0000 7f96bacac640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a00047c0 0x7f96a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.712+0000 7f96bacac640 1 -- 172.21.15.22:0/2372594311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0003520 con 0x7f96a00051d0 2023-11-24T06:16:51.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.713+0000 7f96bacac640 1 -- 172.21.15.22:0/2372594311 reap_dead start 2023-11-24T06:16:51.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.713+0000 7f96bacac640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96a00051d0 0x7f96a000b980 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009fc0 tx=0x7f96a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ca9fdda8635423 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:51.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.713+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac02cc60 con 0x7f96a00051d0 2023-11-24T06:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.713+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac00f040 con 0x7f96a00051d0 2023-11-24T06:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.713+0000 7f96b94a9640 1 -- 172.21.15.22:0/2372594311 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac003990 con 0x7f96a00051d0 2023-11-24T06:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.714+0000 7f96bb4ad640 1 -- 172.21.15.22:0/2372594311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96a00051d0 msgr2=0x7f96a000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.714+0000 7f96bb4ad640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96a00051d0 0x7f96a000b980 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009fc0 tx=0x7f96a00057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.714+0000 7f96bb4ad640 1 -- 172.21.15.22:0/2372594311 shutdown_connections 2023-11-24T06:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.714+0000 7f96bb4ad640 1 --2- 172.21.15.22:0/2372594311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96a00051d0 0x7f96a000b980 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.714+0000 7f96bb4ad640 1 -- 172.21.15.22:0/2372594311 >> 172.21.15.22:0/2372594311 conn(0x7f96b409c3b0 msgr2=0x7f96b40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.714+0000 7f96bb4ad640 1 -- 172.21.15.22:0/2372594311 shutdown_connections 2023-11-24T06:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.714+0000 7f96bb4ad640 1 -- 172.21.15.22:0/2372594311 wait complete. 2023-11-24T06:16:51.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.716+0000 7f96bb4ad640 1 Processor -- start 2023-11-24T06:16:51.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.716+0000 7f96bb4ad640 1 -- start start 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.717+0000 7f96bb4ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a00051d0 0x7f96b4157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.717+0000 7f96bb4ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96b415f6a0 0x7f96b41517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.717+0000 7f96bb4ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b40b2f40 0x7f96b40b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.717+0000 7f96bb4ad640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40b3900 con 0x7f96b40b2f40 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.717+0000 7f96bb4ad640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40cb6a0 con 0x7f96a00051d0 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.717+0000 7f96bb4ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4160390 con 0x7f96b415f6a0 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96bacac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b40b2f40 0x7f96b40b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96bacac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b40b2f40 0x7f96b40b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45898/0 (socket says 172.21.15.22:45898) 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96bacac640 1 -- 172.21.15.22:0/1003257195 learned_addr learned my addr 172.21.15.22:0/1003257195 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96b9caa640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96b415f6a0 0x7f96b41517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96ba4ab640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a00051d0 0x7f96b4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96bacac640 1 -- 172.21.15.22:0/1003257195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96b415f6a0 msgr2=0x7f96b41517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96bacac640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96b415f6a0 0x7f96b41517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96bacac640 1 -- 172.21.15.22:0/1003257195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a00051d0 msgr2=0x7f96b4157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96bacac640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a00051d0 0x7f96b4157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96bacac640 1 -- 172.21.15.22:0/1003257195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b415fdd0 con 0x7f96b40b2f40 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.718+0000 7f96bacac640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b40b2f40 0x7f96b40b33c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00e230 tx=0x7f96ac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.719+0000 7f96aaffd640 1 -- 172.21.15.22:0/1003257195 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac035d60 con 0x7f96b40b2f40 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.719+0000 7f96aaffd640 1 -- 172.21.15.22:0/1003257195 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac035ee0 con 0x7f96b40b2f40 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.719+0000 7f96aaffd640 1 -- 172.21.15.22:0/1003257195 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac003b90 con 0x7f96b40b2f40 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.719+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b41600b0 con 0x7f96b40b2f40 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.719+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b415fac0 con 0x7f96b40b2f40 2023-11-24T06:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.720+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b40cb810 con 0x7f96b40b2f40 2023-11-24T06:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.721+0000 7f96aaffd640 1 -- 172.21.15.22:0/1003257195 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f96ac003cf0 con 0x7f96b40b2f40 2023-11-24T06:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.722+0000 7f96aaffd640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f969806b020 0x7f969806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.722+0000 7f96aaffd640 1 -- 172.21.15.22:0/1003257195 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96ac0ac660 con 0x7f96b40b2f40 2023-11-24T06:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.722+0000 7f96ba4ab640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f969806b020 0x7f969806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.723+0000 7f96ba4ab640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f969806b020 0x7f969806d4e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f96b0001050 tx=0x7f96b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:51.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.727+0000 7f96aaffd640 1 -- 172.21.15.22:0/1003257195 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96ac077510 con 0x7f96b40b2f40 2023-11-24T06:16:51.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:16:51.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:16:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.959+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f96b404e840 con 0x7f96b40b2f40 2023-11-24T06:16:51.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.960+0000 7f96aaffd640 1 -- 172.21.15.22:0/1003257195 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f96ac07ab30 con 0x7f96b40b2f40 2023-11-24T06:16:51.963 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:16:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f969806b020 msgr2=0x7f969806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f969806b020 0x7f969806d4e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f96b0001050 tx=0x7f96b0009040 comp rx=0 tx=0).stop 2023-11-24T06:16:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b40b2f40 msgr2=0x7f96b40b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b40b2f40 0x7f96b40b33c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00e230 tx=0x7f96ac009750 comp rx=0 tx=0).stop 2023-11-24T06:16:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 shutdown_connections 2023-11-24T06:16:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f969806b020 0x7f969806d4e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b40b2f40 0x7f96b40b33c0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96b415f6a0 0x7f96b41517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 --2- 172.21.15.22:0/1003257195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a00051d0 0x7f96b4157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 >> 172.21.15.22:0/1003257195 conn(0x7f96b409c3b0 msgr2=0x7f96b415c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:51.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 shutdown_connections 2023-11-24T06:16:51.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:51.963+0000 7f96bb4ad640 1 -- 172.21.15.22:0/1003257195 wait complete. 2023-11-24T06:16:51.984 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:16:51.984 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:16:51.984 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-11-24T06:16:51.984 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:16:51.984 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:51.984 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:16:51.984 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:16:51.984 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:16:51.985 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:16:51.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:51.985 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-11-24T06:16:52.042 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:16:52.042 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-11-24T06:16:52.043 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 41989sec preferred_lft 41989sec 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:5c:4a:a6:48:09 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:16:52.044 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c062:1fff:fe91:be78/64 scope link 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:5c:4a:a6:48:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c45c:4aff:fea6:4809/64 scope link 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether e2:ba:d2:fd:ba:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::e0ba:d2ff:fefd:bac8/64 scope link 2023-11-24T06:16:52.045 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:52.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:52.046 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:16:52.133 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-11-24T06:16:52.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:52.137 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-11-24T06:16:52.193 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-11-24T06:16:52.193 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:16:52.193 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:16:52.194 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:16:52.194 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:16:52.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:52.194 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-24T06:16:52.194 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-24T06:16:52.194 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:16:52.194 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:16:52.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:16:52.195 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-24T06:16:52.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:52.393 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-24T06:16:52.450 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:16:52.450 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:16:52.451 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:16:52.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:52.452 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-11-24T06:16:52.558 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T06:16:52.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:16:52.558 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:16:52.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:16:52.619 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:52.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:16:52.786 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:16:52.851 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:16:52.852 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:16:52.853 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:16:52.854 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:16:52.854 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:16:52.854 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:16:52.854 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:16:52.854 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:16:52.854 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:16:52.854 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:16:52.854 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:16:52.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:52.855 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:16:52.912 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T06:16:52.913 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T06:16:52.918 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-24T06:16:53.003 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T06:16:53.047 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-24T06:16:53.047 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-24T06:16:53.047 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-24T06:16:53.047 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-24T06:16:53.047 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-24T06:16:53.047 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-24T06:16:53.047 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-24T06:16:53.047 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-24T06:16:53.047 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T06:16:53.048 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:16:53.049 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:16:53.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:53.050 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-24T06:16:53.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:2023-11-24T06:16:53.105+0000 7fc1cac0c480 -1 init, newargv = 0x55b9ec5718e0 newargc=15 2023-11-24T06:16:53.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[96737]: starting ceph client 2023-11-24T06:16:53.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[96737]: starting fuse 2023-11-24T06:16:53.138 INFO:teuthology.orchestra.run.smithi031.stdout:41 2023-11-24T06:16:53.138 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T06:16:53.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2023-11-24T06:16:53.138 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> import re 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2023-11-24T06:16:53.139 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> return f 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.1")) 2023-11-24T06:16:53.140 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-11-24T06:16:53.354 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.1.96737.asok 2023-11-24T06:16:53.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-24T06:16:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T06:16:53.373 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.96737.asok 2023-11-24T06:16:53.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:53.373 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.96737.asok status 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "1", 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "96737", 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2023-11-24T06:16:53.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5461, 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 5461 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1620423935 2023-11-24T06:16:53.632 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1620423935 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.5461 192.168.0.1:0/1620423935", 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/1620423935", 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 34, 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 61, 2023-11-24T06:16:53.633 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2023-11-24T06:16:53.634 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2023-11-24T06:16:53.634 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2023-11-24T06:16:53.634 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-24T06:16:53.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:53.647 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2023-11-24T06:16:53.647 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:53.704 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2023-11-24T06:16:53.704 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:53.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:53.704 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:53.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:16:54.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.050+0000 7f9ade72c640 1 Processor -- start 2023-11-24T06:16:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.050+0000 7f9ade72c640 1 -- start start 2023-11-24T06:16:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.052+0000 7f9ade72c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad806cad0 0x7f9ad8162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.052+0000 7f9ade72c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad8162fa0 con 0x7f9ad8162220 2023-11-24T06:16:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.052+0000 7f9ade72c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80706a0 con 0x7f9ad8162600 2023-11-24T06:16:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.052+0000 7f9ade72c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8070c60 con 0x7f9ad806cad0 2023-11-24T06:16:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.052+0000 7f9ad7fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9ad8162220 0x7f9ad80b1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46378/0 (socket says 172.21.15.22:46378) 2023-11-24T06:16:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.052+0000 7f9ad7fff640 1 -- 172.21.15.22:0/4038021117 learned_addr learned my addr 172.21.15.22:0/4038021117 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109472949 0 0) 0x7f9ad8162fa0 con 0x7f9ad8162220 2023-11-24T06:16:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9adccc9640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad806cad0 0x7f9ad8162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac4003520 con 0x7f9ad8162220 2023-11-24T06:16:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2879650679 0 0) 0x7f9ac4003520 con 0x7f9ad8162220 2023-11-24T06:16:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad806cad0 msgr2=0x7f9ad8162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:54.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad806cad0 0x7f9ad8162a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 >> v1:172.21.15.31:6789/0 conn(0x7f9ad8162600 legacy=0x7f9ad806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80722b0 con 0x7f9ad8162220 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f9ac8001670 con 0x7f9ad8162220 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 >> v1:172.21.15.22:6789/0 conn(0x7f9ad8162220 legacy=0x7f9ad80b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad806cad0 0x7f9ac40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ac4003f70 0x7f9ac40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac4004d00 0x7f9ac4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8070c60 con 0x7f9ac4004d00 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac400bac0 con 0x7f9ac4003f70 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.053+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac400bc80 con 0x7f9ad806cad0 2023-11-24T06:16:54.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.054+0000 7f9adccc9640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac4004d00 0x7f9ac4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.054+0000 7f9ad7fff640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad806cad0 0x7f9ac40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.054+0000 7f9acffff640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ac4003f70 0x7f9ac40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.054+0000 7f9adccc9640 1 -- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad806cad0 msgr2=0x7f9ac40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.054+0000 7f9adccc9640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad806cad0 0x7f9ac40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.054+0000 7f9adccc9640 1 -- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ac4003f70 msgr2=0x7f9ac40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.054+0000 7f9adccc9640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ac4003f70 0x7f9ac40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.054+0000 7f9adccc9640 1 -- 172.21.15.22:0/4038021117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4003520 con 0x7f9ac4004d00 2023-11-24T06:16:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.055+0000 7f9adccc9640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac4004d00 0x7f9ac4005180 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009f90 tx=0x7f9ac40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5358f9e41f9943ff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.056+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad002cbd0 con 0x7f9ac4004d00 2023-11-24T06:16:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.056+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad000f040 con 0x7f9ac4004d00 2023-11-24T06:16:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.056+0000 7f9ad77fe640 1 -- 172.21.15.22:0/4038021117 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0034440 con 0x7f9ac4004d00 2023-11-24T06:16:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.056+0000 7f9ade72c640 1 -- 172.21.15.22:0/4038021117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac4004d00 msgr2=0x7f9ac4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.056+0000 7f9ade72c640 1 --2- 172.21.15.22:0/4038021117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac4004d00 0x7f9ac4005180 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009f90 tx=0x7f9ac40057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.056+0000 7f9adccc9640 1 -- 172.21.15.22:0/4038021117 reap_dead start 2023-11-24T06:16:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.057+0000 7f9ade72c640 1 -- 172.21.15.22:0/4038021117 shutdown_connections 2023-11-24T06:16:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.057+0000 7f9ade72c640 1 -- 172.21.15.22:0/4038021117 >> 172.21.15.22:0/4038021117 conn(0x7f9ad80b0ba0 msgr2=0x7f9ad80b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.057+0000 7f9ade72c640 1 -- 172.21.15.22:0/4038021117 shutdown_connections 2023-11-24T06:16:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.057+0000 7f9ade72c640 1 -- 172.21.15.22:0/4038021117 wait complete. 2023-11-24T06:16:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.058+0000 7f9ade72c640 1 Processor -- start 2023-11-24T06:16:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.059+0000 7f9ade72c640 1 -- start start 2023-11-24T06:16:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9ade72c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ac4004d00 0x7f9ad80abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9ade72c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ad809b400 0x7f9ad809a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9ade72c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad80ac3c0 0x7f9ad809ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9ade72c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8099a00 con 0x7f9ad809b400 2023-11-24T06:16:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9ade72c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad809c6c0 con 0x7f9ac4004d00 2023-11-24T06:16:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9ade72c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8099c50 con 0x7f9ad80ac3c0 2023-11-24T06:16:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9acffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ad809b400 0x7f9ad809a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9acffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ad809b400 0x7f9ad809a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45910/0 (socket says 172.21.15.22:45910) 2023-11-24T06:16:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9acffff640 1 -- 172.21.15.22:0/2354265679 learned_addr learned my addr 172.21.15.22:0/2354265679 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9adccc9640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad80ac3c0 0x7f9ad809ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9ad7fff640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ac4004d00 0x7f9ad80abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9acffff640 1 -- 172.21.15.22:0/2354265679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad80ac3c0 msgr2=0x7f9ad809ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9acffff640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad80ac3c0 0x7f9ad809ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9acffff640 1 -- 172.21.15.22:0/2354265679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ac4004d00 msgr2=0x7f9ad80abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9acffff640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ac4004d00 0x7f9ad80abe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.060+0000 7f9acffff640 1 -- 172.21.15.22:0/2354265679 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8099f30 con 0x7f9ad809b400 2023-11-24T06:16:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.061+0000 7f9acffff640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ad809b400 0x7f9ad809a730 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000e490 tx=0x7f9ac000e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.061+0000 7f9ad57fa640 1 -- 172.21.15.22:0/2354265679 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac00052e0 con 0x7f9ad809b400 2023-11-24T06:16:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.061+0000 7f9ad57fa640 1 -- 172.21.15.22:0/2354265679 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac0005440 con 0x7f9ad809b400 2023-11-24T06:16:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.061+0000 7f9ad57fa640 1 -- 172.21.15.22:0/2354265679 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0003830 con 0x7f9ad809b400 2023-11-24T06:16:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.061+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad809a210 con 0x7f9ad809b400 2023-11-24T06:16:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.061+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad8153210 con 0x7f9ad809b400 2023-11-24T06:16:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.063+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad809d200 con 0x7f9ad809b400 2023-11-24T06:16:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.063+0000 7f9ad57fa640 1 -- 172.21.15.22:0/2354265679 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9ac0003990 con 0x7f9ad809b400 2023-11-24T06:16:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.064+0000 7f9ad57fa640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9ab806aff0 0x7f9ab806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.065+0000 7f9ad57fa640 1 -- 172.21.15.22:0/2354265679 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ac00895e0 con 0x7f9ad809b400 2023-11-24T06:16:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.065+0000 7f9ad7fff640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9ab806aff0 0x7f9ab806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.065+0000 7f9ad7fff640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9ab806aff0 0x7f9ab806d4b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8001eb0 tx=0x7f9ac8000f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.069+0000 7f9ad57fa640 1 -- 172.21.15.22:0/2354265679 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ac00544a0 con 0x7f9ad809b400 2023-11-24T06:16:54.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.303+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9ad804e920 con 0x7f9ad809b400 2023-11-24T06:16:54.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.528+0000 7f9ad57fa640 1 -- 172.21.15.22:0/2354265679 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 136+0+0 (secure 0 0 0) 0x7f9ac0057ac0 con 0x7f9ad809b400 2023-11-24T06:16:54.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9ab806aff0 msgr2=0x7f9ab806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9ab806aff0 0x7f9ab806d4b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8001eb0 tx=0x7f9ac8000f50 comp rx=0 tx=0).stop 2023-11-24T06:16:54.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ad809b400 msgr2=0x7f9ad809a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ad809b400 0x7f9ad809a730 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000e490 tx=0x7f9ac000e950 comp rx=0 tx=0).stop 2023-11-24T06:16:54.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 shutdown_connections 2023-11-24T06:16:54.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9ab806aff0 0x7f9ab806d4b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ad80ac3c0 0x7f9ad809ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ad809b400 0x7f9ad809a730 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 --2- 172.21.15.22:0/2354265679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ac4004d00 0x7f9ad80abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.531+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 >> 172.21.15.22:0/2354265679 conn(0x7f9ad80b0ba0 msgr2=0x7f9ad80710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:54.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.532+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 shutdown_connections 2023-11-24T06:16:54.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.532+0000 7f9ade72c640 1 -- 172.21.15.22:0/2354265679 wait complete. 2023-11-24T06:16:54.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:16:54.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.776+0000 7f577fc7c640 1 Processor -- start 2023-11-24T06:16:54.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.776+0000 7f577fc7c640 1 -- start start 2023-11-24T06:16:54.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.777+0000 7f577fc7c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577815a090 0x7f5778072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.777+0000 7f577fc7c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57780ac760 con 0x7f57780abff0 2023-11-24T06:16:54.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.777+0000 7f577fc7c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577815a7f0 con 0x7f57780b39a0 2023-11-24T06:16:54.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.777+0000 7f577fc7c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577815aad0 con 0x7f577815a090 2023-11-24T06:16:54.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.777+0000 7f577d217640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f57780abff0 0x7f57780b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46380/0 (socket says 172.21.15.22:46380) 2023-11-24T06:16:54.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577d217640 1 -- 172.21.15.22:0/3939203226 learned_addr learned my addr 172.21.15.22:0/3939203226 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:54.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577da18640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577815a090 0x7f5778072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515857399 0 0) 0x7f57780ac760 con 0x7f57780abff0 2023-11-24T06:16:54.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5764003520 con 0x7f57780abff0 2023-11-24T06:16:54.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011416516 0 0) 0x7f5764003520 con 0x7f57780abff0 2023-11-24T06:16:54.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577815a090 msgr2=0x7f5778072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:54.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577ca16640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577815a090 0x7f5778072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 >> v1:172.21.15.31:6789/0 conn(0x7f57780b39a0 legacy=0x7f577806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577815adb0 con 0x7f57780abff0 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f5768001670 con 0x7f57780abff0 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.778+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 >> v1:172.21.15.22:6789/0 conn(0x7f57780abff0 legacy=0x7f57780b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577ca16640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577815a090 0x7f57640039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577ca16640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5764004020 0x7f57640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577ca16640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5764004d00 0x7f5764005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577815aad0 con 0x7f5764004020 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576400bbc0 con 0x7f5764004d00 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576400bd80 con 0x7f577815a090 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577d217640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5764004020 0x7f57640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577da18640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577815a090 0x7f57640039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577d217640 1 -- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577815a090 msgr2=0x7f57640039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577e219640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5764004d00 0x7f5764005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577d217640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577815a090 0x7f57640039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577d217640 1 -- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5764004d00 msgr2=0x7f5764005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:54.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577d217640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5764004d00 0x7f5764005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577d217640 1 -- 172.21.15.22:0/3939203226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5764003520 con 0x7f5764004020 2023-11-24T06:16:54.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.779+0000 7f577e219640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5764004d00 0x7f5764005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.781+0000 7f577d217640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5764004020 0x7f57640047c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f576800c0e0 tx=0x7f57640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cca1156f97fa75 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.781+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768005ad0 con 0x7f5764004020 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.781+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768005c30 con 0x7f5764004020 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.781+0000 7f577ca16640 1 -- 172.21.15.22:0/3939203226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576802ca50 con 0x7f5764004020 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.782+0000 7f577fc7c640 1 -- 172.21.15.22:0/3939203226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5764004020 msgr2=0x7f57640047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.782+0000 7f577fc7c640 1 --2- 172.21.15.22:0/3939203226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5764004020 0x7f57640047c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f576800c0e0 tx=0x7f57640057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.782+0000 7f577e219640 1 -- 172.21.15.22:0/3939203226 reap_dead start 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.782+0000 7f577fc7c640 1 -- 172.21.15.22:0/3939203226 shutdown_connections 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.782+0000 7f577fc7c640 1 -- 172.21.15.22:0/3939203226 >> 172.21.15.22:0/3939203226 conn(0x7f57780b0d80 msgr2=0x7f57780b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:54.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.782+0000 7f577fc7c640 1 -- 172.21.15.22:0/3939203226 shutdown_connections 2023-11-24T06:16:54.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.782+0000 7f577fc7c640 1 -- 172.21.15.22:0/3939203226 wait complete. 2023-11-24T06:16:54.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.784+0000 7f577fc7c640 1 Processor -- start 2023-11-24T06:16:54.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.784+0000 7f577fc7c640 1 -- start start 2023-11-24T06:16:54.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.785+0000 7f577fc7c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5764004020 0x7f57780cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.785+0000 7f577fc7c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57780ca7f0 0x7f5778150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.785+0000 7f577fc7c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577809a240 0x7f57780cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.785+0000 7f577fc7c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57780c8dd0 con 0x7f57780ca7f0 2023-11-24T06:16:54.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.785+0000 7f577fc7c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57780cc7c0 con 0x7f577809a240 2023-11-24T06:16:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.785+0000 7f577fc7c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57780c84a0 con 0x7f5764004020 2023-11-24T06:16:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.785+0000 7f577d217640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57780ca7f0 0x7f5778150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.785+0000 7f577d217640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57780ca7f0 0x7f5778150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45928/0 (socket says 172.21.15.22:45928) 2023-11-24T06:16:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.785+0000 7f577d217640 1 -- 172.21.15.22:0/1468361570 learned_addr learned my addr 172.21.15.22:0/1468361570 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.786+0000 7f577d217640 1 -- 172.21.15.22:0/1468361570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5764004020 msgr2=0x7f57780cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.786+0000 7f577d217640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5764004020 0x7f57780cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.786+0000 7f577d217640 1 -- 172.21.15.22:0/1468361570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577809a240 msgr2=0x7f57780cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.786+0000 7f577d217640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577809a240 0x7f57780cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.786+0000 7f577d217640 1 -- 172.21.15.22:0/1468361570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57780c8780 con 0x7f57780ca7f0 2023-11-24T06:16:54.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.786+0000 7f577d217640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57780ca7f0 0x7f5778150210 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f576802c3b0 tx=0x7f5768001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.786+0000 7f576e7fc640 1 -- 172.21.15.22:0/1468361570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768039070 con 0x7f57780ca7f0 2023-11-24T06:16:54.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.786+0000 7f576e7fc640 1 -- 172.21.15.22:0/1468361570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576802cc20 con 0x7f57780ca7f0 2023-11-24T06:16:54.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.786+0000 7f576e7fc640 1 -- 172.21.15.22:0/1468361570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576803c040 con 0x7f57780ca7f0 2023-11-24T06:16:54.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.787+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57780c8a60 con 0x7f57780ca7f0 2023-11-24T06:16:54.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.787+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5778150750 con 0x7f57780ca7f0 2023-11-24T06:16:54.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.788+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57780c8bf0 con 0x7f57780ca7f0 2023-11-24T06:16:54.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.789+0000 7f576e7fc640 1 -- 172.21.15.22:0/1468361570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5768032070 con 0x7f57780ca7f0 2023-11-24T06:16:54.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.790+0000 7f576e7fc640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f575c06b020 0x7f575c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.790+0000 7f576e7fc640 1 -- 172.21.15.22:0/1468361570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57680aae20 con 0x7f57780ca7f0 2023-11-24T06:16:54.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.790+0000 7f577da18640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f575c06b020 0x7f575c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.791+0000 7f577da18640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f575c06b020 0x7f575c06d4e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f577806d970 tx=0x7f577400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:54.794+0000 7f576e7fc640 1 -- 172.21.15.22:0/1468361570 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5768075bb0 con 0x7f57780ca7f0 2023-11-24T06:16:55.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.011+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f577815b5b0 con 0x7f575c06b020 2023-11-24T06:16:55.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.015+0000 7f576e7fc640 1 -- 172.21.15.22:0/1468361570 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f5774011040 con 0x7f575c06b020 2023-11-24T06:16:55.017 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-11-24T06:16:55.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-11-24T06:16:55.017 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-11-24T06:16:55.018 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-11-24T06:16:55.018 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-11-24T06:16:55.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f575c06b020 msgr2=0x7f575c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f575c06b020 0x7f575c06d4e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f577806d970 tx=0x7f577400b040 comp rx=0 tx=0).stop 2023-11-24T06:16:55.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57780ca7f0 msgr2=0x7f5778150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57780ca7f0 0x7f5778150210 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f576802c3b0 tx=0x7f5768001930 comp rx=0 tx=0).stop 2023-11-24T06:16:55.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 shutdown_connections 2023-11-24T06:16:55.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f575c06b020 0x7f575c06d4e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577809a240 0x7f57780cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57780ca7f0 0x7f5778150210 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 --2- 172.21.15.22:0/1468361570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5764004020 0x7f57780cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.017+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 >> 172.21.15.22:0/1468361570 conn(0x7f57780b0d80 msgr2=0x7f57780af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:55.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.018+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 shutdown_connections 2023-11-24T06:16:55.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.018+0000 7f577fc7c640 1 -- 172.21.15.22:0/1468361570 wait complete. 2023-11-24T06:16:55.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:16:55.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.271+0000 7f178bfff640 1 Processor -- start 2023-11-24T06:16:55.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.271+0000 7f178bfff640 1 -- start start 2023-11-24T06:16:55.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.273+0000 7f178bfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f178c15d340 0x7f178c0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.273+0000 7f178bfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 0x7f178c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.273+0000 7f178bfff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c0cef30 con 0x7f178c0cdbb0 2023-11-24T06:16:55.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.273+0000 7f178bfff640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c0d11a0 con 0x7f178c15d340 2023-11-24T06:16:55.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.273+0000 7f178bfff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0ce320 con 0x7f178c0d1d90 2023-11-24T06:16:55.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.273+0000 7f178affd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f178c15d340 0x7f178c0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.273+0000 7f178a7fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f178c0cdbb0 0x7f178c0d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46394/0 (socket says 172.21.15.22:46394) 2023-11-24T06:16:55.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.273+0000 7f178affd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f178c15d340 0x7f178c0d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45932/0 (socket says 172.21.15.22:45932) 2023-11-24T06:16:55.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.273+0000 7f178a7fc640 1 -- 172.21.15.22:0/643114530 learned_addr learned my addr 172.21.15.22:0/643114530 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:55.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.274+0000 7f178b7fe640 1 --2- 172.21.15.22:0/643114530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 0x7f178c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.274+0000 7f178affd640 1 -- 172.21.15.22:0/643114530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 msgr2=0x7f178c0b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:55.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.274+0000 7f178affd640 1 --2- 172.21.15.22:0/643114530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 0x7f178c0b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.274+0000 7f1789ffb640 1 -- 172.21.15.22:0/643114530 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976222897 0 0) 0x7f178c0cef30 con 0x7f178c0cdbb0 2023-11-24T06:16:55.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.274+0000 7f178affd640 1 -- 172.21.15.22:0/643114530 >> v1:172.21.15.22:6789/0 conn(0x7f178c0cdbb0 legacy=0x7f178c0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.274+0000 7f178affd640 1 -- 172.21.15.22:0/643114530 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c0ce600 con 0x7f178c15d340 2023-11-24T06:16:55.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.274+0000 7f178b7fe640 1 --2- 172.21.15.22:0/643114530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 0x7f178c0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:55.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.275+0000 7f178affd640 1 --2- 172.21.15.22:0/643114530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c15d340 0x7f178c0d00b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f177c009d90 tx=0x7f177c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5831c532f9940a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.275+0000 7f1789ffb640 1 -- 172.21.15.22:0/643114530 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c02cc50 con 0x7f178c15d340 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.275+0000 7f1789ffb640 1 -- 172.21.15.22:0/643114530 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c02cdb0 con 0x7f178c15d340 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.275+0000 7f1789ffb640 1 -- 172.21.15.22:0/643114530 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c034660 con 0x7f178c15d340 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.276+0000 7f178bfff640 1 -- 172.21.15.22:0/643114530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c15d340 msgr2=0x7f178c0d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.276+0000 7f178bfff640 1 --2- 172.21.15.22:0/643114530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c15d340 0x7f178c0d00b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f177c009d90 tx=0x7f177c02bea0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.276+0000 7f178bfff640 1 -- 172.21.15.22:0/643114530 shutdown_connections 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.276+0000 7f178bfff640 1 --2- 172.21.15.22:0/643114530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 0x7f178c0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.276+0000 7f178bfff640 1 --2- 172.21.15.22:0/643114530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c15d340 0x7f178c0d00b0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.276+0000 7f178bfff640 1 -- 172.21.15.22:0/643114530 >> 172.21.15.22:0/643114530 conn(0x7f178c09c370 msgr2=0x7f178c0d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.276+0000 7f178bfff640 1 -- 172.21.15.22:0/643114530 shutdown_connections 2023-11-24T06:16:55.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.276+0000 7f178bfff640 1 -- 172.21.15.22:0/643114530 wait complete. 2023-11-24T06:16:55.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.278+0000 7f178bfff640 1 Processor -- start 2023-11-24T06:16:55.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.278+0000 7f178bfff640 1 -- start start 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.279+0000 7f178bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c0cdbb0 0x7f178c0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.279+0000 7f178bfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 0x7f178c0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.279+0000 7f178bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c15d340 0x7f178c0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.279+0000 7f178bfff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0b3050 con 0x7f178c0cdbb0 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.279+0000 7f178bfff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c1598e0 con 0x7f178c15d340 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.279+0000 7f178bfff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0b2a90 con 0x7f178c0d1d90 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.279+0000 7f178affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c0cdbb0 0x7f178c0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.279+0000 7f178affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c0cdbb0 0x7f178c0cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45946/0 (socket says 172.21.15.22:45946) 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.279+0000 7f178affd640 1 -- 172.21.15.22:0/2346993772 learned_addr learned my addr 172.21.15.22:0/2346993772 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.280+0000 7f178a7fc640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 0x7f178c0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.280+0000 7f178b7fe640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c15d340 0x7f178c0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.280+0000 7f178affd640 1 -- 172.21.15.22:0/2346993772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 msgr2=0x7f178c0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.280+0000 7f178affd640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 0x7f178c0cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.280+0000 7f178affd640 1 -- 172.21.15.22:0/2346993772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c15d340 msgr2=0x7f178c0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.280+0000 7f178affd640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c15d340 0x7f178c0cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.280+0000 7f178affd640 1 -- 172.21.15.22:0/2346993772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c009a70 con 0x7f178c0cdbb0 2023-11-24T06:16:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.280+0000 7f178b7fe640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c15d340 0x7f178c0cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.280+0000 7f178affd640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c0cdbb0 0x7f178c0cbcd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f177c009d90 tx=0x7f177c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:55.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.281+0000 7f17737fe640 1 -- 172.21.15.22:0/2346993772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c03e610 con 0x7f178c0cdbb0 2023-11-24T06:16:55.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.281+0000 7f17737fe640 1 -- 172.21.15.22:0/2346993772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c03e770 con 0x7f178c0cdbb0 2023-11-24T06:16:55.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.281+0000 7f17737fe640 1 -- 172.21.15.22:0/2346993772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c03eb00 con 0x7f178c0cdbb0 2023-11-24T06:16:55.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.281+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c0b2d70 con 0x7f178c0cdbb0 2023-11-24T06:16:55.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.281+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c0c7050 con 0x7f178c0cdbb0 2023-11-24T06:16:55.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.282+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c0c6bd0 con 0x7f178c0cdbb0 2023-11-24T06:16:55.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.283+0000 7f17737fe640 1 -- 172.21.15.22:0/2346993772 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f177c03b050 con 0x7f178c0cdbb0 2023-11-24T06:16:55.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.284+0000 7f17737fe640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f177806b020 0x7f177806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.284+0000 7f17737fe640 1 -- 172.21.15.22:0/2346993772 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f177c0abc70 con 0x7f178c0cdbb0 2023-11-24T06:16:55.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.284+0000 7f178a7fc640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f177806b020 0x7f177806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.285+0000 7f178a7fc640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f177806b020 0x7f177806d4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1780007fd0 tx=0x7f1780009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:55.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.288+0000 7f17737fe640 1 -- 172.21.15.22:0/2346993772 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f178c0c6bd0 con 0x7f178c0cdbb0 2023-11-24T06:16:55.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.485+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f178c067d70 con 0x7f178c0cdbb0 2023-11-24T06:16:55.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.486+0000 7f17737fe640 1 -- 172.21.15.22:0/2346993772 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f177c076a90 con 0x7f178c0cdbb0 2023-11-24T06:16:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f177806b020 msgr2=0x7f177806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f177806b020 0x7f177806d4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1780007fd0 tx=0x7f1780009040 comp rx=0 tx=0).stop 2023-11-24T06:16:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c0cdbb0 msgr2=0x7f178c0cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c0cdbb0 0x7f178c0cbcd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f177c009d90 tx=0x7f177c004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 shutdown_connections 2023-11-24T06:16:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f177806b020 0x7f177806d4e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c15d340 0x7f178c0cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f178c0d1d90 0x7f178c0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 --2- 172.21.15.22:0/2346993772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f178c0cdbb0 0x7f178c0cbcd0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 >> 172.21.15.22:0/2346993772 conn(0x7f178c09c370 msgr2=0x7f178c0d3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:55.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 shutdown_connections 2023-11-24T06:16:55.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:55.489+0000 7f178bfff640 1 -- 172.21.15.22:0/2346993772 wait complete. 2023-11-24T06:16:55.511 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:16:55.511 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:55.623 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:55.752 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:16:55.752 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:16:55.752 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:55.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:56.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.038+0000 7f7aa759e640 1 Processor -- start 2023-11-24T06:16:56.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.039+0000 7f7aa759e640 1 -- start start 2023-11-24T06:16:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.040+0000 7f7aa759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813dfd0 0x7f7aa815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.040+0000 7f7aa759e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7aa80cf4d0 0x7f7aa806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.040+0000 7f7aa759e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa80ce7c0 con 0x7f7aa80cf050 2023-11-24T06:16:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.040+0000 7f7aa759e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa8140900 con 0x7f7aa80cf4d0 2023-11-24T06:16:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.040+0000 7f7aa759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa815fa70 con 0x7f7aa813dfd0 2023-11-24T06:16:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.041+0000 7f7aa5d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7aa80cf050 0x7f7aa806c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46398/0 (socket says 172.21.15.22:46398) 2023-11-24T06:16:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.041+0000 7f7aa5d9b640 1 -- 172.21.15.22:0/2920981930 learned_addr learned my addr 172.21.15.22:0/2920981930 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.041+0000 7f7aa659c640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813dfd0 0x7f7aa815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.041+0000 7f7aa6d9d640 1 --2- 172.21.15.22:0/2920981930 >> v2:172.21.15.31:3300/0 conn(0x7f7aa80cf4d0 0x7f7aa806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.041+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287444506 0 0) 0x7f7aa80ce7c0 con 0x7f7aa80cf050 2023-11-24T06:16:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.041+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a90003520 con 0x7f7aa80cf050 2023-11-24T06:16:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4204745869 0 0) 0x7f7a90003520 con 0x7f7aa80cf050 2023-11-24T06:16:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813dfd0 msgr2=0x7f7aa815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813dfd0 0x7f7aa815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 >> v2:172.21.15.31:3300/0 conn(0x7f7aa80cf4d0 msgr2=0x7f7aa806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 --2- 172.21.15.22:0/2920981930 >> v2:172.21.15.31:3300/0 conn(0x7f7aa80cf4d0 0x7f7aa806c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa815ee60 con 0x7f7aa80cf050 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f7a9c001670 con 0x7f7aa80cf050 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 >> v1:172.21.15.22:6789/0 conn(0x7f7aa80cf050 legacy=0x7f7aa806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a900039e0 0x7f7a90003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7a90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a90005180 0x7f7a9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8140900 con 0x7f7a900047c0 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa815fa70 con 0x7f7a90005180 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9000bf70 con 0x7f7a900039e0 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa659c640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813dfd0 0x7f7aa815be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa5d9b640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7a90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa5d9b640 1 -- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a900039e0 msgr2=0x7f7a90003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:56.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa5d9b640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a900039e0 0x7f7a90003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa5d9b640 1 -- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a90005180 msgr2=0x7f7a9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:56.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.042+0000 7f7aa5d9b640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a90005180 0x7f7a9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.043+0000 7f7aa5d9b640 1 -- 172.21.15.22:0/2920981930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a90003520 con 0x7f7a900047c0 2023-11-24T06:16:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.044+0000 7f7aa5d9b640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7a90004c40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c001eb0 tx=0x7f7a900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c59e0144fa5f438 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.044+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c005ad0 con 0x7f7a900047c0 2023-11-24T06:16:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.044+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c005c30 con 0x7f7a900047c0 2023-11-24T06:16:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.044+0000 7f7aa559a640 1 -- 172.21.15.22:0/2920981930 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c02cad0 con 0x7f7a900047c0 2023-11-24T06:16:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.044+0000 7f7aa759e640 1 -- 172.21.15.22:0/2920981930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 msgr2=0x7f7a90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.044+0000 7f7aa759e640 1 --2- 172.21.15.22:0/2920981930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7a90004c40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c001eb0 tx=0x7f7a900057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.044+0000 7f7aa6d9d640 1 -- 172.21.15.22:0/2920981930 reap_dead start 2023-11-24T06:16:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.045+0000 7f7aa759e640 1 -- 172.21.15.22:0/2920981930 shutdown_connections 2023-11-24T06:16:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.045+0000 7f7aa759e640 1 -- 172.21.15.22:0/2920981930 >> 172.21.15.22:0/2920981930 conn(0x7f7aa806a860 msgr2=0x7f7aa806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.045+0000 7f7aa759e640 1 -- 172.21.15.22:0/2920981930 shutdown_connections 2023-11-24T06:16:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.045+0000 7f7aa759e640 1 -- 172.21.15.22:0/2920981930 wait complete. 2023-11-24T06:16:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.047+0000 7f7aa759e640 1 Processor -- start 2023-11-24T06:16:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.047+0000 7f7aa759e640 1 -- start start 2023-11-24T06:16:56.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7aa8071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813af70 0x7f7aa813b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa759e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa8070670 0x7f7aa8070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa759e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa80b3590 con 0x7f7a900047c0 2023-11-24T06:16:56.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa759e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa813b930 con 0x7f7aa8070670 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8071030 con 0x7f7aa813af70 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7aa8071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7aa8071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45970/0 (socket says 172.21.15.22:45970) 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa659c640 1 -- 172.21.15.22:0/2167756241 learned_addr learned my addr 172.21.15.22:0/2167756241 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa659c640 1 -- 172.21.15.22:0/2167756241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813af70 msgr2=0x7f7aa813b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa5d9b640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813af70 0x7f7aa813b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa659c640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813af70 0x7f7aa813b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa659c640 1 -- 172.21.15.22:0/2167756241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa8070670 msgr2=0x7f7aa8070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa659c640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa8070670 0x7f7aa8070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.048+0000 7f7aa659c640 1 -- 172.21.15.22:0/2167756241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8072050 con 0x7f7a900047c0 2023-11-24T06:16:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.049+0000 7f7aa659c640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7aa8071770 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800d480 tx=0x7f7a9800d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:56.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.049+0000 7f7a96ffd640 1 -- 172.21.15.22:0/2167756241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98004030 con 0x7f7a900047c0 2023-11-24T06:16:56.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.049+0000 7f7a96ffd640 1 -- 172.21.15.22:0/2167756241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a980041b0 con 0x7f7a900047c0 2023-11-24T06:16:56.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.049+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa80b2bf0 con 0x7f7a900047c0 2023-11-24T06:16:56.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.049+0000 7f7a96ffd640 1 -- 172.21.15.22:0/2167756241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98003610 con 0x7f7a900047c0 2023-11-24T06:16:56.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.049+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa80b31b0 con 0x7f7a900047c0 2023-11-24T06:16:56.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.051+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa80b3370 con 0x7f7a900047c0 2023-11-24T06:16:56.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.051+0000 7f7a96ffd640 1 -- 172.21.15.22:0/2167756241 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7a98003770 con 0x7f7a900047c0 2023-11-24T06:16:56.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.052+0000 7f7a96ffd640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7a8806b020 0x7f7a8806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.052+0000 7f7a96ffd640 1 -- 172.21.15.22:0/2167756241 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a98089640 con 0x7f7a900047c0 2023-11-24T06:16:56.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.053+0000 7f7aa5d9b640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7a8806b020 0x7f7a8806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.053+0000 7f7aa5d9b640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7a8806b020 0x7f7a8806d4e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c034000 tx=0x7f7a9c007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:56.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.057+0000 7f7a96ffd640 1 -- 172.21.15.22:0/2167756241 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7a980543d0 con 0x7f7a900047c0 2023-11-24T06:16:56.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.259+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aa806ac70 con 0x7f7a900047c0 2023-11-24T06:16:56.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.261+0000 7f7a96ffd640 1 -- 172.21.15.22:0/2167756241 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f7a980579f0 con 0x7f7a900047c0 2023-11-24T06:16:56.264 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:56.264 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:35.760665+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:32.153129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:33.228812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:56.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7a8806b020 msgr2=0x7f7a8806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7a8806b020 0x7f7a8806d4e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c034000 tx=0x7f7a9c007000 comp rx=0 tx=0).stop 2023-11-24T06:16:56.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 msgr2=0x7f7aa8071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7aa8071770 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800d480 tx=0x7f7a9800d940 comp rx=0 tx=0).stop 2023-11-24T06:16:56.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 shutdown_connections 2023-11-24T06:16:56.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7a8806b020 0x7f7a8806d4e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa8070670 0x7f7aa8070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa813af70 0x7f7aa813b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 --2- 172.21.15.22:0/2167756241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a900047c0 0x7f7aa8071770 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 >> 172.21.15.22:0/2167756241 conn(0x7f7aa806a860 msgr2=0x7f7aa815de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:56.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.264+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 shutdown_connections 2023-11-24T06:16:56.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.265+0000 7f7aa759e640 1 -- 172.21.15.22:0/2167756241 wait complete. 2023-11-24T06:16:56.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:16:32.153129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:16:33.228812+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:56.288 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.508+0000 7fa45d5db640 1 Processor -- start 2023-11-24T06:16:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.508+0000 7fa45d5db640 1 -- start start 2023-11-24T06:16:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.510+0000 7fa45d5db640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa45815efa0 0x7fa458161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.510+0000 7fa45d5db640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4580b3080 0x7fa45806c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.510+0000 7fa45d5db640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45806c9a0 con 0x7fa45806da40 2023-11-24T06:16:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.510+0000 7fa45d5db640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45806cc80 con 0x7fa4580b3080 2023-11-24T06:16:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.510+0000 7fa45d5db640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45806cf60 con 0x7fa45815efa0 2023-11-24T06:16:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.510+0000 7fa4577fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa45806da40 0x7fa4580b2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46400/0 (socket says 172.21.15.22:46400) 2023-11-24T06:16:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.510+0000 7fa4577fe640 1 -- 172.21.15.22:0/2966780958 learned_addr learned my addr 172.21.15.22:0/2966780958 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.510+0000 7fa45cdda640 1 --2- 172.21.15.22:0/2966780958 >> v2:172.21.15.22:3300/0 conn(0x7fa4580b3080 0x7fa45806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.511+0000 7fa457fff640 1 --2- 172.21.15.22:0/2966780958 >> v2:172.21.15.31:3300/0 conn(0x7fa45815efa0 0x7fa458161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.511+0000 7fa45cdda640 1 -- 172.21.15.22:0/2966780958 >> v2:172.21.15.31:3300/0 conn(0x7fa45815efa0 msgr2=0x7fa458161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.511+0000 7fa45cdda640 1 --2- 172.21.15.22:0/2966780958 >> v2:172.21.15.31:3300/0 conn(0x7fa45815efa0 0x7fa458161ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.511+0000 7fa45cdda640 1 -- 172.21.15.22:0/2966780958 >> v1:172.21.15.22:6789/0 conn(0x7fa45806da40 legacy=0x7fa4580b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.511+0000 7fa456ffd640 1 -- 172.21.15.22:0/2966780958 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354496637 0 0) 0x7fa45806c9a0 con 0x7fa45806da40 2023-11-24T06:16:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.511+0000 7fa45cdda640 1 -- 172.21.15.22:0/2966780958 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45806d240 con 0x7fa4580b3080 2023-11-24T06:16:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.511+0000 7fa457fff640 1 --2- 172.21.15.22:0/2966780958 >> v2:172.21.15.31:3300/0 conn(0x7fa45815efa0 0x7fa458161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:56.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.512+0000 7fa45cdda640 1 --2- 172.21.15.22:0/2966780958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 0x7fa45806c310 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa458070970 tx=0x7fa45002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699492f48c274cb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:56.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.512+0000 7fa456ffd640 1 -- 172.21.15.22:0/2966780958 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4500317c0 con 0x7fa4580b3080 2023-11-24T06:16:56.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa456ffd640 1 -- 172.21.15.22:0/2966780958 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450031920 con 0x7fa4580b3080 2023-11-24T06:16:56.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa456ffd640 1 -- 172.21.15.22:0/2966780958 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450031cb0 con 0x7fa4580b3080 2023-11-24T06:16:56.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa45d5db640 1 -- 172.21.15.22:0/2966780958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 msgr2=0x7fa45806c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa45d5db640 1 --2- 172.21.15.22:0/2966780958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 0x7fa45806c310 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa458070970 tx=0x7fa45002b860 comp rx=0 tx=0).stop 2023-11-24T06:16:56.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa45d5db640 1 -- 172.21.15.22:0/2966780958 shutdown_connections 2023-11-24T06:16:56.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa45d5db640 1 --2- 172.21.15.22:0/2966780958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 0x7fa45806c310 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa45d5db640 1 --2- 172.21.15.22:0/2966780958 >> v2:172.21.15.31:3300/0 conn(0x7fa45815efa0 0x7fa458161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa45d5db640 1 -- 172.21.15.22:0/2966780958 >> 172.21.15.22:0/2966780958 conn(0x7fa4580cec10 msgr2=0x7fa4580cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:56.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa45d5db640 1 -- 172.21.15.22:0/2966780958 shutdown_connections 2023-11-24T06:16:56.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.513+0000 7fa45d5db640 1 -- 172.21.15.22:0/2966780958 wait complete. 2023-11-24T06:16:56.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.515+0000 7fa45d5db640 1 Processor -- start 2023-11-24T06:16:56.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.515+0000 7fa45d5db640 1 -- start start 2023-11-24T06:16:56.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.516+0000 7fa45d5db640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa45806da40 0x7fa45814add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.516+0000 7fa45d5db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 0x7fa4580a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.516+0000 7fa45d5db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa45815efa0 0x7fa458163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.516+0000 7fa45d5db640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4580a9c10 con 0x7fa4580b3080 2023-11-24T06:16:56.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.516+0000 7fa45d5db640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45814b620 con 0x7fa45815efa0 2023-11-24T06:16:56.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.516+0000 7fa45d5db640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45814b900 con 0x7fa45806da40 2023-11-24T06:16:56.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa4577fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 0x7fa4580a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa4577fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 0x7fa4580a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45980/0 (socket says 172.21.15.22:45980) 2023-11-24T06:16:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa4577fe640 1 -- 172.21.15.22:0/3354356973 learned_addr learned my addr 172.21.15.22:0/3354356973 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa457fff640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa45806da40 0x7fa45814add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa4577fe640 1 -- 172.21.15.22:0/3354356973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa45806da40 msgr2=0x7fa45814add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa4577fe640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa45806da40 0x7fa45814add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa4577fe640 1 -- 172.21.15.22:0/3354356973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa45815efa0 msgr2=0x7fa458163cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa4577fe640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa45815efa0 0x7fa458163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa4577fe640 1 -- 172.21.15.22:0/3354356973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa450009400 con 0x7fa4580b3080 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa457fff640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa45806da40 0x7fa45814add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.517+0000 7fa4577fe640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 0x7fa4580a96d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa448001560 tx=0x7fa44800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.518+0000 7fa454ff9640 1 -- 172.21.15.22:0/3354356973 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800a640 con 0x7fa4580b3080 2023-11-24T06:16:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.518+0000 7fa454ff9640 1 -- 172.21.15.22:0/3354356973 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44800a7a0 con 0x7fa4580b3080 2023-11-24T06:16:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.518+0000 7fa454ff9640 1 -- 172.21.15.22:0/3354356973 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800ab10 con 0x7fa4580b3080 2023-11-24T06:16:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.518+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45814bbe0 con 0x7fa4580b3080 2023-11-24T06:16:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.518+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45814c1a0 con 0x7fa4580b3080 2023-11-24T06:16:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.519+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45814c3c0 con 0x7fa4580b3080 2023-11-24T06:16:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.520+0000 7fa454ff9640 1 -- 172.21.15.22:0/3354356973 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa44800ac70 con 0x7fa4580b3080 2023-11-24T06:16:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.521+0000 7fa454ff9640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa43806aff0 0x7fa43806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.521+0000 7fa454ff9640 1 -- 172.21.15.22:0/3354356973 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa448089230 con 0x7fa4580b3080 2023-11-24T06:16:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.522+0000 7fa457fff640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa43806aff0 0x7fa43806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.522+0000 7fa457fff640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa43806aff0 0x7fa43806d4b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa440006fd0 tx=0x7fa440008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:56.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.524+0000 7fa454ff9640 1 -- 172.21.15.22:0/3354356973 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa448054180 con 0x7fa4580b3080 2023-11-24T06:16:56.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.718+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa45804e840 con 0x7fa4580b3080 2023-11-24T06:16:56.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.719+0000 7fa454ff9640 1 -- 172.21.15.22:0/3354356973 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa448021020 con 0x7fa4580b3080 2023-11-24T06:16:56.722 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:16:56.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa43806aff0 msgr2=0x7fa43806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa43806aff0 0x7fa43806d4b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa440006fd0 tx=0x7fa440008040 comp rx=0 tx=0).stop 2023-11-24T06:16:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 msgr2=0x7fa4580a96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 0x7fa4580a96d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa448001560 tx=0x7fa44800cd20 comp rx=0 tx=0).stop 2023-11-24T06:16:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 shutdown_connections 2023-11-24T06:16:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa43806aff0 0x7fa43806d4b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa45815efa0 0x7fa458163cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4580b3080 0x7fa4580a96d0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 --2- 172.21.15.22:0/3354356973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa45806da40 0x7fa45814add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 >> 172.21.15.22:0/3354356973 conn(0x7fa4580cec10 msgr2=0x7fa458161780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:56.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 shutdown_connections 2023-11-24T06:16:56.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.722+0000 7fa45d5db640 1 -- 172.21.15.22:0/3354356973 wait complete. 2023-11-24T06:16:56.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:16:56.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.973+0000 7fdc98bfa640 1 Processor -- start 2023-11-24T06:16:56.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.973+0000 7fdc98bfa640 1 -- start start 2023-11-24T06:16:56.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.974+0000 7fdc98bfa640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdc9415d3b0 0x7fdc940ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc98bfa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc940d0fa0 0x7fdc940d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc98bfa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d1bc0 0x7fdc940b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc98bfa640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940c6bf0 con 0x7fdc9415d3b0 2023-11-24T06:16:56.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc98bfa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940d1ff0 con 0x7fdc940d0fa0 2023-11-24T06:16:56.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc98bfa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940d1430 con 0x7fdc940d1bc0 2023-11-24T06:16:56.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc937fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdc9415d3b0 0x7fdc940ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc937fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdc9415d3b0 0x7fdc940ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45988/0 (socket says 172.21.15.22:45988) 2023-11-24T06:16:56.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc937fe640 1 -- 172.21.15.22:0/471361970 learned_addr learned my addr 172.21.15.22:0/471361970 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:56.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc93fff640 1 --2- 172.21.15.22:0/471361970 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d1bc0 0x7fdc940b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc937fe640 1 -- 172.21.15.22:0/471361970 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d1bc0 msgr2=0x7fdc940b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc937fe640 1 --2- 172.21.15.22:0/471361970 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d1bc0 0x7fdc940b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc937fe640 1 -- 172.21.15.22:0/471361970 >> v2:172.21.15.31:3300/0 conn(0x7fdc940d0fa0 msgr2=0x7fdc940d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.975+0000 7fdc8bfff640 1 --2- 172.21.15.22:0/471361970 >> v2:172.21.15.31:3300/0 conn(0x7fdc940d0fa0 0x7fdc940d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.976+0000 7fdc937fe640 1 --2- 172.21.15.22:0/471361970 >> v2:172.21.15.31:3300/0 conn(0x7fdc940d0fa0 0x7fdc940d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.976+0000 7fdc937fe640 1 -- 172.21.15.22:0/471361970 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940cedc0 con 0x7fdc9415d3b0 2023-11-24T06:16:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.977+0000 7fdc937fe640 1 --2- 172.21.15.22:0/471361970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 0x7fdc940ce6c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fdc9408c4a0 tx=0x7fdc8402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c423bd70fc6fe9f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.977+0000 7fdc92ffd640 1 -- 172.21.15.22:0/471361970 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc840317e0 con 0x7fdc9415d3b0 2023-11-24T06:16:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.977+0000 7fdc92ffd640 1 -- 172.21.15.22:0/471361970 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc84031940 con 0x7fdc9415d3b0 2023-11-24T06:16:56.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.977+0000 7fdc92ffd640 1 -- 172.21.15.22:0/471361970 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84031cd0 con 0x7fdc9415d3b0 2023-11-24T06:16:56.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.978+0000 7fdc98bfa640 1 -- 172.21.15.22:0/471361970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 msgr2=0x7fdc940ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.978+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/471361970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 0x7fdc940ce6c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fdc9408c4a0 tx=0x7fdc8402b880 comp rx=0 tx=0).stop 2023-11-24T06:16:56.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.978+0000 7fdc98bfa640 1 -- 172.21.15.22:0/471361970 shutdown_connections 2023-11-24T06:16:56.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.978+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/471361970 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d1bc0 0x7fdc940b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.978+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/471361970 >> v2:172.21.15.31:3300/0 conn(0x7fdc940d0fa0 0x7fdc940d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.978+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/471361970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 0x7fdc940ce6c0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.978+0000 7fdc98bfa640 1 -- 172.21.15.22:0/471361970 >> 172.21.15.22:0/471361970 conn(0x7fdc940d30a0 msgr2=0x7fdc940d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:56.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.978+0000 7fdc98bfa640 1 -- 172.21.15.22:0/471361970 shutdown_connections 2023-11-24T06:16:56.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.978+0000 7fdc98bfa640 1 -- 172.21.15.22:0/471361970 wait complete. 2023-11-24T06:16:56.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.980+0000 7fdc98bfa640 1 Processor -- start 2023-11-24T06:16:56.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.980+0000 7fdc98bfa640 1 -- start start 2023-11-24T06:16:56.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc98bfa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d0fa0 0x7fdc940cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc98bfa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc940d1bc0 0x7fdc940b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc98bfa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 0x7fdc9414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc98bfa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc941f3c00 con 0x7fdc9415d3b0 2023-11-24T06:16:56.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc98bfa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc941f3920 con 0x7fdc940d1bc0 2023-11-24T06:16:56.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc98bfa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940ca2a0 con 0x7fdc940d0fa0 2023-11-24T06:16:56.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc93fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 0x7fdc9414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc93fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 0x7fdc9414f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46002/0 (socket says 172.21.15.22:46002) 2023-11-24T06:16:56.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc93fff640 1 -- 172.21.15.22:0/2030487924 learned_addr learned my addr 172.21.15.22:0/2030487924 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:56.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.981+0000 7fdc937fe640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d0fa0 0x7fdc940cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc93fff640 1 -- 172.21.15.22:0/2030487924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d0fa0 msgr2=0x7fdc940cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc8bfff640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc940d1bc0 0x7fdc940b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc93fff640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d0fa0 0x7fdc940cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc93fff640 1 -- 172.21.15.22:0/2030487924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc940d1bc0 msgr2=0x7fdc940b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:56.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc93fff640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc940d1bc0 0x7fdc940b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:56.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc93fff640 1 -- 172.21.15.22:0/2030487924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840094d0 con 0x7fdc9415d3b0 2023-11-24T06:16:56.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc937fe640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d0fa0 0x7fdc940cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:56.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc93fff640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 0x7fdc9414f0d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00cc30 tx=0x7fdc8c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:56.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc90ff9640 1 -- 172.21.15.22:0/2030487924 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00ce40 con 0x7fdc9415d3b0 2023-11-24T06:16:56.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc90ff9640 1 -- 172.21.15.22:0/2030487924 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c003990 con 0x7fdc9415d3b0 2023-11-24T06:16:56.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc90ff9640 1 -- 172.21.15.22:0/2030487924 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c003d20 con 0x7fdc9415d3b0 2023-11-24T06:16:56.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc940ca580 con 0x7fdc9415d3b0 2023-11-24T06:16:56.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.982+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc940b85e0 con 0x7fdc9415d3b0 2023-11-24T06:16:56.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.984+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc940b8f40 con 0x7fdc9415d3b0 2023-11-24T06:16:56.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.985+0000 7fdc90ff9640 1 -- 172.21.15.22:0/2030487924 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fdc8c003e80 con 0x7fdc9415d3b0 2023-11-24T06:16:56.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.986+0000 7fdc90ff9640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc7406aff0 0x7fdc7406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:56.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.987+0000 7fdc90ff9640 1 -- 172.21.15.22:0/2030487924 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc8c089e40 con 0x7fdc9415d3b0 2023-11-24T06:16:56.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.987+0000 7fdc937fe640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc7406aff0 0x7fdc7406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:56.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.988+0000 7fdc937fe640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc7406aff0 0x7fdc7406d4b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdc84036000 tx=0x7fdc8403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:56.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:56.991+0000 7fdc90ff9640 1 -- 172.21.15.22:0/2030487924 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc8c054b50 con 0x7fdc9415d3b0 2023-11-24T06:16:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.186+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc9404e840 con 0x7fdc9415d3b0 2023-11-24T06:16:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.187+0000 7fdc90ff9640 1 -- 172.21.15.22:0/2030487924 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc8c01d020 con 0x7fdc9415d3b0 2023-11-24T06:16:57.189 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:16:57.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.189+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc7406aff0 msgr2=0x7fdc7406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.189+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc7406aff0 0x7fdc7406d4b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdc84036000 tx=0x7fdc8403d040 comp rx=0 tx=0).stop 2023-11-24T06:16:57.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.189+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 msgr2=0x7fdc9414f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.189+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 0x7fdc9414f0d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00cc30 tx=0x7fdc8c00a5c0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.190+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 shutdown_connections 2023-11-24T06:16:57.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.190+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fdc7406aff0 0x7fdc7406d4b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.190+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc9415d3b0 0x7fdc9414f0d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.190+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc940d1bc0 0x7fdc940b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.190+0000 7fdc98bfa640 1 --2- 172.21.15.22:0/2030487924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc940d0fa0 0x7fdc940cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.190+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 >> 172.21.15.22:0/2030487924 conn(0x7fdc940d30a0 msgr2=0x7fdc9406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:57.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.190+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 shutdown_connections 2023-11-24T06:16:57.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.190+0000 7fdc98bfa640 1 -- 172.21.15.22:0/2030487924 wait complete. 2023-11-24T06:16:57.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:16:57.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.437+0000 7f5f22e3d640 1 Processor -- start 2023-11-24T06:16:57.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.437+0000 7f5f22e3d640 1 -- start start 2023-11-24T06:16:57.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.438+0000 7f5f22e3d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f1c0cd150 0x7f5f1c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.438+0000 7f5f22e3d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f1c06ee30 0x7f5f1c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.438+0000 7f5f22e3d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c142d50 con 0x7f5f1c0702a0 2023-11-24T06:16:57.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.438+0000 7f5f22e3d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c0cd530 con 0x7f5f1c06ee30 2023-11-24T06:16:57.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.438+0000 7f5f22e3d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c0706c0 con 0x7f5f1c0cd150 2023-11-24T06:16:57.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.439+0000 7f5f213da640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f1c06ee30 0x7f5f1c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.439+0000 7f5f213da640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f1c06ee30 0x7f5f1c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46010/0 (socket says 172.21.15.22:46010) 2023-11-24T06:16:57.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.439+0000 7f5f213da640 1 -- 172.21.15.22:0/934570085 learned_addr learned my addr 172.21.15.22:0/934570085 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:57.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.439+0000 7f5f20bd9640 1 --2- 172.21.15.22:0/934570085 >> v2:172.21.15.31:3300/0 conn(0x7f5f1c0cd150 0x7f5f1c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.439+0000 7f5f213da640 1 -- 172.21.15.22:0/934570085 >> v2:172.21.15.31:3300/0 conn(0x7f5f1c0cd150 msgr2=0x7f5f1c06fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:57.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.439+0000 7f5f213da640 1 --2- 172.21.15.22:0/934570085 >> v2:172.21.15.31:3300/0 conn(0x7f5f1c0cd150 0x7f5f1c06fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.439+0000 7f5f213da640 1 -- 172.21.15.22:0/934570085 >> v1:172.21.15.31:6789/0 conn(0x7f5f1c0702a0 legacy=0x7f5f1c06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:57.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.440+0000 7f5f213da640 1 -- 172.21.15.22:0/934570085 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c06f430 con 0x7f5f1c06ee30 2023-11-24T06:16:57.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.441+0000 7f5f213da640 1 --2- 172.21.15.22:0/934570085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c06ee30 0x7f5f1c0cb6f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c072180 tx=0x7f5f1402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd80b16ee22c992 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:57.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.441+0000 7f5f137fe640 1 -- 172.21.15.22:0/934570085 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f140317e0 con 0x7f5f1c06ee30 2023-11-24T06:16:57.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.441+0000 7f5f137fe640 1 -- 172.21.15.22:0/934570085 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f14031940 con 0x7f5f1c06ee30 2023-11-24T06:16:57.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.441+0000 7f5f137fe640 1 -- 172.21.15.22:0/934570085 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14031cd0 con 0x7f5f1c06ee30 2023-11-24T06:16:57.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.442+0000 7f5f22e3d640 1 -- 172.21.15.22:0/934570085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c06ee30 msgr2=0x7f5f1c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.442+0000 7f5f22e3d640 1 --2- 172.21.15.22:0/934570085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c06ee30 0x7f5f1c0cb6f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c072180 tx=0x7f5f1402b880 comp rx=0 tx=0).stop 2023-11-24T06:16:57.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.442+0000 7f5f22e3d640 1 -- 172.21.15.22:0/934570085 shutdown_connections 2023-11-24T06:16:57.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.442+0000 7f5f22e3d640 1 --2- 172.21.15.22:0/934570085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c06ee30 0x7f5f1c0cb6f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.442+0000 7f5f22e3d640 1 --2- 172.21.15.22:0/934570085 >> v2:172.21.15.31:3300/0 conn(0x7f5f1c0cd150 0x7f5f1c06fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.442+0000 7f5f22e3d640 1 -- 172.21.15.22:0/934570085 >> 172.21.15.22:0/934570085 conn(0x7f5f1c0cdb20 msgr2=0x7f5f1c0cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:57.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.442+0000 7f5f22e3d640 1 -- 172.21.15.22:0/934570085 shutdown_connections 2023-11-24T06:16:57.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.442+0000 7f5f22e3d640 1 -- 172.21.15.22:0/934570085 wait complete. 2023-11-24T06:16:57.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.444+0000 7f5f22e3d640 1 Processor -- start 2023-11-24T06:16:57.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.444+0000 7f5f22e3d640 1 -- start start 2023-11-24T06:16:57.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f22e3d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1c06ee30 0x7f5f1c1f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f22e3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f1c0702a0 0x7f5f1c15ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f22e3d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c0cd150 0x7f5f1c158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f22e3d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0c9620 con 0x7f5f1c0cd150 2023-11-24T06:16:57.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f22e3d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c1f6a00 con 0x7f5f1c0702a0 2023-11-24T06:16:57.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f22e3d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c1f6cd0 con 0x7f5f1c06ee30 2023-11-24T06:16:57.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f213da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c0cd150 0x7f5f1c158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f213da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c0cd150 0x7f5f1c158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46024/0 (socket says 172.21.15.22:46024) 2023-11-24T06:16:57.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f213da640 1 -- 172.21.15.22:0/55477657 learned_addr learned my addr 172.21.15.22:0/55477657 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:57.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f20bd9640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1c06ee30 0x7f5f1c1f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.445+0000 7f5f13fff640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f1c0702a0 0x7f5f1c15ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f213da640 1 -- 172.21.15.22:0/55477657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1c06ee30 msgr2=0x7f5f1c1f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f213da640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1c06ee30 0x7f5f1c1f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f213da640 1 -- 172.21.15.22:0/55477657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f1c0702a0 msgr2=0x7f5f1c15ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f213da640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f1c0702a0 0x7f5f1c15ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f213da640 1 -- 172.21.15.22:0/55477657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140094d0 con 0x7f5f1c0cd150 2023-11-24T06:16:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f213da640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c0cd150 0x7f5f1c158980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5f140090b0 tx=0x7f5f140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f117fa640 1 -- 172.21.15.22:0/55477657 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14032880 con 0x7f5f1c0cd150 2023-11-24T06:16:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f117fa640 1 -- 172.21.15.22:0/55477657 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f14032a00 con 0x7f5f1c0cd150 2023-11-24T06:16:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f117fa640 1 -- 172.21.15.22:0/55477657 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14032db0 con 0x7f5f1c0cd150 2023-11-24T06:16:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c1f6fb0 con 0x7f5f1c0cd150 2023-11-24T06:16:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.446+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c0c9870 con 0x7f5f1c0cd150 2023-11-24T06:16:57.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.447+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c06fb50 con 0x7f5f1c0cd150 2023-11-24T06:16:57.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.448+0000 7f5f117fa640 1 -- 172.21.15.22:0/55477657 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5f1404d3f0 con 0x7f5f1c0cd150 2023-11-24T06:16:57.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.450+0000 7f5f117fa640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f0806aff0 0x7f5f0806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.450+0000 7f5f117fa640 1 -- 172.21.15.22:0/55477657 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f140ab770 con 0x7f5f1c0cd150 2023-11-24T06:16:57.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.450+0000 7f5f20bd9640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f0806aff0 0x7f5f0806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.451+0000 7f5f20bd9640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f0806aff0 0x7f5f0806d4b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5f180099c0 tx=0x7f5f18003990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:57.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.454+0000 7f5f117fa640 1 -- 172.21.15.22:0/55477657 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f14076480 con 0x7f5f1c0cd150 2023-11-24T06:16:57.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.650+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f1c04e920 con 0x7f5f1c0cd150 2023-11-24T06:16:57.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.651+0000 7f5f117fa640 1 -- 172.21.15.22:0/55477657 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f14079aa0 con 0x7f5f1c0cd150 2023-11-24T06:16:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:16:57.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.653+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f0806aff0 msgr2=0x7f5f0806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.653+0000 7f5f22e3d640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f0806aff0 0x7f5f0806d4b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5f180099c0 tx=0x7f5f18003990 comp rx=0 tx=0).stop 2023-11-24T06:16:57.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.653+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c0cd150 msgr2=0x7f5f1c158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.653+0000 7f5f22e3d640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c0cd150 0x7f5f1c158980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5f140090b0 tx=0x7f5f140046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.654+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 shutdown_connections 2023-11-24T06:16:57.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.654+0000 7f5f22e3d640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5f0806aff0 0x7f5f0806d4b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.654+0000 7f5f22e3d640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f1c0cd150 0x7f5f1c158980 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.654+0000 7f5f22e3d640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f1c0702a0 0x7f5f1c15ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.654+0000 7f5f22e3d640 1 --2- 172.21.15.22:0/55477657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1c06ee30 0x7f5f1c1f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.654+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 >> 172.21.15.22:0/55477657 conn(0x7f5f1c0cdb20 msgr2=0x7f5f1c06c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:57.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.654+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 shutdown_connections 2023-11-24T06:16:57.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.654+0000 7f5f22e3d640 1 -- 172.21.15.22:0/55477657 wait complete. 2023-11-24T06:16:57.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:16:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.894+0000 7fa0d094c640 1 Processor -- start 2023-11-24T06:16:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.894+0000 7fa0d094c640 1 -- start start 2023-11-24T06:16:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.896+0000 7fa0d094c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0cc0acb50 0x7fa0cc0719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.896+0000 7fa0d094c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc070dc0 con 0x7fa0cc06d520 2023-11-24T06:16:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.896+0000 7fa0d094c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc161d00 con 0x7fa0cc0b2080 2023-11-24T06:16:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.896+0000 7fa0d094c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc0cedb0 con 0x7fa0cc0acb50 2023-11-24T06:16:57.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.896+0000 7fa0ca59c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa0cc06d520 0x7fa0cc06d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46406/0 (socket says 172.21.15.22:46406) 2023-11-24T06:16:57.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.896+0000 7fa0ca59c640 1 -- 172.21.15.22:0/725502038 learned_addr learned my addr 172.21.15.22:0/725502038 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:57.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276620433 0 0) 0x7fa0cc070dc0 con 0x7fa0cc06d520 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b8003520 con 0x7fa0cc06d520 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c9d9b640 1 --2- 172.21.15.22:0/725502038 >> v2:172.21.15.31:3300/0 conn(0x7fa0cc0acb50 0x7fa0cc0719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 836232273 0 0) 0x7fa0b8003520 con 0x7fa0cc06d520 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 >> v2:172.21.15.31:3300/0 conn(0x7fa0cc0acb50 msgr2=0x7fa0cc0719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 --2- 172.21.15.22:0/725502038 >> v2:172.21.15.31:3300/0 conn(0x7fa0cc0acb50 0x7fa0cc0719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 >> v1:172.21.15.31:6789/0 conn(0x7fa0cc0b2080 legacy=0x7fa0cc0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0ad030 con 0x7fa0cc06d520 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fa0bc0019f0 con 0x7fa0cc06d520 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 >> v1:172.21.15.22:6789/0 conn(0x7fa0cc06d520 legacy=0x7fa0cc06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b80047c0 0x7fa0b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0b80051d0 0x7fa0b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0cedb0 con 0x7fa0b80039c0 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b800c120 con 0x7fa0b80047c0 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.897+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b800c2e0 con 0x7fa0b80051d0 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.898+0000 7fa0ca59c640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.898+0000 7fa0cad9d640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0b80051d0 0x7fa0b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.898+0000 7fa0ca59c640 1 -- 172.21.15.22:0/725502038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0b80051d0 msgr2=0x7fa0b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.898+0000 7fa0ca59c640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0b80051d0 0x7fa0b800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.898+0000 7fa0c9d9b640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b80047c0 0x7fa0b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.898+0000 7fa0ca59c640 1 -- 172.21.15.22:0/725502038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b80047c0 msgr2=0x7fa0b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.898+0000 7fa0ca59c640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b80047c0 0x7fa0b8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.898+0000 7fa0cad9d640 1 -- 172.21.15.22:0/725502038 reap_dead start 2023-11-24T06:16:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.898+0000 7fa0ca59c640 1 -- 172.21.15.22:0/725502038 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8003520 con 0x7fa0b80039c0 2023-11-24T06:16:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.899+0000 7fa0ca59c640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00a760 tx=0x7fa0b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5160ed511f76667c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc034630 con 0x7fa0b80039c0 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc02f070 con 0x7fa0b80039c0 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0c959a640 1 -- 172.21.15.22:0/725502038 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc034a50 con 0x7fa0b80039c0 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0d094c640 1 -- 172.21.15.22:0/725502038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 msgr2=0x7fa0b8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0d094c640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00a760 tx=0x7fa0b80057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0d094c640 1 -- 172.21.15.22:0/725502038 shutdown_connections 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0d094c640 1 --2- 172.21.15.22:0/725502038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0d094c640 1 -- 172.21.15.22:0/725502038 >> 172.21.15.22:0/725502038 conn(0x7fa0cc0b0d80 msgr2=0x7fa0cc0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0d094c640 1 -- 172.21.15.22:0/725502038 shutdown_connections 2023-11-24T06:16:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.900+0000 7fa0d094c640 1 -- 172.21.15.22:0/725502038 wait complete. 2023-11-24T06:16:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.902+0000 7fa0d094c640 1 Processor -- start 2023-11-24T06:16:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.902+0000 7fa0d094c640 1 -- start start 2023-11-24T06:16:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.903+0000 7fa0d094c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0cc15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.903+0000 7fa0d094c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc15ea50 0x7fa0cc098100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0d094c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0cc14f640 0x7fa0cc09c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0d094c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc098640 con 0x7fa0b80039c0 2023-11-24T06:16:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0d094c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc15e5c0 con 0x7fa0cc15ea50 2023-11-24T06:16:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0d094c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc14fac0 con 0x7fa0cc14f640 2023-11-24T06:16:57.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0cc15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0cc15d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46040/0 (socket says 172.21.15.22:46040) 2023-11-24T06:16:57.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0ca59c640 1 -- 172.21.15.22:0/3156997186 learned_addr learned my addr 172.21.15.22:0/3156997186 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0cad9d640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0cc14f640 0x7fa0cc09c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0ca59c640 1 -- 172.21.15.22:0/3156997186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0cc14f640 msgr2=0x7fa0cc09c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0ca59c640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0cc14f640 0x7fa0cc09c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0c9d9b640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc15ea50 0x7fa0cc098100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0ca59c640 1 -- 172.21.15.22:0/3156997186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc15ea50 msgr2=0x7fa0cc098100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0ca59c640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc15ea50 0x7fa0cc098100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.904+0000 7fa0ca59c640 1 -- 172.21.15.22:0/3156997186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc15d9b0 con 0x7fa0b80039c0 2023-11-24T06:16:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.905+0000 7fa0ca59c640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0cc15d2c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc02cab0 tx=0x7fa0bc001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.905+0000 7fa0c2ffd640 1 -- 172.21.15.22:0/3156997186 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc004d60 con 0x7fa0b80039c0 2023-11-24T06:16:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.905+0000 7fa0c2ffd640 1 -- 172.21.15.22:0/3156997186 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc001970 con 0x7fa0b80039c0 2023-11-24T06:16:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.905+0000 7fa0c2ffd640 1 -- 172.21.15.22:0/3156997186 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc03f690 con 0x7fa0b80039c0 2023-11-24T06:16:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.905+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc15dc90 con 0x7fa0b80039c0 2023-11-24T06:16:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.905+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc15e250 con 0x7fa0b80039c0 2023-11-24T06:16:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.906+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc074770 con 0x7fa0b80039c0 2023-11-24T06:16:57.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.907+0000 7fa0c2ffd640 1 -- 172.21.15.22:0/3156997186 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa0bc031030 con 0x7fa0b80039c0 2023-11-24T06:16:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.908+0000 7fa0c2ffd640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa0ac06b070 0x7fa0ac06d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.908+0000 7fa0c2ffd640 1 -- 172.21.15.22:0/3156997186 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0bc0ab380 con 0x7fa0b80039c0 2023-11-24T06:16:57.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.909+0000 7fa0c9d9b640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa0ac06b070 0x7fa0ac06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:57.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.909+0000 7fa0c9d9b640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa0ac06b070 0x7fa0ac06d530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc15bde0 tx=0x7fa0b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:57.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:57.913+0000 7fa0c2ffd640 1 -- 172.21.15.22:0/3156997186 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa0bc076080 con 0x7fa0b80039c0 2023-11-24T06:16:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.121+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa0cc09a450 con 0x7fa0b80039c0 2023-11-24T06:16:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.122+0000 7fa0c2ffd640 1 -- 172.21.15.22:0/3156997186 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa0bc0796a0 con 0x7fa0b80039c0 2023-11-24T06:16:58.125 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:16:58.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.124+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa0ac06b070 msgr2=0x7fa0ac06d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.124+0000 7fa0d094c640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa0ac06b070 0x7fa0ac06d530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc15bde0 tx=0x7fa0b4008040 comp rx=0 tx=0).stop 2023-11-24T06:16:58.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.124+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 msgr2=0x7fa0cc15d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.124+0000 7fa0d094c640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0cc15d2c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc02cab0 tx=0x7fa0bc001cb0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.125+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 shutdown_connections 2023-11-24T06:16:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.125+0000 7fa0d094c640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa0ac06b070 0x7fa0ac06d530 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.125+0000 7fa0d094c640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa0cc14f640 0x7fa0cc09c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.125+0000 7fa0d094c640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc15ea50 0x7fa0cc098100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.125+0000 7fa0d094c640 1 --2- 172.21.15.22:0/3156997186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b80039c0 0x7fa0cc15d2c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.125+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 >> 172.21.15.22:0/3156997186 conn(0x7fa0cc0b0d80 msgr2=0x7fa0cc164030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.125+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 shutdown_connections 2023-11-24T06:16:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.125+0000 7fa0d094c640 1 -- 172.21.15.22:0/3156997186 wait complete. 2023-11-24T06:16:58.145 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2023-11-24T06:16:58.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:58.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:58.239 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[109788]: fuse finished with error 0 and tester_r 0 2023-11-24T06:16:58.245 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:16:58.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:58.245 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:16:58.404 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:16:58.405 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:58.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:58.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.701+0000 7f217b2ad640 1 Processor -- start 2023-11-24T06:16:58.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.701+0000 7f217b2ad640 1 -- start start 2023-11-24T06:16:58.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.703+0000 7f217b2ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2174157770 0x7f217406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.703+0000 7f217b2ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f217415df80 0x7f2174070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.703+0000 7f217b2ad640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2174161670 con 0x7f217406d080 2023-11-24T06:16:58.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.703+0000 7f217b2ad640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217415e410 con 0x7f217415df80 2023-11-24T06:16:58.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.703+0000 7f217b2ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217406d500 con 0x7f2174157770 2023-11-24T06:16:58.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.703+0000 7f2179aaa640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f217406d080 0x7f217415d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46414/0 (socket says 172.21.15.22:46414) 2023-11-24T06:16:58.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.703+0000 7f2179aaa640 1 -- 172.21.15.22:0/3456812204 learned_addr learned my addr 172.21.15.22:0/3456812204 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:58.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.704+0000 7f217a2ab640 1 --2- 172.21.15.22:0/3456812204 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2174157770 0x7f217406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.704+0000 7f217aaac640 1 --2- 172.21.15.22:0/3456812204 >> v2:172.21.15.31:3300/0 conn(0x7f217415df80 0x7f2174070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.704+0000 7f217a2ab640 1 -- 172.21.15.22:0/3456812204 >> v2:172.21.15.31:3300/0 conn(0x7f217415df80 msgr2=0x7f2174070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.704+0000 7f217a2ab640 1 --2- 172.21.15.22:0/3456812204 >> v2:172.21.15.31:3300/0 conn(0x7f217415df80 0x7f2174070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.704+0000 7f217a2ab640 1 -- 172.21.15.22:0/3456812204 >> v1:172.21.15.22:6789/0 conn(0x7f217406d080 legacy=0x7f217415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.704+0000 7f21792a9640 1 -- 172.21.15.22:0/3456812204 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413871997 0 0) 0x7f2174161670 con 0x7f217406d080 2023-11-24T06:16:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.704+0000 7f217a2ab640 1 -- 172.21.15.22:0/3456812204 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217415e610 con 0x7f2174157770 2023-11-24T06:16:58.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.706+0000 7f217a2ab640 1 --2- 172.21.15.22:0/3456812204 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2174157770 0x7f217406cb40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21700097a0 tx=0x7f217002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b8b0b067cd6d777 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:58.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.706+0000 7f21792a9640 1 -- 172.21.15.22:0/3456812204 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217002d040 con 0x7f2174157770 2023-11-24T06:16:58.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.706+0000 7f21792a9640 1 -- 172.21.15.22:0/3456812204 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2170031810 con 0x7f2174157770 2023-11-24T06:16:58.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.706+0000 7f21792a9640 1 -- 172.21.15.22:0/3456812204 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170031ba0 con 0x7f2174157770 2023-11-24T06:16:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.707+0000 7f217b2ad640 1 -- 172.21.15.22:0/3456812204 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2174157770 msgr2=0x7f217406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.707+0000 7f217b2ad640 1 --2- 172.21.15.22:0/3456812204 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2174157770 0x7f217406cb40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21700097a0 tx=0x7f217002b8b0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.707+0000 7f217b2ad640 1 -- 172.21.15.22:0/3456812204 shutdown_connections 2023-11-24T06:16:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.707+0000 7f217b2ad640 1 --2- 172.21.15.22:0/3456812204 >> v2:172.21.15.31:3300/0 conn(0x7f217415df80 0x7f2174070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.707+0000 7f217b2ad640 1 --2- 172.21.15.22:0/3456812204 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2174157770 0x7f217406cb40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.707+0000 7f217b2ad640 1 -- 172.21.15.22:0/3456812204 >> 172.21.15.22:0/3456812204 conn(0x7f217406a860 msgr2=0x7f217406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.707+0000 7f217b2ad640 1 -- 172.21.15.22:0/3456812204 shutdown_connections 2023-11-24T06:16:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.707+0000 7f217b2ad640 1 -- 172.21.15.22:0/3456812204 wait complete. 2023-11-24T06:16:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.709+0000 7f217b2ad640 1 Processor -- start 2023-11-24T06:16:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.709+0000 7f217b2ad640 1 -- start start 2023-11-24T06:16:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.710+0000 7f217b2ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f217406d080 0x7f217413efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.710+0000 7f217b2ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2174157770 0x7f2174154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.710+0000 7f217b2ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f217415df80 0x7f2174141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.710+0000 7f217b2ad640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217413f520 con 0x7f217415df80 2023-11-24T06:16:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.710+0000 7f217b2ad640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2174153da0 con 0x7f2174157770 2023-11-24T06:16:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.710+0000 7f217b2ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2174154040 con 0x7f217406d080 2023-11-24T06:16:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.710+0000 7f217aaac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f217415df80 0x7f2174141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.710+0000 7f217aaac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f217415df80 0x7f2174141850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46054/0 (socket says 172.21.15.22:46054) 2023-11-24T06:16:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.710+0000 7f217aaac640 1 -- 172.21.15.22:0/1942027363 learned_addr learned my addr 172.21.15.22:0/1942027363 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f217a2ab640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f217406d080 0x7f217413efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f217aaac640 1 -- 172.21.15.22:0/1942027363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f217406d080 msgr2=0x7f217413efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f217aaac640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f217406d080 0x7f217413efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f2179aaa640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2174157770 0x7f2174154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f217aaac640 1 -- 172.21.15.22:0/1942027363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2174157770 msgr2=0x7f2174154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f217aaac640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2174157770 0x7f2174154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f217aaac640 1 -- 172.21.15.22:0/1942027363 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170009400 con 0x7f217415df80 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f217a2ab640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f217406d080 0x7f217413efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f217aaac640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f217415df80 0x7f2174141850 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f216c00efc0 tx=0x7f216c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f216affd640 1 -- 172.21.15.22:0/1942027363 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c009ba0 con 0x7f217415df80 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.711+0000 7f216affd640 1 -- 172.21.15.22:0/1942027363 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00f040 con 0x7f217415df80 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.712+0000 7f216affd640 1 -- 172.21.15.22:0/1942027363 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c0146c0 con 0x7f217415df80 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.712+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2174150670 con 0x7f217415df80 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.712+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2174150390 con 0x7f217415df80 2023-11-24T06:16:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.713+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217404e840 con 0x7f217415df80 2023-11-24T06:16:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.714+0000 7f216affd640 1 -- 172.21.15.22:0/1942027363 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f216c014820 con 0x7f217415df80 2023-11-24T06:16:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.715+0000 7f216affd640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f215806aff0 0x7f215806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.715+0000 7f216affd640 1 -- 172.21.15.22:0/1942027363 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f216c08a5c0 con 0x7f217415df80 2023-11-24T06:16:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.715+0000 7f217a2ab640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f215806aff0 0x7f215806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.716+0000 7f217a2ab640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f215806aff0 0x7f215806d4b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2170036000 tx=0x7f217003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:58.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.719+0000 7f216affd640 1 -- 172.21.15.22:0/1942027363 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f216c0552c0 con 0x7f217415df80 2023-11-24T06:16:58.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.922+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2174160860 con 0x7f217415df80 2023-11-24T06:16:58.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.924+0000 7f216affd640 1 -- 172.21.15.22:0/1942027363 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f216c0588e0 con 0x7f217415df80 2023-11-24T06:16:58.927 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:16:58.927 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:35.760665+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:32.153129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:33.228812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:58.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f215806aff0 msgr2=0x7f215806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f215806aff0 0x7f215806d4b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2170036000 tx=0x7f217003c040 comp rx=0 tx=0).stop 2023-11-24T06:16:58.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f217415df80 msgr2=0x7f2174141850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f217415df80 0x7f2174141850 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f216c00efc0 tx=0x7f216c00c490 comp rx=0 tx=0).stop 2023-11-24T06:16:58.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 shutdown_connections 2023-11-24T06:16:58.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f215806aff0 0x7f215806d4b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f217415df80 0x7f2174141850 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2174157770 0x7f2174154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 --2- 172.21.15.22:0/1942027363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f217406d080 0x7f217413efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 >> 172.21.15.22:0/1942027363 conn(0x7f217406a860 msgr2=0x7f217406ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:58.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 shutdown_connections 2023-11-24T06:16:58.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:58.927+0000 7f217b2ad640 1 -- 172.21.15.22:0/1942027363 wait complete. 2023-11-24T06:16:58.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:16:32.153129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:16:33.228812+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:58.951 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:59.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.182+0000 7fcaae09b640 1 Processor -- start 2023-11-24T06:16:59.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.183+0000 7fcaae09b640 1 -- start start 2023-11-24T06:16:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.184+0000 7fcaae09b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcaa8162220 0x7fcaa80b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.184+0000 7fcaae09b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa80706a0 con 0x7fcaa806cad0 2023-11-24T06:16:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.184+0000 7fcaae09b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa8070c60 con 0x7fcaa8162600 2023-11-24T06:16:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.184+0000 7fcaae09b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80722b0 con 0x7fcaa8162220 2023-11-24T06:16:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.185+0000 7fcaa7fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcaa806cad0 0x7fcaa80710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46416/0 (socket says 172.21.15.22:46416) 2023-11-24T06:16:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.185+0000 7fcaa7fff640 1 -- 172.21.15.22:0/3312550409 learned_addr learned my addr 172.21.15.22:0/3312550409 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:16:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.185+0000 7fcaa77fe640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcaa8162220 0x7fcaa80b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.185+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874418986 0 0) 0x7fcaa80706a0 con 0x7fcaa806cad0 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.185+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca94003520 con 0x7fcaa806cad0 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.185+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3878914719 0 0) 0x7fca94003520 con 0x7fcaa806cad0 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcaa8162220 msgr2=0x7fcaa80b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcaa8162220 0x7fcaa80b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 >> v1:172.21.15.31:6789/0 conn(0x7fcaa8162600 legacy=0x7fcaa806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8072590 con 0x7fcaa806cad0 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fcaa00019f0 con 0x7fcaa806cad0 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 >> v1:172.21.15.22:6789/0 conn(0x7fcaa806cad0 legacy=0x7fcaa80710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca940039a0 0x7fca94003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcaa8162220 0x7fca940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca94004d00 0x7fca94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80722b0 con 0x7fca94004d00 2023-11-24T06:16:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9400ba30 con 0x7fca940039a0 2023-11-24T06:16:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9400bbf0 con 0x7fcaa8162220 2023-11-24T06:16:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa7fff640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca94004d00 0x7fca94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fcaa77fe640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca940039a0 0x7fca94003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.186+0000 7fca9ffff640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcaa8162220 0x7fca940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.187+0000 7fcaa7fff640 1 -- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcaa8162220 msgr2=0x7fca940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.187+0000 7fcaa7fff640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcaa8162220 0x7fca940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.187+0000 7fcaa7fff640 1 -- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca940039a0 msgr2=0x7fca94003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.187+0000 7fcaa7fff640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca940039a0 0x7fca94003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.187+0000 7fcaa7fff640 1 -- 172.21.15.22:0/3312550409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94003520 con 0x7fca94004d00 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.187+0000 7fca9ffff640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcaa8162220 0x7fca940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.188+0000 7fcaa7fff640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca94004d00 0x7fca94005180 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000a800 tx=0x7fca940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afda633f95ecf06d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.188+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00072d0 con 0x7fca94004d00 2023-11-24T06:16:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.188+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa002f070 con 0x7fca94004d00 2023-11-24T06:16:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.188+0000 7fcaa6ffd640 1 -- 172.21.15.22:0/3312550409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00076b0 con 0x7fca94004d00 2023-11-24T06:16:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.189+0000 7fcaae09b640 1 -- 172.21.15.22:0/3312550409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca94004d00 msgr2=0x7fca94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.189+0000 7fcaae09b640 1 --2- 172.21.15.22:0/3312550409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca94004d00 0x7fca94005180 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000a800 tx=0x7fca940057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.189+0000 7fcaa7fff640 1 -- 172.21.15.22:0/3312550409 reap_dead start 2023-11-24T06:16:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.189+0000 7fcaae09b640 1 -- 172.21.15.22:0/3312550409 shutdown_connections 2023-11-24T06:16:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.189+0000 7fcaae09b640 1 -- 172.21.15.22:0/3312550409 >> 172.21.15.22:0/3312550409 conn(0x7fcaa80b0ba0 msgr2=0x7fcaa80b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.189+0000 7fcaae09b640 1 -- 172.21.15.22:0/3312550409 shutdown_connections 2023-11-24T06:16:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.189+0000 7fcaae09b640 1 -- 172.21.15.22:0/3312550409 wait complete. 2023-11-24T06:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.191+0000 7fcaae09b640 1 Processor -- start 2023-11-24T06:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.191+0000 7fcaae09b640 1 -- start start 2023-11-24T06:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaae09b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca94004d00 0x7fcaa8152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaae09b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaa80b3380 0x7fcaa80b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaae09b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa80cc3d0 0x7fcaa80cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaae09b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80b3d40 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaae09b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8152f60 con 0x7fcaa80b3380 2023-11-24T06:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaae09b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8099a00 con 0x7fca94004d00 2023-11-24T06:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaa7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa80cc3d0 0x7fcaa80cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaa7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa80cc3d0 0x7fcaa80cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46082/0 (socket says 172.21.15.22:46082) 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaa7fff640 1 -- 172.21.15.22:0/3748763992 learned_addr learned my addr 172.21.15.22:0/3748763992 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa7fff640 1 -- 172.21.15.22:0/3748763992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca94004d00 msgr2=0x7fcaa8152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.192+0000 7fcaa77fe640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca94004d00 0x7fcaa8152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fca9ffff640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaa80b3380 0x7fcaa80b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa7fff640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca94004d00 0x7fcaa8152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa7fff640 1 -- 172.21.15.22:0/3748763992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaa80b3380 msgr2=0x7fcaa80b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa7fff640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaa80b3380 0x7fcaa80b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa7fff640 1 -- 172.21.15.22:0/3748763992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa80ccd90 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa77fe640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca94004d00 0x7fcaa8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa7fff640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa80cc3d0 0x7fcaa80cc850 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fcaa002cb50 tx=0x7fcaa0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa4ff9640 1 -- 172.21.15.22:0/3748763992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00019b0 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa4ff9640 1 -- 172.21.15.22:0/3748763992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa002ce90 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaa4ff9640 1 -- 172.21.15.22:0/3748763992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00072d0 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa80cd020 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.193+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa80cd5e0 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.194+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa80cd7d0 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.195+0000 7fcaa4ff9640 1 -- 172.21.15.22:0/3748763992 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fcaa0031030 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.196+0000 7fcaa4ff9640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca8806aff0 0x7fca8806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.197+0000 7fcaa4ff9640 1 -- 172.21.15.22:0/3748763992 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaa00ab460 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.197+0000 7fcaa77fe640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca8806aff0 0x7fca8806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.198+0000 7fcaa77fe640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca8806aff0 0x7fca8806d4b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca98009a00 tx=0x7fca98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.201+0000 7fcaa4ff9640 1 -- 172.21.15.22:0/3748763992 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcaa0076200 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.395+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcaa80cd7d0 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.396+0000 7fcaa4ff9640 1 -- 172.21.15.22:0/3748763992 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcaa0079820 con 0x7fcaa80cc3d0 2023-11-24T06:16:59.399 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:16:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.398+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca8806aff0 msgr2=0x7fca8806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.398+0000 7fcaae09b640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca8806aff0 0x7fca8806d4b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca98009a00 tx=0x7fca98008040 comp rx=0 tx=0).stop 2023-11-24T06:16:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.398+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa80cc3d0 msgr2=0x7fcaa80cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.398+0000 7fcaae09b640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa80cc3d0 0x7fcaa80cc850 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fcaa002cb50 tx=0x7fcaa0001d80 comp rx=0 tx=0).stop 2023-11-24T06:16:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.399+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 shutdown_connections 2023-11-24T06:16:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.399+0000 7fcaae09b640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca8806aff0 0x7fca8806d4b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.399+0000 7fcaae09b640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa80cc3d0 0x7fcaa80cc850 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.399+0000 7fcaae09b640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaa80b3380 0x7fcaa80b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.399+0000 7fcaae09b640 1 --2- 172.21.15.22:0/3748763992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca94004d00 0x7fcaa8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.399+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 >> 172.21.15.22:0/3748763992 conn(0x7fcaa80b0ba0 msgr2=0x7fcaa80af630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.399+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 shutdown_connections 2023-11-24T06:16:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.399+0000 7fcaae09b640 1 -- 172.21.15.22:0/3748763992 wait complete. 2023-11-24T06:16:59.423 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:16:59.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.653+0000 7fa891983640 1 Processor -- start 2023-11-24T06:16:59.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.653+0000 7fa891983640 1 -- start start 2023-11-24T06:16:59.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.655+0000 7fa891983640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa88c153ea0 0x7fa88c0ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.655+0000 7fa891983640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa88c154280 0x7fa88c15d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.655+0000 7fa891983640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c0ce650 con 0x7fa88c070850 2023-11-24T06:16:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.655+0000 7fa891983640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c154710 con 0x7fa88c153ea0 2023-11-24T06:16:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.655+0000 7fa891983640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c15ddd0 con 0x7fa88c154280 2023-11-24T06:16:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.655+0000 7fa890981640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa88c153ea0 0x7fa88c0ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.655+0000 7fa890981640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa88c153ea0 0x7fa88c0ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46090/0 (socket says 172.21.15.22:46090) 2023-11-24T06:16:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.655+0000 7fa890981640 1 -- 172.21.15.22:0/139421939 learned_addr learned my addr 172.21.15.22:0/139421939 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.656+0000 7fa890981640 1 -- 172.21.15.22:0/139421939 >> v2:172.21.15.31:3300/0 conn(0x7fa88c154280 msgr2=0x7fa88c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:59.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.656+0000 7fa890981640 1 --2- 172.21.15.22:0/139421939 >> v2:172.21.15.31:3300/0 conn(0x7fa88c154280 0x7fa88c15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.656+0000 7fa890981640 1 -- 172.21.15.22:0/139421939 >> v1:172.21.15.31:6789/0 conn(0x7fa88c070850 legacy=0x7fa88c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.656+0000 7fa890981640 1 -- 172.21.15.22:0/139421939 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c15e0a0 con 0x7fa88c153ea0 2023-11-24T06:16:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.657+0000 7fa890981640 1 --2- 172.21.15.22:0/139421939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 0x7fa88c0ad450 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa88c157e50 tx=0x7fa88002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7467ef16d5a05ad server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.657+0000 7fa88b7fe640 1 -- 172.21.15.22:0/139421939 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880031870 con 0x7fa88c153ea0 2023-11-24T06:16:59.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.657+0000 7fa88b7fe640 1 -- 172.21.15.22:0/139421939 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8800319d0 con 0x7fa88c153ea0 2023-11-24T06:16:59.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.657+0000 7fa88b7fe640 1 -- 172.21.15.22:0/139421939 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880031d60 con 0x7fa88c153ea0 2023-11-24T06:16:59.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.658+0000 7fa891983640 1 -- 172.21.15.22:0/139421939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 msgr2=0x7fa88c0ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.658+0000 7fa891983640 1 --2- 172.21.15.22:0/139421939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 0x7fa88c0ad450 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa88c157e50 tx=0x7fa88002b910 comp rx=0 tx=0).stop 2023-11-24T06:16:59.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.658+0000 7fa891983640 1 -- 172.21.15.22:0/139421939 shutdown_connections 2023-11-24T06:16:59.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.658+0000 7fa891983640 1 --2- 172.21.15.22:0/139421939 >> v2:172.21.15.31:3300/0 conn(0x7fa88c154280 0x7fa88c15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.658+0000 7fa891983640 1 --2- 172.21.15.22:0/139421939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 0x7fa88c0ad450 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.658+0000 7fa891983640 1 -- 172.21.15.22:0/139421939 >> 172.21.15.22:0/139421939 conn(0x7fa88c0cec10 msgr2=0x7fa88c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:59.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.658+0000 7fa891983640 1 -- 172.21.15.22:0/139421939 shutdown_connections 2023-11-24T06:16:59.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.658+0000 7fa891983640 1 -- 172.21.15.22:0/139421939 wait complete. 2023-11-24T06:16:59.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.660+0000 7fa891983640 1 Processor -- start 2023-11-24T06:16:59.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.660+0000 7fa891983640 1 -- start start 2023-11-24T06:16:59.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.661+0000 7fa891983640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa88c070850 0x7fa88c150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.661+0000 7fa891983640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 0x7fa88c1e6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.661+0000 7fa891983640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa88c154280 0x7fa88c1e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.661+0000 7fa891983640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0b0850 con 0x7fa88c153ea0 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.661+0000 7fa891983640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0b0b30 con 0x7fa88c154280 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.661+0000 7fa891983640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0b0e10 con 0x7fa88c070850 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.661+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 0x7fa88c1e6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.661+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 0x7fa88c1e6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46102/0 (socket says 172.21.15.22:46102) 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.661+0000 7fa88bfff640 1 -- 172.21.15.22:0/750983383 learned_addr learned my addr 172.21.15.22:0/750983383 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa890981640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa88c070850 0x7fa88c150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa891182640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa88c154280 0x7fa88c1e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa88bfff640 1 -- 172.21.15.22:0/750983383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa88c070850 msgr2=0x7fa88c150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa88bfff640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa88c070850 0x7fa88c150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa88bfff640 1 -- 172.21.15.22:0/750983383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa88c154280 msgr2=0x7fa88c1e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa88bfff640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa88c154280 0x7fa88c1e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa88bfff640 1 -- 172.21.15.22:0/750983383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800094d0 con 0x7fa88c153ea0 2023-11-24T06:16:59.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa891182640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa88c154280 0x7fa88c1e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:59.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa88bfff640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 0x7fa88c1e6de0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa87800b410 tx=0x7fa87800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa8897fa640 1 -- 172.21.15.22:0/750983383 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878011830 con 0x7fa88c153ea0 2023-11-24T06:16:59.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.662+0000 7fa8897fa640 1 -- 172.21.15.22:0/750983383 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8780119b0 con 0x7fa88c153ea0 2023-11-24T06:16:59.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.663+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c0b10f0 con 0x7fa88c153ea0 2023-11-24T06:16:59.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.663+0000 7fa8897fa640 1 -- 172.21.15.22:0/750983383 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878011d60 con 0x7fa88c153ea0 2023-11-24T06:16:59.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.663+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c0b0490 con 0x7fa88c153ea0 2023-11-24T06:16:59.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.664+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c0b1610 con 0x7fa88c153ea0 2023-11-24T06:16:59.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.665+0000 7fa8897fa640 1 -- 172.21.15.22:0/750983383 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa87801a400 con 0x7fa88c153ea0 2023-11-24T06:16:59.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.666+0000 7fa8897fa640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa87006aff0 0x7fa87006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.666+0000 7fa8897fa640 1 -- 172.21.15.22:0/750983383 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa878089ba0 con 0x7fa88c153ea0 2023-11-24T06:16:59.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.666+0000 7fa890981640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa87006aff0 0x7fa87006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.667+0000 7fa890981640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa87006aff0 0x7fa87006d4b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa880036000 tx=0x7fa88003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.670+0000 7fa8897fa640 1 -- 172.21.15.22:0/750983383 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa88c0b1610 con 0x7fa88c153ea0 2023-11-24T06:16:59.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.867+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa88c0b18f0 con 0x7fa88c153ea0 2023-11-24T06:16:59.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.868+0000 7fa8897fa640 1 -- 172.21.15.22:0/750983383 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa88c0b18f0 con 0x7fa88c153ea0 2023-11-24T06:16:59.873 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:16:59.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa87006aff0 msgr2=0x7fa87006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa87006aff0 0x7fa87006d4b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa880036000 tx=0x7fa88003c040 comp rx=0 tx=0).stop 2023-11-24T06:16:59.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 msgr2=0x7fa88c1e6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 0x7fa88c1e6de0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa87800b410 tx=0x7fa87800b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 shutdown_connections 2023-11-24T06:16:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fa87006aff0 0x7fa87006d4b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa88c154280 0x7fa88c1e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa88c153ea0 0x7fa88c1e6de0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 --2- 172.21.15.22:0/750983383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa88c070850 0x7fa88c150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 >> 172.21.15.22:0/750983383 conn(0x7fa88c0cec10 msgr2=0x7fa88c160230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 shutdown_connections 2023-11-24T06:16:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:16:59.871+0000 7fa891983640 1 -- 172.21.15.22:0/750983383 wait complete. 2023-11-24T06:16:59.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:17:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.126+0000 7f9e8a3b3640 1 Processor -- start 2023-11-24T06:17:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.126+0000 7f9e8a3b3640 1 -- start start 2023-11-24T06:17:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.127+0000 7f9e8a3b3640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e840d1d90 0x7f9e840ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e8a3b3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e840d0fa0 0x7f9e840b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e8a3b3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e840c6bf0 con 0x7f9e8415d3b0 2023-11-24T06:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e8a3b3640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e840d13f0 con 0x7f9e840d1d90 2023-11-24T06:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e8a3b3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840cedc0 con 0x7f9e840d0fa0 2023-11-24T06:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e88bb0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e840d1d90 0x7f9e840ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e88bb0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e840d1d90 0x7f9e840ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46106/0 (socket says 172.21.15.22:46106) 2023-11-24T06:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e88bb0640 1 -- 172.21.15.22:0/1286235682 learned_addr learned my addr 172.21.15.22:0/1286235682 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e88bb0640 1 -- 172.21.15.22:0/1286235682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e840d0fa0 msgr2=0x7f9e840b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e88bb0640 1 --2- 172.21.15.22:0/1286235682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e840d0fa0 0x7f9e840b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e88bb0640 1 -- 172.21.15.22:0/1286235682 >> v1:172.21.15.31:6789/0 conn(0x7f9e8415d3b0 legacy=0x7f9e840d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.128+0000 7f9e88bb0640 1 -- 172.21.15.22:0/1286235682 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840c6e40 con 0x7f9e840d1d90 2023-11-24T06:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.130+0000 7f9e88bb0640 1 --2- 172.21.15.22:0/1286235682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d1d90 0x7f9e840ce6c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009870 tx=0x7f9e7402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8676c64ba94e3d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.130+0000 7f9e7bfff640 1 -- 172.21.15.22:0/1286235682 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740317c0 con 0x7f9e840d1d90 2023-11-24T06:17:00.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.130+0000 7f9e7bfff640 1 -- 172.21.15.22:0/1286235682 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e74031920 con 0x7f9e840d1d90 2023-11-24T06:17:00.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.130+0000 7f9e7bfff640 1 -- 172.21.15.22:0/1286235682 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74031cb0 con 0x7f9e840d1d90 2023-11-24T06:17:00.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.131+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1286235682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d1d90 msgr2=0x7f9e840ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.131+0000 7f9e8a3b3640 1 --2- 172.21.15.22:0/1286235682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d1d90 0x7f9e840ce6c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009870 tx=0x7f9e7402b860 comp rx=0 tx=0).stop 2023-11-24T06:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.131+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1286235682 shutdown_connections 2023-11-24T06:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.131+0000 7f9e8a3b3640 1 --2- 172.21.15.22:0/1286235682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e840d0fa0 0x7f9e840b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.131+0000 7f9e8a3b3640 1 --2- 172.21.15.22:0/1286235682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d1d90 0x7f9e840ce6c0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.131+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1286235682 >> 172.21.15.22:0/1286235682 conn(0x7f9e840d30a0 msgr2=0x7f9e840d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.131+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1286235682 shutdown_connections 2023-11-24T06:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.131+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1286235682 wait complete. 2023-11-24T06:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.133+0000 7f9e8a3b3640 1 Processor -- start 2023-11-24T06:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.133+0000 7f9e8a3b3640 1 -- start start 2023-11-24T06:17:00.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.134+0000 7f9e8a3b3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d0fa0 0x7f9e841602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.134+0000 7f9e8a3b3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e840d1d90 0x7f9e84158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.134+0000 7f9e8a3b3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8415d3b0 0x7f9e8406c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.134+0000 7f9e8a3b3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84159ba0 con 0x7f9e840d0fa0 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.134+0000 7f9e8a3b3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8415efd0 con 0x7f9e8415d3b0 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.134+0000 7f9e8a3b3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8415f220 con 0x7f9e840d1d90 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.134+0000 7f9e893b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d0fa0 0x7f9e841602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e893b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d0fa0 0x7f9e841602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46120/0 (socket says 172.21.15.22:46120) 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e893b1640 1 -- 172.21.15.22:0/1394881546 learned_addr learned my addr 172.21.15.22:0/1394881546 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e88bb0640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e840d1d90 0x7f9e84158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e893b1640 1 -- 172.21.15.22:0/1394881546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e840d1d90 msgr2=0x7f9e84158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e893b1640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e840d1d90 0x7f9e84158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e893b1640 1 -- 172.21.15.22:0/1394881546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8415d3b0 msgr2=0x7f9e8406c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e893b1640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8415d3b0 0x7f9e8406c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e893b1640 1 -- 172.21.15.22:0/1394881546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e740094d0 con 0x7f9e840d0fa0 2023-11-24T06:17:00.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e893b1640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d0fa0 0x7f9e841602c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000b3f0 tx=0x7f9e8000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.135+0000 7f9e79ffb640 1 -- 172.21.15.22:0/1394881546 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80011830 con 0x7f9e840d0fa0 2023-11-24T06:17:00.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.136+0000 7f9e79ffb640 1 -- 172.21.15.22:0/1394881546 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80011990 con 0x7f9e840d0fa0 2023-11-24T06:17:00.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.136+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8415f500 con 0x7f9e840d0fa0 2023-11-24T06:17:00.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.136+0000 7f9e79ffb640 1 -- 172.21.15.22:0/1394881546 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80011d40 con 0x7f9e840d0fa0 2023-11-24T06:17:00.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.136+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8415fac0 con 0x7f9e840d0fa0 2023-11-24T06:17:00.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.137+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8404e840 con 0x7f9e840d0fa0 2023-11-24T06:17:00.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.138+0000 7f9e79ffb640 1 -- 172.21.15.22:0/1394881546 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9e8001a400 con 0x7f9e840d0fa0 2023-11-24T06:17:00.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.139+0000 7f9e79ffb640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9e6806aff0 0x7f9e6806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.139+0000 7f9e79ffb640 1 -- 172.21.15.22:0/1394881546 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e80089850 con 0x7f9e840d0fa0 2023-11-24T06:17:00.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.139+0000 7f9e88bb0640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9e6806aff0 0x7f9e6806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.140+0000 7f9e88bb0640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9e6806aff0 0x7f9e6806d4b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9e74036000 tx=0x7f9e7403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.143+0000 7f9e79ffb640 1 -- 172.21.15.22:0/1394881546 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e800545e0 con 0x7f9e840d0fa0 2023-11-24T06:17:00.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.336+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e840d1820 con 0x7f9e840d0fa0 2023-11-24T06:17:00.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.337+0000 7f9e79ffb640 1 -- 172.21.15.22:0/1394881546 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e80057c00 con 0x7f9e840d0fa0 2023-11-24T06:17:00.340 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:17:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.339+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9e6806aff0 msgr2=0x7f9e6806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.339+0000 7f9e8a3b3640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9e6806aff0 0x7f9e6806d4b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9e74036000 tx=0x7f9e7403d040 comp rx=0 tx=0).stop 2023-11-24T06:17:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.339+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d0fa0 msgr2=0x7f9e841602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.339+0000 7f9e8a3b3640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d0fa0 0x7f9e841602c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000b3f0 tx=0x7f9e8000b8b0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.340+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 shutdown_connections 2023-11-24T06:17:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.340+0000 7f9e8a3b3640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9e6806aff0 0x7f9e6806d4b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.340+0000 7f9e8a3b3640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8415d3b0 0x7f9e8406c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.340+0000 7f9e8a3b3640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e840d1d90 0x7f9e84158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.340+0000 7f9e8a3b3640 1 --2- 172.21.15.22:0/1394881546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840d0fa0 0x7f9e841602c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.340+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 >> 172.21.15.22:0/1394881546 conn(0x7f9e840d30a0 msgr2=0x7f9e840c8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.340+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 shutdown_connections 2023-11-24T06:17:00.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.340+0000 7f9e8a3b3640 1 -- 172.21.15.22:0/1394881546 wait complete. 2023-11-24T06:17:00.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:17:00.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.582+0000 7f281cba9640 1 Processor -- start 2023-11-24T06:17:00.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.582+0000 7f281cba9640 1 -- start start 2023-11-24T06:17:00.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.584+0000 7f281cba9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28180cbcb0 0x7f281806d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.584+0000 7f281cba9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28180ce880 0x7f281806da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.584+0000 7f281cba9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28180b2080 con 0x7f281815b340 2023-11-24T06:17:00.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.584+0000 7f281cba9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28180b4130 con 0x7f28180cbcb0 2023-11-24T06:17:00.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.584+0000 7f281cba9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28180b2360 con 0x7f28180ce880 2023-11-24T06:17:00.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.584+0000 7f280ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28180cbcb0 0x7f281806d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.584+0000 7f280ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28180cbcb0 0x7f281806d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46126/0 (socket says 172.21.15.22:46126) 2023-11-24T06:17:00.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.584+0000 7f280ffff640 1 -- 172.21.15.22:0/3346899337 learned_addr learned my addr 172.21.15.22:0/3346899337 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:00.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.585+0000 7f2816d9d640 1 --2- 172.21.15.22:0/3346899337 >> v2:172.21.15.31:3300/0 conn(0x7f28180ce880 0x7f281806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.585+0000 7f280ffff640 1 -- 172.21.15.22:0/3346899337 >> v2:172.21.15.31:3300/0 conn(0x7f28180ce880 msgr2=0x7f281806da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.585+0000 7f280ffff640 1 --2- 172.21.15.22:0/3346899337 >> v2:172.21.15.31:3300/0 conn(0x7f28180ce880 0x7f281806da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.585+0000 7f280ffff640 1 -- 172.21.15.22:0/3346899337 >> v1:172.21.15.31:6789/0 conn(0x7f281815b340 legacy=0x7f28180abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.585+0000 7f280ffff640 1 -- 172.21.15.22:0/3346899337 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180b2640 con 0x7f28180cbcb0 2023-11-24T06:17:00.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.586+0000 7f280ffff640 1 --2- 172.21.15.22:0/3346899337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28180cbcb0 0x7f281806d520 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f281815fdf0 tx=0x7f280002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cb15cf4cdfe3ba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.586+0000 7f2815d9b640 1 -- 172.21.15.22:0/3346899337 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800031870 con 0x7f28180cbcb0 2023-11-24T06:17:00.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.586+0000 7f2815d9b640 1 -- 172.21.15.22:0/3346899337 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28000319d0 con 0x7f28180cbcb0 2023-11-24T06:17:00.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.586+0000 7f2815d9b640 1 -- 172.21.15.22:0/3346899337 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800031d60 con 0x7f28180cbcb0 2023-11-24T06:17:00.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.587+0000 7f281cba9640 1 -- 172.21.15.22:0/3346899337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28180cbcb0 msgr2=0x7f281806d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.587+0000 7f281cba9640 1 --2- 172.21.15.22:0/3346899337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28180cbcb0 0x7f281806d520 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f281815fdf0 tx=0x7f280002b910 comp rx=0 tx=0).stop 2023-11-24T06:17:00.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.587+0000 7f281cba9640 1 -- 172.21.15.22:0/3346899337 shutdown_connections 2023-11-24T06:17:00.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.587+0000 7f281cba9640 1 --2- 172.21.15.22:0/3346899337 >> v2:172.21.15.31:3300/0 conn(0x7f28180ce880 0x7f281806da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.587+0000 7f281cba9640 1 --2- 172.21.15.22:0/3346899337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28180cbcb0 0x7f281806d520 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.587+0000 7f281cba9640 1 -- 172.21.15.22:0/3346899337 >> 172.21.15.22:0/3346899337 conn(0x7f28180b0d80 msgr2=0x7f28180b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.587+0000 7f281cba9640 1 -- 172.21.15.22:0/3346899337 shutdown_connections 2023-11-24T06:17:00.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.587+0000 7f281cba9640 1 -- 172.21.15.22:0/3346899337 wait complete. 2023-11-24T06:17:00.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.589+0000 7f281cba9640 1 Processor -- start 2023-11-24T06:17:00.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.589+0000 7f281cba9640 1 -- start start 2023-11-24T06:17:00.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.590+0000 7f281cba9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28180cbcb0 0x7f281815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.590+0000 7f281cba9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28180ce880 0x7f2818098820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.590+0000 7f281cba9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281815b340 0x7f2818154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.590+0000 7f281cba9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2818150e60 con 0x7f281815b340 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.590+0000 7f281cba9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281815d7d0 con 0x7f28180cbcb0 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.590+0000 7f281cba9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281815cbc0 con 0x7f28180ce880 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.590+0000 7f2816d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281815b340 0x7f2818154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f2816d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281815b340 0x7f2818154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46134/0 (socket says 172.21.15.22:46134) 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f2816d9d640 1 -- 172.21.15.22:0/713340113 learned_addr learned my addr 172.21.15.22:0/713340113 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f280ffff640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28180ce880 0x7f2818098820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f281659c640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28180cbcb0 0x7f281815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f2816d9d640 1 -- 172.21.15.22:0/713340113 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28180ce880 msgr2=0x7f2818098820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f2816d9d640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28180ce880 0x7f2818098820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f2816d9d640 1 -- 172.21.15.22:0/713340113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28180cbcb0 msgr2=0x7f281815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f2816d9d640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28180cbcb0 0x7f281815dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f2816d9d640 1 -- 172.21.15.22:0/713340113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000094d0 con 0x7f281815b340 2023-11-24T06:17:00.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.591+0000 7f2816d9d640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281815b340 0x7f2818154b30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f281000cd70 tx=0x7f281000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.592+0000 7f280effd640 1 -- 172.21.15.22:0/713340113 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810003b90 con 0x7f281815b340 2023-11-24T06:17:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.592+0000 7f280effd640 1 -- 172.21.15.22:0/713340113 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2810003cf0 con 0x7f281815b340 2023-11-24T06:17:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.592+0000 7f280effd640 1 -- 172.21.15.22:0/713340113 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810004240 con 0x7f281815b340 2023-11-24T06:17:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.592+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281815cea0 con 0x7f281815b340 2023-11-24T06:17:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.592+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281815d460 con 0x7f281815b340 2023-11-24T06:17:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.593+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281815d960 con 0x7f281815b340 2023-11-24T06:17:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.594+0000 7f280effd640 1 -- 172.21.15.22:0/713340113 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f28100043a0 con 0x7f281815b340 2023-11-24T06:17:00.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.595+0000 7f280effd640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27f806aff0 0x7f27f806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.595+0000 7f280effd640 1 -- 172.21.15.22:0/713340113 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2810012070 con 0x7f281815b340 2023-11-24T06:17:00.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.596+0000 7f281659c640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27f806aff0 0x7f27f806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.596+0000 7f281659c640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27f806aff0 0x7f27f806d4b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2808000f60 tx=0x7f2808009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.600+0000 7f280effd640 1 -- 172.21.15.22:0/713340113 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2810055190 con 0x7f281815b340 2023-11-24T06:17:00.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.807+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2818074770 con 0x7f281815b340 2023-11-24T06:17:00.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.808+0000 7f280effd640 1 -- 172.21.15.22:0/713340113 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f28100587b0 con 0x7f281815b340 2023-11-24T06:17:00.810 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-11-24T06:17:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.810+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27f806aff0 msgr2=0x7f27f806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.810+0000 7f281cba9640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27f806aff0 0x7f27f806d4b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2808000f60 tx=0x7f2808009040 comp rx=0 tx=0).stop 2023-11-24T06:17:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.810+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281815b340 msgr2=0x7f2818154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.810+0000 7f281cba9640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281815b340 0x7f2818154b30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f281000cd70 tx=0x7f281000a660 comp rx=0 tx=0).stop 2023-11-24T06:17:00.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.811+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 shutdown_connections 2023-11-24T06:17:00.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.811+0000 7f281cba9640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f27f806aff0 0x7f27f806d4b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.811+0000 7f281cba9640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f281815b340 0x7f2818154b30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.811+0000 7f281cba9640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28180ce880 0x7f2818098820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.811+0000 7f281cba9640 1 --2- 172.21.15.22:0/713340113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28180cbcb0 0x7f281815dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.811+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 >> 172.21.15.22:0/713340113 conn(0x7f28180b0d80 msgr2=0x7f28180cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.811+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 shutdown_connections 2023-11-24T06:17:00.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:00.811+0000 7f281cba9640 1 -- 172.21.15.22:0/713340113 wait complete. 2023-11-24T06:17:00.830 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2023-11-24T06:17:00.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:00.831 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:00.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[96737]: fuse finished with error 0 and tester_r 0 2023-11-24T06:17:00.943 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:17:00.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:00.943 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:17:01.115 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:17:01.115 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:01.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:17:01.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:17:01.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:01.179 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T06:17:01.237 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-24T06:17:01.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:17:01.239 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:17:01.239 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:01.303 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:17:01.303 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:17:01.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:01.303 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T06:17:01.361 INFO:teuthology.orchestra.run.smithi031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-24T06:17:01.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:17:01.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:01.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.596+0000 7f057ed47640 1 Processor -- start 2023-11-24T06:17:01.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.596+0000 7f057ed47640 1 -- start start 2023-11-24T06:17:01.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.598+0000 7f057ed47640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f057806d250 0x7f057815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.598+0000 7f057ed47640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f057815ddb0 0x7f0578070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.598+0000 7f057ed47640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0578161670 con 0x7f0578157770 2023-11-24T06:17:01.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.598+0000 7f057ed47640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057815e610 con 0x7f057806d250 2023-11-24T06:17:01.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.598+0000 7f057ed47640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0578160d40 con 0x7f057815ddb0 2023-11-24T06:17:01.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.598+0000 7f057dd45640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0578157770 0x7f057806cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33190/0 (socket says 172.21.15.22:33190) 2023-11-24T06:17:01.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.598+0000 7f057dd45640 1 -- 172.21.15.22:0/1181529388 learned_addr learned my addr 172.21.15.22:0/1181529388 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:01.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.599+0000 7f057d544640 1 --2- 172.21.15.22:0/1181529388 >> v2:172.21.15.22:3300/0 conn(0x7f057806d250 0x7f057815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.599+0000 7f057e546640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f057815ddb0 0x7f0578070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.599+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300794214 0 0) 0x7f0578161670 con 0x7f0578157770 2023-11-24T06:17:01.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.599+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0564003520 con 0x7f0578157770 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.599+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1567147512 0 0) 0x7f0564003520 con 0x7f0578157770 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.599+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f057815ddb0 msgr2=0x7f0578070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.599+0000 7f057cd43640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f057815ddb0 0x7f0578070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.599+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 >> v2:172.21.15.22:3300/0 conn(0x7f057806d250 msgr2=0x7f057815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.599+0000 7f057cd43640 1 --2- 172.21.15.22:0/1181529388 >> v2:172.21.15.22:3300/0 conn(0x7f057806d250 0x7f057815d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578161020 con 0x7f0578157770 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f0574001670 con 0x7f0578157770 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057d544640 1 --2- 172.21.15.22:0/1181529388 >> v2:172.21.15.22:3300/0 conn(0x7f057806d250 0x7f057815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 >> v1:172.21.15.22:6789/0 conn(0x7f0578157770 legacy=0x7f057806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057cd43640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05640039e0 0x7f0564003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057cd43640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05640047c0 0x7f0564004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057cd43640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f057815ddb0 0x7f0564005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057815e610 con 0x7f05640039e0 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578160d40 con 0x7f05640047c0 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056400b9b0 con 0x7f057815ddb0 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057dd45640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05640039e0 0x7f0564003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057e546640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f057815ddb0 0x7f0564005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.600+0000 7f057d544640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05640047c0 0x7f0564004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.601+0000 7f057dd45640 1 -- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f057815ddb0 msgr2=0x7f0564005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.601+0000 7f057dd45640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f057815ddb0 0x7f0564005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.601+0000 7f057dd45640 1 -- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05640047c0 msgr2=0x7f0564004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.601+0000 7f057dd45640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05640047c0 0x7f0564004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.601+0000 7f057dd45640 1 -- 172.21.15.22:0/1181529388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564003520 con 0x7f05640039e0 2023-11-24T06:17:01.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.601+0000 7f057d544640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05640047c0 0x7f0564004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:01.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.602+0000 7f057dd45640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05640039e0 0x7f0564003e00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f057400c160 tx=0x7f05640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791badfc2c0ac85 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.602+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0574005ad0 con 0x7f05640039e0 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.602+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0574005c30 con 0x7f05640039e0 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.602+0000 7f057cd43640 1 -- 172.21.15.22:0/1181529388 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057402c810 con 0x7f05640039e0 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.603+0000 7f057ed47640 1 -- 172.21.15.22:0/1181529388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05640039e0 msgr2=0x7f0564003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.603+0000 7f057ed47640 1 --2- 172.21.15.22:0/1181529388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05640039e0 0x7f0564003e00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f057400c160 tx=0x7f05640057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.603+0000 7f057e546640 1 -- 172.21.15.22:0/1181529388 reap_dead start 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.603+0000 7f057ed47640 1 -- 172.21.15.22:0/1181529388 shutdown_connections 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.603+0000 7f057ed47640 1 -- 172.21.15.22:0/1181529388 >> 172.21.15.22:0/1181529388 conn(0x7f057806a860 msgr2=0x7f057806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.603+0000 7f057ed47640 1 -- 172.21.15.22:0/1181529388 shutdown_connections 2023-11-24T06:17:01.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.603+0000 7f057ed47640 1 -- 172.21.15.22:0/1181529388 wait complete. 2023-11-24T06:17:01.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.605+0000 7f057ed47640 1 Processor -- start 2023-11-24T06:17:01.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.605+0000 7f057ed47640 1 -- start start 2023-11-24T06:17:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057ed47640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640039e0 0x7f05781416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057ed47640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05780caea0 0x7f0578154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057ed47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f057815f940 0x7f057815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057ed47640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05780cbfb0 con 0x7f057815f940 2023-11-24T06:17:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057ed47640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578160310 con 0x7f05780caea0 2023-11-24T06:17:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057ed47640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0578155160 con 0x7f05640039e0 2023-11-24T06:17:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057e546640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f057815f940 0x7f057815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057e546640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f057815f940 0x7f057815fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33516/0 (socket says 172.21.15.22:33516) 2023-11-24T06:17:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057e546640 1 -- 172.21.15.22:0/3368458228 learned_addr learned my addr 172.21.15.22:0/3368458228 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:01.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.606+0000 7f057dd45640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640039e0 0x7f05781416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f057d544640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05780caea0 0x7f0578154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f057e546640 1 -- 172.21.15.22:0/3368458228 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640039e0 msgr2=0x7f05781416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f057e546640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640039e0 0x7f05781416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f057e546640 1 -- 172.21.15.22:0/3368458228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05780caea0 msgr2=0x7f0578154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f057e546640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05780caea0 0x7f0578154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f057e546640 1 -- 172.21.15.22:0/3368458228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578161c80 con 0x7f057815f940 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f057e546640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f057815f940 0x7f057815fdd0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f05780b1da0 tx=0x7f057000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f056a7fc640 1 -- 172.21.15.22:0/3368458228 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570017400 con 0x7f057815f940 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f056a7fc640 1 -- 172.21.15.22:0/3368458228 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570011040 con 0x7f057815f940 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f056a7fc640 1 -- 172.21.15.22:0/3368458228 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05700177c0 con 0x7f057815f940 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05780cb3a0 con 0x7f057815f940 2023-11-24T06:17:01.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.607+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05780cb960 con 0x7f057815f940 2023-11-24T06:17:01.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.609+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05780cc160 con 0x7f057815f940 2023-11-24T06:17:01.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.610+0000 7f056a7fc640 1 -- 172.21.15.22:0/3368458228 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0570017920 con 0x7f057815f940 2023-11-24T06:17:01.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.611+0000 7f056a7fc640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f055c06b070 0x7f055c06d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.611+0000 7f056a7fc640 1 -- 172.21.15.22:0/3368458228 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0570089da0 con 0x7f057815f940 2023-11-24T06:17:01.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.611+0000 7f057dd45640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f055c06b070 0x7f055c06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.612+0000 7f057dd45640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f055c06b070 0x7f055c06d530 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0574001050 tx=0x7f0574007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:01.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.617+0000 7f056a7fc640 1 -- 172.21.15.22:0/3368458228 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05780cc160 con 0x7f057815f940 2023-11-24T06:17:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.839+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f057804e840 con 0x7f057815f940 2023-11-24T06:17:01.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.840+0000 7f056a7fc640 1 -- 172.21.15.22:0/3368458228 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f0570054ba0 con 0x7f057815f940 2023-11-24T06:17:01.843 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:01.843 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3364238617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3364238617},{"type":"v1","addr":"172.21.15.31:6835","nonce":3364238617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6420,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/1299665813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1299665813},{"type":"v1","addr":"172.21.15.22:6836","nonce":1299665813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1568499503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1568499503},{"type":"v1","addr":"172.21.15.22:6837","nonce":1568499503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:34.218301+0000","modified":"2023-11-24T06:16:37.280807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6435":{"gid":6435,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2376501260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2376501260},{"type":"v1","addr":"172.21.15.31:6834","nonce":2376501260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:17:01.844 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 35 2023-11-24T06:17:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f055c06b070 msgr2=0x7f055c06d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f055c06b070 0x7f055c06d530 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0574001050 tx=0x7f0574007000 comp rx=0 tx=0).stop 2023-11-24T06:17:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f057815f940 msgr2=0x7f057815fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f057815f940 0x7f057815fdd0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f05780b1da0 tx=0x7f057000f4a0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 shutdown_connections 2023-11-24T06:17:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f055c06b070 0x7f055c06d530 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f057815f940 0x7f057815fdd0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05780caea0 0x7f0578154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 --2- 172.21.15.22:0/3368458228 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05640039e0 0x7f05781416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 >> 172.21.15.22:0/3368458228 conn(0x7f057806a860 msgr2=0x7f0578070720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 shutdown_connections 2023-11-24T06:17:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:01.843+0000 7f057ed47640 1 -- 172.21.15.22:0/3368458228 wait complete. 2023-11-24T06:17:01.863 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:02.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.076+0000 7ff2c70bb640 1 Processor -- start 2023-11-24T06:17:02.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.076+0000 7ff2c70bb640 1 -- start start 2023-11-24T06:17:02.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.077+0000 7ff2c70bb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2c013dfd0 0x7ff2c015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.077+0000 7ff2c70bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c00cf500 0x7ff2c006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.077+0000 7ff2c70bb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c00ce7c0 con 0x7ff2c00cf050 2023-11-24T06:17:02.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.077+0000 7ff2c70bb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c0140900 con 0x7ff2c013dfd0 2023-11-24T06:17:02.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.078+0000 7ff2c70bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c015fa70 con 0x7ff2c00cf500 2023-11-24T06:17:02.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.078+0000 7ff2c58b8640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff2c00cf050 0x7ff2c006c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33202/0 (socket says 172.21.15.22:33202) 2023-11-24T06:17:02.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.078+0000 7ff2c58b8640 1 -- 172.21.15.22:0/1385824933 learned_addr learned my addr 172.21.15.22:0/1385824933 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:02.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.078+0000 7ff2c60b9640 1 --2- 172.21.15.22:0/1385824933 >> v2:172.21.15.31:3300/0 conn(0x7ff2c013dfd0 0x7ff2c015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.078+0000 7ff2c68ba640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c00cf500 0x7ff2c006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603082685 0 0) 0x7ff2c00ce7c0 con 0x7ff2c00cf050 2023-11-24T06:17:02.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ac003520 con 0x7ff2c00cf050 2023-11-24T06:17:02.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1625662840 0 0) 0x7ff2ac003520 con 0x7ff2c00cf050 2023-11-24T06:17:02.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c00cf500 msgr2=0x7ff2c006c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:02.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c00cf500 0x7ff2c006c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 >> v2:172.21.15.31:3300/0 conn(0x7ff2c013dfd0 msgr2=0x7ff2c015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:02.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 --2- 172.21.15.22:0/1385824933 >> v2:172.21.15.31:3300/0 conn(0x7ff2c013dfd0 0x7ff2c015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c00cf950 con 0x7ff2c00cf050 2023-11-24T06:17:02.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7ff2b0001690 con 0x7ff2c00cf050 2023-11-24T06:17:02.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 >> v1:172.21.15.22:6789/0 conn(0x7ff2c00cf050 legacy=0x7ff2c006c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c00cf500 0x7ff2ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ac004d00 0x7ff2ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0140900 con 0x7ff2ac0039e0 2023-11-24T06:17:02.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c015fa70 con 0x7ff2ac004d00 2023-11-24T06:17:02.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.079+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac00b980 con 0x7ff2c00cf500 2023-11-24T06:17:02.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.080+0000 7ff2c60b9640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.080+0000 7ff2c58b8640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c00cf500 0x7ff2ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.080+0000 7ff2c68ba640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ac004d00 0x7ff2ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.080+0000 7ff2c60b9640 1 -- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c00cf500 msgr2=0x7ff2ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:02.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.080+0000 7ff2c60b9640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c00cf500 0x7ff2ac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.080+0000 7ff2c60b9640 1 -- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ac004d00 msgr2=0x7ff2ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:02.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.080+0000 7ff2c60b9640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ac004d00 0x7ff2ac005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.080+0000 7ff2c60b9640 1 -- 172.21.15.22:0/1385824933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac003520 con 0x7ff2ac0039e0 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.081+0000 7ff2c60b9640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2ac003e00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009ac0 tx=0x7ff2ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6314838ca34099fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.081+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc02c710 con 0x7ff2ac0039e0 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.082+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc02c870 con 0x7ff2ac0039e0 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.082+0000 7ff2c50b7640 1 -- 172.21.15.22:0/1385824933 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc02cc00 con 0x7ff2ac0039e0 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.082+0000 7ff2c70bb640 1 -- 172.21.15.22:0/1385824933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 msgr2=0x7ff2ac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.082+0000 7ff2c70bb640 1 --2- 172.21.15.22:0/1385824933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2ac003e00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009ac0 tx=0x7ff2ac0057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.082+0000 7ff2c68ba640 1 -- 172.21.15.22:0/1385824933 reap_dead start 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.082+0000 7ff2c70bb640 1 -- 172.21.15.22:0/1385824933 shutdown_connections 2023-11-24T06:17:02.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.082+0000 7ff2c70bb640 1 -- 172.21.15.22:0/1385824933 >> 172.21.15.22:0/1385824933 conn(0x7ff2c006a860 msgr2=0x7ff2c006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:02.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.082+0000 7ff2c70bb640 1 -- 172.21.15.22:0/1385824933 shutdown_connections 2023-11-24T06:17:02.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.082+0000 7ff2c70bb640 1 -- 172.21.15.22:0/1385824933 wait complete. 2023-11-24T06:17:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.084+0000 7ff2c70bb640 1 Processor -- start 2023-11-24T06:17:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.084+0000 7ff2c70bb640 1 -- start start 2023-11-24T06:17:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.085+0000 7ff2c70bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2c01f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.085+0000 7ff2c70bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c0139e00 0x7ff2c013a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.085+0000 7ff2c70bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2c00b1c40 0x7ff2c00b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.085+0000 7ff2c70bb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c013a7c0 con 0x7ff2ac0039e0 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.085+0000 7ff2c70bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00b3560 con 0x7ff2c00b1c40 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.085+0000 7ff2c70bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00b2950 con 0x7ff2c0139e00 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.085+0000 7ff2c60b9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2c01f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.085+0000 7ff2c60b9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2c01f3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33542/0 (socket says 172.21.15.22:33542) 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.085+0000 7ff2c60b9640 1 -- 172.21.15.22:0/440078323 learned_addr learned my addr 172.21.15.22:0/440078323 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c68ba640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2c00b1c40 0x7ff2c00b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c58b8640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c0139e00 0x7ff2c013a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c60b9640 1 -- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c0139e00 msgr2=0x7ff2c013a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c60b9640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c0139e00 0x7ff2c013a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c60b9640 1 -- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2c00b1c40 msgr2=0x7ff2c00b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c60b9640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2c00b1c40 0x7ff2c00b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c60b9640 1 -- 172.21.15.22:0/440078323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c00b2c30 con 0x7ff2ac0039e0 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c58b8640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c0139e00 0x7ff2c013a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c68ba640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2c00b1c40 0x7ff2c00b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.086+0000 7ff2c60b9640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2c01f3900 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc02c2b0 tx=0x7ff2bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.087+0000 7ff2b6ffd640 1 -- 172.21.15.22:0/440078323 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc003810 con 0x7ff2ac0039e0 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.087+0000 7ff2b6ffd640 1 -- 172.21.15.22:0/440078323 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc02de90 con 0x7ff2ac0039e0 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.087+0000 7ff2b6ffd640 1 -- 172.21.15.22:0/440078323 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc003b70 con 0x7ff2ac0039e0 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.087+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c00b2f10 con 0x7ff2ac0039e0 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.087+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c01f3e40 con 0x7ff2ac0039e0 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.088+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c004e840 con 0x7ff2ac0039e0 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.089+0000 7ff2b6ffd640 1 -- 172.21.15.22:0/440078323 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff2bc003cd0 con 0x7ff2ac0039e0 2023-11-24T06:17:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.090+0000 7ff2b6ffd640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff2a406aff0 0x7ff2a406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.090+0000 7ff2b6ffd640 1 -- 172.21.15.22:0/440078323 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2bc0abb00 con 0x7ff2ac0039e0 2023-11-24T06:17:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.090+0000 7ff2c58b8640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff2a406aff0 0x7ff2a406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.091+0000 7ff2c58b8640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff2a406aff0 0x7ff2a406d4b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000f60 tx=0x7ff2b0000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.095+0000 7ff2b6ffd640 1 -- 172.21.15.22:0/440078323 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2bc0ade60 con 0x7ff2ac0039e0 2023-11-24T06:17:02.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.288+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2c00ce9a0 con 0x7ff2ac0039e0 2023-11-24T06:17:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.291+0000 7ff2b6ffd640 1 -- 172.21.15.22:0/440078323 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16517 (secure 0 0 0) 0x7ff2bc076a40 con 0x7ff2ac0039e0 2023-11-24T06:17:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:02.294 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:35.760665+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:32.153129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:33.228812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:02.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff2a406aff0 msgr2=0x7ff2a406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff2a406aff0 0x7ff2a406d4b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000f60 tx=0x7ff2b0000ed0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 msgr2=0x7ff2c01f3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2c01f3900 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc02c2b0 tx=0x7ff2bc004730 comp rx=0 tx=0).stop 2023-11-24T06:17:02.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 shutdown_connections 2023-11-24T06:17:02.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ff2a406aff0 0x7ff2a406d4b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2c00b1c40 0x7ff2c00b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2c0139e00 0x7ff2c013a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 --2- 172.21.15.22:0/440078323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ac0039e0 0x7ff2c01f3900 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 >> 172.21.15.22:0/440078323 conn(0x7ff2c006a860 msgr2=0x7ff2c013f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:02.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.294+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 shutdown_connections 2023-11-24T06:17:02.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.295+0000 7ff2c70bb640 1 -- 172.21.15.22:0/440078323 wait complete. 2023-11-24T06:17:02.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:11:48.725222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:16:32.153129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:16:33.228812+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:17:02.318 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:17:02.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.543+0000 7fe295b35640 1 Processor -- start 2023-11-24T06:17:02.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.544+0000 7fe295b35640 1 -- start start 2023-11-24T06:17:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.545+0000 7fe295b35640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe29015f270 0x7fe2900cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.545+0000 7fe295b35640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29015f930 con 0x7fe290144770 2023-11-24T06:17:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.545+0000 7fe295b35640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900b3b10 con 0x7fe29006d9e0 2023-11-24T06:17:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.545+0000 7fe295b35640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900b43b0 con 0x7fe29015f270 2023-11-24T06:17:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.546+0000 7fe294b33640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe290144770 0x7fe29015eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33204/0 (socket says 172.21.15.22:33204) 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.546+0000 7fe294b33640 1 -- 172.21.15.22:0/1757731923 learned_addr learned my addr 172.21.15.22:0/1757731923 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.546+0000 7fe28ffff640 1 --2- 172.21.15.22:0/1757731923 >> v2:172.21.15.22:3300/0 conn(0x7fe29015f270 0x7fe2900cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.546+0000 7fe28f7fe640 1 -- 172.21.15.22:0/1757731923 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423480457 0 0) 0x7fe29015f930 con 0x7fe290144770 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.546+0000 7fe28f7fe640 1 -- 172.21.15.22:0/1757731923 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe280003520 con 0x7fe290144770 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.546+0000 7fe28ffff640 1 -- 172.21.15.22:0/1757731923 >> v1:172.21.15.31:6789/0 conn(0x7fe29006d9e0 legacy=0x7fe2900cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.546+0000 7fe28ffff640 1 -- 172.21.15.22:0/1757731923 >> v1:172.21.15.22:6789/0 conn(0x7fe290144770 legacy=0x7fe29015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.546+0000 7fe28ffff640 1 -- 172.21.15.22:0/1757731923 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900b3df0 con 0x7fe29015f270 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.548+0000 7fe28ffff640 1 --2- 172.21.15.22:0/1757731923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 0x7fe2900cd4a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0097a0 tx=0x7fe27c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62b53c93469d155 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.548+0000 7fe28f7fe640 1 -- 172.21.15.22:0/1757731923 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c031830 con 0x7fe29015f270 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.548+0000 7fe28f7fe640 1 -- 172.21.15.22:0/1757731923 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c031990 con 0x7fe29015f270 2023-11-24T06:17:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.548+0000 7fe28f7fe640 1 -- 172.21.15.22:0/1757731923 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c031d20 con 0x7fe29015f270 2023-11-24T06:17:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.549+0000 7fe295b35640 1 -- 172.21.15.22:0/1757731923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 msgr2=0x7fe2900cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.549+0000 7fe295b35640 1 --2- 172.21.15.22:0/1757731923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 0x7fe2900cd4a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0097a0 tx=0x7fe27c02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.549+0000 7fe295b35640 1 -- 172.21.15.22:0/1757731923 shutdown_connections 2023-11-24T06:17:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.549+0000 7fe295b35640 1 --2- 172.21.15.22:0/1757731923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 0x7fe2900cd4a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.549+0000 7fe295b35640 1 -- 172.21.15.22:0/1757731923 >> 172.21.15.22:0/1757731923 conn(0x7fe2900cec10 msgr2=0x7fe2900cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.549+0000 7fe295b35640 1 -- 172.21.15.22:0/1757731923 shutdown_connections 2023-11-24T06:17:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.549+0000 7fe295b35640 1 -- 172.21.15.22:0/1757731923 wait complete. 2023-11-24T06:17:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.551+0000 7fe295b35640 1 Processor -- start 2023-11-24T06:17:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.551+0000 7fe295b35640 1 -- start start 2023-11-24T06:17:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.552+0000 7fe295b35640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe29006d9e0 0x7fe29013ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.552+0000 7fe295b35640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe290144770 0x7fe29013a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.552+0000 7fe295b35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 0x7fe29013ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.552+0000 7fe295b35640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2901409c0 con 0x7fe29015f270 2023-11-24T06:17:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.552+0000 7fe295b35640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290140ca0 con 0x7fe290144770 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.552+0000 7fe295b35640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29013c350 con 0x7fe29006d9e0 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe295334640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 0x7fe29013ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe295334640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 0x7fe29013ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33556/0 (socket says 172.21.15.22:33556) 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe295334640 1 -- 172.21.15.22:0/403815298 learned_addr learned my addr 172.21.15.22:0/403815298 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe294b33640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe29006d9e0 0x7fe29013ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe28ffff640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe290144770 0x7fe29013a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe295334640 1 -- 172.21.15.22:0/403815298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe29006d9e0 msgr2=0x7fe29013ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe295334640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe29006d9e0 0x7fe29013ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe295334640 1 -- 172.21.15.22:0/403815298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe290144770 msgr2=0x7fe29013a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe295334640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe290144770 0x7fe29013a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe295334640 1 -- 172.21.15.22:0/403815298 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c009400 con 0x7fe29015f270 2023-11-24T06:17:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.553+0000 7fe294b33640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe29006d9e0 0x7fe29013ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.554+0000 7fe295334640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 0x7fe29013ffe0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c780 tx=0x7fe28800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.554+0000 7fe28d7fa640 1 -- 172.21.15.22:0/403815298 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288004b60 con 0x7fe29015f270 2023-11-24T06:17:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.554+0000 7fe28d7fa640 1 -- 172.21.15.22:0/403815298 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28800ce90 con 0x7fe29015f270 2023-11-24T06:17:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.554+0000 7fe28d7fa640 1 -- 172.21.15.22:0/403815298 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28800a850 con 0x7fe29015f270 2023-11-24T06:17:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.554+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29013c630 con 0x7fe29015f270 2023-11-24T06:17:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.554+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29013ab10 con 0x7fe29015f270 2023-11-24T06:17:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.555+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29013cb50 con 0x7fe29015f270 2023-11-24T06:17:02.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.556+0000 7fe28d7fa640 1 -- 172.21.15.22:0/403815298 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe28800a9b0 con 0x7fe29015f270 2023-11-24T06:17:02.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.558+0000 7fe28d7fa640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe27406aff0 0x7fe27406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.558+0000 7fe28d7fa640 1 -- 172.21.15.22:0/403815298 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe288089b70 con 0x7fe29015f270 2023-11-24T06:17:02.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.558+0000 7fe294b33640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe27406aff0 0x7fe27406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.559+0000 7fe294b33640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe27406aff0 0x7fe27406d4b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe2840011e0 tx=0x7fe284009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.562+0000 7fe28d7fa640 1 -- 172.21.15.22:0/403815298 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe29013cb50 con 0x7fe29015f270 2023-11-24T06:17:02.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.753+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe29013cb50 con 0x7fe29015f270 2023-11-24T06:17:02.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.754+0000 7fe28d7fa640 1 -- 172.21.15.22:0/403815298 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe29013cb50 con 0x7fe29015f270 2023-11-24T06:17:02.757 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-11-24T06:17:02.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.756+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe27406aff0 msgr2=0x7fe27406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.756+0000 7fe295b35640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe27406aff0 0x7fe27406d4b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe2840011e0 tx=0x7fe284009040 comp rx=0 tx=0).stop 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.756+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 msgr2=0x7fe29013ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.756+0000 7fe295b35640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 0x7fe29013ffe0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c780 tx=0x7fe28800cc40 comp rx=0 tx=0).stop 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.757+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 shutdown_connections 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.757+0000 7fe295b35640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe27406aff0 0x7fe27406d4b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.757+0000 7fe295b35640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe29015f270 0x7fe29013ffe0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.757+0000 7fe295b35640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe290144770 0x7fe29013a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.757+0000 7fe295b35640 1 --2- 172.21.15.22:0/403815298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe29006d9e0 0x7fe29013ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.757+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 >> 172.21.15.22:0/403815298 conn(0x7fe2900cec10 msgr2=0x7fe290070230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.757+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 shutdown_connections 2023-11-24T06:17:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.757+0000 7fe295b35640 1 -- 172.21.15.22:0/403815298 wait complete. 2023-11-24T06:17:02.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:17:02.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.988+0000 7f59af59e640 1 Processor -- start 2023-11-24T06:17:02.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.988+0000 7f59af59e640 1 -- start start 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59af59e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f59b0144770 0x7f59b015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59af59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59b00b35a0 0x7f59b015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59af59e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59b006c9d0 0x7f59b006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59af59e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b00b43b0 con 0x7f59b0144770 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59af59e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b015f930 con 0x7f59b006c9d0 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59af59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00b3b10 con 0x7f59b00b35a0 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59ae59c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f59b0144770 0x7f59b015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59ae59c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f59b0144770 0x7f59b015eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33564/0 (socket says 172.21.15.22:33564) 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59ae59c640 1 -- 172.21.15.22:0/3082668052 learned_addr learned my addr 172.21.15.22:0/3082668052 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:02.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59a7fff640 1 --2- 172.21.15.22:0/3082668052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59b00b35a0 0x7f59b015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.990+0000 7f59aed9d640 1 --2- 172.21.15.22:0/3082668052 >> v2:172.21.15.31:3300/0 conn(0x7f59b006c9d0 0x7f59b006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.991+0000 7f59ae59c640 1 -- 172.21.15.22:0/3082668052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59b00b35a0 msgr2=0x7f59b015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:02.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.991+0000 7f59ae59c640 1 --2- 172.21.15.22:0/3082668052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59b00b35a0 0x7f59b015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.991+0000 7f59ae59c640 1 -- 172.21.15.22:0/3082668052 >> v2:172.21.15.31:3300/0 conn(0x7f59b006c9d0 msgr2=0x7f59b006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:02.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.991+0000 7f59ae59c640 1 --2- 172.21.15.22:0/3082668052 >> v2:172.21.15.31:3300/0 conn(0x7f59b006c9d0 0x7f59b006ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.991+0000 7f59ae59c640 1 -- 172.21.15.22:0/3082668052 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00b3df0 con 0x7f59b0144770 2023-11-24T06:17:02.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.993+0000 7f59ae59c640 1 --2- 172.21.15.22:0/3082668052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b0144770 0x7f59b015eb60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009870 tx=0x7f59a002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8981563aeeb2572 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59add9b640 1 -- 172.21.15.22:0/3082668052 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0031640 con 0x7f59b0144770 2023-11-24T06:17:02.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59add9b640 1 -- 172.21.15.22:0/3082668052 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a00317a0 con 0x7f59b0144770 2023-11-24T06:17:02.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59add9b640 1 -- 172.21.15.22:0/3082668052 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0031b30 con 0x7f59b0144770 2023-11-24T06:17:02.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59af59e640 1 -- 172.21.15.22:0/3082668052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b0144770 msgr2=0x7f59b015eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59af59e640 1 --2- 172.21.15.22:0/3082668052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b0144770 0x7f59b015eb60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009870 tx=0x7f59a002b8f0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59af59e640 1 -- 172.21.15.22:0/3082668052 shutdown_connections 2023-11-24T06:17:02.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59af59e640 1 --2- 172.21.15.22:0/3082668052 >> v2:172.21.15.31:3300/0 conn(0x7f59b006c9d0 0x7f59b006ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59af59e640 1 --2- 172.21.15.22:0/3082668052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59b00b35a0 0x7f59b015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59af59e640 1 --2- 172.21.15.22:0/3082668052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b0144770 0x7f59b015eb60 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.994+0000 7f59af59e640 1 -- 172.21.15.22:0/3082668052 >> 172.21.15.22:0/3082668052 conn(0x7f59b00cec10 msgr2=0x7f59b00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:02.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.995+0000 7f59af59e640 1 -- 172.21.15.22:0/3082668052 shutdown_connections 2023-11-24T06:17:02.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.995+0000 7f59af59e640 1 -- 172.21.15.22:0/3082668052 wait complete. 2023-11-24T06:17:02.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.996+0000 7f59af59e640 1 Processor -- start 2023-11-24T06:17:02.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.997+0000 7f59af59e640 1 -- start start 2023-11-24T06:17:03.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59af59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59b006c9d0 0x7f59b0152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59af59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b00b35a0 0x7f59b00ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59af59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59b0144770 0x7f59b0142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59af59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00aece0 con 0x7f59b00b35a0 2023-11-24T06:17:03.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59af59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00aefc0 con 0x7f59b006c9d0 2023-11-24T06:17:03.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59af59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00af2a0 con 0x7f59b0144770 2023-11-24T06:17:03.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59a7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b00b35a0 0x7f59b00ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59a7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b00b35a0 0x7f59b00ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33568/0 (socket says 172.21.15.22:33568) 2023-11-24T06:17:03.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59a7fff640 1 -- 172.21.15.22:0/2401237859 learned_addr learned my addr 172.21.15.22:0/2401237859 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:03.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59ae59c640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59b006c9d0 0x7f59b0152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59a7fff640 1 -- 172.21.15.22:0/2401237859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59b0144770 msgr2=0x7f59b0142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59a7fff640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59b0144770 0x7f59b0142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59a7fff640 1 -- 172.21.15.22:0/2401237859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59b006c9d0 msgr2=0x7f59b0152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59a7fff640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59b006c9d0 0x7f59b0152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59a7fff640 1 -- 172.21.15.22:0/2401237859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00094d0 con 0x7f59b00b35a0 2023-11-24T06:17:03.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.998+0000 7f59ae59c640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59b006c9d0 0x7f59b0152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:03.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.999+0000 7f59a7fff640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b00b35a0 0x7f59b00ae270 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f599800e9b0 tx=0x7f599800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:03.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.999+0000 7f59a6ffd640 1 -- 172.21.15.22:0/2401237859 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998009670 con 0x7f59b00b35a0 2023-11-24T06:17:03.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.999+0000 7f59a6ffd640 1 -- 172.21.15.22:0/2401237859 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599800c920 con 0x7f59b00b35a0 2023-11-24T06:17:03.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.999+0000 7f59a6ffd640 1 -- 172.21.15.22:0/2401237859 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599800ccd0 con 0x7f59b00b35a0 2023-11-24T06:17:03.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.999+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b00af580 con 0x7f59b00b35a0 2023-11-24T06:17:03.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:02.999+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b0152bb0 con 0x7f59b00b35a0 2023-11-24T06:17:03.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.000+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b004e840 con 0x7f59b00b35a0 2023-11-24T06:17:03.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.001+0000 7f59a6ffd640 1 -- 172.21.15.22:0/2401237859 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5998013470 con 0x7f59b00b35a0 2023-11-24T06:17:03.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.002+0000 7f59a6ffd640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f599006aff0 0x7f599006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.002+0000 7f59a6ffd640 1 -- 172.21.15.22:0/2401237859 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5998089c10 con 0x7f59b00b35a0 2023-11-24T06:17:03.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.002+0000 7f59ae59c640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f599006aff0 0x7f599006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.003+0000 7f59ae59c640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f599006aff0 0x7f599006d4b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f59a0036000 tx=0x7f59a003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:03.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.007+0000 7f59a6ffd640 1 -- 172.21.15.22:0/2401237859 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5998054910 con 0x7f59b00b35a0 2023-11-24T06:17:03.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.206+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f59b00b2460 con 0x7f59b00b35a0 2023-11-24T06:17:03.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.207+0000 7f59a6ffd640 1 -- 172.21.15.22:0/2401237859 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f59980210a0 con 0x7f59b00b35a0 2023-11-24T06:17:03.210 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f599006aff0 msgr2=0x7f599006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f599006aff0 0x7f599006d4b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f59a0036000 tx=0x7f59a003c040 comp rx=0 tx=0).stop 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b00b35a0 msgr2=0x7f59b00ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b00b35a0 0x7f59b00ae270 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f599800e9b0 tx=0x7f599800ee70 comp rx=0 tx=0).stop 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 shutdown_connections 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f599006aff0 0x7f599006d4b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f59b0144770 0x7f59b0142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b00b35a0 0x7f59b00ae270 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 --2- 172.21.15.22:0/2401237859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59b006c9d0 0x7f59b0152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 >> 172.21.15.22:0/2401237859 conn(0x7f59b00cec10 msgr2=0x7f59b0070920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:03.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 shutdown_connections 2023-11-24T06:17:03.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.210+0000 7f59af59e640 1 -- 172.21.15.22:0/2401237859 wait complete. 2023-11-24T06:17:03.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:17:03.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.453+0000 7f58257b3640 1 Processor -- start 2023-11-24T06:17:03.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.454+0000 7f58257b3640 1 -- start start 2023-11-24T06:17:03.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.455+0000 7f58257b3640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f582015efa0 0x7f5820161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.455+0000 7f58257b3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 0x7f582006c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.455+0000 7f58257b3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58200b2970 0x7f58200b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.455+0000 7f58257b3640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58200b32e0 con 0x7f582015efa0 2023-11-24T06:17:03.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.455+0000 7f58257b3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582006c9a0 con 0x7f58200b2970 2023-11-24T06:17:03.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.455+0000 7f58257b3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582006cc80 con 0x7f582006da40 2023-11-24T06:17:03.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.455+0000 7f581ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f582015efa0 0x7f5820161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.456+0000 7f581ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f582015efa0 0x7f5820161ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33582/0 (socket says 172.21.15.22:33582) 2023-11-24T06:17:03.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.456+0000 7f581ffff640 1 -- 172.21.15.22:0/2732750007 learned_addr learned my addr 172.21.15.22:0/2732750007 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:03.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.456+0000 7f5817fff640 1 --2- 172.21.15.22:0/2732750007 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 0x7f582006c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.456+0000 7f5824fb2640 1 --2- 172.21.15.22:0/2732750007 >> v2:172.21.15.31:3300/0 conn(0x7f58200b2970 0x7f58200b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.456+0000 7f581ffff640 1 -- 172.21.15.22:0/2732750007 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 msgr2=0x7f582006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:03.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.456+0000 7f581ffff640 1 --2- 172.21.15.22:0/2732750007 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 0x7f582006c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.456+0000 7f581ffff640 1 -- 172.21.15.22:0/2732750007 >> v2:172.21.15.31:3300/0 conn(0x7f58200b2970 msgr2=0x7f58200b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:03.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.456+0000 7f581ffff640 1 --2- 172.21.15.22:0/2732750007 >> v2:172.21.15.31:3300/0 conn(0x7f58200b2970 0x7f58200b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.456+0000 7f581ffff640 1 -- 172.21.15.22:0/2732750007 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582006cf60 con 0x7f582015efa0 2023-11-24T06:17:03.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.459+0000 7f581ffff640 1 --2- 172.21.15.22:0/2732750007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f582015efa0 0x7f5820161ac0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5820162000 tx=0x7f581002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed53fb6093ecd0f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:03.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f581f7fe640 1 -- 172.21.15.22:0/2732750007 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810031870 con 0x7f582015efa0 2023-11-24T06:17:03.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f581f7fe640 1 -- 172.21.15.22:0/2732750007 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58100319d0 con 0x7f582015efa0 2023-11-24T06:17:03.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f581f7fe640 1 -- 172.21.15.22:0/2732750007 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810031d60 con 0x7f582015efa0 2023-11-24T06:17:03.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f58257b3640 1 -- 172.21.15.22:0/2732750007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f582015efa0 msgr2=0x7f5820161ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f58257b3640 1 --2- 172.21.15.22:0/2732750007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f582015efa0 0x7f5820161ac0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5820162000 tx=0x7f581002b910 comp rx=0 tx=0).stop 2023-11-24T06:17:03.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f58257b3640 1 -- 172.21.15.22:0/2732750007 shutdown_connections 2023-11-24T06:17:03.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f58257b3640 1 --2- 172.21.15.22:0/2732750007 >> v2:172.21.15.31:3300/0 conn(0x7f58200b2970 0x7f58200b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f58257b3640 1 --2- 172.21.15.22:0/2732750007 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 0x7f582006c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f58257b3640 1 --2- 172.21.15.22:0/2732750007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f582015efa0 0x7f5820161ac0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.460+0000 7f58257b3640 1 -- 172.21.15.22:0/2732750007 >> 172.21.15.22:0/2732750007 conn(0x7f58200cec10 msgr2=0x7f58200cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:03.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.461+0000 7f58257b3640 1 -- 172.21.15.22:0/2732750007 shutdown_connections 2023-11-24T06:17:03.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.461+0000 7f58257b3640 1 -- 172.21.15.22:0/2732750007 wait complete. 2023-11-24T06:17:03.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.463+0000 7f58257b3640 1 Processor -- start 2023-11-24T06:17:03.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.463+0000 7f58257b3640 1 -- start start 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f58257b3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 0x7f5820155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f58257b3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58200b2970 0x7f58201f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f58257b3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58201541d0 0x7f5820156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f58257b3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5820155780 con 0x7f58201541d0 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f58257b3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58201f7630 con 0x7f58200b2970 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f58257b3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58201f78d0 con 0x7f582006da40 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f5824fb2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58201541d0 0x7f5820156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f5824fb2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58201541d0 0x7f5820156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33594/0 (socket says 172.21.15.22:33594) 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f5824fb2640 1 -- 172.21.15.22:0/2065151461 learned_addr learned my addr 172.21.15.22:0/2065151461 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:03.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.464+0000 7f5817fff640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58200b2970 0x7f58201f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f581ffff640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 0x7f5820155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f5824fb2640 1 -- 172.21.15.22:0/2065151461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 msgr2=0x7f5820155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f5824fb2640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 0x7f5820155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f5824fb2640 1 -- 172.21.15.22:0/2065151461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58200b2970 msgr2=0x7f58201f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f5824fb2640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58200b2970 0x7f58201f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f5824fb2640 1 -- 172.21.15.22:0/2065151461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58100094d0 con 0x7f58201541d0 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f5817fff640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58200b2970 0x7f58201f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f5824fb2640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58201541d0 0x7f5820156b40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f581800efc0 tx=0x7f581800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f581d7fa640 1 -- 172.21.15.22:0/2065151461 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818009ba0 con 0x7f58201541d0 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f581d7fa640 1 -- 172.21.15.22:0/2065151461 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581800f040 con 0x7f58201541d0 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f581d7fa640 1 -- 172.21.15.22:0/2065151461 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180146c0 con 0x7f58201541d0 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5820157540 con 0x7f58201541d0 2023-11-24T06:17:03.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.465+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5820157b00 con 0x7f58201541d0 2023-11-24T06:17:03.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.467+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5820157c90 con 0x7f58201541d0 2023-11-24T06:17:03.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.468+0000 7f581d7fa640 1 -- 172.21.15.22:0/2065151461 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5818014820 con 0x7f58201541d0 2023-11-24T06:17:03.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.469+0000 7f581d7fa640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f580006b020 0x7f580006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.469+0000 7f581d7fa640 1 -- 172.21.15.22:0/2065151461 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f581808a3f0 con 0x7f58201541d0 2023-11-24T06:17:03.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.469+0000 7f581ffff640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f580006b020 0x7f580006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.470+0000 7f581ffff640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f580006b020 0x7f580006d4e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5810036000 tx=0x7f581003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:03.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.475+0000 7f581d7fa640 1 -- 172.21.15.22:0/2065151461 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58180551a0 con 0x7f58201541d0 2023-11-24T06:17:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.671+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f582004e840 con 0x7f58201541d0 2023-11-24T06:17:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.672+0000 7f581d7fa640 1 -- 172.21.15.22:0/2065151461 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58180587c0 con 0x7f58201541d0 2023-11-24T06:17:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-11-24T06:17:03.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f580006b020 msgr2=0x7f580006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f580006b020 0x7f580006d4e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5810036000 tx=0x7f581003c040 comp rx=0 tx=0).stop 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58201541d0 msgr2=0x7f5820156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58201541d0 0x7f5820156b40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f581800efc0 tx=0x7f581800c490 comp rx=0 tx=0).stop 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 shutdown_connections 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f580006b020 0x7f580006d4e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58201541d0 0x7f5820156b40 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58200b2970 0x7f58201f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 --2- 172.21.15.22:0/2065151461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f582006da40 0x7f5820155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 >> 172.21.15.22:0/2065151461 conn(0x7f58200cec10 msgr2=0x7f5820161900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 shutdown_connections 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.675+0000 7f58257b3640 1 -- 172.21.15.22:0/2065151461 wait complete. 2023-11-24T06:17:03.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:03.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.917+0000 7fe2b8ecf640 1 Processor -- start 2023-11-24T06:17:03.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.917+0000 7fe2b8ecf640 1 -- start start 2023-11-24T06:17:03.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.918+0000 7fe2b8ecf640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2b415b270 0x7fe2b406e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.918+0000 7fe2b8ecf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe2b40ce880 0x7fe2b40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.918+0000 7fe2b8ecf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40cecb0 con 0x7fe2b40cb970 2023-11-24T06:17:03.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.918+0000 7fe2b8ecf640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40cc340 con 0x7fe2b415b270 2023-11-24T06:17:03.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.918+0000 7fe2b8ecf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b406d590 con 0x7fe2b40ce880 2023-11-24T06:17:03.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.919+0000 7fe2b259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2b415b270 0x7fe2b406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.919+0000 7fe2b259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2b415b270 0x7fe2b406e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33606/0 (socket says 172.21.15.22:33606) 2023-11-24T06:17:03.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.919+0000 7fe2b259c640 1 -- 172.21.15.22:0/1782013188 learned_addr learned my addr 172.21.15.22:0/1782013188 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:03.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.919+0000 7fe2b259c640 1 -- 172.21.15.22:0/1782013188 >> v2:172.21.15.31:3300/0 conn(0x7fe2b40ce880 msgr2=0x7fe2b40cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:03.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.919+0000 7fe2b2d9d640 1 --2- 172.21.15.22:0/1782013188 >> v2:172.21.15.31:3300/0 conn(0x7fe2b40ce880 0x7fe2b40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.920+0000 7fe2b259c640 1 --2- 172.21.15.22:0/1782013188 >> v2:172.21.15.31:3300/0 conn(0x7fe2b40ce880 0x7fe2b40cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.920+0000 7fe2b259c640 1 -- 172.21.15.22:0/1782013188 >> v1:172.21.15.31:6789/0 conn(0x7fe2b40cb970 legacy=0x7fe2b40ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:03.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.920+0000 7fe2b259c640 1 -- 172.21.15.22:0/1782013188 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b406d870 con 0x7fe2b415b270 2023-11-24T06:17:03.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.920+0000 7fe2b2d9d640 1 --2- 172.21.15.22:0/1782013188 >> v2:172.21.15.31:3300/0 conn(0x7fe2b40ce880 0x7fe2b40cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:03.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.921+0000 7fe2b259c640 1 --2- 172.21.15.22:0/1782013188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b415b270 0x7fe2b406e350 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40ae0a0 tx=0x7fe2a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50377ee5963216e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:03.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.921+0000 7fe2b159a640 1 -- 172.21.15.22:0/1782013188 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40317e0 con 0x7fe2b415b270 2023-11-24T06:17:03.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.921+0000 7fe2b159a640 1 -- 172.21.15.22:0/1782013188 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4031940 con 0x7fe2b415b270 2023-11-24T06:17:03.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.921+0000 7fe2b159a640 1 -- 172.21.15.22:0/1782013188 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4031cd0 con 0x7fe2b415b270 2023-11-24T06:17:03.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.922+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1782013188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b415b270 msgr2=0x7fe2b406e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.922+0000 7fe2b8ecf640 1 --2- 172.21.15.22:0/1782013188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b415b270 0x7fe2b406e350 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40ae0a0 tx=0x7fe2a402b880 comp rx=0 tx=0).stop 2023-11-24T06:17:03.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.922+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1782013188 shutdown_connections 2023-11-24T06:17:03.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.922+0000 7fe2b8ecf640 1 --2- 172.21.15.22:0/1782013188 >> v2:172.21.15.31:3300/0 conn(0x7fe2b40ce880 0x7fe2b40cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.922+0000 7fe2b8ecf640 1 --2- 172.21.15.22:0/1782013188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b415b270 0x7fe2b406e350 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.922+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1782013188 >> 172.21.15.22:0/1782013188 conn(0x7fe2b40b0c10 msgr2=0x7fe2b40b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:03.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.922+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1782013188 shutdown_connections 2023-11-24T06:17:03.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.922+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1782013188 wait complete. 2023-11-24T06:17:03.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.924+0000 7fe2b8ecf640 1 Processor -- start 2023-11-24T06:17:03.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.924+0000 7fe2b8ecf640 1 -- start start 2023-11-24T06:17:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.925+0000 7fe2b8ecf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b40cb970 0x7fe2b409c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.925+0000 7fe2b8ecf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b40ce880 0x7fe2b41479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.925+0000 7fe2b8ecf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b415b270 0x7fe2b4150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.925+0000 7fe2b8ecf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415c120 con 0x7fe2b40cb970 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.925+0000 7fe2b8ecf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4071d70 con 0x7fe2b415b270 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.925+0000 7fe2b8ecf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4071a90 con 0x7fe2b40ce880 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b40cb970 0x7fe2b409c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b40cb970 0x7fe2b409c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33616/0 (socket says 172.21.15.22:33616) 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b259c640 1 -- 172.21.15.22:0/1638271842 learned_addr learned my addr 172.21.15.22:0/1638271842 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b1d9b640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b40ce880 0x7fe2b41479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b2d9d640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b415b270 0x7fe2b4150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b259c640 1 -- 172.21.15.22:0/1638271842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b40ce880 msgr2=0x7fe2b41479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b259c640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b40ce880 0x7fe2b41479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b259c640 1 -- 172.21.15.22:0/1638271842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b415b270 msgr2=0x7fe2b4150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b259c640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b415b270 0x7fe2b4150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.926+0000 7fe2b259c640 1 -- 172.21.15.22:0/1638271842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a40094d0 con 0x7fe2b40cb970 2023-11-24T06:17:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.927+0000 7fe2b259c640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b40cb970 0x7fe2b409c450 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4000c00 tx=0x7fe2a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.927+0000 7fe2a2ffd640 1 -- 172.21.15.22:0/1638271842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40329c0 con 0x7fe2b40cb970 2023-11-24T06:17:03.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.927+0000 7fe2a2ffd640 1 -- 172.21.15.22:0/1638271842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4032b40 con 0x7fe2b40cb970 2023-11-24T06:17:03.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.927+0000 7fe2a2ffd640 1 -- 172.21.15.22:0/1638271842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40453f0 con 0x7fe2b40cb970 2023-11-24T06:17:03.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.927+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b415ba60 con 0x7fe2b40cb970 2023-11-24T06:17:03.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.927+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b4147f30 con 0x7fe2b40cb970 2023-11-24T06:17:03.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.928+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b409d270 con 0x7fe2b40cb970 2023-11-24T06:17:03.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.929+0000 7fe2a2ffd640 1 -- 172.21.15.22:0/1638271842 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe2a4045550 con 0x7fe2b40cb970 2023-11-24T06:17:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.930+0000 7fe2a2ffd640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406aff0 0x7fe29406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.930+0000 7fe2a2ffd640 1 -- 172.21.15.22:0/1638271842 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2a40abed0 con 0x7fe2b40cb970 2023-11-24T06:17:03.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.931+0000 7fe2b1d9b640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406aff0 0x7fe29406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:03.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.932+0000 7fe2b1d9b640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406aff0 0x7fe29406d4b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8006fd0 tx=0x7fe2a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:03.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:03.935+0000 7fe2a2ffd640 1 -- 172.21.15.22:0/1638271842 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2a4076d00 con 0x7fe2b40cb970 2023-11-24T06:17:04.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.166+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2b404e920 con 0x7fe2b40cb970 2023-11-24T06:17:04.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.167+0000 7fe2a2ffd640 1 -- 172.21.15.22:0/1638271842 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fe2a407a320 con 0x7fe2b40cb970 2023-11-24T06:17:04.170 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3364238617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3364238617},{"type":"v1","addr":"172.21.15.31:6835","nonce":3364238617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6420,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/1299665813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1299665813},{"type":"v1","addr":"172.21.15.22:6836","nonce":1299665813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1568499503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1568499503},{"type":"v1","addr":"172.21.15.22:6837","nonce":1568499503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:34.218301+0000","modified":"2023-11-24T06:16:37.280807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6435":{"gid":6435,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2376501260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2376501260},{"type":"v1","addr":"172.21.15.31:6834","nonce":2376501260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:17:04.170 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 35 2023-11-24T06:17:04.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406aff0 msgr2=0x7fe29406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406aff0 0x7fe29406d4b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8006fd0 tx=0x7fe2a8008040 comp rx=0 tx=0).stop 2023-11-24T06:17:04.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b40cb970 msgr2=0x7fe2b409c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b40cb970 0x7fe2b409c450 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4000c00 tx=0x7fe2a40046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 shutdown_connections 2023-11-24T06:17:04.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe29406aff0 0x7fe29406d4b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b415b270 0x7fe2b4150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b40ce880 0x7fe2b41479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 --2- 172.21.15.22:0/1638271842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2b40cb970 0x7fe2b409c450 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.170+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 >> 172.21.15.22:0/1638271842 conn(0x7fe2b40b0c10 msgr2=0x7fe2b40af520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:04.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.171+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 shutdown_connections 2023-11-24T06:17:04.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.171+0000 7fe2b8ecf640 1 -- 172.21.15.22:0/1638271842 wait complete. 2023-11-24T06:17:04.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:04.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.410+0000 7fea5d652640 1 Processor -- start 2023-11-24T06:17:04.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.410+0000 7fea5d652640 1 -- start start 2023-11-24T06:17:04.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.412+0000 7fea5d652640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fea580cf760 0x7fea5806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.412+0000 7fea5d652640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea58165ca0 con 0x7fea5814b1c0 2023-11-24T06:17:04.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.412+0000 7fea5d652640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea58165f80 con 0x7fea58162670 2023-11-24T06:17:04.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.412+0000 7fea5d652640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea58161e70 con 0x7fea580cf760 2023-11-24T06:17:04.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.413+0000 7fea57fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fea5814b1c0 0x7fea581651a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33206/0 (socket says 172.21.15.22:33206) 2023-11-24T06:17:04.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.413+0000 7fea57fff640 1 -- 172.21.15.22:0/4195895745 learned_addr learned my addr 172.21.15.22:0/4195895745 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:04.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.413+0000 7fea5ce51640 1 --2- 172.21.15.22:0/4195895745 >> v2:172.21.15.31:3300/0 conn(0x7fea580cf760 0x7fea5806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.413+0000 7fea577fe640 1 -- 172.21.15.22:0/4195895745 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890640650 0 0) 0x7fea58165ca0 con 0x7fea5814b1c0 2023-11-24T06:17:04.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.413+0000 7fea577fe640 1 -- 172.21.15.22:0/4195895745 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea44003520 con 0x7fea5814b1c0 2023-11-24T06:17:04.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.414+0000 7fea5ce51640 1 -- 172.21.15.22:0/4195895745 >> v1:172.21.15.31:6789/0 conn(0x7fea58162670 legacy=0x7fea580cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.414+0000 7fea5ce51640 1 -- 172.21.15.22:0/4195895745 >> v1:172.21.15.22:6789/0 conn(0x7fea5814b1c0 legacy=0x7fea581651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.414+0000 7fea577fe640 1 -- 172.21.15.22:0/4195895745 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1630830857 0 0) 0x7fea44003520 con 0x7fea5814b1c0 2023-11-24T06:17:04.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.414+0000 7fea5ce51640 1 -- 172.21.15.22:0/4195895745 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58162150 con 0x7fea580cf760 2023-11-24T06:17:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.416+0000 7fea5ce51640 1 --2- 172.21.15.22:0/4195895745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea580cf760 0x7fea5806c640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fea50009d90 tx=0x7fea5002bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6358c78325c36304 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.416+0000 7fea577fe640 1 -- 172.21.15.22:0/4195895745 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48001670 con 0x7fea580cf760 2023-11-24T06:17:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.416+0000 7fea577fe640 1 -- 172.21.15.22:0/4195895745 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5002c8b0 con 0x7fea580cf760 2023-11-24T06:17:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.416+0000 7fea577fe640 1 -- 172.21.15.22:0/4195895745 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5002cc40 con 0x7fea580cf760 2023-11-24T06:17:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.417+0000 7fea5d652640 1 -- 172.21.15.22:0/4195895745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea580cf760 msgr2=0x7fea5806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.417+0000 7fea5d652640 1 --2- 172.21.15.22:0/4195895745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea580cf760 0x7fea5806c640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fea50009d90 tx=0x7fea5002bd80 comp rx=0 tx=0).stop 2023-11-24T06:17:04.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.418+0000 7fea5d652640 1 -- 172.21.15.22:0/4195895745 shutdown_connections 2023-11-24T06:17:04.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.418+0000 7fea5d652640 1 --2- 172.21.15.22:0/4195895745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea580cf760 0x7fea5806c640 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.418+0000 7fea5d652640 1 -- 172.21.15.22:0/4195895745 >> 172.21.15.22:0/4195895745 conn(0x7fea5806a860 msgr2=0x7fea5806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:04.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.418+0000 7fea5d652640 1 -- 172.21.15.22:0/4195895745 shutdown_connections 2023-11-24T06:17:04.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.418+0000 7fea5d652640 1 -- 172.21.15.22:0/4195895745 wait complete. 2023-11-24T06:17:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.419+0000 7fea5d652640 1 Processor -- start 2023-11-24T06:17:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.420+0000 7fea5d652640 1 -- start start 2023-11-24T06:17:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea5d652640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea580cf760 0x7fea58153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea5d652640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5814b1c0 0x7fea58149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea5d652640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea58162670 0x7fea5806db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea5d652640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5814aa70 con 0x7fea58162670 2023-11-24T06:17:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea5d652640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580cb640 con 0x7fea580cf760 2023-11-24T06:17:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea5d652640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea581515a0 con 0x7fea5814b1c0 2023-11-24T06:17:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea5ce51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea58162670 0x7fea5806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea5ce51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea58162670 0x7fea5806db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33630/0 (socket says 172.21.15.22:33630) 2023-11-24T06:17:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea5ce51640 1 -- 172.21.15.22:0/446266058 learned_addr learned my addr 172.21.15.22:0/446266058 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea57fff640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea580cf760 0x7fea58153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.421+0000 7fea4ffff640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5814b1c0 0x7fea58149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.422+0000 7fea5ce51640 1 -- 172.21.15.22:0/446266058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5814b1c0 msgr2=0x7fea58149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.422+0000 7fea5ce51640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5814b1c0 0x7fea58149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.422+0000 7fea5ce51640 1 -- 172.21.15.22:0/446266058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea580cf760 msgr2=0x7fea58153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.422+0000 7fea5ce51640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea580cf760 0x7fea58153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.422+0000 7fea5ce51640 1 -- 172.21.15.22:0/446266058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009a70 con 0x7fea58162670 2023-11-24T06:17:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.422+0000 7fea5ce51640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea58162670 0x7fea5806db60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fea50009d90 tx=0x7fea50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.422+0000 7fea557fa640 1 -- 172.21.15.22:0/446266058 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5002cea0 con 0x7fea58162670 2023-11-24T06:17:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.422+0000 7fea557fa640 1 -- 172.21.15.22:0/446266058 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea50034c00 con 0x7fea58162670 2023-11-24T06:17:04.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.422+0000 7fea557fa640 1 -- 172.21.15.22:0/446266058 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50003990 con 0x7fea58162670 2023-11-24T06:17:04.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.423+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5814a510 con 0x7fea58162670 2023-11-24T06:17:04.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.423+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea58150f50 con 0x7fea58162670 2023-11-24T06:17:04.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.424+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea58150db0 con 0x7fea58162670 2023-11-24T06:17:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.425+0000 7fea557fa640 1 -- 172.21.15.22:0/446266058 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fea5003f420 con 0x7fea58162670 2023-11-24T06:17:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.426+0000 7fea557fa640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea3806b020 0x7fea3806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.426+0000 7fea557fa640 1 -- 172.21.15.22:0/446266058 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea500ac310 con 0x7fea58162670 2023-11-24T06:17:04.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.426+0000 7fea57fff640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea3806b020 0x7fea3806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.427+0000 7fea57fff640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea3806b020 0x7fea3806d4e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fea58150c80 tx=0x7fea48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:04.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.430+0000 7fea557fa640 1 -- 172.21.15.22:0/446266058 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea58150db0 con 0x7fea58162670 2023-11-24T06:17:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.629+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea58150db0 con 0x7fea58162670 2023-11-24T06:17:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.630+0000 7fea557fa640 1 -- 172.21.15.22:0/446266058 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fea58150db0 con 0x7fea58162670 2023-11-24T06:17:04.651 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:04.651 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:35.760665+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:32.153129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:33.228812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:04.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea3806b020 msgr2=0x7fea3806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea3806b020 0x7fea3806d4e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fea58150c80 tx=0x7fea48009040 comp rx=0 tx=0).stop 2023-11-24T06:17:04.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea58162670 msgr2=0x7fea5806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea58162670 0x7fea5806db60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fea50009d90 tx=0x7fea50004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 shutdown_connections 2023-11-24T06:17:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fea3806b020 0x7fea3806d4e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea58162670 0x7fea5806db60 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5814b1c0 0x7fea58149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 --2- 172.21.15.22:0/446266058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea580cf760 0x7fea58153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.633+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 >> 172.21.15.22:0/446266058 conn(0x7fea5806a860 msgr2=0x7fea58147ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.634+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 shutdown_connections 2023-11-24T06:17:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.634+0000 7fea5d652640 1 -- 172.21.15.22:0/446266058 wait complete. 2023-11-24T06:17:04.655 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:17:04.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:04.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.865+0000 7f7dcac39640 1 Processor -- start 2023-11-24T06:17:04.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.865+0000 7f7dcac39640 1 -- start start 2023-11-24T06:17:04.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.867+0000 7f7dcac39640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 0x7f7dc4162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.867+0000 7f7dcac39640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7dc40cf760 0x7f7dc41655e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.867+0000 7f7dcac39640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc4162bb0 con 0x7f7dc41651a0 2023-11-24T06:17:04.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.867+0000 7f7dcac39640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc4165ca0 con 0x7f7dc40cf760 2023-11-24T06:17:04.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.867+0000 7f7dcac39640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4165f80 con 0x7f7dc414b1c0 2023-11-24T06:17:04.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.867+0000 7f7dca438640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7dc40cf760 0x7f7dc41655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.867+0000 7f7dca438640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7dc40cf760 0x7f7dc41655e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33646/0 (socket says 172.21.15.22:33646) 2023-11-24T06:17:04.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.867+0000 7f7dca438640 1 -- 172.21.15.22:0/113077902 learned_addr learned my addr 172.21.15.22:0/113077902 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:04.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.868+0000 7f7dc9c37640 1 --2- 172.21.15.22:0/113077902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 0x7f7dc4162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.868+0000 7f7dca438640 1 -- 172.21.15.22:0/113077902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 msgr2=0x7f7dc4162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:04.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.868+0000 7f7dca438640 1 --2- 172.21.15.22:0/113077902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 0x7f7dc4162670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.868+0000 7f7dca438640 1 -- 172.21.15.22:0/113077902 >> v1:172.21.15.31:6789/0 conn(0x7f7dc41651a0 legacy=0x7f7dc40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:04.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.868+0000 7f7dca438640 1 -- 172.21.15.22:0/113077902 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4161e70 con 0x7f7dc40cf760 2023-11-24T06:17:04.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.869+0000 7f7dca438640 1 --2- 172.21.15.22:0/113077902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc40cf760 0x7f7dc41655e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009e50 tx=0x7f7dbc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388b5bfda85c4eb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.869+0000 7f7dc8c35640 1 -- 172.21.15.22:0/113077902 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc02c9f0 con 0x7f7dc40cf760 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.869+0000 7f7dc8c35640 1 -- 172.21.15.22:0/113077902 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc02cb50 con 0x7f7dc40cf760 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.869+0000 7f7dc8c35640 1 -- 172.21.15.22:0/113077902 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0343f0 con 0x7f7dc40cf760 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.870+0000 7f7dcac39640 1 -- 172.21.15.22:0/113077902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc40cf760 msgr2=0x7f7dc41655e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.870+0000 7f7dcac39640 1 --2- 172.21.15.22:0/113077902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc40cf760 0x7f7dc41655e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009e50 tx=0x7f7dbc02be50 comp rx=0 tx=0).stop 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.870+0000 7f7dcac39640 1 -- 172.21.15.22:0/113077902 shutdown_connections 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.870+0000 7f7dcac39640 1 --2- 172.21.15.22:0/113077902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc40cf760 0x7f7dc41655e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.870+0000 7f7dcac39640 1 --2- 172.21.15.22:0/113077902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 0x7f7dc4162670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.870+0000 7f7dcac39640 1 -- 172.21.15.22:0/113077902 >> 172.21.15.22:0/113077902 conn(0x7f7dc406a860 msgr2=0x7f7dc406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.870+0000 7f7dcac39640 1 -- 172.21.15.22:0/113077902 shutdown_connections 2023-11-24T06:17:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.870+0000 7f7dcac39640 1 -- 172.21.15.22:0/113077902 wait complete. 2023-11-24T06:17:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.872+0000 7f7dcac39640 1 Processor -- start 2023-11-24T06:17:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.873+0000 7f7dcac39640 1 -- start start 2023-11-24T06:17:04.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dcac39640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dc40cf760 0x7f7dc4145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dcac39640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 0x7f7dc4160480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dcac39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc41651a0 0x7f7dc415e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dcac39640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41457a0 con 0x7f7dc41651a0 2023-11-24T06:17:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dcac39640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc415f3e0 con 0x7f7dc40cf760 2023-11-24T06:17:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dcac39640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc415f6c0 con 0x7f7dc414b1c0 2023-11-24T06:17:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dca438640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc41651a0 0x7f7dc415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dca438640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc41651a0 0x7f7dc415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33662/0 (socket says 172.21.15.22:33662) 2023-11-24T06:17:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dca438640 1 -- 172.21.15.22:0/3808348564 learned_addr learned my addr 172.21.15.22:0/3808348564 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dc9c37640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dc40cf760 0x7f7dc4145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.874+0000 7f7dc9436640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 0x7f7dc4160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dca438640 1 -- 172.21.15.22:0/3808348564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 msgr2=0x7f7dc4160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dca438640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 0x7f7dc4160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dca438640 1 -- 172.21.15.22:0/3808348564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dc40cf760 msgr2=0x7f7dc4145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dca438640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dc40cf760 0x7f7dc4145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dca438640 1 -- 172.21.15.22:0/3808348564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009b30 con 0x7f7dc41651a0 2023-11-24T06:17:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dca438640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc41651a0 0x7f7dc415e550 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc036040 tx=0x7f7dbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dba7fc640 1 -- 172.21.15.22:0/3808348564 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc03e450 con 0x7f7dc41651a0 2023-11-24T06:17:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dba7fc640 1 -- 172.21.15.22:0/3808348564 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc03e5d0 con 0x7f7dc41651a0 2023-11-24T06:17:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dba7fc640 1 -- 172.21.15.22:0/3808348564 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc03e980 con 0x7f7dc41651a0 2023-11-24T06:17:04.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.875+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc415f9a0 con 0x7f7dc41651a0 2023-11-24T06:17:04.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.876+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc415ff60 con 0x7f7dc41651a0 2023-11-24T06:17:04.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.877+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc406c5c0 con 0x7f7dc41651a0 2023-11-24T06:17:04.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.878+0000 7f7dba7fc640 1 -- 172.21.15.22:0/3808348564 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7dbc03eae0 con 0x7f7dc41651a0 2023-11-24T06:17:04.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.879+0000 7f7dba7fc640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7da806b040 0x7f7da806d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.879+0000 7f7dba7fc640 1 -- 172.21.15.22:0/3808348564 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dbc0ac760 con 0x7f7dc41651a0 2023-11-24T06:17:04.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.879+0000 7f7dc9c37640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7da806b040 0x7f7da806d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.880+0000 7f7dc9c37640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7da806b040 0x7f7da806d500 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000a970 tx=0x7f7dc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:04.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:04.884+0000 7f7dba7fc640 1 -- 172.21.15.22:0/3808348564 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7dbc077600 con 0x7f7dc41651a0 2023-11-24T06:17:05.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.122+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dc404e840 con 0x7f7dc41651a0 2023-11-24T06:17:05.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.123+0000 7f7dba7fc640 1 -- 172.21.15.22:0/3808348564 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f7dbc07ac20 con 0x7f7dc41651a0 2023-11-24T06:17:05.126 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:05.126 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3364238617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3364238617},{"type":"v1","addr":"172.21.15.31:6835","nonce":3364238617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6420,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/1299665813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1299665813},{"type":"v1","addr":"172.21.15.22:6836","nonce":1299665813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1568499503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1568499503},{"type":"v1","addr":"172.21.15.22:6837","nonce":1568499503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:34.218301+0000","modified":"2023-11-24T06:16:37.280807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6435":{"gid":6435,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2376501260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2376501260},{"type":"v1","addr":"172.21.15.31:6834","nonce":2376501260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:17:05.127 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 35 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7da806b040 msgr2=0x7f7da806d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7da806b040 0x7f7da806d500 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000a970 tx=0x7f7dc0008040 comp rx=0 tx=0).stop 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc41651a0 msgr2=0x7f7dc415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc41651a0 0x7f7dc415e550 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc036040 tx=0x7f7dbc004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 shutdown_connections 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7da806b040 0x7f7da806d500 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7dc41651a0 0x7f7dc415e550 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7dc414b1c0 0x7f7dc4160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 --2- 172.21.15.22:0/3808348564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dc40cf760 0x7f7dc4145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 >> 172.21.15.22:0/3808348564 conn(0x7f7dc406a860 msgr2=0x7f7dc40b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:05.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 shutdown_connections 2023-11-24T06:17:05.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.126+0000 7f7dcac39640 1 -- 172.21.15.22:0/3808348564 wait complete. 2023-11-24T06:17:05.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.366+0000 7f0059c60640 1 Processor -- start 2023-11-24T06:17:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.366+0000 7f0059c60640 1 -- start start 2023-11-24T06:17:05.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.367+0000 7f0059c60640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00540cf500 0x7f00540cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.368+0000 7f0059c60640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0054140900 con 0x7f00540cf050 2023-11-24T06:17:05.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.368+0000 7f0059c60640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005415fa70 con 0x7f005413dfd0 2023-11-24T06:17:05.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.368+0000 7f0059c60640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005415c580 con 0x7f00540cf500 2023-11-24T06:17:05.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.368+0000 7f0053fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f00540cf050 0x7f00540cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33222/0 (socket says 172.21.15.22:33222) 2023-11-24T06:17:05.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.368+0000 7f0053fff640 1 -- 172.21.15.22:0/3091969458 learned_addr learned my addr 172.21.15.22:0/3091969458 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:05.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.368+0000 7f005945f640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00540cf500 0x7f00540cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.368+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663620040 0 0) 0x7f0054140900 con 0x7f00540cf050 2023-11-24T06:17:05.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0044003520 con 0x7f00540cf050 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1087718046 0 0) 0x7f0044003520 con 0x7f00540cf050 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00540cf500 msgr2=0x7f00540cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00540cf500 0x7f00540cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 >> v1:172.21.15.31:6789/0 conn(0x7f005413dfd0 legacy=0x7f005415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540cf950 con 0x7f00540cf050 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f0040001690 con 0x7f00540cf050 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 >> v1:172.21.15.22:6789/0 conn(0x7f00540cf050 legacy=0x7f00540cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0044003a10 0x7f0044003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00540cf500 0x7f00440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0044004d00 0x7f0044005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005415c580 con 0x7f0044003a10 2023-11-24T06:17:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004400ba90 con 0x7f0044004d00 2023-11-24T06:17:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004400bc50 con 0x7f00540cf500 2023-11-24T06:17:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.369+0000 7f0058c5e640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0044003a10 0x7f0044003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.370+0000 7f005945f640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0044004d00 0x7f0044005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.370+0000 7f0053fff640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00540cf500 0x7f00440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.370+0000 7f0058c5e640 1 -- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00540cf500 msgr2=0x7f00440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.370+0000 7f0058c5e640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00540cf500 0x7f00440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.370+0000 7f0058c5e640 1 -- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0044004d00 msgr2=0x7f0044005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.370+0000 7f0058c5e640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0044004d00 0x7f0044005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.370+0000 7f0058c5e640 1 -- 172.21.15.22:0/3091969458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0044003520 con 0x7f0044003a10 2023-11-24T06:17:05.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.371+0000 7f0058c5e640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0044003a10 0x7f0044003e30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0048001720 tx=0x7f00440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dac50b6411f2588 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.371+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480052d0 con 0x7f0044003a10 2023-11-24T06:17:05.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.371+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004802e050 con 0x7f0044003a10 2023-11-24T06:17:05.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.371+0000 7f00537fe640 1 -- 172.21.15.22:0/3091969458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480035f0 con 0x7f0044003a10 2023-11-24T06:17:05.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.372+0000 7f0059c60640 1 -- 172.21.15.22:0/3091969458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0044003a10 msgr2=0x7f0044003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.372+0000 7f0059c60640 1 --2- 172.21.15.22:0/3091969458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0044003a10 0x7f0044003e30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0048001720 tx=0x7f00440057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.372+0000 7f005945f640 1 -- 172.21.15.22:0/3091969458 reap_dead start 2023-11-24T06:17:05.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.372+0000 7f0059c60640 1 -- 172.21.15.22:0/3091969458 shutdown_connections 2023-11-24T06:17:05.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.372+0000 7f0059c60640 1 -- 172.21.15.22:0/3091969458 >> 172.21.15.22:0/3091969458 conn(0x7f005406a860 msgr2=0x7f005406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:05.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.372+0000 7f0059c60640 1 -- 172.21.15.22:0/3091969458 shutdown_connections 2023-11-24T06:17:05.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.372+0000 7f0059c60640 1 -- 172.21.15.22:0/3091969458 wait complete. 2023-11-24T06:17:05.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.374+0000 7f0059c60640 1 Processor -- start 2023-11-24T06:17:05.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.374+0000 7f0059c60640 1 -- start start 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.375+0000 7f0059c60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0044003a10 0x7f0054155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.375+0000 7f0059c60640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005413f080 0x7f005413f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.375+0000 7f0059c60640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005413b1b0 0x7f005413b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.375+0000 7f0059c60640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005413fa40 con 0x7f005413f080 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.375+0000 7f0059c60640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005413a6f0 con 0x7f0044003a10 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.375+0000 7f0059c60640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0054139ae0 con 0x7f005413b1b0 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.375+0000 7f0053fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005413f080 0x7f005413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.375+0000 7f0053fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005413f080 0x7f005413f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33682/0 (socket says 172.21.15.22:33682) 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.375+0000 7f0053fff640 1 -- 172.21.15.22:0/515514202 learned_addr learned my addr 172.21.15.22:0/515514202 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f005945f640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005413b1b0 0x7f005413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f0053fff640 1 -- 172.21.15.22:0/515514202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005413b1b0 msgr2=0x7f005413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f0053fff640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005413b1b0 0x7f005413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f0053fff640 1 -- 172.21.15.22:0/515514202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0044003a10 msgr2=0x7f0054155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f0058c5e640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0044003a10 0x7f0054155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f0053fff640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0044003a10 0x7f0054155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f0053fff640 1 -- 172.21.15.22:0/515514202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054139dc0 con 0x7f005413f080 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f0053fff640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005413f080 0x7f005413f500 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f004000e730 tx=0x7f004000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f00517fa640 1 -- 172.21.15.22:0/515514202 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000ee40 con 0x7f005413f080 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f00517fa640 1 -- 172.21.15.22:0/515514202 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004000c870 con 0x7f005413f080 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f00517fa640 1 -- 172.21.15.22:0/515514202 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000cc20 con 0x7f005413f080 2023-11-24T06:17:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.376+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005413a0a0 con 0x7f005413f080 2023-11-24T06:17:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.377+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005413bb70 con 0x7f005413f080 2023-11-24T06:17:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.378+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005404e840 con 0x7f005413f080 2023-11-24T06:17:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.379+0000 7f00517fa640 1 -- 172.21.15.22:0/515514202 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f004001d460 con 0x7f005413f080 2023-11-24T06:17:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.380+0000 7f00517fa640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f003806b020 0x7f003806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.380+0000 7f00517fa640 1 -- 172.21.15.22:0/515514202 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0040089860 con 0x7f005413f080 2023-11-24T06:17:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.380+0000 7f0058c5e640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f003806b020 0x7f003806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.381+0000 7f0058c5e640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f003806b020 0x7f003806d4e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0048033000 tx=0x7f0048009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.384+0000 7f00517fa640 1 -- 172.21.15.22:0/515514202 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f00400545f0 con 0x7f005413f080 2023-11-24T06:17:05.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.617+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f005413a830 con 0x7f005413f080 2023-11-24T06:17:05.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.618+0000 7f00517fa640 1 -- 172.21.15.22:0/515514202 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f0040057c10 con 0x7f005413f080 2023-11-24T06:17:05.621 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:05.621 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3364238617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3364238617},{"type":"v1","addr":"172.21.15.31:6835","nonce":3364238617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6420,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/1299665813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1299665813},{"type":"v1","addr":"172.21.15.22:6836","nonce":1299665813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1568499503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1568499503},{"type":"v1","addr":"172.21.15.22:6837","nonce":1568499503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:34.218301+0000","modified":"2023-11-24T06:16:37.280807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6435":{"gid":6435,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2376501260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2376501260},{"type":"v1","addr":"172.21.15.31:6834","nonce":2376501260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:17:05.621 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 35 2023-11-24T06:17:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f003806b020 msgr2=0x7f003806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f003806b020 0x7f003806d4e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0048033000 tx=0x7f0048009030 comp rx=0 tx=0).stop 2023-11-24T06:17:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005413f080 msgr2=0x7f005413f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005413f080 0x7f005413f500 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f004000e730 tx=0x7f004000ebf0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 shutdown_connections 2023-11-24T06:17:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f003806b020 0x7f003806d4e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005413b1b0 0x7f005413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005413f080 0x7f005413f500 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 --2- 172.21.15.22:0/515514202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0044003a10 0x7f0054155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 >> 172.21.15.22:0/515514202 conn(0x7f005406a860 msgr2=0x7f005413cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 shutdown_connections 2023-11-24T06:17:05.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.621+0000 7f0059c60640 1 -- 172.21.15.22:0/515514202 wait complete. 2023-11-24T06:17:05.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:05.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.858+0000 7f46a6a09640 1 Processor -- start 2023-11-24T06:17:05.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.858+0000 7f46a6a09640 1 -- start start 2023-11-24T06:17:05.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.860+0000 7f46a6a09640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a014b1c0 0x7f46a0162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.860+0000 7f46a6a09640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a0162bb0 con 0x7f46a01651a0 2023-11-24T06:17:05.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.860+0000 7f46a6a09640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a0165ca0 con 0x7f46a00cf760 2023-11-24T06:17:05.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.860+0000 7f46a6a09640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0165f80 con 0x7f46a014b1c0 2023-11-24T06:17:05.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.860+0000 7f46a5206640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f46a01651a0 0x7f46a00cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33224/0 (socket says 172.21.15.22:33224) 2023-11-24T06:17:05.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.860+0000 7f46a5206640 1 -- 172.21.15.22:0/1398179526 learned_addr learned my addr 172.21.15.22:0/1398179526 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a5a07640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a014b1c0 0x7f46a0162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080466320 0 0) 0x7f46a0162bb0 con 0x7f46a01651a0 2023-11-24T06:17:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468c003520 con 0x7f46a01651a0 2023-11-24T06:17:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1470603535 0 0) 0x7f468c003520 con 0x7f46a01651a0 2023-11-24T06:17:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a014b1c0 msgr2=0x7f46a0162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a014b1c0 0x7f46a0162670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 >> v1:172.21.15.31:6789/0 conn(0x7f46a00cf760 legacy=0x7f46a006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0161e70 con 0x7f46a01651a0 2023-11-24T06:17:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f4690001670 con 0x7f46a01651a0 2023-11-24T06:17:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 >> v1:172.21.15.22:6789/0 conn(0x7f46a01651a0 legacy=0x7f46a00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c003a10 0x7f468c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.861+0000 7f46a4a05640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f468c0047c0 0x7f468c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.862+0000 7f46a4a05640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a014b1c0 0x7f468c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.862+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0165f80 con 0x7f468c003a10 2023-11-24T06:17:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.862+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c00bb40 con 0x7f468c0047c0 2023-11-24T06:17:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.862+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c00bd00 con 0x7f46a014b1c0 2023-11-24T06:17:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.862+0000 7f46a5a07640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c003a10 0x7f468c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.862+0000 7f46a5206640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f468c0047c0 0x7f468c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.862+0000 7f46a6208640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a014b1c0 0x7f468c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.862+0000 7f46a5a07640 1 -- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a014b1c0 msgr2=0x7f468c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.863+0000 7f46a5a07640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a014b1c0 0x7f468c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.863+0000 7f46a5a07640 1 -- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f468c0047c0 msgr2=0x7f468c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.863+0000 7f46a5a07640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f468c0047c0 0x7f468c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.863+0000 7f46a5a07640 1 -- 172.21.15.22:0/1398179526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c003520 con 0x7f468c003a10 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.864+0000 7f46a5a07640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c003a10 0x7f468c003e30 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f469c009a90 tx=0x7f468c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8654714f8a66c4d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.864+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c02c680 con 0x7f468c003a10 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.864+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c02c7e0 con 0x7f468c003a10 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.864+0000 7f46a4a05640 1 -- 172.21.15.22:0/1398179526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c02cb70 con 0x7f468c003a10 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.865+0000 7f46a6a09640 1 -- 172.21.15.22:0/1398179526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c003a10 msgr2=0x7f468c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.865+0000 7f46a6a09640 1 --2- 172.21.15.22:0/1398179526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c003a10 0x7f468c003e30 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f469c009a90 tx=0x7f468c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.865+0000 7f46a6208640 1 -- 172.21.15.22:0/1398179526 reap_dead start 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.865+0000 7f46a6a09640 1 -- 172.21.15.22:0/1398179526 shutdown_connections 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.865+0000 7f46a6a09640 1 -- 172.21.15.22:0/1398179526 >> 172.21.15.22:0/1398179526 conn(0x7f46a006a860 msgr2=0x7f46a006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.865+0000 7f46a6a09640 1 -- 172.21.15.22:0/1398179526 shutdown_connections 2023-11-24T06:17:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.865+0000 7f46a6a09640 1 -- 172.21.15.22:0/1398179526 wait complete. 2023-11-24T06:17:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.868+0000 7f46a6a09640 1 Processor -- start 2023-11-24T06:17:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.868+0000 7f46a6a09640 1 -- start start 2023-11-24T06:17:05.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.869+0000 7f46a6a09640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f468c003a10 0x7f46a0160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.869+0000 7f46a6a09640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a01f77a0 0x7f46a01eb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.869+0000 7f46a6a09640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01eb750 0x7f46a01631b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.869+0000 7f46a6a09640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01488d0 con 0x7f46a01eb750 2023-11-24T06:17:05.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.869+0000 7f46a6a09640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0148b70 con 0x7f468c003a10 2023-11-24T06:17:05.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.869+0000 7f46a6a09640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0148e50 con 0x7f46a01f77a0 2023-11-24T06:17:05.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a6208640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01eb750 0x7f46a01631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a6208640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01eb750 0x7f46a01631b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33704/0 (socket says 172.21.15.22:33704) 2023-11-24T06:17:05.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a6208640 1 -- 172.21.15.22:0/1494856724 learned_addr learned my addr 172.21.15.22:0/1494856724 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:05.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a5a07640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f468c003a10 0x7f46a0160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a5206640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a01f77a0 0x7f46a01eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a6208640 1 -- 172.21.15.22:0/1494856724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a01f77a0 msgr2=0x7f46a01eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a6208640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a01f77a0 0x7f46a01eb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a6208640 1 -- 172.21.15.22:0/1494856724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f468c003a10 msgr2=0x7f46a0160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a6208640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f468c003a10 0x7f46a0160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a6208640 1 -- 172.21.15.22:0/1494856724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0149130 con 0x7f46a01eb750 2023-11-24T06:17:05.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.870+0000 7f46a6208640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01eb750 0x7f46a01631b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4698007fd0 tx=0x7f469800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.871+0000 7f46967fc640 1 -- 172.21.15.22:0/1494856724 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698003970 con 0x7f46a01eb750 2023-11-24T06:17:05.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.871+0000 7f46967fc640 1 -- 172.21.15.22:0/1494856724 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4698003ad0 con 0x7f46a01eb750 2023-11-24T06:17:05.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.871+0000 7f46967fc640 1 -- 172.21.15.22:0/1494856724 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698003e80 con 0x7f46a01eb750 2023-11-24T06:17:05.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.871+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a01ebcd0 con 0x7f46a01eb750 2023-11-24T06:17:05.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.871+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a0160c50 con 0x7f46a01eb750 2023-11-24T06:17:05.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.873+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a01edf80 con 0x7f46a01eb750 2023-11-24T06:17:05.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.874+0000 7f46967fc640 1 -- 172.21.15.22:0/1494856724 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f46980050d0 con 0x7f46a01eb750 2023-11-24T06:17:05.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.874+0000 7f46967fc640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f468406b020 0x7f468406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.875+0000 7f46967fc640 1 -- 172.21.15.22:0/1494856724 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4698089720 con 0x7f46a01eb750 2023-11-24T06:17:05.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.875+0000 7f46a5a07640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f468406b020 0x7f468406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.876+0000 7f46a5a07640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f468406b020 0x7f468406d4e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f469c036000 tx=0x7f469c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:05.879+0000 7f46967fc640 1 -- 172.21.15.22:0/1494856724 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4698054540 con 0x7f46a01eb750 2023-11-24T06:17:06.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.072+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46a004e840 con 0x7f46a01eb750 2023-11-24T06:17:06.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.075+0000 7f46967fc640 1 -- 172.21.15.22:0/1494856724 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f4698057b60 con 0x7f46a01eb750 2023-11-24T06:17:06.078 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:06.078 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:16:35.760665+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:32.153129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:33.228812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:06.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f468406b020 msgr2=0x7f468406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f468406b020 0x7f468406d4e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f469c036000 tx=0x7f469c030000 comp rx=0 tx=0).stop 2023-11-24T06:17:06.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01eb750 msgr2=0x7f46a01631b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01eb750 0x7f46a01631b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4698007fd0 tx=0x7f469800ec10 comp rx=0 tx=0).stop 2023-11-24T06:17:06.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 shutdown_connections 2023-11-24T06:17:06.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f468406b020 0x7f468406d4e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01eb750 0x7f46a01631b0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46a01f77a0 0x7f46a01eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 --2- 172.21.15.22:0/1494856724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f468c003a10 0x7f46a0160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 >> 172.21.15.22:0/1494856724 conn(0x7f46a006a860 msgr2=0x7f46a014a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:06.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.078+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 shutdown_connections 2023-11-24T06:17:06.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.079+0000 7f46a6a09640 1 -- 172.21.15.22:0/1494856724 wait complete. 2023-11-24T06:17:06.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:17:06.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.322+0000 7fb6d09a8640 1 Processor -- start 2023-11-24T06:17:06.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.322+0000 7fb6d09a8640 1 -- start start 2023-11-24T06:17:06.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.323+0000 7fb6d09a8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6cc15f460 0x7fb6cc06cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.323+0000 7fb6d09a8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6cc141e80 0x7fb6cc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.323+0000 7fb6d09a8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc070bf0 con 0x7fb6cc1416f0 2023-11-24T06:17:06.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.323+0000 7fb6d09a8640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc06db30 con 0x7fb6cc15f460 2023-11-24T06:17:06.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.323+0000 7fb6d09a8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc06d5a0 con 0x7fb6cc141e80 2023-11-24T06:17:06.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.324+0000 7fb6c3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6cc15f460 0x7fb6cc06cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.324+0000 7fb6c3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6cc15f460 0x7fb6cc06cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33712/0 (socket says 172.21.15.22:33712) 2023-11-24T06:17:06.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.324+0000 7fb6c3fff640 1 -- 172.21.15.22:0/555673403 learned_addr learned my addr 172.21.15.22:0/555673403 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:06.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.324+0000 7fb6cb59e640 1 --2- 172.21.15.22:0/555673403 >> v2:172.21.15.31:3300/0 conn(0x7fb6cc141e80 0x7fb6cc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.324+0000 7fb6c3fff640 1 -- 172.21.15.22:0/555673403 >> v2:172.21.15.31:3300/0 conn(0x7fb6cc141e80 msgr2=0x7fb6cc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:06.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.324+0000 7fb6c3fff640 1 --2- 172.21.15.22:0/555673403 >> v2:172.21.15.31:3300/0 conn(0x7fb6cc141e80 0x7fb6cc06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.324+0000 7fb6c3fff640 1 -- 172.21.15.22:0/555673403 >> v1:172.21.15.31:6789/0 conn(0x7fb6cc1416f0 legacy=0x7fb6cc15ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:06.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.324+0000 7fb6c3fff640 1 -- 172.21.15.22:0/555673403 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc06d850 con 0x7fb6cc15f460 2023-11-24T06:17:06.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.324+0000 7fb6cb59e640 1 --2- 172.21.15.22:0/555673403 >> v2:172.21.15.31:3300/0 conn(0x7fb6cc141e80 0x7fb6cc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:06.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.326+0000 7fb6c3fff640 1 --2- 172.21.15.22:0/555673403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc15f460 0x7fb6cc06cb20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0ae750 tx=0x7fb6b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f37122ed43b08e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.326+0000 7fb6ca59c640 1 -- 172.21.15.22:0/555673403 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4031870 con 0x7fb6cc15f460 2023-11-24T06:17:06.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.326+0000 7fb6ca59c640 1 -- 172.21.15.22:0/555673403 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b40319d0 con 0x7fb6cc15f460 2023-11-24T06:17:06.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.326+0000 7fb6ca59c640 1 -- 172.21.15.22:0/555673403 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4031d60 con 0x7fb6cc15f460 2023-11-24T06:17:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.327+0000 7fb6d09a8640 1 -- 172.21.15.22:0/555673403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc15f460 msgr2=0x7fb6cc06cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.327+0000 7fb6d09a8640 1 --2- 172.21.15.22:0/555673403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc15f460 0x7fb6cc06cb20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0ae750 tx=0x7fb6b402b910 comp rx=0 tx=0).stop 2023-11-24T06:17:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.327+0000 7fb6d09a8640 1 -- 172.21.15.22:0/555673403 shutdown_connections 2023-11-24T06:17:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.327+0000 7fb6d09a8640 1 --2- 172.21.15.22:0/555673403 >> v2:172.21.15.31:3300/0 conn(0x7fb6cc141e80 0x7fb6cc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.327+0000 7fb6d09a8640 1 --2- 172.21.15.22:0/555673403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc15f460 0x7fb6cc06cb20 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.327+0000 7fb6d09a8640 1 -- 172.21.15.22:0/555673403 >> 172.21.15.22:0/555673403 conn(0x7fb6cc0b0840 msgr2=0x7fb6cc0b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.327+0000 7fb6d09a8640 1 -- 172.21.15.22:0/555673403 shutdown_connections 2023-11-24T06:17:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.327+0000 7fb6d09a8640 1 -- 172.21.15.22:0/555673403 wait complete. 2023-11-24T06:17:06.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.329+0000 7fb6d09a8640 1 Processor -- start 2023-11-24T06:17:06.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.329+0000 7fb6d09a8640 1 -- start start 2023-11-24T06:17:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.330+0000 7fb6d09a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc1416f0 0x7fb6cc138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.330+0000 7fb6d09a8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6cc141e80 0x7fb6cc13c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.330+0000 7fb6d09a8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15f460 0x7fb6cc15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.330+0000 7fb6d09a8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1366d0 con 0x7fb6cc1416f0 2023-11-24T06:17:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.330+0000 7fb6d09a8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc13cef0 con 0x7fb6cc15f460 2023-11-24T06:17:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.330+0000 7fb6d09a8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1386e0 con 0x7fb6cc141e80 2023-11-24T06:17:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc1416f0 0x7fb6cc138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc1416f0 0x7fb6cc138100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33722/0 (socket says 172.21.15.22:33722) 2023-11-24T06:17:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cad9d640 1 -- 172.21.15.22:0/2200792457 learned_addr learned my addr 172.21.15.22:0/2200792457 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6c3fff640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6cc141e80 0x7fb6cc13c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cb59e640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15f460 0x7fb6cc15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cad9d640 1 -- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6cc141e80 msgr2=0x7fb6cc13c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cad9d640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6cc141e80 0x7fb6cc13c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cad9d640 1 -- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15f460 msgr2=0x7fb6cc15a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cad9d640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15f460 0x7fb6cc15a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cad9d640 1 -- 172.21.15.22:0/2200792457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b40094d0 con 0x7fb6cc1416f0 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6c3fff640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6cc141e80 0x7fb6cc13c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cb59e640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15f460 0x7fb6cc15a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.331+0000 7fb6cad9d640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc1416f0 0x7fb6cc138100 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00c410 tx=0x7fb6bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.332+0000 7fb6c37fe640 1 -- 172.21.15.22:0/2200792457 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0035f0 con 0x7fb6cc1416f0 2023-11-24T06:17:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.332+0000 7fb6c37fe640 1 -- 172.21.15.22:0/2200792457 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc003750 con 0x7fb6cc1416f0 2023-11-24T06:17:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.332+0000 7fb6c37fe640 1 -- 172.21.15.22:0/2200792457 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc003b40 con 0x7fb6cc1416f0 2023-11-24T06:17:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.332+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc1389c0 con 0x7fb6cc1416f0 2023-11-24T06:17:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.332+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc136920 con 0x7fb6cc1416f0 2023-11-24T06:17:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.333+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc0cca10 con 0x7fb6cc1416f0 2023-11-24T06:17:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.334+0000 7fb6c37fe640 1 -- 172.21.15.22:0/2200792457 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb6bc003ca0 con 0x7fb6cc1416f0 2023-11-24T06:17:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.335+0000 7fb6c37fe640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6ac06f400 0x7fb6ac0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.335+0000 7fb6c37fe640 1 -- 172.21.15.22:0/2200792457 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6bc088bd0 con 0x7fb6cc1416f0 2023-11-24T06:17:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.335+0000 7fb6c3fff640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6ac06f400 0x7fb6ac0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.336+0000 7fb6c3fff640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6ac06f400 0x7fb6ac0718c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4036000 tx=0x7fb6b403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.340+0000 7fb6c37fe640 1 -- 172.21.15.22:0/2200792457 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6bc053970 con 0x7fb6cc1416f0 2023-11-24T06:17:06.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.571+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb6cc138ee0 con 0x7fb6cc1416f0 2023-11-24T06:17:06.574 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-11-24T06:17:06.572+0000 7f6dde801640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:17:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.575+0000 7fb6c37fe640 1 -- 172.21.15.22:0/2200792457 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb6bc017090 con 0x7fb6cc1416f0 2023-11-24T06:17:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:17:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6ac06f400 msgr2=0x7fb6ac0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6ac06f400 0x7fb6ac0718c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4036000 tx=0x7fb6b403c040 comp rx=0 tx=0).stop 2023-11-24T06:17:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc1416f0 msgr2=0x7fb6cc138100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc1416f0 0x7fb6cc138100 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00c410 tx=0x7fb6bc00c8d0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 shutdown_connections 2023-11-24T06:17:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fb6ac06f400 0x7fb6ac0718c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15f460 0x7fb6cc15a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6cc141e80 0x7fb6cc13c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 --2- 172.21.15.22:0/2200792457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6cc1416f0 0x7fb6cc138100 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.578+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 >> 172.21.15.22:0/2200792457 conn(0x7fb6cc0b0840 msgr2=0x7fb6cc0af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.579+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 shutdown_connections 2023-11-24T06:17:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.580+0000 7fb6d09a8640 1 -- 172.21.15.22:0/2200792457 wait complete. 2023-11-24T06:17:06.598 INFO:tasks.ceph.mds.d.smithi031.stderr: -1227> 2023-11-24T06:16:39.704+0000 7ff6a838b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:17:06.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:17:06.681 INFO:tasks.ceph.mds.d.smithi031.stdout:starting mds.d at 2023-11-24T06:17:06.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.819+0000 7f880a790640 1 Processor -- start 2023-11-24T06:17:06.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.819+0000 7f880a790640 1 -- start start 2023-11-24T06:17:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.821+0000 7f880a790640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8804162220 0x7f88040b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.821+0000 7f880a790640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8804162600 0x7f8804162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.821+0000 7f880a790640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8804162fa0 con 0x7f880406c3c0 2023-11-24T06:17:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.821+0000 7f880a790640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88040706a0 con 0x7f8804162600 2023-11-24T06:17:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.821+0000 7f880a790640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8804070c60 con 0x7f8804162220 2023-11-24T06:17:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.822+0000 7f8803fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8804162220 0x7f88040b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.822+0000 7f8808d2d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f880406c3c0 0x7f88040710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:35088/0 (socket says 172.21.15.22:35088) 2023-11-24T06:17:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.822+0000 7f88037fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8804162600 0x7f8804162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.822+0000 7f8808d2d640 1 -- 172.21.15.22:0/351902055 learned_addr learned my addr 172.21.15.22:0/351902055 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:06.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.822+0000 7f88037fe640 1 -- 172.21.15.22:0/351902055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8804162220 msgr2=0x7f88040b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:06.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.822+0000 7f88037fe640 1 --2- 172.21.15.22:0/351902055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8804162220 0x7f88040b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.822+0000 7f88037fe640 1 -- 172.21.15.22:0/351902055 >> v1:172.21.15.31:6789/0 conn(0x7f880406c3c0 legacy=0x7f88040710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.822+0000 7f88037fe640 1 -- 172.21.15.22:0/351902055 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040722b0 con 0x7f8804162600 2023-11-24T06:17:06.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.824+0000 7f88037fe640 1 --2- 172.21.15.22:0/351902055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8804162600 0x7f8804162a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009d90 tx=0x7f87ec02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=719188f24d276a56 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.824+0000 7f8802ffd640 1 -- 172.21.15.22:0/351902055 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec02cc50 con 0x7f8804162600 2023-11-24T06:17:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.824+0000 7f8802ffd640 1 -- 172.21.15.22:0/351902055 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec02cdb0 con 0x7f8804162600 2023-11-24T06:17:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.824+0000 7f8802ffd640 1 -- 172.21.15.22:0/351902055 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec034660 con 0x7f8804162600 2023-11-24T06:17:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.825+0000 7f880a790640 1 -- 172.21.15.22:0/351902055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8804162600 msgr2=0x7f8804162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.825+0000 7f880a790640 1 --2- 172.21.15.22:0/351902055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8804162600 0x7f8804162a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009d90 tx=0x7f87ec02bea0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.825+0000 7f880a790640 1 -- 172.21.15.22:0/351902055 shutdown_connections 2023-11-24T06:17:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.825+0000 7f880a790640 1 --2- 172.21.15.22:0/351902055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8804162600 0x7f8804162a60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.825+0000 7f880a790640 1 --2- 172.21.15.22:0/351902055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8804162220 0x7f88040b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.825+0000 7f880a790640 1 -- 172.21.15.22:0/351902055 >> 172.21.15.22:0/351902055 conn(0x7f88040b0ba0 msgr2=0x7f88040b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.826+0000 7f880a790640 1 -- 172.21.15.22:0/351902055 shutdown_connections 2023-11-24T06:17:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.826+0000 7f880a790640 1 -- 172.21.15.22:0/351902055 wait complete. 2023-11-24T06:17:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.827+0000 7f880a790640 1 Processor -- start 2023-11-24T06:17:06.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.828+0000 7f880a790640 1 -- start start 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.828+0000 7f880a790640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f880406c3c0 0x7f880415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.828+0000 7f880a790640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8804162220 0x7f880409a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f880a790640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8804162600 0x7f88040cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f880a790640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880415c9c0 con 0x7f8804162600 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f880a790640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880409b730 con 0x7f8804162220 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f880a790640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880409ae90 con 0x7f880406c3c0 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f8808d2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8804162600 0x7f88040cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f8808d2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8804162600 0x7f88040cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33726/0 (socket says 172.21.15.22:33726) 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f8808d2d640 1 -- 172.21.15.22:0/4018677833 learned_addr learned my addr 172.21.15.22:0/4018677833 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f88037fe640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8804162220 0x7f880409a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f8803fff640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f880406c3c0 0x7f880415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f8808d2d640 1 -- 172.21.15.22:0/4018677833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f880406c3c0 msgr2=0x7f880415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f8808d2d640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f880406c3c0 0x7f880415c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f8808d2d640 1 -- 172.21.15.22:0/4018677833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8804162220 msgr2=0x7f880409a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f8808d2d640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8804162220 0x7f880409a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.829+0000 7f8808d2d640 1 -- 172.21.15.22:0/4018677833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec009a70 con 0x7f8804162600 2023-11-24T06:17:06.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.830+0000 7f8808d2d640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8804162600 0x7f88040cc610 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00c3a0 tx=0x7f87fc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.830+0000 7f8800ff9640 1 -- 172.21.15.22:0/4018677833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc005ce0 con 0x7f8804162600 2023-11-24T06:17:06.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.830+0000 7f8800ff9640 1 -- 172.21.15.22:0/4018677833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc005e40 con 0x7f8804162600 2023-11-24T06:17:06.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.830+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880409b170 con 0x7f8804162600 2023-11-24T06:17:06.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.830+0000 7f8800ff9640 1 -- 172.21.15.22:0/4018677833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc0072d0 con 0x7f8804162600 2023-11-24T06:17:06.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.830+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8804163360 con 0x7f8804162600 2023-11-24T06:17:06.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.831+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880409d200 con 0x7f8804162600 2023-11-24T06:17:06.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.832+0000 7f8800ff9640 1 -- 172.21.15.22:0/4018677833 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f87fc0074f0 con 0x7f8804162600 2023-11-24T06:17:06.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.833+0000 7f8800ff9640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87e406aff0 0x7f87e406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.833+0000 7f8800ff9640 1 -- 172.21.15.22:0/4018677833 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f87fc088dc0 con 0x7f8804162600 2023-11-24T06:17:06.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.834+0000 7f8803fff640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87e406aff0 0x7f87e406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.834+0000 7f8803fff640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87e406aff0 0x7f87e406d4b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009970 tx=0x7f87f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:06.837+0000 7f8800ff9640 1 -- 172.21.15.22:0/4018677833 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87fc053c30 con 0x7f8804162600 2023-11-24T06:17:07.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.066+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f880404e920 con 0x7f8804162600 2023-11-24T06:17:07.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.623+0000 7f8800ff9640 1 -- 172.21.15.22:0/4018677833 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f87fc057250 con 0x7f8804162600 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87e406aff0 msgr2=0x7f87e406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87e406aff0 0x7f87e406d4b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009970 tx=0x7f87f4008040 comp rx=0 tx=0).stop 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8804162600 msgr2=0x7f88040cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8804162600 0x7f88040cc610 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00c3a0 tx=0x7f87fc00c860 comp rx=0 tx=0).stop 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 shutdown_connections 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f87e406aff0 0x7f87e406d4b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8804162600 0x7f88040cc610 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8804162220 0x7f880409a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 --2- 172.21.15.22:0/4018677833 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f880406c3c0 0x7f880415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.627+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 >> 172.21.15.22:0/4018677833 conn(0x7f88040b0ba0 msgr2=0x7f88040b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:07.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.628+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 shutdown_connections 2023-11-24T06:17:07.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.628+0000 7f880a790640 1 -- 172.21.15.22:0/4018677833 wait complete. 2023-11-24T06:17:07.653 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:17:07.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.887+0000 7f9e05999640 1 Processor -- start 2023-11-24T06:17:07.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.888+0000 7f9e05999640 1 -- start start 2023-11-24T06:17:07.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.890+0000 7f9e05999640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9e0006d3d0 0x7f9e0006d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.890+0000 7f9e05999640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0006dd60 con 0x7f9e00165e20 2023-11-24T06:17:07.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.890+0000 7f9e05999640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e00070070 con 0x7f9e0015f100 2023-11-24T06:17:07.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.890+0000 7f9e05999640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e00070f40 con 0x7f9e0006d3d0 2023-11-24T06:17:07.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.890+0000 7f9dfffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9e00165e20 0x7f9e00070830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33230/0 (socket says 172.21.15.22:33230) 2023-11-24T06:17:07.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.890+0000 7f9dfffff640 1 -- 172.21.15.22:0/1782331875 learned_addr learned my addr 172.21.15.22:0/1782331875 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9e05198640 1 --2- 172.21.15.22:0/1782331875 >> v2:172.21.15.31:3300/0 conn(0x7f9e0006d3d0 0x7f9e0006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494115819 0 0) 0x7f9e0006dd60 con 0x7f9e00165e20 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df0003520 con 0x7f9e00165e20 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1591026381 0 0) 0x7f9df0003520 con 0x7f9e00165e20 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 >> v2:172.21.15.31:3300/0 conn(0x7f9e0006d3d0 msgr2=0x7f9e0006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 --2- 172.21.15.22:0/1782331875 >> v2:172.21.15.31:3300/0 conn(0x7f9e0006d3d0 0x7f9e0006d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 >> v1:172.21.15.31:6789/0 conn(0x7f9e0015f100 legacy=0x7f9e00161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e001624e0 con 0x7f9e00165e20 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f9dec0017f0 con 0x7f9e00165e20 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 >> v1:172.21.15.22:6789/0 conn(0x7f9e00165e20 legacy=0x7f9e00070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9df00039e0 0x7f9df0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00047c0 0x7f9df0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9df0005180 0x7f9df000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00070f40 con 0x7f9df00047c0 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df000c0b0 con 0x7f9df0005180 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.891+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df000c270 con 0x7f9df00039e0 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9dfffff640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00047c0 0x7f9df0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9e05198640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9df0005180 0x7f9df000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9e04997640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9df00039e0 0x7f9df0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9dfffff640 1 -- 172.21.15.22:0/1782331875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9df00039e0 msgr2=0x7f9df0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9dfffff640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9df00039e0 0x7f9df0003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9dfffff640 1 -- 172.21.15.22:0/1782331875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9df0005180 msgr2=0x7f9df000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9dfffff640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9df0005180 0x7f9df000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9dfffff640 1 -- 172.21.15.22:0/1782331875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0003520 con 0x7f9df00047c0 2023-11-24T06:17:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9e05198640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9df0005180 0x7f9df000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.892+0000 7f9e05198640 1 -- 172.21.15.22:0/1782331875 reap_dead start 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.893+0000 7f9dfffff640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00047c0 0x7f9df0004c40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00c190 tx=0x7f9df00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fb00e0da01b71c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.894+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec007270 con 0x7f9df00047c0 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.894+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec0073f0 con 0x7f9df00047c0 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.894+0000 7f9dff7fe640 1 -- 172.21.15.22:0/1782331875 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec02c830 con 0x7f9df00047c0 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.894+0000 7f9e05999640 1 -- 172.21.15.22:0/1782331875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00047c0 msgr2=0x7f9df0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.894+0000 7f9e05999640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00047c0 0x7f9df0004c40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00c190 tx=0x7f9df00057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.894+0000 7f9e05999640 1 -- 172.21.15.22:0/1782331875 shutdown_connections 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.894+0000 7f9e05999640 1 --2- 172.21.15.22:0/1782331875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00047c0 0x7f9df0004c40 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.894+0000 7f9e05999640 1 -- 172.21.15.22:0/1782331875 >> 172.21.15.22:0/1782331875 conn(0x7f9e000b0aa0 msgr2=0x7f9e000b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:07.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.895+0000 7f9e05999640 1 -- 172.21.15.22:0/1782331875 shutdown_connections 2023-11-24T06:17:07.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.895+0000 7f9e05999640 1 -- 172.21.15.22:0/1782331875 wait complete. 2023-11-24T06:17:07.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.897+0000 7f9e05999640 1 Processor -- start 2023-11-24T06:17:07.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.897+0000 7f9e05999640 1 -- start start 2023-11-24T06:17:07.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9e05999640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e000ae000 0x7f9e000cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9e05999640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e000cc920 0x7f9e0015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9e05999640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0015cef0 0x7f9e001fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9e05999640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0015d3a0 con 0x7f9e000cc920 2023-11-24T06:17:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9e05999640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0015b7b0 con 0x7f9e0015cef0 2023-11-24T06:17:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9e05999640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000cce80 con 0x7f9e000ae000 2023-11-24T06:17:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9dfffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e000cc920 0x7f9e0015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9dfffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e000cc920 0x7f9e0015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33738/0 (socket says 172.21.15.22:33738) 2023-11-24T06:17:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9dfffff640 1 -- 172.21.15.22:0/2435720536 learned_addr learned my addr 172.21.15.22:0/2435720536 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:07.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.898+0000 7f9e04997640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e000ae000 0x7f9e000cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9e05198640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0015cef0 0x7f9e001fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9dfffff640 1 -- 172.21.15.22:0/2435720536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e000ae000 msgr2=0x7f9e000cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9dfffff640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e000ae000 0x7f9e000cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9dfffff640 1 -- 172.21.15.22:0/2435720536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0015cef0 msgr2=0x7f9e001fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9dfffff640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0015cef0 0x7f9e001fa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9dfffff640 1 -- 172.21.15.22:0/2435720536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e000cd160 con 0x7f9e000cc920 2023-11-24T06:17:07.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9e04997640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e000ae000 0x7f9e000cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:07.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9dfffff640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e000cc920 0x7f9e0015c9b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9dec000ef0 tx=0x7f9dec02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:07.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9dfd7fa640 1 -- 172.21.15.22:0/2435720536 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec03c040 con 0x7f9e000cc920 2023-11-24T06:17:07.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9dfd7fa640 1 -- 172.21.15.22:0/2435720536 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec007270 con 0x7f9e000cc920 2023-11-24T06:17:07.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9dfd7fa640 1 -- 172.21.15.22:0/2435720536 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0059c0 con 0x7f9e000cc920 2023-11-24T06:17:07.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e000cd440 con 0x7f9e000cc920 2023-11-24T06:17:07.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.899+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e000a8460 con 0x7f9e000cc920 2023-11-24T06:17:07.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.900+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e000cd960 con 0x7f9e000cc920 2023-11-24T06:17:07.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.902+0000 7f9dfd7fa640 1 -- 172.21.15.22:0/2435720536 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9dec032070 con 0x7f9e000cc920 2023-11-24T06:17:07.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.902+0000 7f9dfd7fa640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9de406b020 0x7f9de406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.903+0000 7f9dfd7fa640 1 -- 172.21.15.22:0/2435720536 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9dec0aacc0 con 0x7f9e000cc920 2023-11-24T06:17:07.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.903+0000 7f9e04997640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9de406b020 0x7f9de406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.904+0000 7f9e04997640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9de406b020 0x7f9de406d4e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c00 tx=0x7f9df4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:07.907+0000 7f9dfd7fa640 1 -- 172.21.15.22:0/2435720536 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9dec0dde90 con 0x7f9e000cc920 2023-11-24T06:17:08.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.103+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9e000a85f0 con 0x7f9e000cc920 2023-11-24T06:17:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.627+0000 7f9dfd7fa640 1 -- 172.21.15.22:0/2435720536 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9dec075a70 con 0x7f9e000cc920 2023-11-24T06:17:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:17:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.631+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9de406b020 msgr2=0x7f9de406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.631+0000 7f9e05999640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9de406b020 0x7f9de406d4e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c00 tx=0x7f9df4009040 comp rx=0 tx=0).stop 2023-11-24T06:17:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.631+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e000cc920 msgr2=0x7f9e0015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.631+0000 7f9e05999640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e000cc920 0x7f9e0015c9b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9dec000ef0 tx=0x7f9dec02e070 comp rx=0 tx=0).stop 2023-11-24T06:17:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.632+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 shutdown_connections 2023-11-24T06:17:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.632+0000 7f9e05999640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9de406b020 0x7f9de406d4e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.632+0000 7f9e05999640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0015cef0 0x7f9e001fa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.632+0000 7f9e05999640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e000cc920 0x7f9e0015c9b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.632+0000 7f9e05999640 1 --2- 172.21.15.22:0/2435720536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e000ae000 0x7f9e000cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.632+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 >> 172.21.15.22:0/2435720536 conn(0x7f9e000b0aa0 msgr2=0x7f9e001651a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.632+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 shutdown_connections 2023-11-24T06:17:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.633+0000 7f9e05999640 1 -- 172.21.15.22:0/2435720536 wait complete. 2023-11-24T06:17:08.659 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:17:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.882+0000 7f6aa0ed1640 1 Processor -- start 2023-11-24T06:17:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.883+0000 7f6aa0ed1640 1 -- start start 2023-11-24T06:17:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.884+0000 7f6aa0ed1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a9c0c8930 0x7f6a9c0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.884+0000 7f6aa0ed1640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0c6bf0 con 0x7f6a9c15d3b0 2023-11-24T06:17:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.884+0000 7f6aa0ed1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0cedc0 con 0x7f6a9c0d1d90 2023-11-24T06:17:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.884+0000 7f6aa0ed1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0c6e40 con 0x7f6a9c0c8930 2023-11-24T06:17:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.884+0000 7f6a9b7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6a9c15d3b0 0x7f6a9c0d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33232/0 (socket says 172.21.15.22:33232) 2023-11-24T06:17:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.884+0000 7f6a9b7fe640 1 -- 172.21.15.22:0/1268237844 learned_addr learned my addr 172.21.15.22:0/1268237844 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927575808 0 0) 0x7f6a9c0c6bf0 con 0x7f6a9c15d3b0 2023-11-24T06:17:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a88003520 con 0x7f6a9c15d3b0 2023-11-24T06:17:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9bfff640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a9c0c8930 0x7f6a9c0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1767178714 0 0) 0x7f6a88003520 con 0x7f6a9c15d3b0 2023-11-24T06:17:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a9c0c8930 msgr2=0x7f6a9c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a9c0c8930 0x7f6a9c0ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 >> v1:172.21.15.31:6789/0 conn(0x7f6a9c0d1d90 legacy=0x7f6a9c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0c7120 con 0x7f6a9c15d3b0 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f6a84001670 con 0x7f6a9c15d3b0 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 >> v1:172.21.15.22:6789/0 conn(0x7f6a9c15d3b0 legacy=0x7f6a9c0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a88003a10 0x7f6a88003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a9c0c8930 0x7f6a880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a88004d50 0x7f6a880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0c6e40 con 0x7f6a88004d50 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8800bc10 con 0x7f6a88003a10 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.885+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8800bdd0 con 0x7f6a9c0c8930 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.886+0000 7f6a9bfff640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a88004d50 0x7f6a880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.886+0000 7f6a9b7fe640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a88003a10 0x7f6a88003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.886+0000 7f6a9affd640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a9c0c8930 0x7f6a880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.886+0000 7f6a9bfff640 1 -- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a9c0c8930 msgr2=0x7f6a880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.886+0000 7f6a9bfff640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a9c0c8930 0x7f6a880047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.886+0000 7f6a9bfff640 1 -- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a88003a10 msgr2=0x7f6a88003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.886+0000 7f6a9bfff640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a88003a10 0x7f6a88003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.886+0000 7f6a9bfff640 1 -- 172.21.15.22:0/1268237844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88003520 con 0x7f6a88004d50 2023-11-24T06:17:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.886+0000 7f6a9b7fe640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a88003a10 0x7f6a88003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:08.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.887+0000 7f6a9bfff640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a88004d50 0x7f6a880051d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400ba30 tx=0x7f6a880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3497f9e178cd58ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.888+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94032630 con 0x7f6a88004d50 2023-11-24T06:17:08.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.888+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a94032790 con 0x7f6a88004d50 2023-11-24T06:17:08.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.888+0000 7f6a9a7fc640 1 -- 172.21.15.22:0/1268237844 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94032b20 con 0x7f6a88004d50 2023-11-24T06:17:08.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.888+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/1268237844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a88004d50 msgr2=0x7f6a880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.888+0000 7f6aa0ed1640 1 --2- 172.21.15.22:0/1268237844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a88004d50 0x7f6a880051d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400ba30 tx=0x7f6a880057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.888+0000 7f6a9bfff640 1 -- 172.21.15.22:0/1268237844 reap_dead start 2023-11-24T06:17:08.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.888+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/1268237844 shutdown_connections 2023-11-24T06:17:08.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.888+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/1268237844 >> 172.21.15.22:0/1268237844 conn(0x7f6a9c0d30a0 msgr2=0x7f6a9c0d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:08.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.888+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/1268237844 shutdown_connections 2023-11-24T06:17:08.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.889+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/1268237844 wait complete. 2023-11-24T06:17:08.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.890+0000 7f6aa0ed1640 1 Processor -- start 2023-11-24T06:17:08.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.890+0000 7f6aa0ed1640 1 -- start start 2023-11-24T06:17:08.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.891+0000 7f6aa0ed1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a88004d50 0x7f6a9c14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.891+0000 7f6aa0ed1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c09ce50 0x7f6a9c1f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.891+0000 7f6aa0ed1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c0a0540 0x7f6a9c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.891+0000 7f6aa0ed1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1f6a40 con 0x7f6a9c09ce50 2023-11-24T06:17:08.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.891+0000 7f6aa0ed1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1f6d20 con 0x7f6a9c0a0540 2023-11-24T06:17:08.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.891+0000 7f6aa0ed1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1f7000 con 0x7f6a88004d50 2023-11-24T06:17:08.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c09ce50 0x7f6a9c1f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c09ce50 0x7f6a9c1f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33768/0 (socket says 172.21.15.22:33768) 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9affd640 1 -- 172.21.15.22:0/3302694725 learned_addr learned my addr 172.21.15.22:0/3302694725 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9b7fe640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a88004d50 0x7f6a9c14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9bfff640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c0a0540 0x7f6a9c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9affd640 1 -- 172.21.15.22:0/3302694725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a88004d50 msgr2=0x7f6a9c14f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9affd640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a88004d50 0x7f6a9c14f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9affd640 1 -- 172.21.15.22:0/3302694725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c0a0540 msgr2=0x7f6a9c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9affd640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c0a0540 0x7f6a9c0cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.892+0000 7f6a9affd640 1 -- 172.21.15.22:0/3302694725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c09fd40 con 0x7f6a9c09ce50 2023-11-24T06:17:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.893+0000 7f6a9affd640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c09ce50 0x7f6a9c1f6160 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00d860 tx=0x7f6a8c00dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.893+0000 7f6a93fff640 1 -- 172.21.15.22:0/3302694725 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c003da0 con 0x7f6a9c09ce50 2023-11-24T06:17:08.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.893+0000 7f6a93fff640 1 -- 172.21.15.22:0/3302694725 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00b6b0 con 0x7f6a9c09ce50 2023-11-24T06:17:08.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.893+0000 7f6a93fff640 1 -- 172.21.15.22:0/3302694725 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00ba80 con 0x7f6a9c09ce50 2023-11-24T06:17:08.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.893+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c0a0020 con 0x7f6a9c09ce50 2023-11-24T06:17:08.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.893+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c1f66a0 con 0x7f6a9c09ce50 2023-11-24T06:17:08.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.894+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c09fba0 con 0x7f6a9c09ce50 2023-11-24T06:17:08.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.896+0000 7f6a93fff640 1 -- 172.21.15.22:0/3302694725 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6a8c00bbe0 con 0x7f6a9c09ce50 2023-11-24T06:17:08.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.897+0000 7f6a93fff640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6a7c06aff0 0x7f6a7c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.897+0000 7f6a93fff640 1 -- 172.21.15.22:0/3302694725 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f6a8c089aa0 con 0x7f6a9c09ce50 2023-11-24T06:17:08.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.897+0000 7f6a9b7fe640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6a7c06aff0 0x7f6a7c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.897+0000 7f6a9b7fe640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6a7c06aff0 0x7f6a7c06d4b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6a84001eb0 tx=0x7f6a84001550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:08.901+0000 7f6a93fff640 1 -- 172.21.15.22:0/3302694725 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a9c09fba0 con 0x7f6a9c09ce50 2023-11-24T06:17:09.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.098+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a9c09fba0 con 0x7f6a9c09ce50 2023-11-24T06:17:09.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.638+0000 7f6a93fff640 1 -- 172.21.15.22:0/3302694725 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6a9c09fba0 con 0x7f6a9c09ce50 2023-11-24T06:17:09.642 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-11-24T06:17:09.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6a7c06aff0 msgr2=0x7f6a7c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6a7c06aff0 0x7f6a7c06d4b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6a84001eb0 tx=0x7f6a84001550 comp rx=0 tx=0).stop 2023-11-24T06:17:09.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c09ce50 msgr2=0x7f6a9c1f6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c09ce50 0x7f6a9c1f6160 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00d860 tx=0x7f6a8c00dd20 comp rx=0 tx=0).stop 2023-11-24T06:17:09.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 shutdown_connections 2023-11-24T06:17:09.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f6a7c06aff0 0x7f6a7c06d4b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c0a0540 0x7f6a9c0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c09ce50 0x7f6a9c1f6160 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 --2- 172.21.15.22:0/3302694725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a88004d50 0x7f6a9c14f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.642+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 >> 172.21.15.22:0/3302694725 conn(0x7f6a9c0d30a0 msgr2=0x7f6a9c1602c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:09.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.643+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 shutdown_connections 2023-11-24T06:17:09.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.643+0000 7f6aa0ed1640 1 -- 172.21.15.22:0/3302694725 wait complete. 2023-11-24T06:17:09.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:17:09.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.889+0000 7f7fb0e78640 1 Processor -- start 2023-11-24T06:17:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.889+0000 7f7fb0e78640 1 -- start start 2023-11-24T06:17:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.891+0000 7f7fb0e78640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac15f270 0x7f7fac0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.891+0000 7f7fb0e78640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac15f930 con 0x7f7fac06d9e0 2023-11-24T06:17:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.891+0000 7f7fb0e78640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0b3b10 con 0x7f7fac144770 2023-11-24T06:17:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.891+0000 7f7fb0e78640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0b43b0 con 0x7f7fac15f270 2023-11-24T06:17:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.891+0000 7f7fabfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7fac06d9e0 0x7f7fac0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33244/0 (socket says 172.21.15.22:33244) 2023-11-24T06:17:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.891+0000 7f7fabfff640 1 -- 172.21.15.22:0/330685741 learned_addr learned my addr 172.21.15.22:0/330685741 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faaffd640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac15f270 0x7f7fac0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109866992 0 0) 0x7f7fac15f930 con 0x7f7fac06d9e0 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f94003520 con 0x7f7fac06d9e0 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1170902042 0 0) 0x7f7f94003520 con 0x7f7fac06d9e0 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac15f270 msgr2=0x7f7fac0cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac15f270 0x7f7fac0cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 >> v1:172.21.15.31:6789/0 conn(0x7f7fac144770 legacy=0x7f7fac15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0b3df0 con 0x7f7fac06d9e0 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f7fa40019f0 con 0x7f7fac06d9e0 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 >> v1:172.21.15.22:6789/0 conn(0x7f7fac06d9e0 legacy=0x7f7fac0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.892+0000 7f7faa7fc640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac15f270 0x7f7f94003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.893+0000 7f7faa7fc640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f94003f50 0x7f7f940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.893+0000 7f7faa7fc640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f94004d00 0x7f7f94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.893+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0b43b0 con 0x7f7f94004d00 2023-11-24T06:17:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.893+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9400bac0 con 0x7f7f94003f50 2023-11-24T06:17:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.893+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9400bc80 con 0x7f7fac15f270 2023-11-24T06:17:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.893+0000 7f7fabfff640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f94004d00 0x7f7f94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.893+0000 7f7fab7fe640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac15f270 0x7f7f94003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.893+0000 7f7faaffd640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f94003f50 0x7f7f940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.894+0000 7f7fabfff640 1 -- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac15f270 msgr2=0x7f7f94003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.894+0000 7f7fabfff640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7fac15f270 0x7f7f94003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.894+0000 7f7fabfff640 1 -- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f94003f50 msgr2=0x7f7f940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.894+0000 7f7fabfff640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f94003f50 0x7f7f940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.894+0000 7f7fabfff640 1 -- 172.21.15.22:0/330685741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94003520 con 0x7f7f94004d00 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.895+0000 7f7fabfff640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f94004d00 0x7f7f94005180 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400a810 tx=0x7f7f940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fab57f8558d0010 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.896+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4034630 con 0x7f7f94004d00 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.896+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa402f070 con 0x7f7f94004d00 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.896+0000 7f7faa7fc640 1 -- 172.21.15.22:0/330685741 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4034a10 con 0x7f7f94004d00 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.896+0000 7f7fb0e78640 1 -- 172.21.15.22:0/330685741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f94004d00 msgr2=0x7f7f94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.896+0000 7f7fb0e78640 1 --2- 172.21.15.22:0/330685741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f94004d00 0x7f7f94005180 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400a810 tx=0x7f7f940057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.896+0000 7f7fabfff640 1 -- 172.21.15.22:0/330685741 reap_dead start 2023-11-24T06:17:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.896+0000 7f7fb0e78640 1 -- 172.21.15.22:0/330685741 shutdown_connections 2023-11-24T06:17:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.896+0000 7f7fb0e78640 1 -- 172.21.15.22:0/330685741 >> 172.21.15.22:0/330685741 conn(0x7f7fac0cec10 msgr2=0x7f7fac0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.896+0000 7f7fb0e78640 1 -- 172.21.15.22:0/330685741 shutdown_connections 2023-11-24T06:17:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.897+0000 7f7fb0e78640 1 -- 172.21.15.22:0/330685741 wait complete. 2023-11-24T06:17:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.898+0000 7f7fb0e78640 1 Processor -- start 2023-11-24T06:17:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.898+0000 7f7fb0e78640 1 -- start start 2023-11-24T06:17:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.899+0000 7f7fb0e78640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f94004d00 0x7f7fac0aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.899+0000 7f7fb0e78640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac13a810 0x7f7fac0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.899+0000 7f7fb0e78640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fac15cea0 0x7f7fac15d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.899+0000 7f7fb0e78640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac15b620 con 0x7f7fac15cea0 2023-11-24T06:17:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.899+0000 7f7fb0e78640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac15b900 con 0x7f7fac13a810 2023-11-24T06:17:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.899+0000 7f7fb0e78640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac15bbe0 con 0x7f7f94004d00 2023-11-24T06:17:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7fabfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fac15cea0 0x7f7fac15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7fabfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fac15cea0 0x7f7fac15d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33784/0 (socket says 172.21.15.22:33784) 2023-11-24T06:17:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7fabfff640 1 -- 172.21.15.22:0/778243065 learned_addr learned my addr 172.21.15.22:0/778243065 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7fab7fe640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f94004d00 0x7f7fac0aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7faaffd640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac13a810 0x7f7fac0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7fabfff640 1 -- 172.21.15.22:0/778243065 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f94004d00 msgr2=0x7f7fac0aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7fabfff640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f94004d00 0x7f7fac0aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7fabfff640 1 -- 172.21.15.22:0/778243065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac13a810 msgr2=0x7f7fac0af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7fabfff640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac13a810 0x7f7fac0af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.900+0000 7f7fabfff640 1 -- 172.21.15.22:0/778243065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac15bec0 con 0x7f7fac15cea0 2023-11-24T06:17:09.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.901+0000 7f7fabfff640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fac15cea0 0x7f7fac15d320 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4005c20 tx=0x7f7fa4001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:09.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.901+0000 7f7f93fff640 1 -- 172.21.15.22:0/778243065 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4034840 con 0x7f7fac15cea0 2023-11-24T06:17:09.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.901+0000 7f7f93fff640 1 -- 172.21.15.22:0/778243065 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40349a0 con 0x7f7fac15cea0 2023-11-24T06:17:09.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.901+0000 7f7f93fff640 1 -- 172.21.15.22:0/778243065 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4034d10 con 0x7f7fac15cea0 2023-11-24T06:17:09.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.901+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac15c1a0 con 0x7f7fac15cea0 2023-11-24T06:17:09.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.901+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac15d860 con 0x7f7fac15cea0 2023-11-24T06:17:09.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.903+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac04e840 con 0x7f7fac15cea0 2023-11-24T06:17:09.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.903+0000 7f7f93fff640 1 -- 172.21.15.22:0/778243065 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7fa4031030 con 0x7f7fac15cea0 2023-11-24T06:17:09.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.904+0000 7f7f93fff640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f9806b020 0x7f7f9806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.904+0000 7f7f93fff640 1 -- 172.21.15.22:0/778243065 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7fa40abc30 con 0x7f7fac15cea0 2023-11-24T06:17:09.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.905+0000 7f7fab7fe640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f9806b020 0x7f7f9806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.905+0000 7f7fab7fe640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f9806b020 0x7f7f9806d4e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c005520 tx=0x7f7f9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:09.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:09.909+0000 7f7f93fff640 1 -- 172.21.15.22:0/778243065 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7fa4076cd0 con 0x7f7fac15cea0 2023-11-24T06:17:10.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.102+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7fac04e840 con 0x7f7fac15cea0 2023-11-24T06:17:10.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.108+0000 7f7f93fff640 1 -- 172.21.15.22:0/778243065 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7fa4001ef0 con 0x7f7fac15cea0 2023-11-24T06:17:10.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f9806b020 msgr2=0x7f7f9806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f9806b020 0x7f7f9806d4e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c005520 tx=0x7f7f9c009040 comp rx=0 tx=0).stop 2023-11-24T06:17:10.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fac15cea0 msgr2=0x7f7fac15d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fac15cea0 0x7f7fac15d320 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4005c20 tx=0x7f7fa4001cb0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 shutdown_connections 2023-11-24T06:17:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f7f9806b020 0x7f7f9806d4e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fac15cea0 0x7f7fac15d320 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fac13a810 0x7f7fac0af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 --2- 172.21.15.22:0/778243065 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f94004d00 0x7f7fac0aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 >> 172.21.15.22:0/778243065 conn(0x7f7fac0cec10 msgr2=0x7f7fac0afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:10.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.111+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 shutdown_connections 2023-11-24T06:17:10.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.112+0000 7f7fb0e78640 1 -- 172.21.15.22:0/778243065 wait complete. 2023-11-24T06:17:10.134 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-11-24T06:17:10.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.342+0000 7f44bc11d640 1 Processor -- start 2023-11-24T06:17:10.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.343+0000 7f44bc11d640 1 -- start start 2023-11-24T06:17:10.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.344+0000 7f44bc11d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f44b40719c0 0x7f44b40ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.344+0000 7f44bc11d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b406d520 0x7f44b406d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.344+0000 7f44bc11d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b406deb0 con 0x7f44b4161930 2023-11-24T06:17:10.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.344+0000 7f44bc11d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40ad510 con 0x7f44b40719c0 2023-11-24T06:17:10.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.344+0000 7f44bc11d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40acc50 con 0x7f44b406d520 2023-11-24T06:17:10.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.345+0000 7f44b9eb9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f44b4161930 0x7f44b40ad9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33246/0 (socket says 172.21.15.22:33246) 2023-11-24T06:17:10.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.345+0000 7f44b9eb9640 1 -- 172.21.15.22:0/1273241847 learned_addr learned my addr 172.21.15.22:0/1273241847 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:10.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.345+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649023379 0 0) 0x7f44b0001110 con 0x7f44b4161930 2023-11-24T06:17:10.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.345+0000 7f44b96b8640 1 --2- 172.21.15.22:0/1273241847 >> v2:172.21.15.31:3300/0 conn(0x7f44b40719c0 0x7f44b40ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.345+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a0003520 con 0x7f44b4161930 2023-11-24T06:17:10.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.345+0000 7f44ba6ba640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b406d520 0x7f44b406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 198407867 0 0) 0x7f44a0003520 con 0x7f44b4161930 2023-11-24T06:17:10.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b406d520 msgr2=0x7f44b406d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:10.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b406d520 0x7f44b406d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 >> v2:172.21.15.31:3300/0 conn(0x7f44b40719c0 msgr2=0x7f44b40ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:10.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 --2- 172.21.15.22:0/1273241847 >> v2:172.21.15.31:3300/0 conn(0x7f44b40719c0 0x7f44b40ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4071e60 con 0x7f44b4161930 2023-11-24T06:17:10.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f44b0001800 con 0x7f44b4161930 2023-11-24T06:17:10.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b96b8640 1 --2- 172.21.15.22:0/1273241847 >> v2:172.21.15.31:3300/0 conn(0x7f44b40719c0 0x7f44b40ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:10.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 >> v1:172.21.15.22:6789/0 conn(0x7f44b4161930 legacy=0x7f44b40ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44a0003970 0x7f44a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b406d520 0x7f44a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a0004d00 0x7f44a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40ad510 con 0x7f44a0004d00 2023-11-24T06:17:10.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40acc50 con 0x7f44a0003970 2023-11-24T06:17:10.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a000ba30 con 0x7f44b406d520 2023-11-24T06:17:10.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44ba6ba640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a0004d00 0x7f44a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b9eb9640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44a0003970 0x7f44a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.346+0000 7f44b96b8640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b406d520 0x7f44a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.347+0000 7f44ba6ba640 1 -- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b406d520 msgr2=0x7f44a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:10.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.347+0000 7f44ba6ba640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b406d520 0x7f44a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.347+0000 7f44ba6ba640 1 -- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44a0003970 msgr2=0x7f44a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:10.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.347+0000 7f44ba6ba640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44a0003970 0x7f44a0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.347+0000 7f44ba6ba640 1 -- 172.21.15.22:0/1273241847 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a0003520 con 0x7f44a0004d00 2023-11-24T06:17:10.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.348+0000 7f44ba6ba640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a0004d00 0x7f44a0005180 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007390 tx=0x7f44a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f5e9263964d44e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:10.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.348+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac02ccb0 con 0x7f44a0004d00 2023-11-24T06:17:10.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.348+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac02ce10 con 0x7f44a0004d00 2023-11-24T06:17:10.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.348+0000 7f44b8eb7640 1 -- 172.21.15.22:0/1273241847 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac034660 con 0x7f44a0004d00 2023-11-24T06:17:10.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.349+0000 7f44bc11d640 1 -- 172.21.15.22:0/1273241847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a0004d00 msgr2=0x7f44a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.349+0000 7f44bc11d640 1 --2- 172.21.15.22:0/1273241847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a0004d00 0x7f44a0005180 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007390 tx=0x7f44a00057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.349+0000 7f44ba6ba640 1 -- 172.21.15.22:0/1273241847 reap_dead start 2023-11-24T06:17:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.349+0000 7f44bc11d640 1 -- 172.21.15.22:0/1273241847 shutdown_connections 2023-11-24T06:17:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.349+0000 7f44bc11d640 1 -- 172.21.15.22:0/1273241847 >> 172.21.15.22:0/1273241847 conn(0x7f44b40b0d80 msgr2=0x7f44b40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.349+0000 7f44bc11d640 1 -- 172.21.15.22:0/1273241847 shutdown_connections 2023-11-24T06:17:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.349+0000 7f44bc11d640 1 -- 172.21.15.22:0/1273241847 wait complete. 2023-11-24T06:17:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.351+0000 7f44bc11d640 1 Processor -- start 2023-11-24T06:17:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.351+0000 7f44bc11d640 1 -- start start 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44bc11d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44a0004d00 0x7f44b415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44bc11d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b409ca70 0x7f44b41fba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44bc11d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b415f910 0x7f44b415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44bc11d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b415b700 con 0x7f44b415f910 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44bc11d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b415ad40 con 0x7f44a0004d00 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44bc11d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41602e0 con 0x7f44b409ca70 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44ba6ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b415f910 0x7f44b415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44ba6ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b415f910 0x7f44b415fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33790/0 (socket says 172.21.15.22:33790) 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44ba6ba640 1 -- 172.21.15.22:0/2698544265 learned_addr learned my addr 172.21.15.22:0/2698544265 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44b96b8640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b409ca70 0x7f44b41fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.352+0000 7f44b9eb9640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44a0004d00 0x7f44b415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44ba6ba640 1 -- 172.21.15.22:0/2698544265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b409ca70 msgr2=0x7f44b41fba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44ba6ba640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b409ca70 0x7f44b41fba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44ba6ba640 1 -- 172.21.15.22:0/2698544265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44a0004d00 msgr2=0x7f44b415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44ba6ba640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44a0004d00 0x7f44b415a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44ba6ba640 1 -- 172.21.15.22:0/2698544265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40991e0 con 0x7f44b415f910 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44b96b8640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b409ca70 0x7f44b41fba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44ba6ba640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b415f910 0x7f44b415fda0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007390 tx=0x7f44ac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44aa7fc640 1 -- 172.21.15.22:0/2698544265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac03e600 con 0x7f44b415f910 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44aa7fc640 1 -- 172.21.15.22:0/2698544265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac03e760 con 0x7f44b415f910 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44aa7fc640 1 -- 172.21.15.22:0/2698544265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac03eb10 con 0x7f44b415f910 2023-11-24T06:17:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b41fbf40 con 0x7f44b415f910 2023-11-24T06:17:10.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.353+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b40cdaa0 con 0x7f44b415f910 2023-11-24T06:17:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.355+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b415b840 con 0x7f44b415f910 2023-11-24T06:17:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.356+0000 7f44aa7fc640 1 -- 172.21.15.22:0/2698544265 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f44ac03ec70 con 0x7f44b415f910 2023-11-24T06:17:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.357+0000 7f44aa7fc640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449806b020 0x7f449806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.357+0000 7f44aa7fc640 1 -- 172.21.15.22:0/2698544265 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f44ac0ab7c0 con 0x7f44b415f910 2023-11-24T06:17:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.357+0000 7f44b9eb9640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449806b020 0x7f449806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.358+0000 7f44b9eb9640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449806b020 0x7f449806d4e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f44b00012b0 tx=0x7f44b0000fe0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.362+0000 7f44aa7fc640 1 -- 172.21.15.22:0/2698544265 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44b415b840 con 0x7f44b415f910 2023-11-24T06:17:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.623+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f44b41fbf40 con 0x7f44b415f910 2023-11-24T06:17:10.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.642+0000 7f44aa7fc640 1 -- 172.21.15.22:0/2698544265 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v280) v1 ==== 161+0+0 (secure 0 0 0) 0x7f44b41fbf40 con 0x7f44b415f910 2023-11-24T06:17:10.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449806b020 msgr2=0x7f449806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449806b020 0x7f449806d4e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f44b00012b0 tx=0x7f44b0000fe0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b415f910 msgr2=0x7f44b415fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b415f910 0x7f44b415fda0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007390 tx=0x7f44ac004ab0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 shutdown_connections 2023-11-24T06:17:10.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f449806b020 0x7f449806d4e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b415f910 0x7f44b415fda0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b409ca70 0x7f44b41fba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 --2- 172.21.15.22:0/2698544265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44a0004d00 0x7f44b415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.644+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 >> 172.21.15.22:0/2698544265 conn(0x7f44b40b0d80 msgr2=0x7f44b40b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:10.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.645+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 shutdown_connections 2023-11-24T06:17:10.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:10.645+0000 7f44bc11d640 1 -- 172.21.15.22:0/2698544265 wait complete. 2023-11-24T06:17:10.667 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ERROR 2023-11-24T06:17:10.668 INFO:tasks.cephfs_test_runner: 2023-11-24T06:17:10.668 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T06:17:10.668 INFO:tasks.cephfs_test_runner:ERROR: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T06:17:10.668 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T06:17:10.668 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:17:10.668 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T06:17:10.668 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 7881, in test_malicious_metafile_on_legacy_to_v1_upgrade 2023-11-24T06:17:10.668 INFO:tasks.cephfs_test_runner: subvol1, subvol2 = self._generate_random_subvolume_name(2) 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner:AttributeError: 'TestMisc' object has no attribute '_generate_random_subvolume_name' 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner: 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner:Ran 3 tests in 263.195s 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner: 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner: 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner:ERROR: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 7881, in test_malicious_metafile_on_legacy_to_v1_upgrade 2023-11-24T06:17:10.669 INFO:tasks.cephfs_test_runner: subvol1, subvol2 = self._generate_random_subvolume_name(2) 2023-11-24T06:17:10.670 INFO:tasks.cephfs_test_runner:AttributeError: 'TestMisc' object has no attribute '_generate_random_subvolume_name' 2023-11-24T06:17:10.670 INFO:tasks.cephfs_test_runner: 2023-11-24T06:17:10.670 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T06:17:10.778 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2b33eb7fea1a4e7493c95c15e3470ce2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T06:17:10.780 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-24T06:17:10.789 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-24T06:17:10.829 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-24T06:17:10.829 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:17:10.829 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:10.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:17:10.890 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-11-24T06:17:10.890 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:10.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:17:10.945 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:17:10.945 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:11.008 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:17:11.008 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-24T06:17:11.008 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:11.066 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:17:11.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:11.066 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-11-24T06:17:11.125 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:17:11.125 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:17:11.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:11.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:17:11.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:11.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:17:11.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:11.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2023-11-24T06:17:11.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:11.463 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-24T06:17:11.528 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:17:11.528 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:17:11.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:11.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:17:11.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:11.637 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:17:11.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:11.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2023-11-24T06:17:11.878 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-24T06:17:11.887 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T06:17:11.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:17:12.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.121+0000 7f0a8f1ac640 1 Processor -- start 2023-11-24T06:17:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.121+0000 7f0a8f1ac640 1 -- start start 2023-11-24T06:17:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.122+0000 7f0a8f1ac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0a8815d300 0x7f0a880ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.122+0000 7f0a8f1ac640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a8806f620 0x7f0a880ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.122+0000 7f0a8f1ac640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8806fb00 con 0x7f0a880cf2f0 2023-11-24T06:17:12.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.122+0000 7f0a8f1ac640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a880cdc30 con 0x7f0a8806f620 2023-11-24T06:17:12.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.122+0000 7f0a8f1ac640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a880cdf10 con 0x7f0a8815d300 2023-11-24T06:17:12.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.123+0000 7f0a8d9a9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a8806f620 0x7f0a880ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.123+0000 7f0a8d9a9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a8806f620 0x7f0a880ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57970/0 (socket says 172.21.15.22:57970) 2023-11-24T06:17:12.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.123+0000 7f0a8d9a9640 1 -- 172.21.15.22:0/2950790149 learned_addr learned my addr 172.21.15.22:0/2950790149 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:12.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.123+0000 7f0a8e1aa640 1 --2- 172.21.15.22:0/2950790149 >> v2:172.21.15.31:3300/0 conn(0x7f0a8815d300 0x7f0a880ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.123+0000 7f0a8d9a9640 1 -- 172.21.15.22:0/2950790149 >> v2:172.21.15.31:3300/0 conn(0x7f0a8815d300 msgr2=0x7f0a880ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:12.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.123+0000 7f0a8d9a9640 1 --2- 172.21.15.22:0/2950790149 >> v2:172.21.15.31:3300/0 conn(0x7f0a8815d300 0x7f0a880ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.123+0000 7f0a8d9a9640 1 -- 172.21.15.22:0/2950790149 >> v1:172.21.15.31:6789/0 conn(0x7f0a880cf2f0 legacy=0x7f0a8806d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:12.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.123+0000 7f0a8d9a9640 1 -- 172.21.15.22:0/2950790149 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a880ce1f0 con 0x7f0a8806f620 2023-11-24T06:17:12.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.124+0000 7f0a8e1aa640 1 --2- 172.21.15.22:0/2950790149 >> v2:172.21.15.31:3300/0 conn(0x7f0a8815d300 0x7f0a880ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:12.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.125+0000 7f0a8d9a9640 1 --2- 172.21.15.22:0/2950790149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8806f620 0x7f0a880ca370 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f0a88067b80 tx=0x7f0a7802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0e7c2003b4f4d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.125+0000 7f0a8d1a8640 1 -- 172.21.15.22:0/2950790149 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78031750 con 0x7f0a8806f620 2023-11-24T06:17:12.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.125+0000 7f0a8d1a8640 1 -- 172.21.15.22:0/2950790149 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a780318b0 con 0x7f0a8806f620 2023-11-24T06:17:12.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.125+0000 7f0a8d1a8640 1 -- 172.21.15.22:0/2950790149 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78031c40 con 0x7f0a8806f620 2023-11-24T06:17:12.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.126+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/2950790149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8806f620 msgr2=0x7f0a880ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.126+0000 7f0a8f1ac640 1 --2- 172.21.15.22:0/2950790149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8806f620 0x7f0a880ca370 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f0a88067b80 tx=0x7f0a7802b7f0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.126+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/2950790149 shutdown_connections 2023-11-24T06:17:12.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.126+0000 7f0a8f1ac640 1 --2- 172.21.15.22:0/2950790149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8806f620 0x7f0a880ca370 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.126+0000 7f0a8f1ac640 1 --2- 172.21.15.22:0/2950790149 >> v2:172.21.15.31:3300/0 conn(0x7f0a8815d300 0x7f0a880ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.126+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/2950790149 >> 172.21.15.22:0/2950790149 conn(0x7f0a880cfd20 msgr2=0x7f0a880d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:12.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.126+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/2950790149 shutdown_connections 2023-11-24T06:17:12.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.126+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/2950790149 wait complete. 2023-11-24T06:17:12.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.128+0000 7f0a8f1ac640 1 Processor -- start 2023-11-24T06:17:12.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.128+0000 7f0a8f1ac640 1 -- start start 2023-11-24T06:17:12.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.129+0000 7f0a8f1ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a8806f620 0x7f0a881584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.129+0000 7f0a8f1ac640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a880cf2f0 0x7f0a8815f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.129+0000 7f0a8f1ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8815d300 0x7f0a8815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.129+0000 7f0a8f1ac640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a881f31d0 con 0x7f0a8815d300 2023-11-24T06:17:12.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.129+0000 7f0a8f1ac640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a881f4230 con 0x7f0a8806f620 2023-11-24T06:17:12.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.129+0000 7f0a8f1ac640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a881f3470 con 0x7f0a880cf2f0 2023-11-24T06:17:12.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.129+0000 7f0a8e9ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8815d300 0x7f0a8815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.129+0000 7f0a8e9ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8815d300 0x7f0a8815adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57974/0 (socket says 172.21.15.22:57974) 2023-11-24T06:17:12.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.129+0000 7f0a8e9ab640 1 -- 172.21.15.22:0/3718245909 learned_addr learned my addr 172.21.15.22:0/3718245909 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:12.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.130+0000 7f0a8e1aa640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a8806f620 0x7f0a881584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.130+0000 7f0a8e9ab640 1 -- 172.21.15.22:0/3718245909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a880cf2f0 msgr2=0x7f0a8815f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.130+0000 7f0a8e9ab640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a880cf2f0 0x7f0a8815f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.130+0000 7f0a8e9ab640 1 -- 172.21.15.22:0/3718245909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a8806f620 msgr2=0x7f0a881584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.130+0000 7f0a8e9ab640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a8806f620 0x7f0a881584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.130+0000 7f0a8e9ab640 1 -- 172.21.15.22:0/3718245909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a780094d0 con 0x7f0a8815d300 2023-11-24T06:17:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.130+0000 7f0a8e9ab640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8815d300 0x7f0a8815adf0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c780 tx=0x7f0a8000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.130+0000 7f0a7effd640 1 -- 172.21.15.22:0/3718245909 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80004b60 con 0x7f0a8815d300 2023-11-24T06:17:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.131+0000 7f0a7effd640 1 -- 172.21.15.22:0/3718245909 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8000ce90 con 0x7f0a8815d300 2023-11-24T06:17:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.131+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a881f3750 con 0x7f0a8815d300 2023-11-24T06:17:12.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.131+0000 7f0a7effd640 1 -- 172.21.15.22:0/3718245909 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000a850 con 0x7f0a8815d300 2023-11-24T06:17:12.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.131+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a881f3d10 con 0x7f0a8815d300 2023-11-24T06:17:12.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.132+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a88160940 con 0x7f0a8815d300 2023-11-24T06:17:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.133+0000 7f0a7effd640 1 -- 172.21.15.22:0/3718245909 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0a8000a9b0 con 0x7f0a8815d300 2023-11-24T06:17:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.134+0000 7f0a7effd640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0a6c06aff0 0x7f0a6c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.134+0000 7f0a7effd640 1 -- 172.21.15.22:0/3718245909 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0a800897e0 con 0x7f0a8815d300 2023-11-24T06:17:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.134+0000 7f0a8e1aa640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0a6c06aff0 0x7f0a6c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.135+0000 7f0a8e1aa640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0a6c06aff0 0x7f0a6c06d4b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400a950 tx=0x7f0a84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.140+0000 7f0a7effd640 1 -- 172.21.15.22:0/3718245909 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a80054900 con 0x7f0a8815d300 2023-11-24T06:17:12.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.332+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a880ca1c0 con 0x7f0a6c06aff0 2023-11-24T06:17:12.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.338+0000 7f0a7effd640 1 -- 172.21.15.22:0/3718245909 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48621 (secure 0 0 0) 0x7f0a880ca1c0 con 0x7f0a6c06aff0 2023-11-24T06:17:12.341 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:12.341 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:17:12.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.340+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0a6c06aff0 msgr2=0x7f0a6c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.340+0000 7f0a8f1ac640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0a6c06aff0 0x7f0a6c06d4b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400a950 tx=0x7f0a84008040 comp rx=0 tx=0).stop 2023-11-24T06:17:12.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.340+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8815d300 msgr2=0x7f0a8815adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.341+0000 7f0a8f1ac640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8815d300 0x7f0a8815adf0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c780 tx=0x7f0a8000cc40 comp rx=0 tx=0).stop 2023-11-24T06:17:12.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.341+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 shutdown_connections 2023-11-24T06:17:12.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.341+0000 7f0a8f1ac640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f0a6c06aff0 0x7f0a6c06d4b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.341+0000 7f0a8f1ac640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8815d300 0x7f0a8815adf0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.341+0000 7f0a8f1ac640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0a880cf2f0 0x7f0a8815f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.341+0000 7f0a8f1ac640 1 --2- 172.21.15.22:0/3718245909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a8806f620 0x7f0a881584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.341+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 >> 172.21.15.22:0/3718245909 conn(0x7f0a880cfd20 msgr2=0x7f0a880ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:12.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.341+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 shutdown_connections 2023-11-24T06:17:12.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.341+0000 7f0a8f1ac640 1 -- 172.21.15.22:0/3718245909 wait complete. 2023-11-24T06:17:12.362 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-11-24T06:17:10.754519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243956,"kb_used_data":6992,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730764,"statfs":{"total":773094113280,"available":772844302336,"internally_reserved":0,"allocated":7159808,"data_stored":3651287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4388,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001749"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-24T06:17:06.584681+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:17:06.584681+0000","last_peered":"2023-11-24T06:17:06.584681+0000","last_clean":"2023-11-24T06:17:06.584681+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:17:06.584681+0000","last_undegraded":"2023-11-24T06:17:06.584681+0000","last_fullsized":"2023-11-24T06:17:06.584681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476803,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":313056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1140000000000001,"15min":1.0649999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.149,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":1.512},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1639999999999999,"15min":1.0680000000000001},"min":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.861,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.222}]},{"osd":1,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1319999999999999,"15min":1.1160000000000001},"min":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.617,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.3},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2050000000000001,"15min":1.1279999999999999},"min":{"1min":0.76900000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.1040000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.23,"15min":1.159},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8180000000000001,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.391,"5min":1.2969999999999999,"15min":1.341},"min":{"1min":1.0369999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7669999999999999,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.5700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.349,"15min":1.3169999999999999},"min":{"1min":0.94799999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7669999999999999,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.456},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3799999999999999,"15min":1.349},"min":{"1min":0.91500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.0819999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.8999999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.339,"15min":1.3049999999999999},"min":{"1min":0.75700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1150000000000002,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.262},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.4850000000000001,"15min":1.373},"min":{"1min":0.95399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.9450000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.8460000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.88900000000000001,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.865,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.504,"15min":1.4630000000000001},"min":{"1min":0.82299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.994,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.369}]},{"osd":7,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.6000000000000001,"15min":1.5620000000000001},"min":{"1min":0.71599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.052,"5min":3.262,"15min":3.262},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.653,"15min":1.6830000000000001},"min":{"1min":1.345,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.206,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.4119999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1339392,"data_stored":897581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1439999999999999,"15min":1.0800000000000001},"min":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.343},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.218,"15min":1.1599999999999999},"min":{"1min":0.73099999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6220000000000001,"5min":1.72,"15min":1.72},"last":1.4199999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1910000000000001,"15min":1.198},"min":{"1min":0.64900000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.794,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3149999999999999,"15min":1.294},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.782,"5min":1.847,"15min":1.847},"last":1.5580000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.236,"15min":1.2090000000000001},"min":{"1min":0.82399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8129999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2829999999999999,"15min":1.2949999999999999},"min":{"1min":0.85099999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.456}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3140000000000001,"15min":1.3240000000000001},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6499999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.3879999999999999,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.7829999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.1879999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.258,"15min":1.242},"min":{"1min":0.75600000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.78,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.226},{"interface":"front","average":{"1min":1.425,"5min":1.46,"15min":1.4259999999999999},"min":{"1min":0.88,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.964,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.5309999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.55,"15min":1.532},"min":{"1min":1.097,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.927,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.7010000000000001,"15min":1.6739999999999999},"min":{"1min":1.2729999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":1.9059999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.288}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.446,"15min":1.494},"min":{"1min":0.92600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8740000000000001,"5min":2.5,"15min":2.5},"last":1.5},{"interface":"front","average":{"1min":1.694,"5min":1.758,"15min":1.7390000000000001},"min":{"1min":1.2529999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.9530000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.607}]}]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":307053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0660000000000001,"15min":1.0649999999999999},"min":{"1min":0.66700000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.595},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.127},"min":{"1min":0.70099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.71,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.377}]},{"osd":1,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1160000000000001,"15min":1.212},"min":{"1min":0.77000000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.04},{"interface":"front","average":{"1min":1.27,"5min":1.272,"15min":1.2589999999999999},"min":{"1min":0.73999999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.907,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.6259999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3129999999999999,"15min":1.319},"min":{"1min":0.82699999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8380000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.23},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3700000000000001,"15min":1.458},"min":{"1min":0.86499999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.754,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.3799999999999999},"min":{"1min":0.98099999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.623,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.512},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3380000000000001,"15min":1.454},"min":{"1min":0.746,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8029999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.96599999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.79,"5min":2.258,"15min":2.258},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.427,"15min":1.5269999999999999},"min":{"1min":1.095,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9039999999999999,"5min":2.105,"15min":2.105},"last":1.7070000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.492,"15min":1.5549999999999999},"min":{"1min":1.0489999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8220000000000001,"5min":2.319,"15min":2.319},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.5940000000000001,"15min":1.6459999999999999},"min":{"1min":1.0800000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9390000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.4079999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.6419999999999999,"15min":1.6850000000000001},"min":{"1min":1.117,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.8560000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.7909999999999999},{"interface":"front","average":{"1min":1.625,"5min":1.698,"15min":1.7689999999999999},"min":{"1min":1.226,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0329999999999999,"5min":2.669,"15min":2.669},"last":1.5640000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":310643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.101,"15min":1.091},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.327}]},{"osd":1,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2729999999999999,"15min":1.2949999999999999},"min":{"1min":0.92300000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.603},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.212,"15min":1.2769999999999999},"min":{"1min":0.69799999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.73,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.389}]},{"osd":2,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2330000000000001,"15min":1.1970000000000001},"min":{"1min":0.80400000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.748,"5min":2.04,"15min":2.04},"last":1.159},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3640000000000001,"15min":1.4059999999999999},"min":{"1min":0.89900000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.839,"5min":2.016,"15min":2.016},"last":1.4970000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.242,"15min":1.286},"min":{"1min":0.98099999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.706,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3129999999999999,"15min":1.3480000000000001},"min":{"1min":0.83199999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9690000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.4259999999999999},"min":{"1min":0.70399999999999996,"5min":0.63,"15min":0.63},"max":{"1min":2.0289999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.409,"15min":1.5149999999999999},"min":{"1min":0.79400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9510000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.554}]},{"osd":6,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5009999999999999,"15min":1.5700000000000001},"min":{"1min":0.68100000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.0739999999999998,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.647},{"interface":"front","average":{"1min":1.5,"5min":1.492,"15min":1.603},"min":{"1min":0.85299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9670000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.802}]},{"osd":7,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.423,"15min":1.5369999999999999},"min":{"1min":0.71599999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8999999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.851},{"interface":"front","average":{"1min":1.579,"5min":1.625,"15min":1.7},"min":{"1min":0.74199999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2130000000000001,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.748}]}]},{"osd":3,"up_from":15,"seq":64424509506,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":307109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.86799999999999999},"min":{"1min":0.52300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.274,"5min":1.607,"15min":1.607},"last":1.105},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.90300000000000002,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7649999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.60099999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.647,"5min":1.796,"15min":1.796},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.222,"5min":1.1539999999999999,"15min":1.1499999999999999},"min":{"1min":0.68100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.829,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.1279999999999999,"15min":1.0740000000000001},"min":{"1min":0.60099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.042},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.179,"15min":1.137},"min":{"1min":0.64200000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.6299999999999999,"5min":2.399,"15min":2.399},"last":0.93600000000000005}]},{"osd":4,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.89500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.403},{"interface":"front","average":{"1min":1.383,"5min":1.3300000000000001,"15min":1.29},"min":{"1min":1.0660000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":2.141,"15min":2.141},"last":1.6599999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.359,"15min":1.3360000000000001},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.849,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.3979999999999999,"15min":1.403},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1779999999999999,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.4650000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.94899999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.827,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.484},{"interface":"front","average":{"1min":1.401,"5min":1.3700000000000001,"15min":1.3400000000000001},"min":{"1min":0.85799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0030000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.4299999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4450000000000001,"15min":1.4370000000000001},"min":{"1min":0.92000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1299999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.4870000000000001,"15min":1.4770000000000001},"min":{"1min":1.099,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.2639999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.522}]}]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":307109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2869999999999999,"5min":2.552,"15min":2.552},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.92700000000000005,"15min":0.95999999999999996},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5649999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.173,"15min":1.137},"min":{"1min":0.68200000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5509999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.121},"min":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8340000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1519999999999999,"15min":1.161},"min":{"1min":0.63300000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.405,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.97199999999999998},"min":{"1min":0.48699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.423,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3069999999999999,"15min":1.329},"min":{"1min":0.85099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0640000000000001,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.448,"15min":1.4890000000000001},"min":{"1min":0.85899999999999999,"5min":0.755,"15min":0.755},"max":{"1min":1.601,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.5149999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2949999999999999,"15min":1.2410000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.901,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.391,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.851,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.28}]},{"osd":6,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3799999999999999,"15min":1.3959999999999999},"min":{"1min":0.82499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7390000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.476,"15min":1.54},"min":{"1min":0.98199999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.962,"5min":4.101,"15min":4.101},"last":1.3480000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4810000000000001,"15min":1.498},"min":{"1min":0.90700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.762,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.4650000000000001,"15min":1.488},"min":{"1min":0.86599999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8009999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.3069999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1347584,"data_stored":901593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1060000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":0.97599999999999998},"min":{"1min":0.60199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.554,"5min":2.161,"15min":2.161},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.996,"15min":1.026},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.742,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.105,"15min":1.1120000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5429999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.94999999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1879999999999999},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5009999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.202,"15min":1.206},"min":{"1min":0.65000000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5700000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.847}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.347,"15min":1.304},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5800000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.5},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3500000000000001,"15min":1.3879999999999999},"min":{"1min":0.88600000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.756,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.8859999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3080000000000001,"15min":1.282},"min":{"1min":0.79200000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.544,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":1.571},{"interface":"front","average":{"1min":1.407,"5min":1.3320000000000001,"15min":1.2629999999999999},"min":{"1min":0.80100000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.649}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4350000000000001,"15min":1.4370000000000001},"min":{"1min":0.94099999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.8460000000000001,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.716},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4119999999999999,"15min":1.3520000000000001},"min":{"1min":0.85799999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0859999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.472}]},{"osd":7,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.4490000000000001,"15min":1.4339999999999999},"min":{"1min":0.84099999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8100000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.427},{"interface":"front","average":{"1min":1.462,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.018,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.95,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.8120000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":307143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85599999999999998,"15min":0.93400000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.492,"5min":1.571,"15min":1.571},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4850000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.98499999999999999,"15min":1.0089999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4910000000000001,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.095,"15min":1.2030000000000001},"min":{"1min":0.51800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2470000000000001,"5min":2.964,"15min":2.964},"last":1.208}]},{"osd":3,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3089999999999999,"15min":1.3600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.704,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.254,"15min":1.3109999999999999},"min":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.859,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.86199999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3360000000000001,"15min":1.3300000000000001},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7130000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4199999999999999,"15min":1.5349999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8879999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.6679999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.367,"15min":1.4510000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.804,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4350000000000001,"15min":1.4610000000000001},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.718,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.371}]},{"osd":6,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.456,"15min":1.5329999999999999},"min":{"1min":0.94299999999999995,"5min":0.87,"15min":0.87},"max":{"1min":1.869,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.585},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.528,"15min":1.5409999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8460000000000001,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":1.631}]},{"osd":7,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.52,"15min":1.601},"min":{"1min":0.94599999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.04,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.613,"15min":1.6619999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.5329999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:17:12.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:17:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.584+0000 7f3675be9640 1 Processor -- start 2023-11-24T06:17:12.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.584+0000 7f3675be9640 1 -- start start 2023-11-24T06:17:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.585+0000 7f3675be9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f367015e9b0 0x7f36700cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3675be9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36700b0b10 0x7f36700b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3675be9640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700aef20 con 0x7f36700cef60 2023-11-24T06:17:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3675be9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700cfce0 con 0x7f367015e9b0 2023-11-24T06:17:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3675be9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367015ed90 con 0x7f36700b0b10 2023-11-24T06:17:12.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3674be7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f367015e9b0 0x7f36700cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3674be7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f367015e9b0 0x7f36700cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57980/0 (socket says 172.21.15.22:57980) 2023-11-24T06:17:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3674be7640 1 -- 172.21.15.22:0/533456465 learned_addr learned my addr 172.21.15.22:0/533456465 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f366ffff640 1 --1- 172.21.15.22:0/533456465 >> v1:172.21.15.22:6789/0 conn(0x7f36700cef60 0x7f36700b0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51362/0 (socket says 172.21.15.22:51362) 2023-11-24T06:17:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f36753e8640 1 --2- 172.21.15.22:0/533456465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36700b0b10 0x7f36700b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3674be7640 1 -- 172.21.15.22:0/533456465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36700b0b10 msgr2=0x7f36700b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3674be7640 1 --2- 172.21.15.22:0/533456465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36700b0b10 0x7f36700b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f3674be7640 1 -- 172.21.15.22:0/533456465 >> v1:172.21.15.22:6789/0 conn(0x7f36700cef60 legacy=0x7f36700b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.587+0000 7f3674be7640 1 -- 172.21.15.22:0/533456465 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700cf440 con 0x7f367015e9b0 2023-11-24T06:17:12.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.586+0000 7f366f7fe640 1 -- 172.21.15.22:0/533456465 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428614207 0 0) 0x7f36700aef20 con 0x7f36700cef60 2023-11-24T06:17:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.588+0000 7f3674be7640 1 --2- 172.21.15.22:0/533456465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367015e9b0 0x7f36700cb860 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f3660009870 tx=0x7f366002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8a3d36494bb3da server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.588+0000 7f366f7fe640 1 -- 172.21.15.22:0/533456465 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660030840 con 0x7f367015e9b0 2023-11-24T06:17:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.588+0000 7f366f7fe640 1 -- 172.21.15.22:0/533456465 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36600309a0 con 0x7f367015e9b0 2023-11-24T06:17:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.588+0000 7f366f7fe640 1 -- 172.21.15.22:0/533456465 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660030d30 con 0x7f367015e9b0 2023-11-24T06:17:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.589+0000 7f3675be9640 1 -- 172.21.15.22:0/533456465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367015e9b0 msgr2=0x7f36700cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.589+0000 7f3675be9640 1 --2- 172.21.15.22:0/533456465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367015e9b0 0x7f36700cb860 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f3660009870 tx=0x7f366002b980 comp rx=0 tx=0).stop 2023-11-24T06:17:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.589+0000 7f3675be9640 1 -- 172.21.15.22:0/533456465 shutdown_connections 2023-11-24T06:17:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.589+0000 7f3675be9640 1 --2- 172.21.15.22:0/533456465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36700b0b10 0x7f36700b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.589+0000 7f3675be9640 1 --2- 172.21.15.22:0/533456465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367015e9b0 0x7f36700cb860 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.589+0000 7f3675be9640 1 -- 172.21.15.22:0/533456465 >> 172.21.15.22:0/533456465 conn(0x7f36700b2a00 msgr2=0x7f36700b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.589+0000 7f3675be9640 1 -- 172.21.15.22:0/533456465 shutdown_connections 2023-11-24T06:17:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.589+0000 7f3675be9640 1 -- 172.21.15.22:0/533456465 wait complete. 2023-11-24T06:17:12.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.591+0000 7f3675be9640 1 Processor -- start 2023-11-24T06:17:12.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.591+0000 7f3675be9640 1 -- start start 2023-11-24T06:17:12.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.592+0000 7f3675be9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36700b0b10 0x7f36700ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.592+0000 7f3675be9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36700cef60 0x7f36700c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.592+0000 7f3675be9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f367015e9b0 0x7f36701e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.592+0000 7f3675be9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36700b4bd0 con 0x7f36700b0b10 2023-11-24T06:17:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.592+0000 7f3675be9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36700b3fc0 con 0x7f36700cef60 2023-11-24T06:17:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.592+0000 7f3675be9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36700b42a0 con 0x7f367015e9b0 2023-11-24T06:17:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.592+0000 7f3674be7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36700b0b10 0x7f36700ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f3674be7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36700b0b10 0x7f36700ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57996/0 (socket says 172.21.15.22:57996) 2023-11-24T06:17:12.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f3674be7640 1 -- 172.21.15.22:0/3392415427 learned_addr learned my addr 172.21.15.22:0/3392415427 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f366ffff640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36700cef60 0x7f36700c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f36753e8640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f367015e9b0 0x7f36701e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f3674be7640 1 -- 172.21.15.22:0/3392415427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f367015e9b0 msgr2=0x7f36701e4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f3674be7640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f367015e9b0 0x7f36701e4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f3674be7640 1 -- 172.21.15.22:0/3392415427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36700cef60 msgr2=0x7f36700c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f3674be7640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36700cef60 0x7f36700c6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f3674be7640 1 -- 172.21.15.22:0/3392415427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36600094d0 con 0x7f36700b0b10 2023-11-24T06:17:12.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.593+0000 7f3674be7640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36700b0b10 0x7f36700ca980 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f3660009870 tx=0x7f3660004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.594+0000 7f366d7fa640 1 -- 172.21.15.22:0/3392415427 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36600307f0 con 0x7f36700b0b10 2023-11-24T06:17:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.594+0000 7f366d7fa640 1 -- 172.21.15.22:0/3392415427 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3660043400 con 0x7f36700b0b10 2023-11-24T06:17:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.594+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36700b4580 con 0x7f36700b0b10 2023-11-24T06:17:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.594+0000 7f366d7fa640 1 -- 172.21.15.22:0/3392415427 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36600437b0 con 0x7f36700b0b10 2023-11-24T06:17:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.594+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36700c5ec0 con 0x7f36700b0b10 2023-11-24T06:17:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.595+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367004e840 con 0x7f36700b0b10 2023-11-24T06:17:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.596+0000 7f366d7fa640 1 -- 172.21.15.22:0/3392415427 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3660043910 con 0x7f36700b0b10 2023-11-24T06:17:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.597+0000 7f366d7fa640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f365c06b020 0x7f365c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.597+0000 7f366d7fa640 1 -- 172.21.15.22:0/3392415427 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f366003e070 con 0x7f36700b0b10 2023-11-24T06:17:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.597+0000 7f366ffff640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f365c06b020 0x7f365c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.598+0000 7f366ffff640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f365c06b020 0x7f365c06d4e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f36701e5ee0 tx=0x7f3664007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.601+0000 7f366d7fa640 1 -- 172.21.15.22:0/3392415427 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3660077a00 con 0x7f36700b0b10 2023-11-24T06:17:12.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.791+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36700cff60 con 0x7f365c06b020 2023-11-24T06:17:12.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.797+0000 7f366d7fa640 1 -- 172.21.15.22:0/3392415427 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48621 (secure 0 0 0) 0x7f36700cff60 con 0x7f365c06b020 2023-11-24T06:17:12.800 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:12.801 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:17:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f365c06b020 msgr2=0x7f365c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f365c06b020 0x7f365c06d4e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f36701e5ee0 tx=0x7f3664007b50 comp rx=0 tx=0).stop 2023-11-24T06:17:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36700b0b10 msgr2=0x7f36700ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36700b0b10 0x7f36700ca980 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f3660009870 tx=0x7f3660004730 comp rx=0 tx=0).stop 2023-11-24T06:17:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 shutdown_connections 2023-11-24T06:17:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f365c06b020 0x7f365c06d4e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f367015e9b0 0x7f36701e4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36700cef60 0x7f36700c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 --2- 172.21.15.22:0/3392415427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36700b0b10 0x7f36700ca980 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 >> 172.21.15.22:0/3392415427 conn(0x7f36700b2a00 msgr2=0x7f36700af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.800+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 shutdown_connections 2023-11-24T06:17:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:12.801+0000 7f3675be9640 1 -- 172.21.15.22:0/3392415427 wait complete. 2023-11-24T06:17:12.822 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2023-11-24T06:17:12.754973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243956,"kb_used_data":6992,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730764,"statfs":{"total":773094113280,"available":772844302336,"internally_reserved":0,"allocated":7159808,"data_stored":3651287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4388,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.177434"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-24T06:17:06.584681+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:17:06.584681+0000","last_peered":"2023-11-24T06:17:06.584681+0000","last_clean":"2023-11-24T06:17:06.584681+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:17:06.584681+0000","last_undegraded":"2023-11-24T06:17:06.584681+0000","last_fullsized":"2023-11-24T06:17:06.584681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476803,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":313056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1140000000000001,"15min":1.0649999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.149,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":1.512},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1639999999999999,"15min":1.0680000000000001},"min":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.861,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.222}]},{"osd":1,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1319999999999999,"15min":1.1160000000000001},"min":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.617,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.3},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2050000000000001,"15min":1.1279999999999999},"min":{"1min":0.76900000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.1040000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.23,"15min":1.159},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8180000000000001,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.391,"5min":1.2969999999999999,"15min":1.341},"min":{"1min":1.0369999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7669999999999999,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.5700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.349,"15min":1.3169999999999999},"min":{"1min":0.94799999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7669999999999999,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.456},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3799999999999999,"15min":1.349},"min":{"1min":0.91500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.0819999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.8999999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.339,"15min":1.3049999999999999},"min":{"1min":0.75700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1150000000000002,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.262},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.4850000000000001,"15min":1.373},"min":{"1min":0.95399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.9450000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.8460000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.88900000000000001,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.865,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.504,"15min":1.4630000000000001},"min":{"1min":0.82299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.994,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.369}]},{"osd":7,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.6000000000000001,"15min":1.5620000000000001},"min":{"1min":0.71599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.052,"5min":3.262,"15min":3.262},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.653,"15min":1.6830000000000001},"min":{"1min":1.345,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.206,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.4119999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1339392,"data_stored":897581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1439999999999999,"15min":1.0800000000000001},"min":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.343},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.218,"15min":1.1599999999999999},"min":{"1min":0.73099999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6220000000000001,"5min":1.72,"15min":1.72},"last":1.4199999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1910000000000001,"15min":1.198},"min":{"1min":0.64900000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.794,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3149999999999999,"15min":1.294},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.782,"5min":1.847,"15min":1.847},"last":1.5580000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.236,"15min":1.2090000000000001},"min":{"1min":0.82399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8129999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2829999999999999,"15min":1.2949999999999999},"min":{"1min":0.85099999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.456}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3140000000000001,"15min":1.3240000000000001},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6499999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.3879999999999999,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.7829999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.1879999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.258,"15min":1.242},"min":{"1min":0.75600000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.78,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.226},{"interface":"front","average":{"1min":1.425,"5min":1.46,"15min":1.4259999999999999},"min":{"1min":0.88,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.964,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.5309999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.55,"15min":1.532},"min":{"1min":1.097,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.927,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.7010000000000001,"15min":1.6739999999999999},"min":{"1min":1.2729999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":1.9059999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.288}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.446,"15min":1.494},"min":{"1min":0.92600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8740000000000001,"5min":2.5,"15min":2.5},"last":1.5},{"interface":"front","average":{"1min":1.694,"5min":1.758,"15min":1.7390000000000001},"min":{"1min":1.2529999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.9530000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.607}]}]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":307053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0660000000000001,"15min":1.0649999999999999},"min":{"1min":0.66700000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.595},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.127},"min":{"1min":0.70099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.71,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.377}]},{"osd":1,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1160000000000001,"15min":1.212},"min":{"1min":0.77000000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.04},{"interface":"front","average":{"1min":1.27,"5min":1.272,"15min":1.2589999999999999},"min":{"1min":0.73999999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.907,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.6259999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3129999999999999,"15min":1.319},"min":{"1min":0.82699999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8380000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.23},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3700000000000001,"15min":1.458},"min":{"1min":0.86499999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.754,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.3799999999999999},"min":{"1min":0.98099999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.623,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.512},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3380000000000001,"15min":1.454},"min":{"1min":0.746,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8029999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.96599999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.79,"5min":2.258,"15min":2.258},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.427,"15min":1.5269999999999999},"min":{"1min":1.095,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9039999999999999,"5min":2.105,"15min":2.105},"last":1.7070000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.492,"15min":1.5549999999999999},"min":{"1min":1.0489999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8220000000000001,"5min":2.319,"15min":2.319},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.5940000000000001,"15min":1.6459999999999999},"min":{"1min":1.0800000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9390000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.4079999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.6419999999999999,"15min":1.6850000000000001},"min":{"1min":1.117,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.8560000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.7909999999999999},{"interface":"front","average":{"1min":1.625,"5min":1.698,"15min":1.7689999999999999},"min":{"1min":1.226,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0329999999999999,"5min":2.669,"15min":2.669},"last":1.5640000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":310643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.101,"15min":1.091},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.327}]},{"osd":1,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2729999999999999,"15min":1.2949999999999999},"min":{"1min":0.92300000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.603},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.212,"15min":1.2769999999999999},"min":{"1min":0.69799999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.73,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.389}]},{"osd":2,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2330000000000001,"15min":1.1970000000000001},"min":{"1min":0.80400000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.748,"5min":2.04,"15min":2.04},"last":1.159},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3640000000000001,"15min":1.4059999999999999},"min":{"1min":0.89900000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.839,"5min":2.016,"15min":2.016},"last":1.4970000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.242,"15min":1.286},"min":{"1min":0.98099999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.706,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3129999999999999,"15min":1.3480000000000001},"min":{"1min":0.83199999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9690000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.4259999999999999},"min":{"1min":0.70399999999999996,"5min":0.63,"15min":0.63},"max":{"1min":2.0289999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.409,"15min":1.5149999999999999},"min":{"1min":0.79400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9510000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.554}]},{"osd":6,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5009999999999999,"15min":1.5700000000000001},"min":{"1min":0.68100000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.0739999999999998,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.647},{"interface":"front","average":{"1min":1.5,"5min":1.492,"15min":1.603},"min":{"1min":0.85299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9670000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.802}]},{"osd":7,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.423,"15min":1.5369999999999999},"min":{"1min":0.71599999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8999999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.851},{"interface":"front","average":{"1min":1.579,"5min":1.625,"15min":1.7},"min":{"1min":0.74199999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2130000000000001,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.748}]}]},{"osd":3,"up_from":15,"seq":64424509506,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":307109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.86799999999999999},"min":{"1min":0.52300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.274,"5min":1.607,"15min":1.607},"last":1.105},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.90300000000000002,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7649999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.60099999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.647,"5min":1.796,"15min":1.796},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.222,"5min":1.1539999999999999,"15min":1.1499999999999999},"min":{"1min":0.68100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.829,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.1279999999999999,"15min":1.0740000000000001},"min":{"1min":0.60099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.042},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.179,"15min":1.137},"min":{"1min":0.64200000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.6299999999999999,"5min":2.399,"15min":2.399},"last":0.93600000000000005}]},{"osd":4,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.89500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.403},{"interface":"front","average":{"1min":1.383,"5min":1.3300000000000001,"15min":1.29},"min":{"1min":1.0660000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":2.141,"15min":2.141},"last":1.6599999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.359,"15min":1.3360000000000001},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.849,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.3979999999999999,"15min":1.403},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1779999999999999,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.4650000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.94899999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.827,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.484},{"interface":"front","average":{"1min":1.401,"5min":1.3700000000000001,"15min":1.3400000000000001},"min":{"1min":0.85799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0030000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.4299999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4450000000000001,"15min":1.4370000000000001},"min":{"1min":0.92000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1299999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.4870000000000001,"15min":1.4770000000000001},"min":{"1min":1.099,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.2639999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.522}]}]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":307109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2869999999999999,"5min":2.552,"15min":2.552},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.92700000000000005,"15min":0.95999999999999996},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5649999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.173,"15min":1.137},"min":{"1min":0.68200000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5509999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.121},"min":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8340000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1519999999999999,"15min":1.161},"min":{"1min":0.63300000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.405,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.97199999999999998},"min":{"1min":0.48699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.423,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3069999999999999,"15min":1.329},"min":{"1min":0.85099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0640000000000001,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.448,"15min":1.4890000000000001},"min":{"1min":0.85899999999999999,"5min":0.755,"15min":0.755},"max":{"1min":1.601,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.5149999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2949999999999999,"15min":1.2410000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.901,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.391,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.851,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.28}]},{"osd":6,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3799999999999999,"15min":1.3959999999999999},"min":{"1min":0.82499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7390000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.476,"15min":1.54},"min":{"1min":0.98199999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.962,"5min":4.101,"15min":4.101},"last":1.3480000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4810000000000001,"15min":1.498},"min":{"1min":0.90700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.762,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.4650000000000001,"15min":1.488},"min":{"1min":0.86599999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8009999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.3069999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1347584,"data_stored":901593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1060000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":0.97599999999999998},"min":{"1min":0.60199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.554,"5min":2.161,"15min":2.161},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.996,"15min":1.026},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.742,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.105,"15min":1.1120000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5429999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.94999999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1879999999999999},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5009999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.202,"15min":1.206},"min":{"1min":0.65000000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5700000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.847}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.347,"15min":1.304},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5800000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.5},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3500000000000001,"15min":1.3879999999999999},"min":{"1min":0.88600000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.756,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.8859999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3080000000000001,"15min":1.282},"min":{"1min":0.79200000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.544,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":1.571},{"interface":"front","average":{"1min":1.407,"5min":1.3320000000000001,"15min":1.2629999999999999},"min":{"1min":0.80100000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.649}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4350000000000001,"15min":1.4370000000000001},"min":{"1min":0.94099999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.8460000000000001,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.716},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4119999999999999,"15min":1.3520000000000001},"min":{"1min":0.85799999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0859999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.472}]},{"osd":7,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.4490000000000001,"15min":1.4339999999999999},"min":{"1min":0.84099999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8100000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.427},{"interface":"front","average":{"1min":1.462,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.018,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.95,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.8120000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":307143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85599999999999998,"15min":0.93400000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.492,"5min":1.571,"15min":1.571},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4850000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.98499999999999999,"15min":1.0089999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4910000000000001,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.095,"15min":1.2030000000000001},"min":{"1min":0.51800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2470000000000001,"5min":2.964,"15min":2.964},"last":1.208}]},{"osd":3,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3089999999999999,"15min":1.3600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.704,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.254,"15min":1.3109999999999999},"min":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.859,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.86199999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3360000000000001,"15min":1.3300000000000001},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7130000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4199999999999999,"15min":1.5349999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8879999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.6679999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.367,"15min":1.4510000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.804,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4350000000000001,"15min":1.4610000000000001},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.718,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.371}]},{"osd":6,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.456,"15min":1.5329999999999999},"min":{"1min":0.94299999999999995,"5min":0.87,"15min":0.87},"max":{"1min":1.869,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.585},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.528,"15min":1.5409999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8460000000000001,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":1.631}]},{"osd":7,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.52,"15min":1.601},"min":{"1min":0.94599999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.04,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.613,"15min":1.6619999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.5329999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:17:12.823 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T06:17:12.824 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:17:13.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.044+0000 7ffa3147c640 1 Processor -- start 2023-11-24T06:17:13.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.045+0000 7ffa3147c640 1 -- start start 2023-11-24T06:17:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.046+0000 7ffa3147c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffa2c146010 0x7ffa2c1463f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.046+0000 7ffa3147c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffa2c06f1a0 0x7ffa2c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.046+0000 7ffa3147c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2c15d970 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.046+0000 7ffa3147c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c06b890 con 0x7ffa2c146010 2023-11-24T06:17:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.046+0000 7ffa3147c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c0d1550 con 0x7ffa2c06f1a0 2023-11-24T06:17:13.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.047+0000 7ffa2affd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffa2c146010 0x7ffa2c1463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.047+0000 7ffa2affd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffa2c146010 0x7ffa2c1463f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58010/0 (socket says 172.21.15.22:58010) 2023-11-24T06:17:13.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.047+0000 7ffa2affd640 1 -- 172.21.15.22:0/3361465519 learned_addr learned my addr 172.21.15.22:0/3361465519 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:13.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.047+0000 7ffa2affd640 1 -- 172.21.15.22:0/3361465519 >> v2:172.21.15.31:3300/0 conn(0x7ffa2c06f1a0 msgr2=0x7ffa2c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.047+0000 7ffa2affd640 1 --2- 172.21.15.22:0/3361465519 >> v2:172.21.15.31:3300/0 conn(0x7ffa2c06f1a0 0x7ffa2c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.047+0000 7ffa2affd640 1 -- 172.21.15.22:0/3361465519 >> v1:172.21.15.22:6789/0 conn(0x7ffa2c0d0fe0 legacy=0x7ffa2c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.047+0000 7ffa2affd640 1 -- 172.21.15.22:0/3361465519 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c0d1830 con 0x7ffa2c146010 2023-11-24T06:17:13.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.048+0000 7ffa2affd640 1 --2- 172.21.15.22:0/3361465519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c146010 0x7ffa2c1463f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0d1460 tx=0x7ffa1c02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a1180427ddb023 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa29ffb640 1 -- 172.21.15.22:0/3361465519 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c030870 con 0x7ffa2c146010 2023-11-24T06:17:13.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa29ffb640 1 -- 172.21.15.22:0/3361465519 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c0309d0 con 0x7ffa2c146010 2023-11-24T06:17:13.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa29ffb640 1 -- 172.21.15.22:0/3361465519 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c030d60 con 0x7ffa2c146010 2023-11-24T06:17:13.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa3147c640 1 -- 172.21.15.22:0/3361465519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c146010 msgr2=0x7ffa2c1463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa3147c640 1 --2- 172.21.15.22:0/3361465519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c146010 0x7ffa2c1463f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0d1460 tx=0x7ffa1c02b9b0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa3147c640 1 -- 172.21.15.22:0/3361465519 shutdown_connections 2023-11-24T06:17:13.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa3147c640 1 --2- 172.21.15.22:0/3361465519 >> v2:172.21.15.31:3300/0 conn(0x7ffa2c06f1a0 0x7ffa2c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa3147c640 1 --2- 172.21.15.22:0/3361465519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c146010 0x7ffa2c1463f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa3147c640 1 -- 172.21.15.22:0/3361465519 >> 172.21.15.22:0/3361465519 conn(0x7ffa2c0663d0 msgr2=0x7ffa2c0667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:13.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.049+0000 7ffa3147c640 1 -- 172.21.15.22:0/3361465519 shutdown_connections 2023-11-24T06:17:13.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.050+0000 7ffa3147c640 1 -- 172.21.15.22:0/3361465519 wait complete. 2023-11-24T06:17:13.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.051+0000 7ffa3147c640 1 Processor -- start 2023-11-24T06:17:13.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.051+0000 7ffa3147c640 1 -- start start 2023-11-24T06:17:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.052+0000 7ffa3147c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa2c06f1a0 0x7ffa2c0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.052+0000 7ffa3147c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c0d0fe0 0x7ffa2c1f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.052+0000 7ffa3147c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa2c146010 0x7ffa2c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.052+0000 7ffa3147c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c14c5e0 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.052+0000 7ffa3147c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c1f38b0 con 0x7ffa2c06f1a0 2023-11-24T06:17:13.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.052+0000 7ffa3147c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c1f3b90 con 0x7ffa2c146010 2023-11-24T06:17:13.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c0d0fe0 0x7ffa2c1f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c0d0fe0 0x7ffa2c1f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58022/0 (socket says 172.21.15.22:58022) 2023-11-24T06:17:13.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/4191363514 learned_addr learned my addr 172.21.15.22:0/4191363514 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2affd640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa2c06f1a0 0x7ffa2c0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/4191363514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa2c146010 msgr2=0x7ffa2c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2a7fc640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa2c146010 0x7ffa2c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/4191363514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa2c06f1a0 msgr2=0x7ffa2c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2a7fc640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa2c06f1a0 0x7ffa2c0cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/4191363514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0094d0 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2affd640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa2c06f1a0 0x7ffa2c0cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.053+0000 7ffa2a7fc640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c0d0fe0 0x7ffa2c1f2ff0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400c870 tx=0x7ffa1400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.054+0000 7ffa237fe640 1 -- 172.21.15.22:0/4191363514 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14003b70 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.054+0000 7ffa237fe640 1 -- 172.21.15.22:0/4191363514 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa14003cf0 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.054+0000 7ffa237fe640 1 -- 172.21.15.22:0/4191363514 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400aa90 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.054+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2c1f3e70 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.054+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2c1f3530 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.055+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2c14cac0 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.056+0000 7ffa237fe640 1 -- 172.21.15.22:0/4191363514 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ffa1400abf0 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.057+0000 7ffa237fe640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ffa0c06aff0 0x7ffa0c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.057+0000 7ffa237fe640 1 -- 172.21.15.22:0/4191363514 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffa14089420 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.057+0000 7ffa2affd640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ffa0c06aff0 0x7ffa0c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.058+0000 7ffa2affd640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ffa0c06aff0 0x7ffa0c06d4b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c036000 tx=0x7ffa1c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.061+0000 7ffa237fe640 1 -- 172.21.15.22:0/4191363514 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa2c14cac0 con 0x7ffa2c0d0fe0 2023-11-24T06:17:13.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.250+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa2c146930 con 0x7ffa0c06aff0 2023-11-24T06:17:13.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.254+0000 7ffa237fe640 1 -- 172.21.15.22:0/4191363514 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48621 (secure 0 0 0) 0x7ffa1c030c40 con 0x7ffa0c06aff0 2023-11-24T06:17:13.257 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:13.257 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:17:13.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.256+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ffa0c06aff0 msgr2=0x7ffa0c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.256+0000 7ffa3147c640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ffa0c06aff0 0x7ffa0c06d4b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c036000 tx=0x7ffa1c03b040 comp rx=0 tx=0).stop 2023-11-24T06:17:13.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c0d0fe0 msgr2=0x7ffa2c1f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c0d0fe0 0x7ffa2c1f2ff0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400c870 tx=0x7ffa1400cd30 comp rx=0 tx=0).stop 2023-11-24T06:17:13.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 shutdown_connections 2023-11-24T06:17:13.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7ffa0c06aff0 0x7ffa0c06d4b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffa2c146010 0x7ffa2c0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa2c0d0fe0 0x7ffa2c1f2ff0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 --2- 172.21.15.22:0/4191363514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa2c06f1a0 0x7ffa2c0cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 >> 172.21.15.22:0/4191363514 conn(0x7ffa2c0663d0 msgr2=0x7ffa2c0667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 shutdown_connections 2023-11-24T06:17:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.257+0000 7ffa3147c640 1 -- 172.21.15.22:0/4191363514 wait complete. 2023-11-24T06:17:13.280 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2023-11-24T06:17:12.754973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243956,"kb_used_data":6992,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730764,"statfs":{"total":773094113280,"available":772844302336,"internally_reserved":0,"allocated":7159808,"data_stored":3651287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4388,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.177434"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-24T06:17:06.584681+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:17:06.584681+0000","last_peered":"2023-11-24T06:17:06.584681+0000","last_clean":"2023-11-24T06:17:06.584681+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:17:06.584681+0000","last_undegraded":"2023-11-24T06:17:06.584681+0000","last_fullsized":"2023-11-24T06:17:06.584681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476803,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":313056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1140000000000001,"15min":1.0649999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.149,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":1.512},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1639999999999999,"15min":1.0680000000000001},"min":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.861,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.222}]},{"osd":1,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1319999999999999,"15min":1.1160000000000001},"min":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.617,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.3},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2050000000000001,"15min":1.1279999999999999},"min":{"1min":0.76900000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.1040000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.23,"15min":1.159},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8180000000000001,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.391,"5min":1.2969999999999999,"15min":1.341},"min":{"1min":1.0369999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7669999999999999,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.5700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.349,"15min":1.3169999999999999},"min":{"1min":0.94799999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7669999999999999,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.456},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3799999999999999,"15min":1.349},"min":{"1min":0.91500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.0819999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.8999999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.339,"15min":1.3049999999999999},"min":{"1min":0.75700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1150000000000002,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.262},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.4850000000000001,"15min":1.373},"min":{"1min":0.95399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.9450000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.8460000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.88900000000000001,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.865,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.504,"15min":1.4630000000000001},"min":{"1min":0.82299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.994,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.369}]},{"osd":7,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.6000000000000001,"15min":1.5620000000000001},"min":{"1min":0.71599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.052,"5min":3.262,"15min":3.262},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.653,"15min":1.6830000000000001},"min":{"1min":1.345,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.206,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.4119999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1339392,"data_stored":897581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1439999999999999,"15min":1.0800000000000001},"min":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.343},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.218,"15min":1.1599999999999999},"min":{"1min":0.73099999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6220000000000001,"5min":1.72,"15min":1.72},"last":1.4199999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1910000000000001,"15min":1.198},"min":{"1min":0.64900000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.794,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3149999999999999,"15min":1.294},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.782,"5min":1.847,"15min":1.847},"last":1.5580000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.236,"15min":1.2090000000000001},"min":{"1min":0.82399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8129999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2829999999999999,"15min":1.2949999999999999},"min":{"1min":0.85099999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.456}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3140000000000001,"15min":1.3240000000000001},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6499999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.3879999999999999,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.7829999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.1879999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.258,"15min":1.242},"min":{"1min":0.75600000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.78,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.226},{"interface":"front","average":{"1min":1.425,"5min":1.46,"15min":1.4259999999999999},"min":{"1min":0.88,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.964,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.5309999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.55,"15min":1.532},"min":{"1min":1.097,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.927,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.7010000000000001,"15min":1.6739999999999999},"min":{"1min":1.2729999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":1.9059999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.288}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.446,"15min":1.494},"min":{"1min":0.92600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8740000000000001,"5min":2.5,"15min":2.5},"last":1.5},{"interface":"front","average":{"1min":1.694,"5min":1.758,"15min":1.7390000000000001},"min":{"1min":1.2529999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.9530000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.607}]}]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":307053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0660000000000001,"15min":1.0649999999999999},"min":{"1min":0.66700000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.595},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.127},"min":{"1min":0.70099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.71,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.377}]},{"osd":1,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1160000000000001,"15min":1.212},"min":{"1min":0.77000000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.04},{"interface":"front","average":{"1min":1.27,"5min":1.272,"15min":1.2589999999999999},"min":{"1min":0.73999999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.907,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.6259999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3129999999999999,"15min":1.319},"min":{"1min":0.82699999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8380000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.23},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3700000000000001,"15min":1.458},"min":{"1min":0.86499999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.754,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.3799999999999999},"min":{"1min":0.98099999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.623,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.512},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3380000000000001,"15min":1.454},"min":{"1min":0.746,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8029999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.96599999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.79,"5min":2.258,"15min":2.258},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.427,"15min":1.5269999999999999},"min":{"1min":1.095,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9039999999999999,"5min":2.105,"15min":2.105},"last":1.7070000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.492,"15min":1.5549999999999999},"min":{"1min":1.0489999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8220000000000001,"5min":2.319,"15min":2.319},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.5940000000000001,"15min":1.6459999999999999},"min":{"1min":1.0800000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9390000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.4079999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.6419999999999999,"15min":1.6850000000000001},"min":{"1min":1.117,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.8560000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.7909999999999999},{"interface":"front","average":{"1min":1.625,"5min":1.698,"15min":1.7689999999999999},"min":{"1min":1.226,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0329999999999999,"5min":2.669,"15min":2.669},"last":1.5640000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":310643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.101,"15min":1.091},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.327}]},{"osd":1,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2729999999999999,"15min":1.2949999999999999},"min":{"1min":0.92300000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.603},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.212,"15min":1.2769999999999999},"min":{"1min":0.69799999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.73,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.389}]},{"osd":2,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2330000000000001,"15min":1.1970000000000001},"min":{"1min":0.80400000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.748,"5min":2.04,"15min":2.04},"last":1.159},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3640000000000001,"15min":1.4059999999999999},"min":{"1min":0.89900000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.839,"5min":2.016,"15min":2.016},"last":1.4970000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.242,"15min":1.286},"min":{"1min":0.98099999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.706,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3129999999999999,"15min":1.3480000000000001},"min":{"1min":0.83199999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9690000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.4259999999999999},"min":{"1min":0.70399999999999996,"5min":0.63,"15min":0.63},"max":{"1min":2.0289999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.409,"15min":1.5149999999999999},"min":{"1min":0.79400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9510000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.554}]},{"osd":6,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5009999999999999,"15min":1.5700000000000001},"min":{"1min":0.68100000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.0739999999999998,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.647},{"interface":"front","average":{"1min":1.5,"5min":1.492,"15min":1.603},"min":{"1min":0.85299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9670000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.802}]},{"osd":7,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.423,"15min":1.5369999999999999},"min":{"1min":0.71599999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8999999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.851},{"interface":"front","average":{"1min":1.579,"5min":1.625,"15min":1.7},"min":{"1min":0.74199999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2130000000000001,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.748}]}]},{"osd":3,"up_from":15,"seq":64424509506,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":307109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.86799999999999999},"min":{"1min":0.52300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.274,"5min":1.607,"15min":1.607},"last":1.105},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.90300000000000002,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7649999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.60099999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.647,"5min":1.796,"15min":1.796},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.222,"5min":1.1539999999999999,"15min":1.1499999999999999},"min":{"1min":0.68100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.829,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.1279999999999999,"15min":1.0740000000000001},"min":{"1min":0.60099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.042},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.179,"15min":1.137},"min":{"1min":0.64200000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.6299999999999999,"5min":2.399,"15min":2.399},"last":0.93600000000000005}]},{"osd":4,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.89500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.403},{"interface":"front","average":{"1min":1.383,"5min":1.3300000000000001,"15min":1.29},"min":{"1min":1.0660000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":2.141,"15min":2.141},"last":1.6599999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.359,"15min":1.3360000000000001},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.849,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.3979999999999999,"15min":1.403},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1779999999999999,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.4650000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.94899999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.827,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.484},{"interface":"front","average":{"1min":1.401,"5min":1.3700000000000001,"15min":1.3400000000000001},"min":{"1min":0.85799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0030000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.4299999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4450000000000001,"15min":1.4370000000000001},"min":{"1min":0.92000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1299999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.4870000000000001,"15min":1.4770000000000001},"min":{"1min":1.099,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.2639999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.522}]}]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":307109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2869999999999999,"5min":2.552,"15min":2.552},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.92700000000000005,"15min":0.95999999999999996},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5649999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.173,"15min":1.137},"min":{"1min":0.68200000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5509999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.121},"min":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8340000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1519999999999999,"15min":1.161},"min":{"1min":0.63300000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.405,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.97199999999999998},"min":{"1min":0.48699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.423,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3069999999999999,"15min":1.329},"min":{"1min":0.85099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0640000000000001,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.448,"15min":1.4890000000000001},"min":{"1min":0.85899999999999999,"5min":0.755,"15min":0.755},"max":{"1min":1.601,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.5149999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2949999999999999,"15min":1.2410000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.901,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.391,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.851,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.28}]},{"osd":6,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3799999999999999,"15min":1.3959999999999999},"min":{"1min":0.82499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7390000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.476,"15min":1.54},"min":{"1min":0.98199999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.962,"5min":4.101,"15min":4.101},"last":1.3480000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4810000000000001,"15min":1.498},"min":{"1min":0.90700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.762,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.4650000000000001,"15min":1.488},"min":{"1min":0.86599999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8009999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.3069999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1347584,"data_stored":901593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1060000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":0.97599999999999998},"min":{"1min":0.60199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.554,"5min":2.161,"15min":2.161},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.996,"15min":1.026},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.742,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.105,"15min":1.1120000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5429999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.94999999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1879999999999999},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5009999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.202,"15min":1.206},"min":{"1min":0.65000000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5700000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.847}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.347,"15min":1.304},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5800000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.5},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3500000000000001,"15min":1.3879999999999999},"min":{"1min":0.88600000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.756,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.8859999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3080000000000001,"15min":1.282},"min":{"1min":0.79200000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.544,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":1.571},{"interface":"front","average":{"1min":1.407,"5min":1.3320000000000001,"15min":1.2629999999999999},"min":{"1min":0.80100000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.649}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4350000000000001,"15min":1.4370000000000001},"min":{"1min":0.94099999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.8460000000000001,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.716},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4119999999999999,"15min":1.3520000000000001},"min":{"1min":0.85799999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0859999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.472}]},{"osd":7,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.4490000000000001,"15min":1.4339999999999999},"min":{"1min":0.84099999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8100000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.427},{"interface":"front","average":{"1min":1.462,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.018,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.95,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.8120000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":307143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85599999999999998,"15min":0.93400000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.492,"5min":1.571,"15min":1.571},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4850000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.98499999999999999,"15min":1.0089999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4910000000000001,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.095,"15min":1.2030000000000001},"min":{"1min":0.51800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2470000000000001,"5min":2.964,"15min":2.964},"last":1.208}]},{"osd":3,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3089999999999999,"15min":1.3600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.704,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.254,"15min":1.3109999999999999},"min":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.859,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.86199999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3360000000000001,"15min":1.3300000000000001},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7130000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4199999999999999,"15min":1.5349999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8879999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.6679999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.367,"15min":1.4510000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.804,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4350000000000001,"15min":1.4610000000000001},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.718,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.371}]},{"osd":6,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.456,"15min":1.5329999999999999},"min":{"1min":0.94299999999999995,"5min":0.87,"15min":0.87},"max":{"1min":1.869,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.585},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.528,"15min":1.5409999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8460000000000001,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":1.631}]},{"osd":7,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.52,"15min":1.601},"min":{"1min":0.94599999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.04,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.613,"15min":1.6619999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.5329999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:17:13.281 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:13.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.491+0000 7fcaa0a55640 1 Processor -- start 2023-11-24T06:17:13.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.491+0000 7fcaa0a55640 1 -- start start 2023-11-24T06:17:13.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.492+0000 7fcaa0a55640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca9c15d5b0 0x7fca9c0d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.492+0000 7fcaa0a55640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca9c0b1650 0x7fca9c0d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.492+0000 7fcaa0a55640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c0cf0c0 con 0x7fca9c0d14a0 2023-11-24T06:17:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.492+0000 7fcaa0a55640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c0b01b0 con 0x7fca9c15d5b0 2023-11-24T06:17:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.492+0000 7fcaa0a55640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c15d990 con 0x7fca9c0b1650 2023-11-24T06:17:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca9ad9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca9c15d5b0 0x7fca9c0d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca9ad9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca9c15d5b0 0x7fca9c0d3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58032/0 (socket says 172.21.15.22:58032) 2023-11-24T06:17:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca93fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fca9c0d14a0 0x7fca9c0cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51382/0 (socket says 172.21.15.22:51382) 2023-11-24T06:17:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca9ad9d640 1 -- 172.21.15.22:0/2984739212 learned_addr learned my addr 172.21.15.22:0/2984739212 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:13.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca9b59e640 1 --2- 172.21.15.22:0/2984739212 >> v2:172.21.15.31:3300/0 conn(0x7fca9c0b1650 0x7fca9c0d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca9ad9d640 1 -- 172.21.15.22:0/2984739212 >> v2:172.21.15.31:3300/0 conn(0x7fca9c0b1650 msgr2=0x7fca9c0d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:13.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca9ad9d640 1 --2- 172.21.15.22:0/2984739212 >> v2:172.21.15.31:3300/0 conn(0x7fca9c0b1650 0x7fca9c0d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca9ad9d640 1 -- 172.21.15.22:0/2984739212 >> v1:172.21.15.22:6789/0 conn(0x7fca9c0d14a0 legacy=0x7fca9c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca9ad9d640 1 -- 172.21.15.22:0/2984739212 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0d1e40 con 0x7fca9c15d5b0 2023-11-24T06:17:13.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.493+0000 7fca9b59e640 1 --2- 172.21.15.22:0/2984739212 >> v2:172.21.15.31:3300/0 conn(0x7fca9c0b1650 0x7fca9c0d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:13.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.494+0000 7fca9ad9d640 1 --2- 172.21.15.22:0/2984739212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c15d5b0 0x7fca9c0d3990 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fca9c08bc30 tx=0x7fca8c02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d17318a6721dd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.495+0000 7fca9a59c640 1 -- 172.21.15.22:0/2984739212 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c030870 con 0x7fca9c15d5b0 2023-11-24T06:17:13.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.495+0000 7fca9a59c640 1 -- 172.21.15.22:0/2984739212 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c0309d0 con 0x7fca9c15d5b0 2023-11-24T06:17:13.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.495+0000 7fca9a59c640 1 -- 172.21.15.22:0/2984739212 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c030d60 con 0x7fca9c15d5b0 2023-11-24T06:17:13.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.495+0000 7fcaa0a55640 1 -- 172.21.15.22:0/2984739212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c15d5b0 msgr2=0x7fca9c0d3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.495+0000 7fcaa0a55640 1 --2- 172.21.15.22:0/2984739212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c15d5b0 0x7fca9c0d3990 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fca9c08bc30 tx=0x7fca8c02b9b0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.496+0000 7fcaa0a55640 1 -- 172.21.15.22:0/2984739212 shutdown_connections 2023-11-24T06:17:13.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.496+0000 7fcaa0a55640 1 --2- 172.21.15.22:0/2984739212 >> v2:172.21.15.31:3300/0 conn(0x7fca9c0b1650 0x7fca9c0d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.496+0000 7fcaa0a55640 1 --2- 172.21.15.22:0/2984739212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c15d5b0 0x7fca9c0d3990 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.496+0000 7fcaa0a55640 1 -- 172.21.15.22:0/2984739212 >> 172.21.15.22:0/2984739212 conn(0x7fca9c09c3b0 msgr2=0x7fca9c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:13.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.496+0000 7fcaa0a55640 1 -- 172.21.15.22:0/2984739212 shutdown_connections 2023-11-24T06:17:13.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.496+0000 7fcaa0a55640 1 -- 172.21.15.22:0/2984739212 wait complete. 2023-11-24T06:17:13.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.497+0000 7fcaa0a55640 1 Processor -- start 2023-11-24T06:17:13.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.498+0000 7fcaa0a55640 1 -- start start 2023-11-24T06:17:13.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.498+0000 7fcaa0a55640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca9c0b1650 0x7fca9c1574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.498+0000 7fcaa0a55640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c0d14a0 0x7fca9c0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.498+0000 7fcaa0a55640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca9c15d5b0 0x7fca9c0b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fcaa0a55640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b7e70 con 0x7fca9c0d14a0 2023-11-24T06:17:13.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fcaa0a55640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0c8480 con 0x7fca9c0b1650 2023-11-24T06:17:13.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fcaa0a55640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b71f0 con 0x7fca9c15d5b0 2023-11-24T06:17:13.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca93fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c0d14a0 0x7fca9c0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca93fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c0d14a0 0x7fca9c0cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58034/0 (socket says 172.21.15.22:58034) 2023-11-24T06:17:13.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca93fff640 1 -- 172.21.15.22:0/819278583 learned_addr learned my addr 172.21.15.22:0/819278583 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:13.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca93fff640 1 -- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca9c15d5b0 msgr2=0x7fca9c0b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca9ad9d640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca9c0b1650 0x7fca9c1574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca9b59e640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca9c15d5b0 0x7fca9c0b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca93fff640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca9c15d5b0 0x7fca9c0b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca93fff640 1 -- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca9c0b1650 msgr2=0x7fca9c1574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca93fff640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca9c0b1650 0x7fca9c1574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca93fff640 1 -- 172.21.15.22:0/819278583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c0094d0 con 0x7fca9c0d14a0 2023-11-24T06:17:13.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca9ad9d640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca9c0b1650 0x7fca9c1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:13.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.499+0000 7fca9b59e640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca9c15d5b0 0x7fca9c0b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:13.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.500+0000 7fca93fff640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c0d14a0 0x7fca9c0cc7a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fca8400c3e0 tx=0x7fca8400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.500+0000 7fca937fe640 1 -- 172.21.15.22:0/819278583 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca840074e0 con 0x7fca9c0d14a0 2023-11-24T06:17:13.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.500+0000 7fca937fe640 1 -- 172.21.15.22:0/819278583 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca84007640 con 0x7fca9c0d14a0 2023-11-24T06:17:13.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.500+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c0b74d0 con 0x7fca9c0d14a0 2023-11-24T06:17:13.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.500+0000 7fca937fe640 1 -- 172.21.15.22:0/819278583 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca840049e0 con 0x7fca9c0d14a0 2023-11-24T06:17:13.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.500+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c0b7a90 con 0x7fca9c0d14a0 2023-11-24T06:17:13.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.502+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c0b7fb0 con 0x7fca9c0d14a0 2023-11-24T06:17:13.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.502+0000 7fca937fe640 1 -- 172.21.15.22:0/819278583 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fca84004b40 con 0x7fca9c0d14a0 2023-11-24T06:17:13.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.504+0000 7fca937fe640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca7c06aff0 0x7fca7c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.504+0000 7fca937fe640 1 -- 172.21.15.22:0/819278583 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fca84088ff0 con 0x7fca9c0d14a0 2023-11-24T06:17:13.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.504+0000 7fca9ad9d640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca7c06aff0 0x7fca7c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.505+0000 7fca9ad9d640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca7c06aff0 0x7fca7c06d4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca8c036000 tx=0x7fca8c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.508+0000 7fca937fe640 1 -- 172.21.15.22:0/819278583 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca840bbe90 con 0x7fca9c0d14a0 2023-11-24T06:17:13.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.710+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca9c04e840 con 0x7fca9c0d14a0 2023-11-24T06:17:13.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.711+0000 7fca937fe640 1 -- 172.21.15.22:0/819278583 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12938 (secure 0 0 0) 0x7fca9c0b7fb0 con 0x7fca9c0d14a0 2023-11-24T06:17:13.714 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:13.715 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":64,"fsid":"d0664f6f-6758-42fa-85ad-04f9384b4bc8","created":"2023-11-24T06:11:35.604726+0000","modified":"2023-11-24T06:17:09.629146+0000","last_up_change":"2023-11-24T06:11:49.178707+0000","last_in_change":"2023-11-24T06:11:39.325872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:11:48.725222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2532170-60c2-45eb-a4ef-a4334335c962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6805","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6807","nonce":3183424560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6812","nonce":3183424560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6820","nonce":3183424560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6815","nonce":3183424560},{"type":"v1","addr":"172.21.15.22:6817","nonce":3183424560}]},"public_addr":"172.21.15.22:6807/3183424560","cluster_addr":"172.21.15.22:6812/3183424560","heartbeat_back_addr":"172.21.15.22:6820/3183424560","heartbeat_front_addr":"172.21.15.22:6817/3183424560","state":["exists","up"]},{"osd":1,"uuid":"a76af5ff-8a66-4296-9f11-79883330c1bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6801","nonce":3484548105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6803","nonce":3484548105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6811","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6814","nonce":3484548105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3484548105},{"type":"v1","addr":"172.21.15.22:6808","nonce":3484548105}]},"public_addr":"172.21.15.22:6801/3484548105","cluster_addr":"172.21.15.22:6803/3484548105","heartbeat_back_addr":"172.21.15.22:6814/3484548105","heartbeat_front_addr":"172.21.15.22:6808/3484548105","state":["exists","up"]},{"osd":2,"uuid":"bce2b13a-ab53-49bc-ba86-3e989e813e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6809","nonce":2854052422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6816","nonce":2854052422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6825","nonce":2854052422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":2854052422},{"type":"v1","addr":"172.21.15.22:6821","nonce":2854052422}]},"public_addr":"172.21.15.22:6809/2854052422","cluster_addr":"172.21.15.22:6816/2854052422","heartbeat_back_addr":"172.21.15.22:6825/2854052422","heartbeat_front_addr":"172.21.15.22:6821/2854052422","state":["exists","up"]},{"osd":3,"uuid":"788a69fe-610a-4be7-8ae9-c90e6aa9f772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6824","nonce":2514152945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6827","nonce":2514152945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6831","nonce":2514152945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2514152945},{"type":"v1","addr":"172.21.15.22:6829","nonce":2514152945}]},"public_addr":"172.21.15.22:6824/2514152945","cluster_addr":"172.21.15.22:6827/2514152945","heartbeat_back_addr":"172.21.15.22:6831/2514152945","heartbeat_front_addr":"172.21.15.22:6829/2514152945","state":["exists","up"]},{"osd":4,"uuid":"b1a62b11-eaac-4ceb-a90b-9d00731801b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6804","nonce":2142081467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6808","nonce":2142081467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6815","nonce":2142081467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2142081467},{"type":"v1","addr":"172.21.15.31:6812","nonce":2142081467}]},"public_addr":"172.21.15.31:6804/2142081467","cluster_addr":"172.21.15.31:6808/2142081467","heartbeat_back_addr":"172.21.15.31:6815/2142081467","heartbeat_front_addr":"172.21.15.31:6812/2142081467","state":["exists","up"]},{"osd":5,"uuid":"64739292-4eae-4bd0-8535-26e29f391124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6817","nonce":2704270440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6819","nonce":2704270440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6828","nonce":2704270440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2704270440},{"type":"v1","addr":"172.21.15.31:6824","nonce":2704270440}]},"public_addr":"172.21.15.31:6817/2704270440","cluster_addr":"172.21.15.31:6819/2704270440","heartbeat_back_addr":"172.21.15.31:6828/2704270440","heartbeat_front_addr":"172.21.15.31:6824/2704270440","state":["exists","up"]},{"osd":6,"uuid":"ce2ed6d5-c2ef-4f5b-ab98-9b658c82f4c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6801","nonce":1824539617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6805","nonce":1824539617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6813","nonce":1824539617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":1824539617},{"type":"v1","addr":"172.21.15.31:6809","nonce":1824539617}]},"public_addr":"172.21.15.31:6801/1824539617","cluster_addr":"172.21.15.31:6805/1824539617","heartbeat_back_addr":"172.21.15.31:6813/1824539617","heartbeat_front_addr":"172.21.15.31:6809/1824539617","state":["exists","up"]},{"osd":7,"uuid":"6a9301bd-e40a-4141-a2fc-a5cd45bd45ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6821","nonce":682432999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6825","nonce":682432999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6831","nonce":682432999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6827","nonce":682432999},{"type":"v1","addr":"172.21.15.31:6829","nonce":682432999}]},"public_addr":"172.21.15.31:6821/682432999","cluster_addr":"172.21.15.31:6825/682432999","heartbeat_back_addr":"172.21.15.31:6831/682432999","heartbeat_front_addr":"172.21.15.31:6829/682432999","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.951264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.624412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.894699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.660529+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.918720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.738548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.695755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:11:44.709731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6834/2376501260":"2023-11-25T06:17:06.573213+0000","172.21.15.31:6832/2376501260":"2023-11-25T06:17:06.573213+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca7c06aff0 msgr2=0x7fca7c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca7c06aff0 0x7fca7c06d4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca8c036000 tx=0x7fca8c03b040 comp rx=0 tx=0).stop 2023-11-24T06:17:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c0d14a0 msgr2=0x7fca9c0cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c0d14a0 0x7fca9c0cc7a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fca8400c3e0 tx=0x7fca8400c8a0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 shutdown_connections 2023-11-24T06:17:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fca7c06aff0 0x7fca7c06d4b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca9c15d5b0 0x7fca9c0b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca9c0d14a0 0x7fca9c0cc7a0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 --2- 172.21.15.22:0/819278583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca9c0b1650 0x7fca9c1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 >> 172.21.15.22:0/819278583 conn(0x7fca9c09c3b0 msgr2=0x7fca9c06c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:13.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 shutdown_connections 2023-11-24T06:17:13.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:13.714+0000 7fcaa0a55640 1 -- 172.21.15.22:0/819278583 wait complete. 2023-11-24T06:17:14.737 INFO:tasks.ceph:Scrubbing osd.0 2023-11-24T06:17:14.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:17:14.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.957+0000 7f41aeb1d640 1 Processor -- start 2023-11-24T06:17:14.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.957+0000 7f41aeb1d640 1 -- start start 2023-11-24T06:17:14.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.959+0000 7f41aeb1d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f41a8162220 0x7f41a80b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.959+0000 7f41aeb1d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a80706a0 con 0x7f41a806cad0 2023-11-24T06:17:14.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.959+0000 7f41aeb1d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a8070c60 con 0x7f41a8162600 2023-11-24T06:17:14.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.959+0000 7f41aeb1d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a80722b0 con 0x7f41a8162220 2023-11-24T06:17:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.959+0000 7f41ac8b9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f41a8162220 0x7f41a80b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.960+0000 7f41ac8b9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f41a8162220 0x7f41a80b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58040/0 (socket says 172.21.15.22:58040) 2023-11-24T06:17:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.960+0000 7f41ac8b9640 1 -- 172.21.15.22:0/324433864 learned_addr learned my addr 172.21.15.22:0/324433864 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.960+0000 7f41ad0ba640 1 --1- 172.21.15.22:0/324433864 >> v1:172.21.15.22:6789/0 conn(0x7f41a806cad0 0x7f41a80710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51390/0 (socket says 172.21.15.22:51390) 2023-11-24T06:17:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.960+0000 7f41ac8b9640 1 -- 172.21.15.22:0/324433864 >> v1:172.21.15.31:6789/0 conn(0x7f41a8162600 legacy=0x7f41a806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.960+0000 7f41ac8b9640 1 -- 172.21.15.22:0/324433864 >> v1:172.21.15.22:6789/0 conn(0x7f41a806cad0 legacy=0x7f41a80710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.960+0000 7f41ac8b9640 1 -- 172.21.15.22:0/324433864 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a8072590 con 0x7f41a8162220 2023-11-24T06:17:14.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.960+0000 7f41a77fe640 1 -- 172.21.15.22:0/324433864 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229282336 0 0) 0x7f41a80706a0 con 0x7f41a806cad0 2023-11-24T06:17:14.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.962+0000 7f41ac8b9640 1 --2- 172.21.15.22:0/324433864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 0x7f41a80b1ea0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f419c009870 tx=0x7f419c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb660375ff7054e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.962+0000 7f41a77fe640 1 -- 172.21.15.22:0/324433864 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c02f840 con 0x7f41a8162220 2023-11-24T06:17:14.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.963+0000 7f41a77fe640 1 -- 172.21.15.22:0/324433864 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c02f9a0 con 0x7f41a8162220 2023-11-24T06:17:14.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.963+0000 7f41a77fe640 1 -- 172.21.15.22:0/324433864 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c02fd30 con 0x7f41a8162220 2023-11-24T06:17:14.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.963+0000 7f41aeb1d640 1 -- 172.21.15.22:0/324433864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 msgr2=0x7f41a80b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.963+0000 7f41aeb1d640 1 --2- 172.21.15.22:0/324433864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 0x7f41a80b1ea0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f419c009870 tx=0x7f419c02ba20 comp rx=0 tx=0).stop 2023-11-24T06:17:14.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.963+0000 7f41aeb1d640 1 -- 172.21.15.22:0/324433864 shutdown_connections 2023-11-24T06:17:14.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.963+0000 7f41aeb1d640 1 --2- 172.21.15.22:0/324433864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 0x7f41a80b1ea0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.963+0000 7f41aeb1d640 1 -- 172.21.15.22:0/324433864 >> 172.21.15.22:0/324433864 conn(0x7f41a80b0ba0 msgr2=0x7f41a80b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:14.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.963+0000 7f41aeb1d640 1 -- 172.21.15.22:0/324433864 shutdown_connections 2023-11-24T06:17:14.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.963+0000 7f41aeb1d640 1 -- 172.21.15.22:0/324433864 wait complete. 2023-11-24T06:17:14.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.965+0000 7f41aeb1d640 1 Processor -- start 2023-11-24T06:17:14.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.965+0000 7f41aeb1d640 1 -- start start 2023-11-24T06:17:14.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.966+0000 7f41aeb1d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a806cad0 0x7f41a8099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.966+0000 7f41aeb1d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 0x7f41a81f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.966+0000 7f41aeb1d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a8162600 0x7f41a81f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.966+0000 7f41aeb1d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a809a0a0 con 0x7f41a8162220 2023-11-24T06:17:14.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.966+0000 7f41aeb1d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a809a380 con 0x7f41a8162600 2023-11-24T06:17:14.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.966+0000 7f41aeb1d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a809a660 con 0x7f41a806cad0 2023-11-24T06:17:14.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41a7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 0x7f41a81f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41a7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 0x7f41a81f7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58044/0 (socket says 172.21.15.22:58044) 2023-11-24T06:17:14.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41a7fff640 1 -- 172.21.15.22:0/1777018996 learned_addr learned my addr 172.21.15.22:0/1777018996 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:14.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41ac8b9640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a806cad0 0x7f41a8099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41ad0ba640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a8162600 0x7f41a81f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41a7fff640 1 -- 172.21.15.22:0/1777018996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a806cad0 msgr2=0x7f41a8099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41a7fff640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a806cad0 0x7f41a8099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41a7fff640 1 -- 172.21.15.22:0/1777018996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a8162600 msgr2=0x7f41a81f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41a7fff640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a8162600 0x7f41a81f7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41a7fff640 1 -- 172.21.15.22:0/1777018996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0094d0 con 0x7f41a8162220 2023-11-24T06:17:14.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.967+0000 7f41a7fff640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 0x7f41a81f7910 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f419400c450 tx=0x7f419400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.968+0000 7f41a57fa640 1 -- 172.21.15.22:0/1777018996 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41940052d0 con 0x7f41a8162220 2023-11-24T06:17:14.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.968+0000 7f41a57fa640 1 -- 172.21.15.22:0/1777018996 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4194005430 con 0x7f41a8162220 2023-11-24T06:17:14.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.968+0000 7f41a57fa640 1 -- 172.21.15.22:0/1777018996 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194012870 con 0x7f41a8162220 2023-11-24T06:17:14.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.968+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a809a940 con 0x7f41a8162220 2023-11-24T06:17:14.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.968+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a809b140 con 0x7f41a8162220 2023-11-24T06:17:14.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.969+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41a809a4f0 con 0x7f41a8162220 2023-11-24T06:17:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.970+0000 7f41a57fa640 1 -- 172.21.15.22:0/1777018996 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f41940129d0 con 0x7f41a8162220 2023-11-24T06:17:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.971+0000 7f41a57fa640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f418c06aff0 0x7f418c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.971+0000 7f41a57fa640 1 -- 172.21.15.22:0/1777018996 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4194089210 con 0x7f41a8162220 2023-11-24T06:17:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.971+0000 7f41ac8b9640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f418c06aff0 0x7f418c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.971+0000 7f41a57fa640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f418c070e50 0x7f418c073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.971+0000 7f41a57fa640 1 -- 172.21.15.22:0/1777018996 --> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f418c073920 con 0x7f418c070e50 2023-11-24T06:17:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.971+0000 7f41a57fa640 1 -- 172.21.15.22:0/1777018996 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f419408b790 con 0x7f41a8162220 2023-11-24T06:17:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.971+0000 7f41ad0ba640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f418c070e50 0x7f418c073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.972+0000 7f41ac8b9640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f418c06aff0 0x7f418c06d4b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f419c036000 tx=0x7f419c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.972+0000 7f41ad0ba640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f418c070e50 0x7f418c073270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.973+0000 7f41a57fa640 1 -- 172.21.15.22:0/1777018996 <== osd.0 v2:172.21.15.22:6805/3183424560 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f418c073920 con 0x7f418c070e50 2023-11-24T06:17:14.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.987+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 --> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f41a80b23e0 con 0x7f418c070e50 2023-11-24T06:17:14.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.988+0000 7f41a57fa640 1 -- 172.21.15.22:0/1777018996 <== osd.0 v2:172.21.15.22:6805/3183424560 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f41a0005c10 con 0x7f418c070e50 2023-11-24T06:17:14.991 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:17:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:17:14.991 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:17:14.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.988+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f418c070e50 msgr2=0x7f418c073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.988+0000 7f41aeb1d640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6805/3183424560,v1:172.21.15.22:6807/3183424560] conn(0x7f418c070e50 0x7f418c073270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.988+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f418c06aff0 msgr2=0x7f418c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.988+0000 7f41aeb1d640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f418c06aff0 0x7f418c06d4b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f419c036000 tx=0x7f419c008030 comp rx=0 tx=0).stop 2023-11-24T06:17:14.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.988+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 msgr2=0x7f41a81f7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.988+0000 7f41aeb1d640 1 --2- 172.21.15.22:0/1777018996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41a8162220 0x7f41a81f7910 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f419400c450 tx=0x7f419400c910 comp rx=0 tx=0).stop 2023-11-24T06:17:14.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.989+0000 7f41ad0ba640 1 -- 172.21.15.22:0/1777018996 reap_dead start 2023-11-24T06:17:14.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.989+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 shutdown_connections 2023-11-24T06:17:14.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.989+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 >> 172.21.15.22:0/1777018996 conn(0x7f41a80b0ba0 msgr2=0x7f41a80710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:14.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.989+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 shutdown_connections 2023-11-24T06:17:14.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:14.989+0000 7f41aeb1d640 1 -- 172.21.15.22:0/1777018996 wait complete. 2023-11-24T06:17:15.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-24T06:17:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.201+0000 7f10d4935640 1 Processor -- start 2023-11-24T06:17:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.202+0000 7f10d4935640 1 -- start start 2023-11-24T06:17:15.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.203+0000 7f10d4935640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d0141e80 0x7f10d0071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.203+0000 7f10d4935640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10d0071650 0x7f10d006cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10d4935640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d006cae0 con 0x7f10d015ed20 2023-11-24T06:17:15.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10d4935640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d01422e0 con 0x7f10d0071650 2023-11-24T06:17:15.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10d4935640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0071e40 con 0x7f10d0141e80 2023-11-24T06:17:15.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10cf7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f10d015ed20 0x7f10d015f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51396/0 (socket says 172.21.15.22:51396) 2023-11-24T06:17:15.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10cf7fe640 1 -- 172.21.15.22:0/1321121757 learned_addr learned my addr 172.21.15.22:0/1321121757 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:15.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10cffff640 1 --2- 172.21.15.22:0/1321121757 >> v2:172.21.15.22:3300/0 conn(0x7f10d0071650 0x7f10d006cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10c7fff640 1 --2- 172.21.15.22:0/1321121757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d0141e80 0x7f10d0071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10ceffd640 1 -- 172.21.15.22:0/1321121757 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060642602 0 0) 0x7f10d006cae0 con 0x7f10d015ed20 2023-11-24T06:17:15.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10ceffd640 1 -- 172.21.15.22:0/1321121757 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10bc003520 con 0x7f10d015ed20 2023-11-24T06:17:15.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10cffff640 1 -- 172.21.15.22:0/1321121757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d0141e80 msgr2=0x7f10d0071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:15.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10cffff640 1 --2- 172.21.15.22:0/1321121757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d0141e80 0x7f10d0071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10cffff640 1 -- 172.21.15.22:0/1321121757 >> v1:172.21.15.22:6789/0 conn(0x7f10d015ed20 legacy=0x7f10d015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.204+0000 7f10cffff640 1 -- 172.21.15.22:0/1321121757 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d006c1b0 con 0x7f10d0071650 2023-11-24T06:17:15.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.206+0000 7f10cffff640 1 --2- 172.21.15.22:0/1321121757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0071650 0x7f10d006cf70 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009d90 tx=0x7f10c802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b68f3cfe13f148 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.206+0000 7f10ceffd640 1 -- 172.21.15.22:0/1321121757 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c802cc50 con 0x7f10d0071650 2023-11-24T06:17:15.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.206+0000 7f10ceffd640 1 -- 172.21.15.22:0/1321121757 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c802cdb0 con 0x7f10d0071650 2023-11-24T06:17:15.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.206+0000 7f10ceffd640 1 -- 172.21.15.22:0/1321121757 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8034660 con 0x7f10d0071650 2023-11-24T06:17:15.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.207+0000 7f10d4935640 1 -- 172.21.15.22:0/1321121757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0071650 msgr2=0x7f10d006cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.207+0000 7f10d4935640 1 --2- 172.21.15.22:0/1321121757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0071650 0x7f10d006cf70 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009d90 tx=0x7f10c802bea0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.207+0000 7f10d4935640 1 -- 172.21.15.22:0/1321121757 shutdown_connections 2023-11-24T06:17:15.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.207+0000 7f10d4935640 1 --2- 172.21.15.22:0/1321121757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0071650 0x7f10d006cf70 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.207+0000 7f10d4935640 1 --2- 172.21.15.22:0/1321121757 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d0141e80 0x7f10d0071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.207+0000 7f10d4935640 1 -- 172.21.15.22:0/1321121757 >> 172.21.15.22:0/1321121757 conn(0x7f10d00b0840 msgr2=0x7f10d00b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.207+0000 7f10d4935640 1 -- 172.21.15.22:0/1321121757 shutdown_connections 2023-11-24T06:17:15.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.207+0000 7f10d4935640 1 -- 172.21.15.22:0/1321121757 wait complete. 2023-11-24T06:17:15.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.208+0000 7f10d4935640 1 Processor -- start 2023-11-24T06:17:15.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.209+0000 7f10d4935640 1 -- start start 2023-11-24T06:17:15.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10d4935640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10d0071650 0x7f10d0133080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10d4935640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0141e80 0x7f10d015d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10d4935640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d015ed20 0x7f10d015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10d4935640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d015e9b0 con 0x7f10d0141e80 2023-11-24T06:17:15.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10d4935640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d015dda0 con 0x7f10d0071650 2023-11-24T06:17:15.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10d4935640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d015e080 con 0x7f10d015ed20 2023-11-24T06:17:15.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0141e80 0x7f10d015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0141e80 0x7f10d015d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58064/0 (socket says 172.21.15.22:58064) 2023-11-24T06:17:15.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10c7fff640 1 -- 172.21.15.22:0/217428588 learned_addr learned my addr 172.21.15.22:0/217428588 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:15.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10c7fff640 1 -- 172.21.15.22:0/217428588 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d015ed20 msgr2=0x7f10d015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10c7fff640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d015ed20 0x7f10d015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10c7fff640 1 -- 172.21.15.22:0/217428588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10d0071650 msgr2=0x7f10d0133080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10c7fff640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10d0071650 0x7f10d0133080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.210+0000 7f10c7fff640 1 -- 172.21.15.22:0/217428588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8009a70 con 0x7f10d0141e80 2023-11-24T06:17:15.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.211+0000 7f10c7fff640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0141e80 0x7f10d015d570 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f10b800d800 tx=0x7f10b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.211+0000 7f10ccff9640 1 -- 172.21.15.22:0/217428588 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800b6c0 con 0x7f10d0141e80 2023-11-24T06:17:15.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.211+0000 7f10ccff9640 1 -- 172.21.15.22:0/217428588 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b800b820 con 0x7f10d0141e80 2023-11-24T06:17:15.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.211+0000 7f10ccff9640 1 -- 172.21.15.22:0/217428588 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800bbb0 con 0x7f10d0141e80 2023-11-24T06:17:15.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.211+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d015e360 con 0x7f10d0141e80 2023-11-24T06:17:15.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.211+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d015dab0 con 0x7f10d0141e80 2023-11-24T06:17:15.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.212+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d0067d10 con 0x7f10d0141e80 2023-11-24T06:17:15.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.213+0000 7f10ccff9640 1 -- 172.21.15.22:0/217428588 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f10b800bd10 con 0x7f10d0141e80 2023-11-24T06:17:15.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.214+0000 7f10ccff9640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f10b006aff0 0x7f10b006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.214+0000 7f10ccff9640 1 -- 172.21.15.22:0/217428588 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f10b8089c10 con 0x7f10d0141e80 2023-11-24T06:17:15.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.214+0000 7f10cf7fe640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f10b006aff0 0x7f10b006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.215+0000 7f10cf7fe640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f10b006aff0 0x7f10b006d4b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f10d0141190 tx=0x7f10c0007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.219+0000 7f10ccff9640 1 -- 172.21.15.22:0/217428588 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f10b8054ca0 con 0x7f10d0141e80 2023-11-24T06:17:15.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.412+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f10d0071ab0 con 0x7f10b006aff0 2023-11-24T06:17:15.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.413+0000 7f10ccff9640 1 -- 172.21.15.22:0/217428588 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f10c00058b0 con 0x7f10b006aff0 2023-11-24T06:17:15.415 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 0 to deep-scrub 2023-11-24T06:17:15.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.415+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f10b006aff0 msgr2=0x7f10b006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.415+0000 7f10d4935640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f10b006aff0 0x7f10b006d4b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f10d0141190 tx=0x7f10c0007930 comp rx=0 tx=0).stop 2023-11-24T06:17:15.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.415+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0141e80 msgr2=0x7f10d015d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.415+0000 7f10d4935640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0141e80 0x7f10d015d570 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f10b800d800 tx=0x7f10b800dcc0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.416+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 shutdown_connections 2023-11-24T06:17:15.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.416+0000 7f10d4935640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f10b006aff0 0x7f10b006d4b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.416+0000 7f10d4935640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d015ed20 0x7f10d015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.416+0000 7f10d4935640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10d0141e80 0x7f10d015d570 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.416+0000 7f10d4935640 1 --2- 172.21.15.22:0/217428588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10d0071650 0x7f10d0133080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.416+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 >> 172.21.15.22:0/217428588 conn(0x7f10d00b0840 msgr2=0x7f10d0143ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.416+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 shutdown_connections 2023-11-24T06:17:15.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.416+0000 7f10d4935640 1 -- 172.21.15.22:0/217428588 wait complete. 2023-11-24T06:17:15.437 INFO:tasks.ceph:Scrubbing osd.1 2023-11-24T06:17:15.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:17:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.663+0000 7f5ebda71640 1 Processor -- start 2023-11-24T06:17:15.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.664+0000 7f5ebda71640 1 -- start start 2023-11-24T06:17:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.665+0000 7f5ebda71640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80d1fd0 0x7f5eb80ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.665+0000 7f5ebda71640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb80b2980 con 0x7f5eb80b33d0 2023-11-24T06:17:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.666+0000 7f5ebda71640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb80cf220 con 0x7f5eb80cfa30 2023-11-24T06:17:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.666+0000 7f5ebda71640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80cf500 con 0x7f5eb80d1fd0 2023-11-24T06:17:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.666+0000 7f5ebd270640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5eb80b33d0 0x7f5eb80b3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51400/0 (socket says 172.21.15.22:51400) 2023-11-24T06:17:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.666+0000 7f5ebd270640 1 -- 172.21.15.22:0/2499625568 learned_addr learned my addr 172.21.15.22:0/2499625568 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.666+0000 7f5eb7fff640 1 --2- 172.21.15.22:0/2499625568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80d1fd0 0x7f5eb80ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.667+0000 7f5eb77fe640 1 -- 172.21.15.22:0/2499625568 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169902637 0 0) 0x7f5eb80cf220 con 0x7f5eb80cfa30 2023-11-24T06:17:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.667+0000 7f5eb77fe640 1 -- 172.21.15.22:0/2499625568 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea8003520 con 0x7f5eb80cfa30 2023-11-24T06:17:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.667+0000 7f5eb77fe640 1 -- 172.21.15.22:0/2499625568 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138219072 0 0) 0x7f5eb80b2980 con 0x7f5eb80b33d0 2023-11-24T06:17:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.667+0000 7f5eb77fe640 1 -- 172.21.15.22:0/2499625568 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb80cf220 con 0x7f5eb80b33d0 2023-11-24T06:17:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.667+0000 7f5eb7fff640 1 -- 172.21.15.22:0/2499625568 >> v1:172.21.15.31:6789/0 conn(0x7f5eb80cfa30 legacy=0x7f5eb80cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.667+0000 7f5eb7fff640 1 -- 172.21.15.22:0/2499625568 >> v1:172.21.15.22:6789/0 conn(0x7f5eb80b33d0 legacy=0x7f5eb80b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.667+0000 7f5eb7fff640 1 -- 172.21.15.22:0/2499625568 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80b2bd0 con 0x7f5eb80d1fd0 2023-11-24T06:17:15.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.669+0000 7f5eb7fff640 1 --2- 172.21.15.22:0/2499625568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80d1fd0 0x7f5eb80ce920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40097d0 tx=0x7f5ea402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=962e6c342acc8a45 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.673+0000 7f5eb77fe640 1 -- 172.21.15.22:0/2499625568 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4030800 con 0x7f5eb80d1fd0 2023-11-24T06:17:15.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.673+0000 7f5eb77fe640 1 -- 172.21.15.22:0/2499625568 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea4030960 con 0x7f5eb80d1fd0 2023-11-24T06:17:15.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.673+0000 7f5eb77fe640 1 -- 172.21.15.22:0/2499625568 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4030cf0 con 0x7f5eb80d1fd0 2023-11-24T06:17:15.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.674+0000 7f5ebda71640 1 -- 172.21.15.22:0/2499625568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80d1fd0 msgr2=0x7f5eb80ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.674+0000 7f5ebda71640 1 --2- 172.21.15.22:0/2499625568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80d1fd0 0x7f5eb80ce920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40097d0 tx=0x7f5ea402b940 comp rx=0 tx=0).stop 2023-11-24T06:17:15.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.674+0000 7f5ebda71640 1 -- 172.21.15.22:0/2499625568 shutdown_connections 2023-11-24T06:17:15.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.674+0000 7f5ebda71640 1 --2- 172.21.15.22:0/2499625568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80d1fd0 0x7f5eb80ce920 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.674+0000 7f5ebda71640 1 -- 172.21.15.22:0/2499625568 >> 172.21.15.22:0/2499625568 conn(0x7f5eb80d3020 msgr2=0x7f5eb80d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.674+0000 7f5ebda71640 1 -- 172.21.15.22:0/2499625568 shutdown_connections 2023-11-24T06:17:15.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.674+0000 7f5ebda71640 1 -- 172.21.15.22:0/2499625568 wait complete. 2023-11-24T06:17:15.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.676+0000 7f5ebda71640 1 Processor -- start 2023-11-24T06:17:15.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.677+0000 7f5ebda71640 1 -- start start 2023-11-24T06:17:15.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.678+0000 7f5ebda71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb80b33d0 0x7f5eb80c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.678+0000 7f5ebda71640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80cfa30 0x7f5eb80b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.678+0000 7f5ebda71640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5eb80d1fd0 0x7f5eb8154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.678+0000 7f5ebda71640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8154ba0 con 0x7f5eb80b33d0 2023-11-24T06:17:15.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.678+0000 7f5ebda71640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8160a50 con 0x7f5eb80d1fd0 2023-11-24T06:17:15.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.678+0000 7f5ebda71640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8160770 con 0x7f5eb80cfa30 2023-11-24T06:17:15.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.678+0000 7f5ebca6f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb80b33d0 0x7f5eb80c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.678+0000 7f5ebca6f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb80b33d0 0x7f5eb80c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58070/0 (socket says 172.21.15.22:58070) 2023-11-24T06:17:15.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.678+0000 7f5ebca6f640 1 -- 172.21.15.22:0/733372339 learned_addr learned my addr 172.21.15.22:0/733372339 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5eb7fff640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80cfa30 0x7f5eb80b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5ebd270640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5eb80d1fd0 0x7f5eb8154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5ebca6f640 1 -- 172.21.15.22:0/733372339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80cfa30 msgr2=0x7f5eb80b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5ebca6f640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5eb80cfa30 0x7f5eb80b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5ebca6f640 1 -- 172.21.15.22:0/733372339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5eb80d1fd0 msgr2=0x7f5eb8154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5ebca6f640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5eb80d1fd0 0x7f5eb8154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5ebca6f640 1 -- 172.21.15.22:0/733372339 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4009400 con 0x7f5eb80b33d0 2023-11-24T06:17:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5ebca6f640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb80b33d0 0x7f5eb80c7810 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5eac001eb0 tx=0x7f5eac00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5eb57fa640 1 -- 172.21.15.22:0/733372339 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0052d0 con 0x7f5eb80b33d0 2023-11-24T06:17:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5eb57fa640 1 -- 172.21.15.22:0/733372339 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac005430 con 0x7f5eb80b33d0 2023-11-24T06:17:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb80cb1e0 con 0x7f5eb80b33d0 2023-11-24T06:17:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5eb57fa640 1 -- 172.21.15.22:0/733372339 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac012870 con 0x7f5eb80b33d0 2023-11-24T06:17:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.679+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb80cb7a0 con 0x7f5eb80b33d0 2023-11-24T06:17:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.680+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5eb815d7f0 con 0x7f5eb80b33d0 2023-11-24T06:17:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.682+0000 7f5eb57fa640 1 -- 172.21.15.22:0/733372339 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5eac0035f0 con 0x7f5eb80b33d0 2023-11-24T06:17:15.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.683+0000 7f5eb57fa640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5e9c06aff0 0x7f5e9c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.683+0000 7f5eb57fa640 1 -- 172.21.15.22:0/733372339 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5eac088c80 con 0x7f5eb80b33d0 2023-11-24T06:17:15.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.683+0000 7f5eb7fff640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5e9c06aff0 0x7f5e9c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.683+0000 7f5eb57fa640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f5e9c070e50 0x7f5e9c073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.683+0000 7f5eb57fa640 1 -- 172.21.15.22:0/733372339 --> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e9c073920 con 0x7f5e9c070e50 2023-11-24T06:17:15.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.683+0000 7f5eb57fa640 1 -- 172.21.15.22:0/733372339 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eac08d2a0 con 0x7f5eb80b33d0 2023-11-24T06:17:15.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.683+0000 7f5ebd270640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f5e9c070e50 0x7f5e9c073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.684+0000 7f5eb7fff640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5e9c06aff0 0x7f5e9c06d4b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4036000 tx=0x7f5ea403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.684+0000 7f5ebd270640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f5e9c070e50 0x7f5e9c073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.685+0000 7f5eb57fa640 1 -- 172.21.15.22:0/733372339 <== osd.1 v2:172.21.15.22:6800/3484548105 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5e9c073920 con 0x7f5e9c070e50 2023-11-24T06:17:15.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.699+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 --> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5eb808d1c0 con 0x7f5e9c070e50 2023-11-24T06:17:15.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.700+0000 7f5eb57fa640 1 -- 172.21.15.22:0/733372339 <== osd.1 v2:172.21.15.22:6800/3484548105 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5eb808d1c0 con 0x7f5e9c070e50 2023-11-24T06:17:15.703 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:17:15.703 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:17:15.703 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:17:15.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.700+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f5e9c070e50 msgr2=0x7f5e9c073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.700+0000 7f5ebda71640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6800/3484548105,v1:172.21.15.22:6801/3484548105] conn(0x7f5e9c070e50 0x7f5e9c073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.701+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5e9c06aff0 msgr2=0x7f5e9c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.701+0000 7f5ebda71640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f5e9c06aff0 0x7f5e9c06d4b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4036000 tx=0x7f5ea403b040 comp rx=0 tx=0).stop 2023-11-24T06:17:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.701+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb80b33d0 msgr2=0x7f5eb80c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.701+0000 7f5ebda71640 1 --2- 172.21.15.22:0/733372339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb80b33d0 0x7f5eb80c7810 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5eac001eb0 tx=0x7f5eac00c960 comp rx=0 tx=0).stop 2023-11-24T06:17:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.701+0000 7f5ebd270640 1 -- 172.21.15.22:0/733372339 reap_dead start 2023-11-24T06:17:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.701+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 shutdown_connections 2023-11-24T06:17:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.701+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 >> 172.21.15.22:0/733372339 conn(0x7f5eb80d3020 msgr2=0x7f5eb815c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.701+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 shutdown_connections 2023-11-24T06:17:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.701+0000 7f5ebda71640 1 -- 172.21.15.22:0/733372339 wait complete. 2023-11-24T06:17:15.718 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-24T06:17:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.910+0000 7fc3c359e640 1 Processor -- start 2023-11-24T06:17:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.910+0000 7fc3c359e640 1 -- start start 2023-11-24T06:17:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.912+0000 7fc3c359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3c406a8d0 0x7fc3c415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.912+0000 7fc3c359e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c4144c70 con 0x7fc3c406a440 2023-11-24T06:17:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.912+0000 7fc3c359e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c40ce910 con 0x7fc3c4144890 2023-11-24T06:17:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.912+0000 7fc3c359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c40cebf0 con 0x7fc3c406a8d0 2023-11-24T06:17:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.912+0000 7fc3b9d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc3c406a440 0x7fc3c415c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51404/0 (socket says 172.21.15.22:51404) 2023-11-24T06:17:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.912+0000 7fc3b9d9b640 1 -- 172.21.15.22:0/3685744436 learned_addr learned my addr 172.21.15.22:0/3685744436 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:15.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.913+0000 7fc3c2d9d640 1 --2- 172.21.15.22:0/3685744436 >> v2:172.21.15.31:3300/0 conn(0x7fc3c406a8d0 0x7fc3c415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.913+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188578717 0 0) 0x7fc3c4144c70 con 0x7fc3c406a440 2023-11-24T06:17:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.913+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a4003520 con 0x7fc3c406a440 2023-11-24T06:17:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.913+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2797883831 0 0) 0x7fc3a4003520 con 0x7fc3c406a440 2023-11-24T06:17:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.913+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 >> v2:172.21.15.31:3300/0 conn(0x7fc3c406a8d0 msgr2=0x7fc3c415ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.913+0000 7fc3c1d9b640 1 --2- 172.21.15.22:0/3685744436 >> v2:172.21.15.31:3300/0 conn(0x7fc3c406a8d0 0x7fc3c415ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.913+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 >> v1:172.21.15.31:6789/0 conn(0x7fc3c4144890 legacy=0x7fc3c415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.913+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c40ceed0 con 0x7fc3c406a440 2023-11-24T06:17:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.913+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fc3ac001670 con 0x7fc3c406a440 2023-11-24T06:17:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 >> v1:172.21.15.22:6789/0 conn(0x7fc3c406a440 legacy=0x7fc3c415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c1d9b640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a40039e0 0x7fc3a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c1d9b640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40047c0 0x7fc3a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c1d9b640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a4005180 0x7fc3a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40cebf0 con 0x7fc3a4005180 2023-11-24T06:17:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a400c0b0 con 0x7fc3a40047c0 2023-11-24T06:17:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a400c270 con 0x7fc3a40039e0 2023-11-24T06:17:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c2d9d640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a4005180 0x7fc3a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c259c640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a40039e0 0x7fc3a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c2d9d640 1 -- 172.21.15.22:0/3685744436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a40039e0 msgr2=0x7fc3a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c2d9d640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a40039e0 0x7fc3a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c2d9d640 1 -- 172.21.15.22:0/3685744436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40047c0 msgr2=0x7fc3a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c2d9d640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40047c0 0x7fc3a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c2d9d640 1 -- 172.21.15.22:0/3685744436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4003520 con 0x7fc3a4005180 2023-11-24T06:17:15.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.914+0000 7fc3c259c640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a40039e0 0x7fc3a4003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:15.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.915+0000 7fc3c2d9d640 1 -- 172.21.15.22:0/3685744436 reap_dead start 2023-11-24T06:17:15.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.915+0000 7fc3c2d9d640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a4005180 0x7fc3a400b980 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009fc0 tx=0x7fc3a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b9adc3ad9a0987 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc02cc60 con 0x7fc3a4005180 2023-11-24T06:17:15.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc00f040 con 0x7fc3a4005180 2023-11-24T06:17:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c1d9b640 1 -- 172.21.15.22:0/3685744436 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc003990 con 0x7fc3a4005180 2023-11-24T06:17:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c359e640 1 -- 172.21.15.22:0/3685744436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a4005180 msgr2=0x7fc3a400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c359e640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a4005180 0x7fc3a400b980 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009fc0 tx=0x7fc3a40057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c359e640 1 -- 172.21.15.22:0/3685744436 shutdown_connections 2023-11-24T06:17:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c359e640 1 --2- 172.21.15.22:0/3685744436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a4005180 0x7fc3a400b980 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c359e640 1 -- 172.21.15.22:0/3685744436 >> 172.21.15.22:0/3685744436 conn(0x7fc3c40cfd20 msgr2=0x7fc3c40d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c359e640 1 -- 172.21.15.22:0/3685744436 shutdown_connections 2023-11-24T06:17:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.916+0000 7fc3c359e640 1 -- 172.21.15.22:0/3685744436 wait complete. 2023-11-24T06:17:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.918+0000 7fc3c359e640 1 Processor -- start 2023-11-24T06:17:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.918+0000 7fc3c359e640 1 -- start start 2023-11-24T06:17:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.919+0000 7fc3c359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4005180 0x7fc3c41419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.919+0000 7fc3c359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c40a8df0 0x7fc3c413b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.919+0000 7fc3c359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3c413b560 0x7fc3c413b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.919+0000 7fc3c359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c41536b0 con 0x7fc3c413b560 2023-11-24T06:17:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.919+0000 7fc3c359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c4141fe0 con 0x7fc3a4005180 2023-11-24T06:17:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.919+0000 7fc3c359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c41422c0 con 0x7fc3c40a8df0 2023-11-24T06:17:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.919+0000 7fc3c2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3c413b560 0x7fc3c413b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.919+0000 7fc3c2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3c413b560 0x7fc3c413b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58086/0 (socket says 172.21.15.22:58086) 2023-11-24T06:17:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.919+0000 7fc3c2d9d640 1 -- 172.21.15.22:0/53831312 learned_addr learned my addr 172.21.15.22:0/53831312 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3b9d9b640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c40a8df0 0x7fc3c413b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3c2d9d640 1 -- 172.21.15.22:0/53831312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c40a8df0 msgr2=0x7fc3c413b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3c2d9d640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c40a8df0 0x7fc3c413b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3c2d9d640 1 -- 172.21.15.22:0/53831312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4005180 msgr2=0x7fc3c41419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3c2d9d640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4005180 0x7fc3c41419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3c2d9d640 1 -- 172.21.15.22:0/53831312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c41425a0 con 0x7fc3c413b560 2023-11-24T06:17:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3c2d9d640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3c413b560 0x7fc3c413b9e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc02c6d0 tx=0x7fc3bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3bb7fe640 1 -- 172.21.15.22:0/53831312 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc035dc0 con 0x7fc3c413b560 2023-11-24T06:17:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3bb7fe640 1 -- 172.21.15.22:0/53831312 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc003990 con 0x7fc3c413b560 2023-11-24T06:17:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3bb7fe640 1 -- 172.21.15.22:0/53831312 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc003d80 con 0x7fc3c413b560 2023-11-24T06:17:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.920+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c4142880 con 0x7fc3c413b560 2023-11-24T06:17:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.921+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c40a9270 con 0x7fc3c413b560 2023-11-24T06:17:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.922+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c4153820 con 0x7fc3c413b560 2023-11-24T06:17:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.923+0000 7fc3bb7fe640 1 -- 172.21.15.22:0/53831312 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc3bc004030 con 0x7fc3c413b560 2023-11-24T06:17:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.924+0000 7fc3bb7fe640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc3a806aff0 0x7fc3a806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.924+0000 7fc3bb7fe640 1 -- 172.21.15.22:0/53831312 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc3bc0ac2c0 con 0x7fc3c413b560 2023-11-24T06:17:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.924+0000 7fc3c259c640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc3a806aff0 0x7fc3a806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.925+0000 7fc3c259c640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc3a806aff0 0x7fc3a806d4b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4001670 tx=0x7fc3b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:15.929+0000 7fc3bb7fe640 1 -- 172.21.15.22:0/53831312 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3bc0773e0 con 0x7fc3c413b560 2023-11-24T06:17:16.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.123+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3c406ace0 con 0x7fc3a806aff0 2023-11-24T06:17:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.123+0000 7fc3bb7fe640 1 -- 172.21.15.22:0/53831312 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc3b4001bf0 con 0x7fc3a806aff0 2023-11-24T06:17:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 1 to deep-scrub 2023-11-24T06:17:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc3a806aff0 msgr2=0x7fc3a806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc3a806aff0 0x7fc3a806d4b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4001670 tx=0x7fc3b4009040 comp rx=0 tx=0).stop 2023-11-24T06:17:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3c413b560 msgr2=0x7fc3c413b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3c413b560 0x7fc3c413b9e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc02c6d0 tx=0x7fc3bc009750 comp rx=0 tx=0).stop 2023-11-24T06:17:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 shutdown_connections 2023-11-24T06:17:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc3a806aff0 0x7fc3a806d4b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3c413b560 0x7fc3c413b9e0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c40a8df0 0x7fc3c413b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 --2- 172.21.15.22:0/53831312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4005180 0x7fc3c41419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 >> 172.21.15.22:0/53831312 conn(0x7fc3c40cfd20 msgr2=0x7fc3c413efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 shutdown_connections 2023-11-24T06:17:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.126+0000 7fc3c359e640 1 -- 172.21.15.22:0/53831312 wait complete. 2023-11-24T06:17:16.147 INFO:tasks.ceph:Scrubbing osd.2 2023-11-24T06:17:16.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:17:16.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.377+0000 7f9c64cca640 1 Processor -- start 2023-11-24T06:17:16.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.377+0000 7f9c64cca640 1 -- start start 2023-11-24T06:17:16.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.378+0000 7f9c64cca640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c600d1d90 0x7f9c600ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.378+0000 7f9c64cca640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c600d0fa0 0x7f9c600b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.378+0000 7f9c64cca640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c600c6bf0 con 0x7f9c6015d3b0 2023-11-24T06:17:16.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.378+0000 7f9c64cca640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c600d13f0 con 0x7f9c600d1d90 2023-11-24T06:17:16.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.378+0000 7f9c64cca640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c600cedc0 con 0x7f9c600d0fa0 2023-11-24T06:17:16.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5f7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9c6015d3b0 0x7f9c600d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51408/0 (socket says 172.21.15.22:51408) 2023-11-24T06:17:16.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5f7fe640 1 -- 172.21.15.22:0/316041097 learned_addr learned my addr 172.21.15.22:0/316041097 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:16.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5effd640 1 --2- 172.21.15.22:0/316041097 >> v2:172.21.15.22:3300/0 conn(0x7f9c600d1d90 0x7f9c600ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5ffff640 1 --2- 172.21.15.22:0/316041097 >> v2:172.21.15.31:3300/0 conn(0x7f9c600d0fa0 0x7f9c600b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5e7fc640 1 -- 172.21.15.22:0/316041097 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916542290 0 0) 0x7f9c600c6bf0 con 0x7f9c6015d3b0 2023-11-24T06:17:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5e7fc640 1 -- 172.21.15.22:0/316041097 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c4c003520 con 0x7f9c6015d3b0 2023-11-24T06:17:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5effd640 1 -- 172.21.15.22:0/316041097 >> v2:172.21.15.31:3300/0 conn(0x7f9c600d0fa0 msgr2=0x7f9c600b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:16.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5effd640 1 --2- 172.21.15.22:0/316041097 >> v2:172.21.15.31:3300/0 conn(0x7f9c600d0fa0 0x7f9c600b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5effd640 1 -- 172.21.15.22:0/316041097 >> v1:172.21.15.22:6789/0 conn(0x7f9c6015d3b0 legacy=0x7f9c600d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.379+0000 7f9c5effd640 1 -- 172.21.15.22:0/316041097 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600c6e40 con 0x7f9c600d1d90 2023-11-24T06:17:16.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.380+0000 7f9c5effd640 1 --2- 172.21.15.22:0/316041097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 0x7f9c600ce6c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9c60072b10 tx=0x7f9c4802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d157fe848ad0d52 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.381+0000 7f9c5e7fc640 1 -- 172.21.15.22:0/316041097 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4802e070 con 0x7f9c600d1d90 2023-11-24T06:17:16.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.381+0000 7f9c5e7fc640 1 -- 172.21.15.22:0/316041097 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c480315a0 con 0x7f9c600d1d90 2023-11-24T06:17:16.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.381+0000 7f9c5e7fc640 1 -- 172.21.15.22:0/316041097 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48031930 con 0x7f9c600d1d90 2023-11-24T06:17:16.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.381+0000 7f9c64cca640 1 -- 172.21.15.22:0/316041097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 msgr2=0x7f9c600ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.381+0000 7f9c64cca640 1 --2- 172.21.15.22:0/316041097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 0x7f9c600ce6c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9c60072b10 tx=0x7f9c4802b840 comp rx=0 tx=0).stop 2023-11-24T06:17:16.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.381+0000 7f9c64cca640 1 -- 172.21.15.22:0/316041097 shutdown_connections 2023-11-24T06:17:16.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.381+0000 7f9c64cca640 1 --2- 172.21.15.22:0/316041097 >> v2:172.21.15.31:3300/0 conn(0x7f9c600d0fa0 0x7f9c600b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.381+0000 7f9c64cca640 1 --2- 172.21.15.22:0/316041097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 0x7f9c600ce6c0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.381+0000 7f9c64cca640 1 -- 172.21.15.22:0/316041097 >> 172.21.15.22:0/316041097 conn(0x7f9c600d30a0 msgr2=0x7f9c600d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:16.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.382+0000 7f9c64cca640 1 -- 172.21.15.22:0/316041097 shutdown_connections 2023-11-24T06:17:16.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.382+0000 7f9c64cca640 1 -- 172.21.15.22:0/316041097 wait complete. 2023-11-24T06:17:16.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.383+0000 7f9c64cca640 1 Processor -- start 2023-11-24T06:17:16.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.384+0000 7f9c64cca640 1 -- start start 2023-11-24T06:17:16.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.384+0000 7f9c64cca640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c600d0fa0 0x7f9c600ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.384+0000 7f9c64cca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 0x7f9c6009cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c64cca640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6015d3b0 0x7f9c601f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c64cca640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600b70e0 con 0x7f9c600d1d90 2023-11-24T06:17:16.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c64cca640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600cd460 con 0x7f9c6015d3b0 2023-11-24T06:17:16.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c64cca640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6009fa70 con 0x7f9c600d0fa0 2023-11-24T06:17:16.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c5effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 0x7f9c6009cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c5effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 0x7f9c6009cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58114/0 (socket says 172.21.15.22:58114) 2023-11-24T06:17:16.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c5effd640 1 -- 172.21.15.22:0/2512451571 learned_addr learned my addr 172.21.15.22:0/2512451571 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:16.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c5f7fe640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c600d0fa0 0x7f9c600ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c5effd640 1 -- 172.21.15.22:0/2512451571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c600d0fa0 msgr2=0x7f9c600ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c5effd640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c600d0fa0 0x7f9c600ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c5effd640 1 -- 172.21.15.22:0/2512451571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6015d3b0 msgr2=0x7f9c601f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c5effd640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6015d3b0 0x7f9c601f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.385+0000 7f9c5effd640 1 -- 172.21.15.22:0/2512451571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48009400 con 0x7f9c600d1d90 2023-11-24T06:17:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.386+0000 7f9c5effd640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 0x7f9c6009cf30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009890 tx=0x7f9c480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.386+0000 7f9c57fff640 1 -- 172.21.15.22:0/2512451571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48032840 con 0x7f9c600d1d90 2023-11-24T06:17:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.386+0000 7f9c57fff640 1 -- 172.21.15.22:0/2512451571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48031f00 con 0x7f9c600d1d90 2023-11-24T06:17:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.386+0000 7f9c57fff640 1 -- 172.21.15.22:0/2512451571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48032be0 con 0x7f9c600d1d90 2023-11-24T06:17:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.386+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6009fd50 con 0x7f9c600d1d90 2023-11-24T06:17:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.386+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c600b6d70 con 0x7f9c600d1d90 2023-11-24T06:17:16.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.387+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c6015d790 con 0x7f9c600d1d90 2023-11-24T06:17:16.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.388+0000 7f9c57fff640 1 -- 172.21.15.22:0/2512451571 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9c48032d40 con 0x7f9c600d1d90 2023-11-24T06:17:16.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.389+0000 7f9c57fff640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c4006aff0 0x7f9c4006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.389+0000 7f9c57fff640 1 -- 172.21.15.22:0/2512451571 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c480ab5a0 con 0x7f9c600d1d90 2023-11-24T06:17:16.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.390+0000 7f9c5f7fe640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c4006aff0 0x7f9c4006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.390+0000 7f9c57fff640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f9c40070e50 0x7f9c40073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.390+0000 7f9c57fff640 1 -- 172.21.15.22:0/2512451571 --> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c40073920 con 0x7f9c40070e50 2023-11-24T06:17:16.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.390+0000 7f9c57fff640 1 -- 172.21.15.22:0/2512451571 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c480adc40 con 0x7f9c600d1d90 2023-11-24T06:17:16.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.390+0000 7f9c5ffff640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f9c40070e50 0x7f9c40073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.390+0000 7f9c5f7fe640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c4006aff0 0x7f9c4006d4b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9c50001560 tx=0x7f9c50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.391+0000 7f9c5ffff640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f9c40070e50 0x7f9c40073270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.392+0000 7f9c57fff640 1 -- 172.21.15.22:0/2512451571 <== osd.2 v2:172.21.15.22:6806/2854052422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9c40073920 con 0x7f9c40070e50 2023-11-24T06:17:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.406+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 --> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9c600c7400 con 0x7f9c40070e50 2023-11-24T06:17:16.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.407+0000 7f9c57fff640 1 -- 172.21.15.22:0/2512451571 <== osd.2 v2:172.21.15.22:6806/2854052422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9c580099a0 con 0x7f9c40070e50 2023-11-24T06:17:16.409 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:17:16.409 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:17:16.410 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:17:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.407+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f9c40070e50 msgr2=0x7f9c40073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.407+0000 7f9c64cca640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6806/2854052422,v1:172.21.15.22:6809/2854052422] conn(0x7f9c40070e50 0x7f9c40073270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.407+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c4006aff0 msgr2=0x7f9c4006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.407+0000 7f9c64cca640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9c4006aff0 0x7f9c4006d4b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9c50001560 tx=0x7f9c50009040 comp rx=0 tx=0).stop 2023-11-24T06:17:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.407+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 msgr2=0x7f9c6009cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.407+0000 7f9c64cca640 1 --2- 172.21.15.22:0/2512451571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c600d1d90 0x7f9c6009cf30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009890 tx=0x7f9c480046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.407+0000 7f9c5ffff640 1 -- 172.21.15.22:0/2512451571 reap_dead start 2023-11-24T06:17:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.408+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 shutdown_connections 2023-11-24T06:17:16.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.408+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 >> 172.21.15.22:0/2512451571 conn(0x7f9c600d30a0 msgr2=0x7f9c6015f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:16.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.408+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 shutdown_connections 2023-11-24T06:17:16.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.408+0000 7f9c64cca640 1 -- 172.21.15.22:0/2512451571 wait complete. 2023-11-24T06:17:16.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-24T06:17:16.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.647+0000 7efd2c67c640 1 Processor -- start 2023-11-24T06:17:16.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.648+0000 7efd2c67c640 1 -- start start 2023-11-24T06:17:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.649+0000 7efd2c67c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd2415d480 0x7efd24161050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.649+0000 7efd2c67c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd240ce750 0x7efd240d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.649+0000 7efd2c67c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd24161b80 con 0x7efd24161590 2023-11-24T06:17:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.649+0000 7efd2c67c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd24161e60 con 0x7efd2415d480 2023-11-24T06:17:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.649+0000 7efd2c67c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd240d1360 con 0x7efd240ce750 2023-11-24T06:17:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.650+0000 7efd2a418640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd2415d480 0x7efd24161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.650+0000 7efd2a418640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd2415d480 0x7efd24161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58122/0 (socket says 172.21.15.22:58122) 2023-11-24T06:17:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.650+0000 7efd2a418640 1 -- 172.21.15.22:0/3955716474 learned_addr learned my addr 172.21.15.22:0/3955716474 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:16.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.650+0000 7efd2ac19640 1 --2- 172.21.15.22:0/3955716474 >> v2:172.21.15.31:3300/0 conn(0x7efd240ce750 0x7efd240d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.650+0000 7efd2a418640 1 -- 172.21.15.22:0/3955716474 >> v2:172.21.15.31:3300/0 conn(0x7efd240ce750 msgr2=0x7efd240d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:16.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.650+0000 7efd2a418640 1 --2- 172.21.15.22:0/3955716474 >> v2:172.21.15.31:3300/0 conn(0x7efd240ce750 0x7efd240d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.650+0000 7efd2a418640 1 -- 172.21.15.22:0/3955716474 >> v1:172.21.15.22:6789/0 conn(0x7efd24161590 legacy=0x7efd240ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.650+0000 7efd2a418640 1 -- 172.21.15.22:0/3955716474 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd240d1640 con 0x7efd2415d480 2023-11-24T06:17:16.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.650+0000 7efd2ac19640 1 --2- 172.21.15.22:0/3955716474 >> v2:172.21.15.31:3300/0 conn(0x7efd240ce750 0x7efd240d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:16.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.651+0000 7efd2a418640 1 --2- 172.21.15.22:0/3955716474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2415d480 0x7efd24161050 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7efd240b5e30 tx=0x7efd2002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e43e9177fe9ce95 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.652+0000 7efd29416640 1 -- 172.21.15.22:0/3955716474 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2002ca80 con 0x7efd2415d480 2023-11-24T06:17:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.652+0000 7efd29416640 1 -- 172.21.15.22:0/3955716474 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2002cbe0 con 0x7efd2415d480 2023-11-24T06:17:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.652+0000 7efd29416640 1 -- 172.21.15.22:0/3955716474 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200343f0 con 0x7efd2415d480 2023-11-24T06:17:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.652+0000 7efd2c67c640 1 -- 172.21.15.22:0/3955716474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2415d480 msgr2=0x7efd24161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.652+0000 7efd2c67c640 1 --2- 172.21.15.22:0/3955716474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2415d480 0x7efd24161050 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7efd240b5e30 tx=0x7efd2002bee0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.652+0000 7efd2c67c640 1 -- 172.21.15.22:0/3955716474 shutdown_connections 2023-11-24T06:17:16.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.652+0000 7efd2c67c640 1 --2- 172.21.15.22:0/3955716474 >> v2:172.21.15.31:3300/0 conn(0x7efd240ce750 0x7efd240d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.652+0000 7efd2c67c640 1 --2- 172.21.15.22:0/3955716474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2415d480 0x7efd24161050 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.652+0000 7efd2c67c640 1 -- 172.21.15.22:0/3955716474 >> 172.21.15.22:0/3955716474 conn(0x7efd2406b420 msgr2=0x7efd2406b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:16.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.653+0000 7efd2c67c640 1 -- 172.21.15.22:0/3955716474 shutdown_connections 2023-11-24T06:17:16.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.653+0000 7efd2c67c640 1 -- 172.21.15.22:0/3955716474 wait complete. 2023-11-24T06:17:16.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.654+0000 7efd2c67c640 1 Processor -- start 2023-11-24T06:17:16.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.655+0000 7efd2c67c640 1 -- start start 2023-11-24T06:17:16.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2c67c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd240ce750 0x7efd241600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2c67c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd2415d480 0x7efd241f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2c67c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd24161590 0x7efd241f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2c67c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd241f0ba0 con 0x7efd240ce750 2023-11-24T06:17:16.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2c67c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd241f3110 con 0x7efd2415d480 2023-11-24T06:17:16.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2c67c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd241f33d0 con 0x7efd24161590 2023-11-24T06:17:16.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2a418640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd240ce750 0x7efd241600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2a418640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd240ce750 0x7efd241600e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58136/0 (socket says 172.21.15.22:58136) 2023-11-24T06:17:16.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2a418640 1 -- 172.21.15.22:0/1678702815 learned_addr learned my addr 172.21.15.22:0/1678702815 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:16.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2ac19640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd24161590 0x7efd241f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2a418640 1 -- 172.21.15.22:0/1678702815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd24161590 msgr2=0x7efd241f0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2a418640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd24161590 0x7efd241f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2a418640 1 -- 172.21.15.22:0/1678702815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd2415d480 msgr2=0x7efd241f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2a418640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd2415d480 0x7efd241f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.656+0000 7efd2a418640 1 -- 172.21.15.22:0/1678702815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd20009b30 con 0x7efd240ce750 2023-11-24T06:17:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.657+0000 7efd2a418640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd240ce750 0x7efd241600e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7efd20000f80 tx=0x7efd20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.657+0000 7efd1affd640 1 -- 172.21.15.22:0/1678702815 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20009510 con 0x7efd240ce750 2023-11-24T06:17:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.657+0000 7efd1affd640 1 -- 172.21.15.22:0/1678702815 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2003e450 con 0x7efd240ce750 2023-11-24T06:17:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.657+0000 7efd1affd640 1 -- 172.21.15.22:0/1678702815 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2003e800 con 0x7efd240ce750 2023-11-24T06:17:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.657+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd241f36b0 con 0x7efd240ce750 2023-11-24T06:17:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.657+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd241f3c70 con 0x7efd240ce750 2023-11-24T06:17:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.658+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd24074770 con 0x7efd240ce750 2023-11-24T06:17:16.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.659+0000 7efd1affd640 1 -- 172.21.15.22:0/1678702815 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7efd2002cd50 con 0x7efd240ce750 2023-11-24T06:17:16.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.660+0000 7efd1affd640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd0806aff0 0x7efd0806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.660+0000 7efd1affd640 1 -- 172.21.15.22:0/1678702815 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd200ac2d0 con 0x7efd240ce750 2023-11-24T06:17:16.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.661+0000 7efd29c17640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd0806aff0 0x7efd0806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.661+0000 7efd29c17640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd0806aff0 0x7efd0806d4b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efd14000f60 tx=0x7efd140079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.665+0000 7efd1affd640 1 -- 172.21.15.22:0/1678702815 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd20077360 con 0x7efd240ce750 2023-11-24T06:17:16.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.866+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7efd240b63a0 con 0x7efd0806aff0 2023-11-24T06:17:16.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.867+0000 7efd1affd640 1 -- 172.21.15.22:0/1678702815 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd14005080 con 0x7efd0806aff0 2023-11-24T06:17:16.869 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 2 to deep-scrub 2023-11-24T06:17:16.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.869+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd0806aff0 msgr2=0x7efd0806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.869+0000 7efd2c67c640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd0806aff0 0x7efd0806d4b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efd14000f60 tx=0x7efd140079b0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.869+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd240ce750 msgr2=0x7efd241600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.869+0000 7efd2c67c640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd240ce750 0x7efd241600e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7efd20000f80 tx=0x7efd20004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.870+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 shutdown_connections 2023-11-24T06:17:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.870+0000 7efd2c67c640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7efd0806aff0 0x7efd0806d4b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.870+0000 7efd2c67c640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd24161590 0x7efd241f0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.870+0000 7efd2c67c640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd2415d480 0x7efd241f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.870+0000 7efd2c67c640 1 --2- 172.21.15.22:0/1678702815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd240ce750 0x7efd241600e0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.870+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 >> 172.21.15.22:0/1678702815 conn(0x7efd2406b420 msgr2=0x7efd240b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:16.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.870+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 shutdown_connections 2023-11-24T06:17:16.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:16.870+0000 7efd2c67c640 1 -- 172.21.15.22:0/1678702815 wait complete. 2023-11-24T06:17:16.892 INFO:tasks.ceph:Scrubbing osd.3 2023-11-24T06:17:16.892 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:17:17.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.114+0000 7f3b624f8640 1 Processor -- start 2023-11-24T06:17:17.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.115+0000 7f3b624f8640 1 -- start start 2023-11-24T06:17:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.116+0000 7f3b624f8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3b5c15f270 0x7f3b5c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.116+0000 7f3b624f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3b5c06d9e0 0x7f3b5c0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.117+0000 7f3b624f8640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c15f930 con 0x7f3b5c144770 2023-11-24T06:17:17.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.117+0000 7f3b624f8640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0b43b0 con 0x7f3b5c15f270 2023-11-24T06:17:17.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.117+0000 7f3b624f8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0b3b10 con 0x7f3b5c06d9e0 2023-11-24T06:17:17.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.117+0000 7f3b60cf5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3b5c15f270 0x7f3b5c0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.117+0000 7f3b60cf5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3b5c15f270 0x7f3b5c0cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58146/0 (socket says 172.21.15.22:58146) 2023-11-24T06:17:17.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.117+0000 7f3b60cf5640 1 -- 172.21.15.22:0/35282874 learned_addr learned my addr 172.21.15.22:0/35282874 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:17.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.117+0000 7f3b614f6640 1 --1- 172.21.15.22:0/35282874 >> v1:172.21.15.22:6789/0 conn(0x7f3b5c144770 0x7f3b5c15eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51422/0 (socket says 172.21.15.22:51422) 2023-11-24T06:17:17.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.117+0000 7f3b61cf7640 1 --2- 172.21.15.22:0/35282874 >> v2:172.21.15.31:3300/0 conn(0x7f3b5c06d9e0 0x7f3b5c0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.117+0000 7f3b60cf5640 1 -- 172.21.15.22:0/35282874 >> v2:172.21.15.31:3300/0 conn(0x7f3b5c06d9e0 msgr2=0x7f3b5c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.118+0000 7f3b60cf5640 1 --2- 172.21.15.22:0/35282874 >> v2:172.21.15.31:3300/0 conn(0x7f3b5c06d9e0 0x7f3b5c0cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.118+0000 7f3b60cf5640 1 -- 172.21.15.22:0/35282874 >> v1:172.21.15.22:6789/0 conn(0x7f3b5c144770 legacy=0x7f3b5c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.118+0000 7f3b53fff640 1 -- 172.21.15.22:0/35282874 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445650588 0 0) 0x7f3b5c15f930 con 0x7f3b5c144770 2023-11-24T06:17:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.118+0000 7f3b60cf5640 1 -- 172.21.15.22:0/35282874 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0b3df0 con 0x7f3b5c15f270 2023-11-24T06:17:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.119+0000 7f3b60cf5640 1 --2- 172.21.15.22:0/35282874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c15f270 0x7f3b5c0cd4a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c144eb0 tx=0x7f3b4c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfa7fa259bb7a10 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.119+0000 7f3b53fff640 1 -- 172.21.15.22:0/35282874 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c030860 con 0x7f3b5c15f270 2023-11-24T06:17:17.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.119+0000 7f3b53fff640 1 -- 172.21.15.22:0/35282874 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0309c0 con 0x7f3b5c15f270 2023-11-24T06:17:17.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.119+0000 7f3b53fff640 1 -- 172.21.15.22:0/35282874 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c030d50 con 0x7f3b5c15f270 2023-11-24T06:17:17.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.120+0000 7f3b624f8640 1 -- 172.21.15.22:0/35282874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c15f270 msgr2=0x7f3b5c0cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.120+0000 7f3b624f8640 1 --2- 172.21.15.22:0/35282874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c15f270 0x7f3b5c0cd4a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c144eb0 tx=0x7f3b4c02b9a0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.120+0000 7f3b624f8640 1 -- 172.21.15.22:0/35282874 shutdown_connections 2023-11-24T06:17:17.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.120+0000 7f3b624f8640 1 --2- 172.21.15.22:0/35282874 >> v2:172.21.15.31:3300/0 conn(0x7f3b5c06d9e0 0x7f3b5c0cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.120+0000 7f3b624f8640 1 --2- 172.21.15.22:0/35282874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c15f270 0x7f3b5c0cd4a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.120+0000 7f3b624f8640 1 -- 172.21.15.22:0/35282874 >> 172.21.15.22:0/35282874 conn(0x7f3b5c0cec10 msgr2=0x7f3b5c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.120+0000 7f3b624f8640 1 -- 172.21.15.22:0/35282874 shutdown_connections 2023-11-24T06:17:17.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.120+0000 7f3b624f8640 1 -- 172.21.15.22:0/35282874 wait complete. 2023-11-24T06:17:17.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.122+0000 7f3b624f8640 1 Processor -- start 2023-11-24T06:17:17.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.122+0000 7f3b624f8640 1 -- start start 2023-11-24T06:17:17.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.123+0000 7f3b624f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b5c06d9e0 0x7f3b5c1574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.123+0000 7f3b624f8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c144770 0x7f3b5c13d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.123+0000 7f3b624f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b5c15f270 0x7f3b5c13bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.123+0000 7f3b624f8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c13d480 con 0x7f3b5c144770 2023-11-24T06:17:17.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.123+0000 7f3b624f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c13c650 con 0x7f3b5c15f270 2023-11-24T06:17:17.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.123+0000 7f3b624f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c13cb50 con 0x7f3b5c06d9e0 2023-11-24T06:17:17.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.123+0000 7f3b60cf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c144770 0x7f3b5c13d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.123+0000 7f3b60cf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c144770 0x7f3b5c13d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58154/0 (socket says 172.21.15.22:58154) 2023-11-24T06:17:17.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.123+0000 7f3b60cf5640 1 -- 172.21.15.22:0/3385054559 learned_addr learned my addr 172.21.15.22:0/3385054559 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:17.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b614f6640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b5c06d9e0 0x7f3b5c1574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b61cf7640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b5c15f270 0x7f3b5c13bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b60cf5640 1 -- 172.21.15.22:0/3385054559 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b5c06d9e0 msgr2=0x7f3b5c1574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b60cf5640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b5c06d9e0 0x7f3b5c1574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b60cf5640 1 -- 172.21.15.22:0/3385054559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b5c15f270 msgr2=0x7f3b5c13bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b60cf5640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b5c15f270 0x7f3b5c13bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b60cf5640 1 -- 172.21.15.22:0/3385054559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0094d0 con 0x7f3b5c144770 2023-11-24T06:17:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b614f6640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b5c06d9e0 0x7f3b5c1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b61cf7640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b5c15f270 0x7f3b5c13bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b60cf5640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c144770 0x7f3b5c13d910 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c000c00 tx=0x7f3b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b51ffb640 1 -- 172.21.15.22:0/3385054559 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c03e070 con 0x7f3b5c144770 2023-11-24T06:17:17.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b51ffb640 1 -- 172.21.15.22:0/3385054559 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c004030 con 0x7f3b5c144770 2023-11-24T06:17:17.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b51ffb640 1 -- 172.21.15.22:0/3385054559 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0043c0 con 0x7f3b5c144770 2023-11-24T06:17:17.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.124+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c13ce30 con 0x7f3b5c144770 2023-11-24T06:17:17.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.125+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c157c50 con 0x7f3b5c144770 2023-11-24T06:17:17.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.126+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b5c13fd90 con 0x7f3b5c144770 2023-11-24T06:17:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.127+0000 7f3b51ffb640 1 -- 172.21.15.22:0/3385054559 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3b4c042070 con 0x7f3b5c144770 2023-11-24T06:17:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.127+0000 7f3b51ffb640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b4006b020 0x7f3b4006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.128+0000 7f3b51ffb640 1 -- 172.21.15.22:0/3385054559 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3b4c0ab5c0 con 0x7f3b5c144770 2023-11-24T06:17:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.128+0000 7f3b614f6640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b4006b020 0x7f3b4006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.128+0000 7f3b51ffb640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7f3b40070e80 0x7f3b400732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.128+0000 7f3b51ffb640 1 -- 172.21.15.22:0/3385054559 --> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b40073950 con 0x7f3b40070e80 2023-11-24T06:17:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.128+0000 7f3b51ffb640 1 -- 172.21.15.22:0/3385054559 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b4c0adc00 con 0x7f3b5c144770 2023-11-24T06:17:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.128+0000 7f3b61cf7640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7f3b40070e80 0x7f3b400732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.129+0000 7f3b614f6640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b4006b020 0x7f3b4006d4e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3b58000f60 tx=0x7f3b58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.129+0000 7f3b61cf7640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7f3b40070e80 0x7f3b400732a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.130+0000 7f3b51ffb640 1 -- 172.21.15.22:0/3385054559 <== osd.3 v2:172.21.15.22:6822/2514152945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3b40073950 con 0x7f3b40070e80 2023-11-24T06:17:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.144+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 --> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3b5c0ceff0 con 0x7f3b40070e80 2023-11-24T06:17:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.145+0000 7f3b51ffb640 1 -- 172.21.15.22:0/3385054559 <== osd.3 v2:172.21.15.22:6822/2514152945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3b5c0ceff0 con 0x7f3b40070e80 2023-11-24T06:17:17.148 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:17:17.148 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:17:17.148 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:17:17.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.145+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7f3b40070e80 msgr2=0x7f3b400732a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.145+0000 7f3b624f8640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6822/2514152945,v1:172.21.15.22:6824/2514152945] conn(0x7f3b40070e80 0x7f3b400732a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.145+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b4006b020 msgr2=0x7f3b4006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.145+0000 7f3b624f8640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f3b4006b020 0x7f3b4006d4e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3b58000f60 tx=0x7f3b58009040 comp rx=0 tx=0).stop 2023-11-24T06:17:17.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.145+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c144770 msgr2=0x7f3b5c13d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.145+0000 7f3b624f8640 1 --2- 172.21.15.22:0/3385054559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b5c144770 0x7f3b5c13d910 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c000c00 tx=0x7f3b4c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.145+0000 7f3b61cf7640 1 -- 172.21.15.22:0/3385054559 reap_dead start 2023-11-24T06:17:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.146+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 shutdown_connections 2023-11-24T06:17:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.146+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 >> 172.21.15.22:0/3385054559 conn(0x7f3b5c0cec10 msgr2=0x7f3b5c0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.146+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 shutdown_connections 2023-11-24T06:17:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.146+0000 7f3b624f8640 1 -- 172.21.15.22:0/3385054559 wait complete. 2023-11-24T06:17:17.166 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-24T06:17:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.384+0000 7f1e8dccf640 1 Processor -- start 2023-11-24T06:17:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.384+0000 7f1e8dccf640 1 -- start start 2023-11-24T06:17:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.385+0000 7f1e8dccf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1e8806d520 0x7f1e8806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.386+0000 7f1e8dccf640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8815c360 con 0x7f1e880ad720 2023-11-24T06:17:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.386+0000 7f1e8dccf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8815faf0 con 0x7f1e880abff0 2023-11-24T06:17:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.386+0000 7f1e8dccf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880b41a0 con 0x7f1e8806d520 2023-11-24T06:17:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.386+0000 7f1e86ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1e880ad720 0x7f1e8815ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51430/0 (socket says 172.21.15.22:51430) 2023-11-24T06:17:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.386+0000 7f1e86ffd640 1 -- 172.21.15.22:0/1796802576 learned_addr learned my addr 172.21.15.22:0/1796802576 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.386+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657093406 0 0) 0x7f1e8815c360 con 0x7f1e880ad720 2023-11-24T06:17:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.386+0000 7f1e877fe640 1 --2- 172.21.15.22:0/1796802576 >> v2:172.21.15.31:3300/0 conn(0x7f1e8806d520 0x7f1e8806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e74003520 con 0x7f1e880ad720 2023-11-24T06:17:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148335926 0 0) 0x7f1e74003520 con 0x7f1e880ad720 2023-11-24T06:17:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 >> v2:172.21.15.31:3300/0 conn(0x7f1e8806d520 msgr2=0x7f1e8806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 --2- 172.21.15.22:0/1796802576 >> v2:172.21.15.31:3300/0 conn(0x7f1e8806d520 0x7f1e8806d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 >> v1:172.21.15.31:6789/0 conn(0x7f1e880abff0 legacy=0x7f1e8815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8806de40 con 0x7f1e880ad720 2023-11-24T06:17:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f1e70001670 con 0x7f1e880ad720 2023-11-24T06:17:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 >> v1:172.21.15.22:6789/0 conn(0x7f1e880ad720 legacy=0x7f1e8815ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e74003970 0x7f1e74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e740047c0 0x7f1e74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7400c0a0 con 0x7f1e74005180 2023-11-24T06:17:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7400c210 con 0x7f1e740047c0 2023-11-24T06:17:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7400c3d0 con 0x7f1e74003970 2023-11-24T06:17:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.387+0000 7f1e87fff640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.388+0000 7f1e877fe640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e74003970 0x7f1e74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.388+0000 7f1e86ffd640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e740047c0 0x7f1e74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.388+0000 7f1e87fff640 1 -- 172.21.15.22:0/1796802576 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e74003970 msgr2=0x7f1e74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.388+0000 7f1e87fff640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e74003970 0x7f1e74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.388+0000 7f1e87fff640 1 -- 172.21.15.22:0/1796802576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e740047c0 msgr2=0x7f1e74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.388+0000 7f1e87fff640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e740047c0 0x7f1e74004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.388+0000 7f1e87fff640 1 -- 172.21.15.22:0/1796802576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74003520 con 0x7f1e74005180 2023-11-24T06:17:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.388+0000 7f1e86ffd640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e740047c0 0x7f1e74004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.389+0000 7f1e87fff640 1 -- 172.21.15.22:0/1796802576 reap_dead start 2023-11-24T06:17:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.389+0000 7f1e87fff640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e7400b980 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1e80001720 tx=0x7f1e740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9261153ffe1c97 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.389+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800052d0 con 0x7f1e74005180 2023-11-24T06:17:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.389+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8002e050 con 0x7f1e74005180 2023-11-24T06:17:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.389+0000 7f1e867fc640 1 -- 172.21.15.22:0/1796802576 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800035f0 con 0x7f1e74005180 2023-11-24T06:17:17.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.390+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1796802576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 msgr2=0x7f1e7400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.390+0000 7f1e8dccf640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e7400b980 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1e80001720 tx=0x7f1e740057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.390+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1796802576 shutdown_connections 2023-11-24T06:17:17.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.390+0000 7f1e8dccf640 1 --2- 172.21.15.22:0/1796802576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e7400b980 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.390+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1796802576 >> 172.21.15.22:0/1796802576 conn(0x7f1e880b0d80 msgr2=0x7f1e880b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.390+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1796802576 shutdown_connections 2023-11-24T06:17:17.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.390+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1796802576 wait complete. 2023-11-24T06:17:17.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.392+0000 7f1e8dccf640 1 Processor -- start 2023-11-24T06:17:17.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.392+0000 7f1e8dccf640 1 -- start start 2023-11-24T06:17:17.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.393+0000 7f1e8dccf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e8815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.393+0000 7f1e8dccf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e880cbd00 0x7f1e880cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.393+0000 7f1e8dccf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e880cdfb0 0x7f1e880ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.393+0000 7f1e8dccf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880c8400 con 0x7f1e74005180 2023-11-24T06:17:17.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.393+0000 7f1e8dccf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880ce970 con 0x7f1e880cdfb0 2023-11-24T06:17:17.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.393+0000 7f1e8dccf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8815b330 con 0x7f1e880cbd00 2023-11-24T06:17:17.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.393+0000 7f1e877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e8815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e8815a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58176/0 (socket says 172.21.15.22:58176) 2023-11-24T06:17:17.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e877fe640 1 -- 172.21.15.22:0/1200223842 learned_addr learned my addr 172.21.15.22:0/1200223842 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:17.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e87fff640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e880cdfb0 0x7f1e880ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e86ffd640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e880cbd00 0x7f1e880cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e877fe640 1 -- 172.21.15.22:0/1200223842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e880cbd00 msgr2=0x7f1e880cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e877fe640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e880cbd00 0x7f1e880cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e877fe640 1 -- 172.21.15.22:0/1200223842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e880cdfb0 msgr2=0x7f1e880ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e877fe640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e880cdfb0 0x7f1e880ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e877fe640 1 -- 172.21.15.22:0/1200223842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880c8650 con 0x7f1e74005180 2023-11-24T06:17:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e86ffd640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e880cbd00 0x7f1e880cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.394+0000 7f1e877fe640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e8815a9a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009cb0 tx=0x7f1e78007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.395+0000 7f1e7ffff640 1 -- 172.21.15.22:0/1200223842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78014610 con 0x7f1e74005180 2023-11-24T06:17:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.395+0000 7f1e7ffff640 1 -- 172.21.15.22:0/1200223842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7800f050 con 0x7f1e74005180 2023-11-24T06:17:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.395+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e880c8930 con 0x7f1e74005180 2023-11-24T06:17:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.395+0000 7f1e7ffff640 1 -- 172.21.15.22:0/1200223842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e780149d0 con 0x7f1e74005180 2023-11-24T06:17:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.395+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e880cb160 con 0x7f1e74005180 2023-11-24T06:17:17.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.396+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e88074770 con 0x7f1e74005180 2023-11-24T06:17:17.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.397+0000 7f1e7ffff640 1 -- 172.21.15.22:0/1200223842 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1e78014b30 con 0x7f1e74005180 2023-11-24T06:17:17.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.398+0000 7f1e7ffff640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e6806aff0 0x7f1e6806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.398+0000 7f1e7ffff640 1 -- 172.21.15.22:0/1200223842 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1e78089fc0 con 0x7f1e74005180 2023-11-24T06:17:17.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.398+0000 7f1e86ffd640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e6806aff0 0x7f1e6806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.399+0000 7f1e86ffd640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e6806aff0 0x7f1e6806d4b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1e70000f60 tx=0x7f1e70001170 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.402+0000 7f1e7ffff640 1 -- 172.21.15.22:0/1200223842 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e780bce90 con 0x7f1e74005180 2023-11-24T06:17:17.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.596+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e8815bff0 con 0x7f1e6806aff0 2023-11-24T06:17:17.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.597+0000 7f1e7ffff640 1 -- 172.21.15.22:0/1200223842 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1e70001d60 con 0x7f1e6806aff0 2023-11-24T06:17:17.600 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 3 to deep-scrub 2023-11-24T06:17:17.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e6806aff0 msgr2=0x7f1e6806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e6806aff0 0x7f1e6806d4b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1e70000f60 tx=0x7f1e70001170 comp rx=0 tx=0).stop 2023-11-24T06:17:17.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 msgr2=0x7f1e8815a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e8815a9a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009cb0 tx=0x7f1e78007700 comp rx=0 tx=0).stop 2023-11-24T06:17:17.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 shutdown_connections 2023-11-24T06:17:17.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f1e6806aff0 0x7f1e6806d4b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e880cdfb0 0x7f1e880ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e880cbd00 0x7f1e880cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 --2- 172.21.15.22:0/1200223842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e74005180 0x7f1e8815a9a0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 >> 172.21.15.22:0/1200223842 conn(0x7f1e880b0d80 msgr2=0x7f1e880b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 shutdown_connections 2023-11-24T06:17:17.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.600+0000 7f1e8dccf640 1 -- 172.21.15.22:0/1200223842 wait complete. 2023-11-24T06:17:17.621 INFO:tasks.ceph:Scrubbing osd.4 2023-11-24T06:17:17.622 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:17:17.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.856+0000 7f9a33078640 1 Processor -- start 2023-11-24T06:17:17.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.856+0000 7f9a33078640 1 -- start start 2023-11-24T06:17:17.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.858+0000 7f9a33078640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9a2c0cfa30 0x7f9a2c0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.858+0000 7f9a33078640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0b2980 con 0x7f9a2c0d1fd0 2023-11-24T06:17:17.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.858+0000 7f9a33078640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0d0350 con 0x7f9a2c0b33d0 2023-11-24T06:17:17.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.858+0000 7f9a33078640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c0cf030 con 0x7f9a2c0cfa30 2023-11-24T06:17:17.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.858+0000 7f9a31875640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9a2c0d1fd0 0x7f9a2c0ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51438/0 (socket says 172.21.15.22:51438) 2023-11-24T06:17:17.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.858+0000 7f9a31875640 1 -- 172.21.15.22:0/741417448 learned_addr learned my addr 172.21.15.22:0/741417448 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:17.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a32076640 1 --2- 172.21.15.22:0/741417448 >> v2:172.21.15.31:3300/0 conn(0x7f9a2c0cfa30 0x7f9a2c0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380062538 0 0) 0x7f9a2c0b2980 con 0x7f9a2c0d1fd0 2023-11-24T06:17:17.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a18003520 con 0x7f9a2c0d1fd0 2023-11-24T06:17:17.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1156355039 0 0) 0x7f9a18003520 con 0x7f9a2c0d1fd0 2023-11-24T06:17:17.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 >> v2:172.21.15.31:3300/0 conn(0x7f9a2c0cfa30 msgr2=0x7f9a2c0cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 --2- 172.21.15.22:0/741417448 >> v2:172.21.15.31:3300/0 conn(0x7f9a2c0cfa30 0x7f9a2c0cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 >> v1:172.21.15.31:6789/0 conn(0x7f9a2c0b33d0 legacy=0x7f9a2c0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0cf220 con 0x7f9a2c0d1fd0 2023-11-24T06:17:17.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f9a1c001670 con 0x7f9a2c0d1fd0 2023-11-24T06:17:17.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 >> v1:172.21.15.22:6789/0 conn(0x7f9a2c0d1fd0 legacy=0x7f9a2c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a180039e0 0x7f9a18003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a180047c0 0x7f9a18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a18005180 0x7f9a1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1800c080 con 0x7f9a18005180 2023-11-24T06:17:17.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1800c1f0 con 0x7f9a180039e0 2023-11-24T06:17:17.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.859+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1800c3b0 con 0x7f9a180047c0 2023-11-24T06:17:17.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.860+0000 7f9a32877640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a18005180 0x7f9a1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.860+0000 7f9a32076640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a180039e0 0x7f9a18003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.860+0000 7f9a31875640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a180047c0 0x7f9a18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.860+0000 7f9a32877640 1 -- 172.21.15.22:0/741417448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a180047c0 msgr2=0x7f9a18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.860+0000 7f9a32877640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a180047c0 0x7f9a18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.860+0000 7f9a32877640 1 -- 172.21.15.22:0/741417448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a180039e0 msgr2=0x7f9a18003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.860+0000 7f9a32877640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a180039e0 0x7f9a18003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.860+0000 7f9a32877640 1 -- 172.21.15.22:0/741417448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18003520 con 0x7f9a18005180 2023-11-24T06:17:17.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.861+0000 7f9a32877640 1 -- 172.21.15.22:0/741417448 reap_dead start 2023-11-24T06:17:17.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.862+0000 7f9a32877640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a18005180 0x7f9a1800b980 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f9a24001e50 tx=0x7f9a180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c8532e38794060 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.862+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24003b70 con 0x7f9a18005180 2023-11-24T06:17:17.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.862+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a24003d10 con 0x7f9a18005180 2023-11-24T06:17:17.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.862+0000 7f9a31074640 1 -- 172.21.15.22:0/741417448 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24005310 con 0x7f9a18005180 2023-11-24T06:17:17.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.862+0000 7f9a33078640 1 -- 172.21.15.22:0/741417448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a18005180 msgr2=0x7f9a1800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.862+0000 7f9a33078640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a18005180 0x7f9a1800b980 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f9a24001e50 tx=0x7f9a180057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.862+0000 7f9a33078640 1 -- 172.21.15.22:0/741417448 shutdown_connections 2023-11-24T06:17:17.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.862+0000 7f9a33078640 1 --2- 172.21.15.22:0/741417448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a18005180 0x7f9a1800b980 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.862+0000 7f9a33078640 1 -- 172.21.15.22:0/741417448 >> 172.21.15.22:0/741417448 conn(0x7f9a2c0d3020 msgr2=0x7f9a2c0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.863+0000 7f9a33078640 1 -- 172.21.15.22:0/741417448 shutdown_connections 2023-11-24T06:17:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.863+0000 7f9a33078640 1 -- 172.21.15.22:0/741417448 wait complete. 2023-11-24T06:17:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.864+0000 7f9a33078640 1 Processor -- start 2023-11-24T06:17:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.865+0000 7f9a33078640 1 -- start start 2023-11-24T06:17:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.865+0000 7f9a33078640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18005180 0x7f9a2c0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a33078640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a2c0cc490 0x7f9a2c148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a33078640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a2c0ca480 0x7f9a2c148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a33078640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c160a60 con 0x7f9a2c0cc490 2023-11-24T06:17:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a33078640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0cc940 con 0x7f9a18005180 2023-11-24T06:17:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a33078640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0ccc20 con 0x7f9a2c0ca480 2023-11-24T06:17:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a31875640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a2c0cc490 0x7f9a2c148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a31875640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a2c0cc490 0x7f9a2c148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58182/0 (socket says 172.21.15.22:58182) 2023-11-24T06:17:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a31875640 1 -- 172.21.15.22:0/211709219 learned_addr learned my addr 172.21.15.22:0/211709219 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a32076640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18005180 0x7f9a2c0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a31875640 1 -- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a2c0ca480 msgr2=0x7f9a2c148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a32877640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a2c0ca480 0x7f9a2c148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a31875640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a2c0ca480 0x7f9a2c148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a31875640 1 -- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18005180 msgr2=0x7f9a2c0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a31875640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18005180 0x7f9a2c0cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a31875640 1 -- 172.21.15.22:0/211709219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0ccf00 con 0x7f9a2c0cc490 2023-11-24T06:17:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.866+0000 7f9a32076640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18005180 0x7f9a2c0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.867+0000 7f9a31875640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a2c0cc490 0x7f9a2c148430 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00e780 tx=0x7f9a1c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.867+0000 7f9a22ffd640 1 -- 172.21.15.22:0/211709219 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00ee30 con 0x7f9a2c0cc490 2023-11-24T06:17:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.867+0000 7f9a22ffd640 1 -- 172.21.15.22:0/211709219 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c00c870 con 0x7f9a2c0cc490 2023-11-24T06:17:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.867+0000 7f9a22ffd640 1 -- 172.21.15.22:0/211709219 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00cc20 con 0x7f9a2c0cc490 2023-11-24T06:17:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.867+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c0cd1e0 con 0x7f9a2c0cc490 2023-11-24T06:17:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.867+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c0c73c0 con 0x7f9a2c0cc490 2023-11-24T06:17:17.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.868+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a2c0b2eb0 con 0x7f9a2c0cc490 2023-11-24T06:17:17.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.869+0000 7f9a22ffd640 1 -- 172.21.15.22:0/211709219 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9a1c01d460 con 0x7f9a2c0cc490 2023-11-24T06:17:17.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.870+0000 7f9a22ffd640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a1006aff0 0x7f9a1006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.870+0000 7f9a22ffd640 1 -- 172.21.15.22:0/211709219 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9a1c089720 con 0x7f9a2c0cc490 2023-11-24T06:17:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.871+0000 7f9a22ffd640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f9a10070e50 0x7f9a10073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.871+0000 7f9a32076640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a1006aff0 0x7f9a1006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.871+0000 7f9a22ffd640 1 -- 172.21.15.22:0/211709219 --> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a10073920 con 0x7f9a10070e50 2023-11-24T06:17:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.871+0000 7f9a22ffd640 1 -- 172.21.15.22:0/211709219 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a1c08bd00 con 0x7f9a2c0cc490 2023-11-24T06:17:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.871+0000 7f9a32076640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a1006aff0 0x7f9a1006d4b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009980 tx=0x7f9a28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.872+0000 7f9a32877640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f9a10070e50 0x7f9a10073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.873+0000 7f9a32877640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f9a10070e50 0x7f9a10073270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.875+0000 7f9a22ffd640 1 -- 172.21.15.22:0/211709219 <== osd.4 v2:172.21.15.31:6802/2142081467 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9a10073920 con 0x7f9a10070e50 2023-11-24T06:17:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.889+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 --> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9a2c0b2bd0 con 0x7f9a10070e50 2023-11-24T06:17:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a22ffd640 1 -- 172.21.15.22:0/211709219 <== osd.4 v2:172.21.15.31:6802/2142081467 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9a24003af0 con 0x7f9a10070e50 2023-11-24T06:17:17.893 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:17:17.893 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:17:17.894 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:17:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f9a10070e50 msgr2=0x7f9a10073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a33078640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.31:6802/2142081467,v1:172.21.15.31:6804/2142081467] conn(0x7f9a10070e50 0x7f9a10073270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a1006aff0 msgr2=0x7f9a1006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a33078640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f9a1006aff0 0x7f9a1006d4b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009980 tx=0x7f9a28008040 comp rx=0 tx=0).stop 2023-11-24T06:17:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a2c0cc490 msgr2=0x7f9a2c148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a33078640 1 --2- 172.21.15.22:0/211709219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a2c0cc490 0x7f9a2c148430 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00e780 tx=0x7f9a1c00ec40 comp rx=0 tx=0).stop 2023-11-24T06:17:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a32877640 1 -- 172.21.15.22:0/211709219 reap_dead start 2023-11-24T06:17:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 shutdown_connections 2023-11-24T06:17:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.891+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 >> 172.21.15.22:0/211709219 conn(0x7f9a2c0d3020 msgr2=0x7f9a2c0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.892+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 shutdown_connections 2023-11-24T06:17:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:17.892+0000 7f9a33078640 1 -- 172.21.15.22:0/211709219 wait complete. 2023-11-24T06:17:17.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-24T06:17:18.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.142+0000 7fcf87fff640 1 Processor -- start 2023-11-24T06:17:18.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.143+0000 7fcf87fff640 1 -- start start 2023-11-24T06:17:18.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.144+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf8815ed20 0x7fcf88141e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.145+0000 7fcf87fff640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8806cae0 con 0x7fcf8815f100 2023-11-24T06:17:18.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.145+0000 7fcf87fff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf88071e40 con 0x7fcf88071820 2023-11-24T06:17:18.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.145+0000 7fcf87fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8806c1b0 con 0x7fcf8815ed20 2023-11-24T06:17:18.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.145+0000 7fcf867fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcf8815f100 0x7fcf88071110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51454/0 (socket says 172.21.15.22:51454) 2023-11-24T06:17:18.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.145+0000 7fcf867fc640 1 -- 172.21.15.22:0/4114608656 learned_addr learned my addr 172.21.15.22:0/4114608656 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:18.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.145+0000 7fcf86ffd640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf8815ed20 0x7fcf88141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011987060 0 0) 0x7fcf8806cae0 con 0x7fcf8815f100 2023-11-24T06:17:18.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf70003520 con 0x7fcf8815f100 2023-11-24T06:17:18.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 458857177 0 0) 0x7fcf70003520 con 0x7fcf8815f100 2023-11-24T06:17:18.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf8815ed20 msgr2=0x7fcf88141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf8815ed20 0x7fcf88141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 >> v1:172.21.15.31:6789/0 conn(0x7fcf88071820 legacy=0x7fcf8806cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8806c490 con 0x7fcf8815f100 2023-11-24T06:17:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7fcf7c001670 con 0x7fcf8815f100 2023-11-24T06:17:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 >> v1:172.21.15.22:6789/0 conn(0x7fcf8815f100 legacy=0x7fcf88071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf70003a10 0x7fcf70003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf8815ed20 0x7fcf700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf70004d00 0x7fcf70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8806c1b0 con 0x7fcf70003a10 2023-11-24T06:17:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7000bb10 con 0x7fcf70004d00 2023-11-24T06:17:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7000bca0 con 0x7fcf8815ed20 2023-11-24T06:17:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.146+0000 7fcf86ffd640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf70003a10 0x7fcf70003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.147+0000 7fcf867fc640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf8815ed20 0x7fcf700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.147+0000 7fcf86ffd640 1 -- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf8815ed20 msgr2=0x7fcf700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.147+0000 7fcf86ffd640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf8815ed20 0x7fcf700047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.147+0000 7fcf86ffd640 1 -- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf70004d00 msgr2=0x7fcf70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.147+0000 7fcf86ffd640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf70004d00 0x7fcf70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.147+0000 7fcf86ffd640 1 -- 172.21.15.22:0/4114608656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf70003520 con 0x7fcf70003a10 2023-11-24T06:17:18.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.148+0000 7fcf86ffd640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf70003a10 0x7fcf70003e30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009fc0 tx=0x7fcf700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c879ce1a47b03fa4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.148+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7802cbd0 con 0x7fcf70003a10 2023-11-24T06:17:18.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.148+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7800f040 con 0x7fcf70003a10 2023-11-24T06:17:18.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.148+0000 7fcf85ffb640 1 -- 172.21.15.22:0/4114608656 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78034440 con 0x7fcf70003a10 2023-11-24T06:17:18.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.149+0000 7fcf87fff640 1 -- 172.21.15.22:0/4114608656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf70003a10 msgr2=0x7fcf70003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.149+0000 7fcf87fff640 1 --2- 172.21.15.22:0/4114608656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf70003a10 0x7fcf70003e30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009fc0 tx=0x7fcf700057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.149+0000 7fcf877fe640 1 -- 172.21.15.22:0/4114608656 reap_dead start 2023-11-24T06:17:18.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.149+0000 7fcf87fff640 1 -- 172.21.15.22:0/4114608656 shutdown_connections 2023-11-24T06:17:18.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.149+0000 7fcf87fff640 1 -- 172.21.15.22:0/4114608656 >> 172.21.15.22:0/4114608656 conn(0x7fcf880b0840 msgr2=0x7fcf880b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:18.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.149+0000 7fcf87fff640 1 -- 172.21.15.22:0/4114608656 shutdown_connections 2023-11-24T06:17:18.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.149+0000 7fcf87fff640 1 -- 172.21.15.22:0/4114608656 wait complete. 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.151+0000 7fcf87fff640 1 Processor -- start 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.151+0000 7fcf87fff640 1 -- start start 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.152+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf70003a10 0x7fcf881519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.152+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf88159cb0 0x7fcf8815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.152+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf88143020 0x7fcf881434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.152+0000 7fcf87fff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf881eef70 con 0x7fcf88159cb0 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.152+0000 7fcf87fff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8815a670 con 0x7fcf70003a10 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.152+0000 7fcf87fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf881439e0 con 0x7fcf88143020 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.152+0000 7fcf867fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf88159cb0 0x7fcf8815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.152+0000 7fcf867fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf88159cb0 0x7fcf8815a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58198/0 (socket says 172.21.15.22:58198) 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.152+0000 7fcf867fc640 1 -- 172.21.15.22:0/2530831084 learned_addr learned my addr 172.21.15.22:0/2530831084 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf877fe640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf88143020 0x7fcf881434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf867fc640 1 -- 172.21.15.22:0/2530831084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf88143020 msgr2=0x7fcf881434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf867fc640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf88143020 0x7fcf881434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf867fc640 1 -- 172.21.15.22:0/2530831084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf70003a10 msgr2=0x7fcf881519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf867fc640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf70003a10 0x7fcf881519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf867fc640 1 -- 172.21.15.22:0/2530831084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88143c70 con 0x7fcf88159cb0 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf867fc640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf88159cb0 0x7fcf8815a130 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00d7a0 tx=0x7fcf7c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf6f7fe640 1 -- 172.21.15.22:0/2530831084 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0074e0 con 0x7fcf88159cb0 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf6f7fe640 1 -- 172.21.15.22:0/2530831084 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c007640 con 0x7fcf88159cb0 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf6f7fe640 1 -- 172.21.15.22:0/2530831084 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c004a00 con 0x7fcf88159cb0 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.153+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf88143f50 con 0x7fcf88159cb0 2023-11-24T06:17:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.154+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf88144510 con 0x7fcf88159cb0 2023-11-24T06:17:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.155+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf881ef0e0 con 0x7fcf88159cb0 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.156+0000 7fcf6f7fe640 1 -- 172.21.15.22:0/2530831084 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fcf7c004b60 con 0x7fcf88159cb0 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.157+0000 7fcf6f7fe640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf7406b020 0x7fcf7406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.157+0000 7fcf6f7fe640 1 -- 172.21.15.22:0/2530831084 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcf7c089110 con 0x7fcf88159cb0 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.157+0000 7fcf86ffd640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf7406b020 0x7fcf7406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.158+0000 7fcf86ffd640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf7406b020 0x7fcf7406d4e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcf78036000 tx=0x7fcf7802e070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.162+0000 7fcf6f7fe640 1 -- 172.21.15.22:0/2530831084 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcf881ef0e0 con 0x7fcf88159cb0 2023-11-24T06:17:18.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.356+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf8815f560 con 0x7fcf7406b020 2023-11-24T06:17:18.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.357+0000 7fcf6f7fe640 1 -- 172.21.15.22:0/2530831084 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcf7802caf0 con 0x7fcf7406b020 2023-11-24T06:17:18.360 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 4 to deep-scrub 2023-11-24T06:17:18.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf7406b020 msgr2=0x7fcf7406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf7406b020 0x7fcf7406d4e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcf78036000 tx=0x7fcf7802e070 comp rx=0 tx=0).stop 2023-11-24T06:17:18.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf88159cb0 msgr2=0x7fcf8815a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf88159cb0 0x7fcf8815a130 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00d7a0 tx=0x7fcf7c00dc60 comp rx=0 tx=0).stop 2023-11-24T06:17:18.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 shutdown_connections 2023-11-24T06:17:18.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fcf7406b020 0x7fcf7406d4e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf88143020 0x7fcf881434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf88159cb0 0x7fcf8815a130 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 --2- 172.21.15.22:0/2530831084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf70003a10 0x7fcf881519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 >> 172.21.15.22:0/2530831084 conn(0x7fcf880b0840 msgr2=0x7fcf880b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:18.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 shutdown_connections 2023-11-24T06:17:18.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.360+0000 7fcf87fff640 1 -- 172.21.15.22:0/2530831084 wait complete. 2023-11-24T06:17:18.382 INFO:tasks.ceph:Scrubbing osd.5 2023-11-24T06:17:18.382 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:17:18.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.598+0000 7f6525da0640 1 Processor -- start 2023-11-24T06:17:18.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.598+0000 7f6525da0640 1 -- start start 2023-11-24T06:17:18.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.600+0000 7f6525da0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6520144770 0x7f652015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.600+0000 7f6525da0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f652015f0a0 0x7f65200ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.600+0000 7f6525da0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652015f930 con 0x7f65200b35a0 2023-11-24T06:17:18.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.600+0000 7f6525da0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65200b43b0 con 0x7f6520144770 2023-11-24T06:17:18.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.600+0000 7f6525da0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652015f530 con 0x7f652015f0a0 2023-11-24T06:17:18.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.600+0000 7f6524d9e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6520144770 0x7f652015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.600+0000 7f651ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f65200b35a0 0x7f652006c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51470/0 (socket says 172.21.15.22:51470) 2023-11-24T06:17:18.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.600+0000 7f651ffff640 1 -- 172.21.15.22:0/8800479 learned_addr learned my addr 172.21.15.22:0/8800479 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.600+0000 7f652559f640 1 --2- 172.21.15.22:0/8800479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f652015f0a0 0x7f65200ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.601+0000 7f6524d9e640 1 -- 172.21.15.22:0/8800479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f652015f0a0 msgr2=0x7f65200ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.601+0000 7f6524d9e640 1 --2- 172.21.15.22:0/8800479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f652015f0a0 0x7f65200ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.601+0000 7f6524d9e640 1 -- 172.21.15.22:0/8800479 >> v1:172.21.15.22:6789/0 conn(0x7f65200b35a0 legacy=0x7f652006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.601+0000 7f6524d9e640 1 -- 172.21.15.22:0/8800479 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65200ce9f0 con 0x7f6520144770 2023-11-24T06:17:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.601+0000 7f652559f640 1 --2- 172.21.15.22:0/8800479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f652015f0a0 0x7f65200ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.601+0000 7f651f7fe640 1 -- 172.21.15.22:0/8800479 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766320338 0 0) 0x7f652015f930 con 0x7f65200b35a0 2023-11-24T06:17:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.602+0000 7f6524d9e640 1 --2- 172.21.15.22:0/8800479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6520144770 0x7f652015eb60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f65140097a0 tx=0x7f651402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8368799672a2d24 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.602+0000 7f651f7fe640 1 -- 172.21.15.22:0/8800479 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651402d040 con 0x7f6520144770 2023-11-24T06:17:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.602+0000 7f651f7fe640 1 -- 172.21.15.22:0/8800479 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6514031810 con 0x7f6520144770 2023-11-24T06:17:18.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.602+0000 7f651f7fe640 1 -- 172.21.15.22:0/8800479 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514031ba0 con 0x7f6520144770 2023-11-24T06:17:18.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.603+0000 7f6525da0640 1 -- 172.21.15.22:0/8800479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6520144770 msgr2=0x7f652015eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.603+0000 7f6525da0640 1 --2- 172.21.15.22:0/8800479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6520144770 0x7f652015eb60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f65140097a0 tx=0x7f651402b8b0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.603+0000 7f6525da0640 1 -- 172.21.15.22:0/8800479 shutdown_connections 2023-11-24T06:17:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.603+0000 7f6525da0640 1 --2- 172.21.15.22:0/8800479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f652015f0a0 0x7f65200ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.603+0000 7f6525da0640 1 --2- 172.21.15.22:0/8800479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6520144770 0x7f652015eb60 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.603+0000 7f6525da0640 1 -- 172.21.15.22:0/8800479 >> 172.21.15.22:0/8800479 conn(0x7f65200cec10 msgr2=0x7f65200cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.603+0000 7f6525da0640 1 -- 172.21.15.22:0/8800479 shutdown_connections 2023-11-24T06:17:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.603+0000 7f6525da0640 1 -- 172.21.15.22:0/8800479 wait complete. 2023-11-24T06:17:18.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.605+0000 7f6525da0640 1 Processor -- start 2023-11-24T06:17:18.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.605+0000 7f6525da0640 1 -- start start 2023-11-24T06:17:18.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.606+0000 7f6525da0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65200b35a0 0x7f652013a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.606+0000 7f6525da0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6520144770 0x7f652014e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.606+0000 7f6525da0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f652015f0a0 0x7f652014eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.606+0000 7f6525da0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652014ff80 con 0x7f65200b35a0 2023-11-24T06:17:18.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.606+0000 7f6525da0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65201503a0 con 0x7f6520144770 2023-11-24T06:17:18.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.606+0000 7f6525da0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652013a950 con 0x7f652015f0a0 2023-11-24T06:17:18.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.606+0000 7f6524d9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65200b35a0 0x7f652013a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.606+0000 7f6524d9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65200b35a0 0x7f652013a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58218/0 (socket says 172.21.15.22:58218) 2023-11-24T06:17:18.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.606+0000 7f6524d9e640 1 -- 172.21.15.22:0/3906700837 learned_addr learned my addr 172.21.15.22:0/3906700837 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:18.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f6524d9e640 1 -- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f652015f0a0 msgr2=0x7f652014eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f651ffff640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6520144770 0x7f652014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f6524d9e640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f652015f0a0 0x7f652014eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f6524d9e640 1 -- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6520144770 msgr2=0x7f652014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f6524d9e640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6520144770 0x7f652014e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f6524d9e640 1 -- 172.21.15.22:0/3906700837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6514009400 con 0x7f65200b35a0 2023-11-24T06:17:18.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f6524d9e640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65200b35a0 0x7f652013a410 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f651402bec0 tx=0x7f65140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f651d7fa640 1 -- 172.21.15.22:0/3906700837 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651403ad60 con 0x7f65200b35a0 2023-11-24T06:17:18.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f651d7fa640 1 -- 172.21.15.22:0/3906700837 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65140423f0 con 0x7f65200b35a0 2023-11-24T06:17:18.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f651d7fa640 1 -- 172.21.15.22:0/3906700837 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65140427a0 con 0x7f65200b35a0 2023-11-24T06:17:18.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.607+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652014f300 con 0x7f65200b35a0 2023-11-24T06:17:18.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.608+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652014f8c0 con 0x7f65200b35a0 2023-11-24T06:17:18.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.608+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6520144b50 con 0x7f65200b35a0 2023-11-24T06:17:18.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.610+0000 7f651d7fa640 1 -- 172.21.15.22:0/3906700837 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6514042900 con 0x7f65200b35a0 2023-11-24T06:17:18.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.611+0000 7f651d7fa640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f650406b020 0x7f650406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.611+0000 7f651d7fa640 1 -- 172.21.15.22:0/3906700837 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f65140ab8d0 con 0x7f65200b35a0 2023-11-24T06:17:18.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.611+0000 7f651d7fa640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f6504070e80 0x7f65040732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.611+0000 7f651ffff640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f650406b020 0x7f650406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.611+0000 7f651d7fa640 1 -- 172.21.15.22:0/3906700837 --> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6504073950 con 0x7f6504070e80 2023-11-24T06:17:18.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.611+0000 7f651d7fa640 1 -- 172.21.15.22:0/3906700837 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65140b02a0 con 0x7f65200b35a0 2023-11-24T06:17:18.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.612+0000 7f651ffff640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f650406b020 0x7f650406d4e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f650c007fd0 tx=0x7f650c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.612+0000 7f652559f640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f6504070e80 0x7f65040732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.613+0000 7f652559f640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f6504070e80 0x7f65040732a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.615+0000 7f651d7fa640 1 -- 172.21.15.22:0/3906700837 <== osd.5 v2:172.21.15.31:6816/2704270440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6504073950 con 0x7f6504070e80 2023-11-24T06:17:18.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.629+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 --> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f65200b40d0 con 0x7f6504070e80 2023-11-24T06:17:18.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.630+0000 7f651d7fa640 1 -- 172.21.15.22:0/3906700837 <== osd.5 v2:172.21.15.31:6816/2704270440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6518008950 con 0x7f6504070e80 2023-11-24T06:17:18.633 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:17:18.633 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:17:18.633 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:17:18.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.631+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f6504070e80 msgr2=0x7f65040732a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.631+0000 7f6525da0640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.31:6816/2704270440,v1:172.21.15.31:6817/2704270440] conn(0x7f6504070e80 0x7f65040732a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.631+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f650406b020 msgr2=0x7f650406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.631+0000 7f6525da0640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f650406b020 0x7f650406d4e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f650c007fd0 tx=0x7f650c009040 comp rx=0 tx=0).stop 2023-11-24T06:17:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.631+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65200b35a0 msgr2=0x7f652013a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.631+0000 7f6525da0640 1 --2- 172.21.15.22:0/3906700837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65200b35a0 0x7f652013a410 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f651402bec0 tx=0x7f65140046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.631+0000 7f652559f640 1 -- 172.21.15.22:0/3906700837 reap_dead start 2023-11-24T06:17:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.631+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 shutdown_connections 2023-11-24T06:17:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.631+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 >> 172.21.15.22:0/3906700837 conn(0x7f65200cec10 msgr2=0x7f65200af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.632+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 shutdown_connections 2023-11-24T06:17:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.632+0000 7f6525da0640 1 -- 172.21.15.22:0/3906700837 wait complete. 2023-11-24T06:17:18.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-24T06:17:18.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.881+0000 7f850223d640 1 Processor -- start 2023-11-24T06:17:18.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.881+0000 7f850223d640 1 -- start start 2023-11-24T06:17:18.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.883+0000 7f850223d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f84fc146d60 0x7f84fc06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.883+0000 7f850223d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc0b44a0 0x7f84fc0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.883+0000 7f850223d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc147140 con 0x7f84fc161c10 2023-11-24T06:17:18.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.883+0000 7f850223d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0b4e70 con 0x7f84fc146d60 2023-11-24T06:17:18.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.883+0000 7f850223d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc06c210 con 0x7f84fc0b44a0 2023-11-24T06:17:18.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.883+0000 7f84faffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f84fc161c10 0x7f84fc0d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51472/0 (socket says 172.21.15.22:51472) 2023-11-24T06:17:18.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.883+0000 7f84faffd640 1 -- 172.21.15.22:0/2986470011 learned_addr learned my addr 172.21.15.22:0/2986470011 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:18.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.883+0000 7f84fbfff640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc0b44a0 0x7f84fc0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.883+0000 7f84fb7fe640 1 --2- 172.21.15.22:0/2986470011 >> v2:172.21.15.31:3300/0 conn(0x7f84fc146d60 0x7f84fc06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970378275 0 0) 0x7f84fc147140 con 0x7f84fc161c10 2023-11-24T06:17:18.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e8003520 con 0x7f84fc161c10 2023-11-24T06:17:18.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2049431094 0 0) 0x7f84e8003520 con 0x7f84fc161c10 2023-11-24T06:17:18.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc0b44a0 msgr2=0x7f84fc0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc0b44a0 0x7f84fc0b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 >> v2:172.21.15.31:3300/0 conn(0x7f84fc146d60 msgr2=0x7f84fc06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 --2- 172.21.15.22:0/2986470011 >> v2:172.21.15.31:3300/0 conn(0x7f84fc146d60 0x7f84fc06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0d19c0 con 0x7f84fc161c10 2023-11-24T06:17:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f84e4001670 con 0x7f84fc161c10 2023-11-24T06:17:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 >> v1:172.21.15.22:6789/0 conn(0x7f84fc161c10 legacy=0x7f84fc0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc0b44a0 0x7f84e8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84e8003ef0 0x7f84e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc0b4e70 con 0x7f84e8004d00 2023-11-24T06:17:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc06c210 con 0x7f84e8003ef0 2023-11-24T06:17:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.884+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e800b980 con 0x7f84fc0b44a0 2023-11-24T06:17:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.885+0000 7f84fbfff640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.885+0000 7f84fb7fe640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc0b44a0 0x7f84e8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.885+0000 7f84fbfff640 1 -- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc0b44a0 msgr2=0x7f84e8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.885+0000 7f84fbfff640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc0b44a0 0x7f84e8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.885+0000 7f84fbfff640 1 -- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84e8003ef0 msgr2=0x7f84e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.885+0000 7f84fbfff640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84e8003ef0 0x7f84e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.885+0000 7f84fbfff640 1 -- 172.21.15.22:0/2986470011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e8003520 con 0x7f84e8004d00 2023-11-24T06:17:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.886+0000 7f84fbfff640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84e8005180 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009ac0 tx=0x7f84e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7743c63f280b8f70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.887+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f402c6b0 con 0x7f84e8004d00 2023-11-24T06:17:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.887+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f402c810 con 0x7f84e8004d00 2023-11-24T06:17:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.887+0000 7f84fa7fc640 1 -- 172.21.15.22:0/2986470011 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f402cba0 con 0x7f84e8004d00 2023-11-24T06:17:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.887+0000 7f850223d640 1 -- 172.21.15.22:0/2986470011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 msgr2=0x7f84e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.887+0000 7f850223d640 1 --2- 172.21.15.22:0/2986470011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84e8005180 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009ac0 tx=0x7f84e80057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.887+0000 7f84fbfff640 1 -- 172.21.15.22:0/2986470011 reap_dead start 2023-11-24T06:17:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.887+0000 7f850223d640 1 -- 172.21.15.22:0/2986470011 shutdown_connections 2023-11-24T06:17:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.887+0000 7f850223d640 1 -- 172.21.15.22:0/2986470011 >> 172.21.15.22:0/2986470011 conn(0x7f84fc0b2e00 msgr2=0x7f84fc0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.888+0000 7f850223d640 1 -- 172.21.15.22:0/2986470011 shutdown_connections 2023-11-24T06:17:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.888+0000 7f850223d640 1 -- 172.21.15.22:0/2986470011 wait complete. 2023-11-24T06:17:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.889+0000 7f850223d640 1 Processor -- start 2023-11-24T06:17:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.889+0000 7f850223d640 1 -- start start 2023-11-24T06:17:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.890+0000 7f850223d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84fc13c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.890+0000 7f850223d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84fc14c790 0x7f84fc1f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.890+0000 7f850223d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc1f23f0 0x7f84fc1f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.890+0000 7f850223d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc13e7b0 con 0x7f84e8004d00 2023-11-24T06:17:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.890+0000 7f850223d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc142bc0 con 0x7f84fc14c790 2023-11-24T06:17:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.890+0000 7f850223d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc142ea0 con 0x7f84fc1f23f0 2023-11-24T06:17:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.891+0000 7f84fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84fc13c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.891+0000 7f84fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84fc13c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58232/0 (socket says 172.21.15.22:58232) 2023-11-24T06:17:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.891+0000 7f84fb7fe640 1 -- 172.21.15.22:0/1236522980 learned_addr learned my addr 172.21.15.22:0/1236522980 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.891+0000 7f84fb7fe640 1 -- 172.21.15.22:0/1236522980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc1f23f0 msgr2=0x7f84fc1f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.891+0000 7f84fb7fe640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc1f23f0 0x7f84fc1f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.891+0000 7f84fb7fe640 1 -- 172.21.15.22:0/1236522980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84fc14c790 msgr2=0x7f84fc1f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.891+0000 7f84fb7fe640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84fc14c790 0x7f84fc1f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.891+0000 7f84fb7fe640 1 -- 172.21.15.22:0/1236522980 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc13e3d0 con 0x7f84e8004d00 2023-11-24T06:17:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.891+0000 7f84fb7fe640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84fc13c700 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f84ec007f30 tx=0x7f84ec011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.892+0000 7f84f3fff640 1 -- 172.21.15.22:0/1236522980 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec00e030 con 0x7f84e8004d00 2023-11-24T06:17:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.892+0000 7f84f3fff640 1 -- 172.21.15.22:0/1236522980 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec016470 con 0x7f84e8004d00 2023-11-24T06:17:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.892+0000 7f84f3fff640 1 -- 172.21.15.22:0/1236522980 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec016820 con 0x7f84e8004d00 2023-11-24T06:17:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.892+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc13dff0 con 0x7f84e8004d00 2023-11-24T06:17:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.892+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc0ced90 con 0x7f84e8004d00 2023-11-24T06:17:18.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.893+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc13ea20 con 0x7f84e8004d00 2023-11-24T06:17:18.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.894+0000 7f84f3fff640 1 -- 172.21.15.22:0/1236522980 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f84ec016980 con 0x7f84e8004d00 2023-11-24T06:17:18.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.895+0000 7f84f3fff640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f84dc06aff0 0x7f84dc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.895+0000 7f84f3fff640 1 -- 172.21.15.22:0/1236522980 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f84ec00f070 con 0x7f84e8004d00 2023-11-24T06:17:18.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.895+0000 7f84faffd640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f84dc06aff0 0x7f84dc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.896+0000 7f84faffd640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f84dc06aff0 0x7f84dc06d4b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f84e4000f60 tx=0x7f84e40015c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:18.899+0000 7f84f3fff640 1 -- 172.21.15.22:0/1236522980 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f84ec055720 con 0x7f84e8004d00 2023-11-24T06:17:19.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.093+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f84fc06cbe0 con 0x7f84dc06aff0 2023-11-24T06:17:19.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.094+0000 7f84f3fff640 1 -- 172.21.15.22:0/1236522980 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f84e4007050 con 0x7f84dc06aff0 2023-11-24T06:17:19.097 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 5 to deep-scrub 2023-11-24T06:17:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f84dc06aff0 msgr2=0x7f84dc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f84dc06aff0 0x7f84dc06d4b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f84e4000f60 tx=0x7f84e40015c0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 msgr2=0x7f84fc13c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84fc13c700 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f84ec007f30 tx=0x7f84ec011660 comp rx=0 tx=0).stop 2023-11-24T06:17:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 shutdown_connections 2023-11-24T06:17:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f84dc06aff0 0x7f84dc06d4b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84fc1f23f0 0x7f84fc1f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84fc14c790 0x7f84fc1f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 --2- 172.21.15.22:0/1236522980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84e8004d00 0x7f84fc13c700 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 >> 172.21.15.22:0/1236522980 conn(0x7f84fc0b2e00 msgr2=0x7f84fc0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 shutdown_connections 2023-11-24T06:17:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.097+0000 7f850223d640 1 -- 172.21.15.22:0/1236522980 wait complete. 2023-11-24T06:17:19.119 INFO:tasks.ceph:Scrubbing osd.6 2023-11-24T06:17:19.119 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:17:19.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.336+0000 7fd5cb59e640 1 Processor -- start 2023-11-24T06:17:19.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.336+0000 7fd5cb59e640 1 -- start start 2023-11-24T06:17:19.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.338+0000 7fd5cb59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 0x7fd5cc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.338+0000 7fd5cb59e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5cc143ac0 0x7fd5cc0b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.338+0000 7fd5cb59e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5cc0cf920 con 0x7fd5cc15e130 2023-11-24T06:17:19.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.338+0000 7fd5cb59e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc0cfc00 con 0x7fd5cc143ac0 2023-11-24T06:17:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.338+0000 7fd5cb59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc06d780 con 0x7fd5cc15dd50 2023-11-24T06:17:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.338+0000 7fd5cad9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5cc143ac0 0x7fd5cc0b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.338+0000 7fd5cad9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5cc143ac0 0x7fd5cc0b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58236/0 (socket says 172.21.15.22:58236) 2023-11-24T06:17:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.338+0000 7fd5cad9d640 1 -- 172.21.15.22:0/2861809516 learned_addr learned my addr 172.21.15.22:0/2861809516 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.338+0000 7fd5ca59c640 1 --2- 172.21.15.22:0/2861809516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 0x7fd5cc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.339+0000 7fd5cad9d640 1 -- 172.21.15.22:0/2861809516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 msgr2=0x7fd5cc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.339+0000 7fd5cad9d640 1 --2- 172.21.15.22:0/2861809516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 0x7fd5cc0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.339+0000 7fd5cad9d640 1 -- 172.21.15.22:0/2861809516 >> v1:172.21.15.22:6789/0 conn(0x7fd5cc15e130 legacy=0x7fd5cc1433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.339+0000 7fd5cad9d640 1 -- 172.21.15.22:0/2861809516 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc06da60 con 0x7fd5cc143ac0 2023-11-24T06:17:19.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.340+0000 7fd5cad9d640 1 --2- 172.21.15.22:0/2861809516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 0x7fd5cc0b2fe0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009870 tx=0x7fd5c402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b765457bd5e29bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.340+0000 7fd5c959a640 1 -- 172.21.15.22:0/2861809516 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4030840 con 0x7fd5cc143ac0 2023-11-24T06:17:19.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.340+0000 7fd5c959a640 1 -- 172.21.15.22:0/2861809516 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c40309a0 con 0x7fd5cc143ac0 2023-11-24T06:17:19.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.340+0000 7fd5c959a640 1 -- 172.21.15.22:0/2861809516 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4030d30 con 0x7fd5cc143ac0 2023-11-24T06:17:19.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.341+0000 7fd5cb59e640 1 -- 172.21.15.22:0/2861809516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 msgr2=0x7fd5cc0b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.341+0000 7fd5cb59e640 1 --2- 172.21.15.22:0/2861809516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 0x7fd5cc0b2fe0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009870 tx=0x7fd5c402b980 comp rx=0 tx=0).stop 2023-11-24T06:17:19.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.341+0000 7fd5cb59e640 1 -- 172.21.15.22:0/2861809516 shutdown_connections 2023-11-24T06:17:19.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.341+0000 7fd5cb59e640 1 --2- 172.21.15.22:0/2861809516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 0x7fd5cc0b2fe0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.341+0000 7fd5cb59e640 1 --2- 172.21.15.22:0/2861809516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 0x7fd5cc0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.341+0000 7fd5cb59e640 1 -- 172.21.15.22:0/2861809516 >> 172.21.15.22:0/2861809516 conn(0x7fd5cc06bbb0 msgr2=0x7fd5cc0b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:19.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.341+0000 7fd5cb59e640 1 -- 172.21.15.22:0/2861809516 shutdown_connections 2023-11-24T06:17:19.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.341+0000 7fd5cb59e640 1 -- 172.21.15.22:0/2861809516 wait complete. 2023-11-24T06:17:19.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.343+0000 7fd5cb59e640 1 Processor -- start 2023-11-24T06:17:19.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.343+0000 7fd5cb59e640 1 -- start start 2023-11-24T06:17:19.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.344+0000 7fd5cb59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 0x7fd5cc13aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.344+0000 7fd5cb59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 0x7fd5cc130f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.344+0000 7fd5cb59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5cc15e130 0x7fd5cc153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.344+0000 7fd5cb59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc1544a0 con 0x7fd5cc143ac0 2023-11-24T06:17:19.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.344+0000 7fd5cb59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc1595e0 con 0x7fd5cc15e130 2023-11-24T06:17:19.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.344+0000 7fd5cb59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc1598c0 con 0x7fd5cc15dd50 2023-11-24T06:17:19.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.344+0000 7fd5ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 0x7fd5cc13aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 0x7fd5cc13aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58246/0 (socket says 172.21.15.22:58246) 2023-11-24T06:17:19.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5ca59c640 1 -- 172.21.15.22:0/137250548 learned_addr learned my addr 172.21.15.22:0/137250548 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:19.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5cad9d640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5cc15e130 0x7fd5cc153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5c9d9b640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 0x7fd5cc130f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5ca59c640 1 -- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 msgr2=0x7fd5cc130f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5ca59c640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 0x7fd5cc130f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5ca59c640 1 -- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5cc15e130 msgr2=0x7fd5cc153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5ca59c640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5cc15e130 0x7fd5cc153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5ca59c640 1 -- 172.21.15.22:0/137250548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40094d0 con 0x7fd5cc143ac0 2023-11-24T06:17:19.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5c9d9b640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5cc15dd50 0x7fd5cc130f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:19.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.345+0000 7fd5ca59c640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 0x7fd5cc13aa80 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00d800 tx=0x7fd5bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.346+0000 7fd5c2ffd640 1 -- 172.21.15.22:0/137250548 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00b6c0 con 0x7fd5cc143ac0 2023-11-24T06:17:19.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.346+0000 7fd5c2ffd640 1 -- 172.21.15.22:0/137250548 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00b820 con 0x7fd5cc143ac0 2023-11-24T06:17:19.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.346+0000 7fd5c2ffd640 1 -- 172.21.15.22:0/137250548 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00bbb0 con 0x7fd5cc143ac0 2023-11-24T06:17:19.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.346+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc159ba0 con 0x7fd5cc143ac0 2023-11-24T06:17:19.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.346+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc15a160 con 0x7fd5cc143ac0 2023-11-24T06:17:19.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.347+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5cc04e840 con 0x7fd5cc143ac0 2023-11-24T06:17:19.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.348+0000 7fd5c2ffd640 1 -- 172.21.15.22:0/137250548 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd5bc00bd10 con 0x7fd5cc143ac0 2023-11-24T06:17:19.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.349+0000 7fd5c2ffd640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5ac06aff0 0x7fd5ac06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.349+0000 7fd5c2ffd640 1 -- 172.21.15.22:0/137250548 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd5bc089ca0 con 0x7fd5cc143ac0 2023-11-24T06:17:19.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.349+0000 7fd5c2ffd640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fd5ac070e50 0x7fd5ac073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.349+0000 7fd5c2ffd640 1 -- 172.21.15.22:0/137250548 --> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5ac073920 con 0x7fd5ac070e50 2023-11-24T06:17:19.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.349+0000 7fd5c2ffd640 1 -- 172.21.15.22:0/137250548 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5bc08e2a0 con 0x7fd5cc143ac0 2023-11-24T06:17:19.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.349+0000 7fd5c9d9b640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5ac06aff0 0x7fd5ac06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.350+0000 7fd5cad9d640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fd5ac070e50 0x7fd5ac073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.350+0000 7fd5c9d9b640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5ac06aff0 0x7fd5ac06d4b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc13f490 tx=0x7fd5b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.351+0000 7fd5cad9d640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fd5ac070e50 0x7fd5ac073270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.353+0000 7fd5c2ffd640 1 -- 172.21.15.22:0/137250548 <== osd.6 v2:172.21.15.31:6800/1824539617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd5ac073920 con 0x7fd5ac070e50 2023-11-24T06:17:19.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.368+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 --> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd5cc15a2f0 con 0x7fd5ac070e50 2023-11-24T06:17:19.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5c2ffd640 1 -- 172.21.15.22:0/137250548 <== osd.6 v2:172.21.15.31:6800/1824539617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd5cc15a2f0 con 0x7fd5ac070e50 2023-11-24T06:17:19.374 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:17:19.374 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:17:19.374 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:17:19.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fd5ac070e50 msgr2=0x7fd5ac073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5cb59e640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.31:6800/1824539617,v1:172.21.15.31:6801/1824539617] conn(0x7fd5ac070e50 0x7fd5ac073270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5ac06aff0 msgr2=0x7fd5ac06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5cb59e640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fd5ac06aff0 0x7fd5ac06d4b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc13f490 tx=0x7fd5b4009040 comp rx=0 tx=0).stop 2023-11-24T06:17:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 msgr2=0x7fd5cc13aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5cb59e640 1 --2- 172.21.15.22:0/137250548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5cc143ac0 0x7fd5cc13aa80 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00d800 tx=0x7fd5bc00dcc0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5cad9d640 1 -- 172.21.15.22:0/137250548 reap_dead start 2023-11-24T06:17:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 shutdown_connections 2023-11-24T06:17:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.369+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 >> 172.21.15.22:0/137250548 conn(0x7fd5cc06bbb0 msgr2=0x7fd5cc0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.370+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 shutdown_connections 2023-11-24T06:17:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.370+0000 7fd5cb59e640 1 -- 172.21.15.22:0/137250548 wait complete. 2023-11-24T06:17:19.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-24T06:17:19.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.621+0000 7f2e1dde2640 1 Processor -- start 2023-11-24T06:17:19.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.621+0000 7f2e1dde2640 1 -- start start 2023-11-24T06:17:19.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.623+0000 7f2e1dde2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e180d3810 0x7f2e180cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.623+0000 7f2e1dde2640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1815d810 con 0x7f2e1815d430 2023-11-24T06:17:19.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.623+0000 7f2e1dde2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e180d0130 con 0x7f2e180d1690 2023-11-24T06:17:19.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.623+0000 7f2e1dde2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e180d09d0 con 0x7f2e180d3810 2023-11-24T06:17:19.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.623+0000 7f2e1cde0640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2e1815d430 0x7f2e181615e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51488/0 (socket says 172.21.15.22:51488) 2023-11-24T06:17:19.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.623+0000 7f2e1cde0640 1 -- 172.21.15.22:0/173697667 learned_addr learned my addr 172.21.15.22:0/173697667 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:19.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.623+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109877537 0 0) 0x7f2e1815d810 con 0x7f2e1815d430 2023-11-24T06:17:19.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e00003520 con 0x7f2e1815d430 2023-11-24T06:17:19.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e17fff640 1 --2- 172.21.15.22:0/173697667 >> v2:172.21.15.31:3300/0 conn(0x7f2e180d3810 0x7f2e180cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 178724172 0 0) 0x7f2e00003520 con 0x7f2e1815d430 2023-11-24T06:17:19.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 >> v2:172.21.15.31:3300/0 conn(0x7f2e180d3810 msgr2=0x7f2e180cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:19.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 --2- 172.21.15.22:0/173697667 >> v2:172.21.15.31:3300/0 conn(0x7f2e180d3810 0x7f2e180cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 >> v1:172.21.15.31:6789/0 conn(0x7f2e180d1690 legacy=0x7f2e180cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180d0410 con 0x7f2e1815d430 2023-11-24T06:17:19.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 989374528 0 0) 0x7f2e080019f0 con 0x7f2e1815d430 2023-11-24T06:17:19.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 >> v1:172.21.15.22:6789/0 conn(0x7f2e1815d430 legacy=0x7f2e181615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e000039e0 0x7f2e00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e000047c0 0x7f2e00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e000051f0 0x7f2e0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180d09d0 con 0x7f2e000047c0 2023-11-24T06:17:19.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0000c150 con 0x7f2e000051f0 2023-11-24T06:17:19.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0000c310 con 0x7f2e000039e0 2023-11-24T06:17:19.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.624+0000 7f2e17fff640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e000047c0 0x7f2e00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.625+0000 7f2e1d5e1640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e000051f0 0x7f2e0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.625+0000 7f2e1cde0640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e000039e0 0x7f2e00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.625+0000 7f2e17fff640 1 -- 172.21.15.22:0/173697667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e000039e0 msgr2=0x7f2e00003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:19.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.625+0000 7f2e17fff640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e000039e0 0x7f2e00003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.625+0000 7f2e17fff640 1 -- 172.21.15.22:0/173697667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e000051f0 msgr2=0x7f2e0000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:19.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.625+0000 7f2e17fff640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e000051f0 0x7f2e0000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.625+0000 7f2e17fff640 1 -- 172.21.15.22:0/173697667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00003520 con 0x7f2e000047c0 2023-11-24T06:17:19.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.625+0000 7f2e1d5e1640 1 -- 172.21.15.22:0/173697667 reap_dead start 2023-11-24T06:17:19.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.625+0000 7f2e1cde0640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e000039e0 0x7f2e00003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:19.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.626+0000 7f2e17fff640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e000047c0 0x7f2e00004c40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00ba30 tx=0x7f2e000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13987098abd97d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.626+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c032660 con 0x7f2e000047c0 2023-11-24T06:17:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.627+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0327c0 con 0x7f2e000047c0 2023-11-24T06:17:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.627+0000 7f2e177fe640 1 -- 172.21.15.22:0/173697667 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c032b50 con 0x7f2e000047c0 2023-11-24T06:17:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.627+0000 7f2e1dde2640 1 -- 172.21.15.22:0/173697667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e000047c0 msgr2=0x7f2e00004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.627+0000 7f2e1dde2640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e000047c0 0x7f2e00004c40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00ba30 tx=0x7f2e000057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.627+0000 7f2e1dde2640 1 -- 172.21.15.22:0/173697667 shutdown_connections 2023-11-24T06:17:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.627+0000 7f2e1dde2640 1 --2- 172.21.15.22:0/173697667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e000047c0 0x7f2e00004c40 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.627+0000 7f2e1dde2640 1 -- 172.21.15.22:0/173697667 >> 172.21.15.22:0/173697667 conn(0x7f2e1808cb00 msgr2=0x7f2e1809c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.627+0000 7f2e1dde2640 1 -- 172.21.15.22:0/173697667 shutdown_connections 2023-11-24T06:17:19.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.627+0000 7f2e1dde2640 1 -- 172.21.15.22:0/173697667 wait complete. 2023-11-24T06:17:19.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.629+0000 7f2e1dde2640 1 Processor -- start 2023-11-24T06:17:19.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.629+0000 7f2e1dde2640 1 -- start start 2023-11-24T06:17:19.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e1dde2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e000047c0 0x7f2e18152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e1dde2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e181f41b0 0x7f2e180c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e1dde2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e181f4640 0x7f2e181f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e1dde2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180d3ca0 con 0x7f2e181f41b0 2023-11-24T06:17:19.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e1dde2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1815e820 con 0x7f2e000047c0 2023-11-24T06:17:19.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e1dde2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1815dba0 con 0x7f2e181f4640 2023-11-24T06:17:19.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e17fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e181f41b0 0x7f2e180c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e17fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e181f41b0 0x7f2e180c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58250/0 (socket says 172.21.15.22:58250) 2023-11-24T06:17:19.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e17fff640 1 -- 172.21.15.22:0/3282842642 learned_addr learned my addr 172.21.15.22:0/3282842642 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:19.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e1d5e1640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e181f4640 0x7f2e181f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e17fff640 1 -- 172.21.15.22:0/3282842642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e181f4640 msgr2=0x7f2e181f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e17fff640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e181f4640 0x7f2e181f4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e17fff640 1 -- 172.21.15.22:0/3282842642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e000047c0 msgr2=0x7f2e18152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e17fff640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e000047c0 0x7f2e18152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.631+0000 7f2e17fff640 1 -- 172.21.15.22:0/3282842642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1815de80 con 0x7f2e181f41b0 2023-11-24T06:17:19.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.632+0000 7f2e17fff640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e181f41b0 0x7f2e180c8b40 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c02bee0 tx=0x7f2e0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.632+0000 7f2e157fa640 1 -- 172.21.15.22:0/3282842642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c030a80 con 0x7f2e181f41b0 2023-11-24T06:17:19.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.632+0000 7f2e157fa640 1 -- 172.21.15.22:0/3282842642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c030be0 con 0x7f2e181f41b0 2023-11-24T06:17:19.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.632+0000 7f2e157fa640 1 -- 172.21.15.22:0/3282842642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c03b420 con 0x7f2e181f41b0 2023-11-24T06:17:19.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.632+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1815e160 con 0x7f2e181f41b0 2023-11-24T06:17:19.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.632+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e180c9080 con 0x7f2e181f41b0 2023-11-24T06:17:19.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.633+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e180c9270 con 0x7f2e181f41b0 2023-11-24T06:17:19.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.634+0000 7f2e157fa640 1 -- 172.21.15.22:0/3282842642 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2e0c03b580 con 0x7f2e181f41b0 2023-11-24T06:17:19.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.636+0000 7f2e157fa640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e0406b020 0x7f2e0406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.636+0000 7f2e157fa640 1 -- 172.21.15.22:0/3282842642 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2e0c0abff0 con 0x7f2e181f41b0 2023-11-24T06:17:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.636+0000 7f2e1cde0640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e0406b020 0x7f2e0406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.637+0000 7f2e1cde0640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e0406b020 0x7f2e0406d4e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2e08001580 tx=0x7f2e08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.640+0000 7f2e157fa640 1 -- 172.21.15.22:0/3282842642 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e0c0dee90 con 0x7f2e181f41b0 2023-11-24T06:17:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.836+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e181610c0 con 0x7f2e0406b020 2023-11-24T06:17:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.837+0000 7f2e157fa640 1 -- 172.21.15.22:0/3282842642 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2e0800ddc0 con 0x7f2e0406b020 2023-11-24T06:17:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 6 to deep-scrub 2023-11-24T06:17:19.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e0406b020 msgr2=0x7f2e0406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e0406b020 0x7f2e0406d4e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2e08001580 tx=0x7f2e08009040 comp rx=0 tx=0).stop 2023-11-24T06:17:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e181f41b0 msgr2=0x7f2e180c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e181f41b0 0x7f2e180c8b40 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c02bee0 tx=0x7f2e0c004730 comp rx=0 tx=0).stop 2023-11-24T06:17:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 shutdown_connections 2023-11-24T06:17:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f2e0406b020 0x7f2e0406d4e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e181f4640 0x7f2e181f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e181f41b0 0x7f2e180c8b40 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 --2- 172.21.15.22:0/3282842642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e000047c0 0x7f2e18152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 >> 172.21.15.22:0/3282842642 conn(0x7f2e1808cb00 msgr2=0x7f2e180b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 shutdown_connections 2023-11-24T06:17:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:19.840+0000 7f2e1dde2640 1 -- 172.21.15.22:0/3282842642 wait complete. 2023-11-24T06:17:19.863 INFO:tasks.ceph:Scrubbing osd.7 2023-11-24T06:17:19.863 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:17:20.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.095+0000 7f83b8ac2640 1 Processor -- start 2023-11-24T06:17:20.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.095+0000 7f83b8ac2640 1 -- start start 2023-11-24T06:17:20.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.097+0000 7f83b8ac2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f83b40b3210 0x7f83b40b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.097+0000 7f83b8ac2640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b40b23e0 con 0x7f83b40b48d0 2023-11-24T06:17:20.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.097+0000 7f83b8ac2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b40d41b0 con 0x7f83b4160bd0 2023-11-24T06:17:20.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.097+0000 7f83b8ac2640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b40cdc70 con 0x7f83b40b3210 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.097+0000 7f83b1d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f83b40b48d0 0x7f83b4165280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51498/0 (socket says 172.21.15.22:51498) 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.097+0000 7f83b1d9b640 1 -- 172.21.15.22:0/3422010307 learned_addr learned my addr 172.21.15.22:0/3422010307 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.097+0000 7f83b2d9d640 1 --2- 172.21.15.22:0/3422010307 >> v2:172.21.15.22:3300/0 conn(0x7f83b40b3210 0x7f83b40b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.098+0000 7f83b159a640 1 -- 172.21.15.22:0/3422010307 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263622274 0 0) 0x7f83b40b23e0 con 0x7f83b40b48d0 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.098+0000 7f83b159a640 1 -- 172.21.15.22:0/3422010307 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a0003520 con 0x7f83b40b48d0 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.098+0000 7f83b2d9d640 1 -- 172.21.15.22:0/3422010307 >> v1:172.21.15.31:6789/0 conn(0x7f83b4160bd0 legacy=0x7f83b40b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.098+0000 7f83b2d9d640 1 -- 172.21.15.22:0/3422010307 >> v1:172.21.15.22:6789/0 conn(0x7f83b40b48d0 legacy=0x7f83b4165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.098+0000 7f83b2d9d640 1 -- 172.21.15.22:0/3422010307 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4160fb0 con 0x7f83b40b3210 2023-11-24T06:17:20.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.099+0000 7f83b2d9d640 1 --2- 172.21.15.22:0/3422010307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b40b3210 0x7f83b40b1ea0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f83b40cddb0 tx=0x7f83ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af7d92fbfc8c59a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.099+0000 7f83b159a640 1 -- 172.21.15.22:0/3422010307 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac031830 con 0x7f83b40b3210 2023-11-24T06:17:20.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.099+0000 7f83b159a640 1 -- 172.21.15.22:0/3422010307 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac031990 con 0x7f83b40b3210 2023-11-24T06:17:20.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.099+0000 7f83b159a640 1 -- 172.21.15.22:0/3422010307 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac031d00 con 0x7f83b40b3210 2023-11-24T06:17:20.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.100+0000 7f83b8ac2640 1 -- 172.21.15.22:0/3422010307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b40b3210 msgr2=0x7f83b40b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.100+0000 7f83b8ac2640 1 --2- 172.21.15.22:0/3422010307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b40b3210 0x7f83b40b1ea0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f83b40cddb0 tx=0x7f83ac02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.100+0000 7f83b8ac2640 1 -- 172.21.15.22:0/3422010307 shutdown_connections 2023-11-24T06:17:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.100+0000 7f83b8ac2640 1 --2- 172.21.15.22:0/3422010307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b40b3210 0x7f83b40b1ea0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.100+0000 7f83b8ac2640 1 -- 172.21.15.22:0/3422010307 >> 172.21.15.22:0/3422010307 conn(0x7f83b409c5a0 msgr2=0x7f83b40d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.100+0000 7f83b8ac2640 1 -- 172.21.15.22:0/3422010307 shutdown_connections 2023-11-24T06:17:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.100+0000 7f83b8ac2640 1 -- 172.21.15.22:0/3422010307 wait complete. 2023-11-24T06:17:20.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.102+0000 7f83b8ac2640 1 Processor -- start 2023-11-24T06:17:20.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.102+0000 7f83b8ac2640 1 -- start start 2023-11-24T06:17:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.103+0000 7f83b8ac2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83b40b3210 0x7f83b40b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.103+0000 7f83b8ac2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b40b48d0 0x7f83b40ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.103+0000 7f83b8ac2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b4160bd0 0x7f83b40cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.103+0000 7f83b8ac2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40cbeb0 con 0x7f83b4160bd0 2023-11-24T06:17:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.103+0000 7f83b8ac2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40cc190 con 0x7f83b40b48d0 2023-11-24T06:17:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.103+0000 7f83b8ac2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40cc470 con 0x7f83b40b3210 2023-11-24T06:17:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b4160bd0 0x7f83b40cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b4160bd0 0x7f83b40cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58264/0 (socket says 172.21.15.22:58264) 2023-11-24T06:17:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b2d9d640 1 -- 172.21.15.22:0/566508394 learned_addr learned my addr 172.21.15.22:0/566508394 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b1d9b640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b40b48d0 0x7f83b40ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b259c640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83b40b3210 0x7f83b40b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b2d9d640 1 -- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83b40b3210 msgr2=0x7f83b40b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b2d9d640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f83b40b3210 0x7f83b40b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b2d9d640 1 -- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b40b48d0 msgr2=0x7f83b40ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b2d9d640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b40b48d0 0x7f83b40ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.104+0000 7f83b2d9d640 1 -- 172.21.15.22:0/566508394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009400 con 0x7f83b4160bd0 2023-11-24T06:17:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.105+0000 7f83b2d9d640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b4160bd0 0x7f83b40cd490 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009890 tx=0x7f83ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.105+0000 7f83aaffd640 1 -- 172.21.15.22:0/566508394 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac004230 con 0x7f83b4160bd0 2023-11-24T06:17:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.105+0000 7f83aaffd640 1 -- 172.21.15.22:0/566508394 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac004390 con 0x7f83b4160bd0 2023-11-24T06:17:20.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.105+0000 7f83aaffd640 1 -- 172.21.15.22:0/566508394 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac03a8a0 con 0x7f83b4160bd0 2023-11-24T06:17:20.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.105+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b40cc750 con 0x7f83b4160bd0 2023-11-24T06:17:20.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.105+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b40cb9b0 con 0x7f83b4160bd0 2023-11-24T06:17:20.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.106+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83b40cc300 con 0x7f83b4160bd0 2023-11-24T06:17:20.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.107+0000 7f83aaffd640 1 -- 172.21.15.22:0/566508394 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f83ac03aa00 con 0x7f83b4160bd0 2023-11-24T06:17:20.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.108+0000 7f83aaffd640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f839406b020 0x7f839406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.108+0000 7f83aaffd640 1 -- 172.21.15.22:0/566508394 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f83ac0ac180 con 0x7f83b4160bd0 2023-11-24T06:17:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.108+0000 7f83b259c640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f839406b020 0x7f839406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.108+0000 7f83aaffd640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f8394070e80 0x7f83940732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.108+0000 7f83aaffd640 1 -- 172.21.15.22:0/566508394 --> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8394073950 con 0x7f8394070e80 2023-11-24T06:17:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.108+0000 7f83aaffd640 1 -- 172.21.15.22:0/566508394 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83ac0ae820 con 0x7f83b4160bd0 2023-11-24T06:17:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.109+0000 7f83b259c640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f839406b020 0x7f839406d4e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f83a40012e0 tx=0x7f83a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.109+0000 7f83b1d9b640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f8394070e80 0x7f83940732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.110+0000 7f83b1d9b640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f8394070e80 0x7f83940732a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.113+0000 7f83aaffd640 1 -- 172.21.15.22:0/566508394 <== osd.7 v2:172.21.15.31:6820/682432999 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8394073950 con 0x7f8394070e80 2023-11-24T06:17:20.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.127+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 --> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f83b40b3a40 con 0x7f8394070e80 2023-11-24T06:17:20.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.128+0000 7f83aaffd640 1 -- 172.21.15.22:0/566508394 <== osd.7 v2:172.21.15.31:6820/682432999 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f839c001860 con 0x7f8394070e80 2023-11-24T06:17:20.131 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-11-24T06:17:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:17:20.132 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-11-24T06:17:20.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.129+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f8394070e80 msgr2=0x7f83940732a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.129+0000 7f83b8ac2640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.31:6820/682432999,v1:172.21.15.31:6821/682432999] conn(0x7f8394070e80 0x7f83940732a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.129+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f839406b020 msgr2=0x7f839406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.129+0000 7f83b8ac2640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f839406b020 0x7f839406d4e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f83a40012e0 tx=0x7f83a4009040 comp rx=0 tx=0).stop 2023-11-24T06:17:20.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.129+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b4160bd0 msgr2=0x7f83b40cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.129+0000 7f83b8ac2640 1 --2- 172.21.15.22:0/566508394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83b4160bd0 0x7f83b40cd490 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009890 tx=0x7f83ac0046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.129+0000 7f83b2d9d640 1 -- 172.21.15.22:0/566508394 reap_dead start 2023-11-24T06:17:20.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.129+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 shutdown_connections 2023-11-24T06:17:20.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.129+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 >> 172.21.15.22:0/566508394 conn(0x7f83b409c5a0 msgr2=0x7f83b415f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:20.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.130+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 shutdown_connections 2023-11-24T06:17:20.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.130+0000 7f83b8ac2640 1 -- 172.21.15.22:0/566508394 wait complete. 2023-11-24T06:17:20.151 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-24T06:17:20.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.372+0000 7f28cbfff640 1 Processor -- start 2023-11-24T06:17:20.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.372+0000 7f28cbfff640 1 -- start start 2023-11-24T06:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.374+0000 7f28cbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28cc147f50 0x7f28cc06cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.374+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc06d060 0x7f28cc070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.374+0000 7f28cbfff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc1489e0 con 0x7f28cc070840 2023-11-24T06:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.374+0000 7f28cbfff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc070cd0 con 0x7f28cc147f50 2023-11-24T06:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.374+0000 7f28cbfff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc148330 con 0x7f28cc06d060 2023-11-24T06:17:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.375+0000 7f28caffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28cc147f50 0x7f28cc06cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.375+0000 7f28caffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28cc147f50 0x7f28cc06cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.22:37918/0 (socket says 172.21.15.22:37918) 2023-11-24T06:17:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.375+0000 7f28caffd640 1 -- 172.21.15.22:0/3237471030 learned_addr learned my addr 172.21.15.22:0/3237471030 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.375+0000 7f28ca7fc640 1 --2- 172.21.15.22:0/3237471030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc06d060 0x7f28cc070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.376+0000 7f28ca7fc640 1 -- 172.21.15.22:0/3237471030 >> v2:172.21.15.31:3300/0 conn(0x7f28cc147f50 msgr2=0x7f28cc06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.376+0000 7f28ca7fc640 1 --2- 172.21.15.22:0/3237471030 >> v2:172.21.15.31:3300/0 conn(0x7f28cc147f50 0x7f28cc06cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.376+0000 7f28ca7fc640 1 -- 172.21.15.22:0/3237471030 >> v1:172.21.15.31:6789/0 conn(0x7f28cc070840 legacy=0x7f28cc0b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.376+0000 7f28ca7fc640 1 -- 172.21.15.22:0/3237471030 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc06d500 con 0x7f28cc06d060 2023-11-24T06:17:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.376+0000 7f28caffd640 1 --2- 172.21.15.22:0/3237471030 >> v2:172.21.15.31:3300/0 conn(0x7f28cc147f50 0x7f28cc06cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:17:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.378+0000 7f28ca7fc640 1 --2- 172.21.15.22:0/3237471030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc06d060 0x7f28cc070300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28b40097a0 tx=0x7f28b402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=581a6b437c87ecfb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.378+0000 7f28c9ffb640 1 -- 172.21.15.22:0/3237471030 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4030800 con 0x7f28cc06d060 2023-11-24T06:17:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.378+0000 7f28c9ffb640 1 -- 172.21.15.22:0/3237471030 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4030960 con 0x7f28cc06d060 2023-11-24T06:17:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.378+0000 7f28c9ffb640 1 -- 172.21.15.22:0/3237471030 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4030cf0 con 0x7f28cc06d060 2023-11-24T06:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.379+0000 7f28cbfff640 1 -- 172.21.15.22:0/3237471030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc06d060 msgr2=0x7f28cc070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.379+0000 7f28cbfff640 1 --2- 172.21.15.22:0/3237471030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc06d060 0x7f28cc070300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28b40097a0 tx=0x7f28b402b940 comp rx=0 tx=0).stop 2023-11-24T06:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.379+0000 7f28cbfff640 1 -- 172.21.15.22:0/3237471030 shutdown_connections 2023-11-24T06:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.379+0000 7f28cbfff640 1 --2- 172.21.15.22:0/3237471030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc06d060 0x7f28cc070300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.379+0000 7f28cbfff640 1 --2- 172.21.15.22:0/3237471030 >> v2:172.21.15.31:3300/0 conn(0x7f28cc147f50 0x7f28cc06cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.379+0000 7f28cbfff640 1 -- 172.21.15.22:0/3237471030 >> 172.21.15.22:0/3237471030 conn(0x7f28cc0b0840 msgr2=0x7f28cc0b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.379+0000 7f28cbfff640 1 -- 172.21.15.22:0/3237471030 shutdown_connections 2023-11-24T06:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.379+0000 7f28cbfff640 1 -- 172.21.15.22:0/3237471030 wait complete. 2023-11-24T06:17:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.381+0000 7f28cbfff640 1 Processor -- start 2023-11-24T06:17:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.381+0000 7f28cbfff640 1 -- start start 2023-11-24T06:17:20.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.382+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28cc06d060 0x7f28cc1f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.382+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28cc070840 0x7f28cc1626c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.382+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc147f50 0x7f28cc162c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.382+0000 7f28cbfff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc1fa680 con 0x7f28cc070840 2023-11-24T06:17:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.382+0000 7f28cbfff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc1faee0 con 0x7f28cc06d060 2023-11-24T06:17:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.382+0000 7f28cbfff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc139cb0 con 0x7f28cc147f50 2023-11-24T06:17:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.382+0000 7f28ca7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28cc070840 0x7f28cc1626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.382+0000 7f28ca7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28cc070840 0x7f28cc1626c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58272/0 (socket says 172.21.15.22:58272) 2023-11-24T06:17:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.382+0000 7f28ca7fc640 1 -- 172.21.15.22:0/3646029521 learned_addr learned my addr 172.21.15.22:0/3646029521 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.383+0000 7f28caffd640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28cc06d060 0x7f28cc1f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.383+0000 7f28cb7fe640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc147f50 0x7f28cc162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.383+0000 7f28ca7fc640 1 -- 172.21.15.22:0/3646029521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc147f50 msgr2=0x7f28cc162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.383+0000 7f28ca7fc640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc147f50 0x7f28cc162c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.383+0000 7f28ca7fc640 1 -- 172.21.15.22:0/3646029521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28cc06d060 msgr2=0x7f28cc1f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.383+0000 7f28ca7fc640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28cc06d060 0x7f28cc1f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.383+0000 7f28ca7fc640 1 -- 172.21.15.22:0/3646029521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc009b30 con 0x7f28cc070840 2023-11-24T06:17:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.383+0000 7f28ca7fc640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28cc070840 0x7f28cc1626c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f28b402bf50 tx=0x7f28b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.383+0000 7f28c37fe640 1 -- 172.21.15.22:0/3646029521 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b403e040 con 0x7f28cc070840 2023-11-24T06:17:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.384+0000 7f28c37fe640 1 -- 172.21.15.22:0/3646029521 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4039c70 con 0x7f28cc070840 2023-11-24T06:17:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.384+0000 7f28c37fe640 1 -- 172.21.15.22:0/3646029521 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40443f0 con 0x7f28cc070840 2023-11-24T06:17:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.384+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b4009400 con 0x7f28cc070840 2023-11-24T06:17:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.384+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc1fab70 con 0x7f28cc070840 2023-11-24T06:17:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.385+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28cc0b1bf0 con 0x7f28cc070840 2023-11-24T06:17:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.386+0000 7f28c37fe640 1 -- 172.21.15.22:0/3646029521 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f28b4043390 con 0x7f28cc070840 2023-11-24T06:17:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.387+0000 7f28c37fe640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f28ac06aff0 0x7f28ac06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.387+0000 7f28c37fe640 1 -- 172.21.15.22:0/3646029521 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f28b40abac0 con 0x7f28cc070840 2023-11-24T06:17:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.387+0000 7f28caffd640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f28ac06aff0 0x7f28ac06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.388+0000 7f28caffd640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f28ac06aff0 0x7f28ac06d4b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009280 tx=0x7f28bc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.391+0000 7f28c37fe640 1 -- 172.21.15.22:0/3646029521 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28b4076a40 con 0x7f28cc070840 2023-11-24T06:17:20.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.589+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f28cc148670 con 0x7f28ac06aff0 2023-11-24T06:17:20.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.590+0000 7f28c37fe640 1 -- 172.21.15.22:0/3646029521 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f28bc00f040 con 0x7f28ac06aff0 2023-11-24T06:17:20.592 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 7 to deep-scrub 2023-11-24T06:17:20.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f28ac06aff0 msgr2=0x7f28ac06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f28ac06aff0 0x7f28ac06d4b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009280 tx=0x7f28bc00b040 comp rx=0 tx=0).stop 2023-11-24T06:17:20.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28cc070840 msgr2=0x7f28cc1626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28cc070840 0x7f28cc1626c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f28b402bf50 tx=0x7f28b4004730 comp rx=0 tx=0).stop 2023-11-24T06:17:20.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 shutdown_connections 2023-11-24T06:17:20.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f28ac06aff0 0x7f28ac06d4b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28cc147f50 0x7f28cc162c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28cc070840 0x7f28cc1626c0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 --2- 172.21.15.22:0/3646029521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28cc06d060 0x7f28cc1f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.592+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 >> 172.21.15.22:0/3646029521 conn(0x7f28cc0b0840 msgr2=0x7f28cc161f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:20.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.593+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 shutdown_connections 2023-11-24T06:17:20.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.593+0000 7f28cbfff640 1 -- 172.21.15.22:0/3646029521 wait complete. 2023-11-24T06:17:20.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:17:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.837+0000 7fe064644640 1 Processor -- start 2023-11-24T06:17:20.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.838+0000 7fe064644640 1 -- start start 2023-11-24T06:17:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.839+0000 7fe064644640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe05c0ad720 0x7fe05c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.839+0000 7fe064644640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c0abff0 0x7fe05c0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.839+0000 7fe064644640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c15c360 con 0x7fe05c06d520 2023-11-24T06:17:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.839+0000 7fe064644640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c0b41a0 con 0x7fe05c0ad720 2023-11-24T06:17:20.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.839+0000 7fe064644640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c15ba30 con 0x7fe05c0abff0 2023-11-24T06:17:20.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.840+0000 7fe062be1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c0abff0 0x7fe05c0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.840+0000 7fe062be1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c0abff0 0x7fe05c0b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.22:47098/0 (socket says 172.21.15.22:47098) 2023-11-24T06:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.840+0000 7fe062be1640 1 -- 172.21.15.22:0/1272742888 learned_addr learned my addr 172.21.15.22:0/1272742888 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.840+0000 7fe061bdf640 1 --2- 172.21.15.22:0/1272742888 >> v2:172.21.15.31:3300/0 conn(0x7fe05c0ad720 0x7fe05c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.841+0000 7fe062be1640 1 -- 172.21.15.22:0/1272742888 >> v2:172.21.15.31:3300/0 conn(0x7fe05c0ad720 msgr2=0x7fe05c0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.841+0000 7fe062be1640 1 --2- 172.21.15.22:0/1272742888 >> v2:172.21.15.31:3300/0 conn(0x7fe05c0ad720 0x7fe05c0b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.841+0000 7fe062be1640 1 -- 172.21.15.22:0/1272742888 >> v1:172.21.15.31:6789/0 conn(0x7fe05c06d520 legacy=0x7fe05c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.841+0000 7fe062be1640 1 -- 172.21.15.22:0/1272742888 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c15bd10 con 0x7fe05c0abff0 2023-11-24T06:17:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.842+0000 7fe062be1640 1 --2- 172.21.15.22:0/1272742888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c0abff0 0x7fe05c0b25c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe054009e50 tx=0x7fe05402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682ace2b83e18e2b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe0613de640 1 -- 172.21.15.22:0/1272742888 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05402cb00 con 0x7fe05c0abff0 2023-11-24T06:17:20.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe0613de640 1 -- 172.21.15.22:0/1272742888 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05402cc60 con 0x7fe05c0abff0 2023-11-24T06:17:20.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe0613de640 1 -- 172.21.15.22:0/1272742888 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540343f0 con 0x7fe05c0abff0 2023-11-24T06:17:20.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe064644640 1 -- 172.21.15.22:0/1272742888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c0abff0 msgr2=0x7fe05c0b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe064644640 1 --2- 172.21.15.22:0/1272742888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c0abff0 0x7fe05c0b25c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe054009e50 tx=0x7fe05402bf60 comp rx=0 tx=0).stop 2023-11-24T06:17:20.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe064644640 1 -- 172.21.15.22:0/1272742888 shutdown_connections 2023-11-24T06:17:20.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe064644640 1 --2- 172.21.15.22:0/1272742888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c0abff0 0x7fe05c0b25c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe064644640 1 --2- 172.21.15.22:0/1272742888 >> v2:172.21.15.31:3300/0 conn(0x7fe05c0ad720 0x7fe05c0b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe064644640 1 -- 172.21.15.22:0/1272742888 >> 172.21.15.22:0/1272742888 conn(0x7fe05c0b0d80 msgr2=0x7fe05c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:20.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe064644640 1 -- 172.21.15.22:0/1272742888 shutdown_connections 2023-11-24T06:17:20.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.843+0000 7fe064644640 1 -- 172.21.15.22:0/1272742888 wait complete. 2023-11-24T06:17:20.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.845+0000 7fe064644640 1 Processor -- start 2023-11-24T06:17:20.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.845+0000 7fe064644640 1 -- start start 2023-11-24T06:17:20.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.846+0000 7fe064644640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c06d520 0x7fe05c0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.846+0000 7fe064644640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe05c0abff0 0x7fe05c158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.846+0000 7fe064644640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe05c0ad720 0x7fe05c15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.846+0000 7fe064644640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0c8530 con 0x7fe05c0ad720 2023-11-24T06:17:20.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.846+0000 7fe064644640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0cde80 con 0x7fe05c0abff0 2023-11-24T06:17:20.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.846+0000 7fe064644640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0cd5e0 con 0x7fe05c06d520 2023-11-24T06:17:20.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe062be1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe05c0ad720 0x7fe05c15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe062be1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe05c0ad720 0x7fe05c15ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58276/0 (socket says 172.21.15.22:58276) 2023-11-24T06:17:20.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe062be1640 1 -- 172.21.15.22:0/2535427605 learned_addr learned my addr 172.21.15.22:0/2535427605 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:20.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe0623e0640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c06d520 0x7fe05c0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe061bdf640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe05c0abff0 0x7fe05c158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe062be1640 1 -- 172.21.15.22:0/2535427605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c06d520 msgr2=0x7fe05c0ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe062be1640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c06d520 0x7fe05c0ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe062be1640 1 -- 172.21.15.22:0/2535427605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe05c0abff0 msgr2=0x7fe05c158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe062be1640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe05c0abff0 0x7fe05c158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.847+0000 7fe062be1640 1 -- 172.21.15.22:0/2535427605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe054009b30 con 0x7fe05c0ad720 2023-11-24T06:17:20.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.848+0000 7fe062be1640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe05c0ad720 0x7fe05c15ead0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fe054009e50 tx=0x7fe054004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.848+0000 7fe052ffd640 1 -- 172.21.15.22:0/2535427605 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054009510 con 0x7fe05c0ad720 2023-11-24T06:17:20.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.848+0000 7fe052ffd640 1 -- 172.21.15.22:0/2535427605 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05403e450 con 0x7fe05c0ad720 2023-11-24T06:17:20.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.848+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c0cd8c0 con 0x7fe05c0ad720 2023-11-24T06:17:20.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.848+0000 7fe052ffd640 1 -- 172.21.15.22:0/2535427605 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05403e800 con 0x7fe05c0ad720 2023-11-24T06:17:20.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.848+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c0cd2d0 con 0x7fe05c0ad720 2023-11-24T06:17:20.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.849+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c0c86e0 con 0x7fe05c0ad720 2023-11-24T06:17:20.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.850+0000 7fe052ffd640 1 -- 172.21.15.22:0/2535427605 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe05403e960 con 0x7fe05c0ad720 2023-11-24T06:17:20.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.851+0000 7fe052ffd640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe04006b020 0x7fe04006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.851+0000 7fe052ffd640 1 -- 172.21.15.22:0/2535427605 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe0540ac400 con 0x7fe05c0ad720 2023-11-24T06:17:20.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.852+0000 7fe0623e0640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe04006b020 0x7fe04006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.852+0000 7fe0623e0640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe04006b020 0x7fe04006d4e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe058000f60 tx=0x7fe058009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:20.856+0000 7fe052ffd640 1 -- 172.21.15.22:0/2535427605 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe05c0c86e0 con 0x7fe05c0ad720 2023-11-24T06:17:21.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.052+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe05c15b6e0 con 0x7fe04006b020 2023-11-24T06:17:21.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.056+0000 7fe052ffd640 1 -- 172.21.15.22:0/2535427605 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48520 (secure 0 0 0) 0x7fe058001c70 con 0x7fe04006b020 2023-11-24T06:17:21.059 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:21.059 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:17:21.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe04006b020 msgr2=0x7fe04006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe04006b020 0x7fe04006d4e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe058000f60 tx=0x7fe058009040 comp rx=0 tx=0).stop 2023-11-24T06:17:21.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe05c0ad720 msgr2=0x7fe05c15ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe05c0ad720 0x7fe05c15ead0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fe054009e50 tx=0x7fe054004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:21.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 shutdown_connections 2023-11-24T06:17:21.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fe04006b020 0x7fe04006d4e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe05c0ad720 0x7fe05c15ead0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe05c0abff0 0x7fe05c158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 --2- 172.21.15.22:0/2535427605 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe05c06d520 0x7fe05c0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 >> 172.21.15.22:0/2535427605 conn(0x7fe05c0b0d80 msgr2=0x7fe05c0acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:21.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 shutdown_connections 2023-11-24T06:17:21.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:21.059+0000 7fe064644640 1 -- 172.21.15.22:0/2535427605 wait complete. 2023-11-24T06:17:21.082 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2023-11-24T06:17:20.756989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":252472,"kb_used_data":7176,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722248,"statfs":{"total":773094113280,"available":772835581952,"internally_reserved":0,"allocated":7348224,"data_stored":3729704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.116236"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":209,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-24T06:17:08.638059+0000","last_change":"2023-11-24T06:11:50.973972+0000","last_active":"2023-11-24T06:17:08.638059+0000","last_peered":"2023-11-24T06:17:08.638059+0000","last_clean":"2023-11-24T06:17:08.638059+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:17:08.638059+0000","last_undegraded":"2023-11-24T06:17:08.638059+0000","last_fullsized":"2023-11-24T06:17:08.638059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:11:49.178707+0000","last_clean_scrub_stamp":"2023-11-24T06:11:49.178707+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:21.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476805,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1140000000000001,"15min":1.0649999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.149,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1639999999999999,"15min":1.0680000000000001},"min":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.861,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.077}]},{"osd":1,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1319999999999999,"15min":1.1160000000000001},"min":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.617,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2050000000000001,"15min":1.1279999999999999},"min":{"1min":0.76900000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.141}]},{"osd":2,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.23,"15min":1.159},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8180000000000001,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.391,"5min":1.2969999999999999,"15min":1.341},"min":{"1min":1.0369999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7669999999999999,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.198}]},{"osd":3,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.349,"15min":1.3169999999999999},"min":{"1min":0.94799999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7669999999999999,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.454},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3799999999999999,"15min":1.349},"min":{"1min":0.91500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.0819999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.391}]},{"osd":4,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.339,"15min":1.3049999999999999},"min":{"1min":0.75700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1150000000000002,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.4850000000000001,"15min":1.373},"min":{"1min":0.95399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.9450000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.2629999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.88900000000000001,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.865,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.504,"15min":1.4630000000000001},"min":{"1min":0.82299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.994,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.7390000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.6000000000000001,"15min":1.5620000000000001},"min":{"1min":0.71599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.052,"5min":3.262,"15min":3.262},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.653,"15min":1.6830000000000001},"min":{"1min":1.345,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.206,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.6830000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1363968,"data_stored":908989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1439999999999999,"15min":1.0800000000000001},"min":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.218,"15min":1.1599999999999999},"min":{"1min":0.73099999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6220000000000001,"5min":1.72,"15min":1.72},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1910000000000001,"15min":1.198},"min":{"1min":0.64900000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.794,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3149999999999999,"15min":1.294},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.782,"5min":1.847,"15min":1.847},"last":0.90100000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.236,"15min":1.2090000000000001},"min":{"1min":0.82399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8129999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2829999999999999,"15min":1.2949999999999999},"min":{"1min":0.85099999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.3080000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3140000000000001,"15min":1.3240000000000001},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6499999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.3879999999999999,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.7829999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.4650000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.258,"15min":1.242},"min":{"1min":0.75600000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.78,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.46,"15min":1.4259999999999999},"min":{"1min":0.88,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.964,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.4159999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.55,"15min":1.532},"min":{"1min":1.097,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.927,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.7010000000000001,"15min":1.6739999999999999},"min":{"1min":1.2729999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":1.9059999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.3580000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.446,"15min":1.494},"min":{"1min":0.92600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8740000000000001,"5min":2.5,"15min":2.5},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.694,"5min":1.758,"15min":1.7390000000000001},"min":{"1min":1.2529999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.9530000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.5209999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0660000000000001,"15min":1.0649999999999999},"min":{"1min":0.66700000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.363},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.127},"min":{"1min":0.70099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.71,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.1799999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1160000000000001,"15min":1.212},"min":{"1min":0.77000000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.272,"15min":1.2589999999999999},"min":{"1min":0.73999999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.907,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.85599999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3129999999999999,"15min":1.319},"min":{"1min":0.82699999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8380000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.997},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3700000000000001,"15min":1.458},"min":{"1min":0.86499999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.754,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.468}]},{"osd":3,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.3799999999999999},"min":{"1min":0.98099999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.623,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.054},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3380000000000001,"15min":1.454},"min":{"1min":0.746,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8029999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.1140000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.79,"5min":2.258,"15min":2.258},"last":1.22},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.427,"15min":1.5269999999999999},"min":{"1min":1.095,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9039999999999999,"5min":2.105,"15min":2.105},"last":1.635}]},{"osd":5,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.492,"15min":1.5549999999999999},"min":{"1min":1.0489999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8220000000000001,"5min":2.319,"15min":2.319},"last":1.51},{"interface":"front","average":{"1min":1.546,"5min":1.5940000000000001,"15min":1.6459999999999999},"min":{"1min":1.0800000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9390000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.323}]},{"osd":7,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.6419999999999999,"15min":1.6850000000000001},"min":{"1min":1.117,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.8560000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.274},{"interface":"front","average":{"1min":1.625,"5min":1.698,"15min":1.7689999999999999},"min":{"1min":1.226,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0329999999999999,"5min":2.669,"15min":2.669},"last":1.425}]}]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.181,"5min":1.101,"15min":1.091},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2729999999999999,"15min":1.2949999999999999},"min":{"1min":0.92300000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.212,"15min":1.2769999999999999},"min":{"1min":0.69799999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.73,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.3300000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2330000000000001,"15min":1.1970000000000001},"min":{"1min":0.80400000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.748,"5min":2.04,"15min":2.04},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3640000000000001,"15min":1.4059999999999999},"min":{"1min":0.89900000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.839,"5min":2.016,"15min":2.016},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.242,"15min":1.286},"min":{"1min":0.98099999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.706,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.49},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3129999999999999,"15min":1.3480000000000001},"min":{"1min":0.83199999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9690000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.0680000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.4259999999999999},"min":{"1min":0.70399999999999996,"5min":0.63,"15min":0.63},"max":{"1min":2.0289999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.123},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.409,"15min":1.5149999999999999},"min":{"1min":0.79400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9510000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.282}]},{"osd":6,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5009999999999999,"15min":1.5700000000000001},"min":{"1min":0.68100000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.0739999999999998,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.492,"15min":1.603},"min":{"1min":0.85299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9670000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.385}]},{"osd":7,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.423,"15min":1.5369999999999999},"min":{"1min":0.71599999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8999999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.579,"5min":1.625,"15min":1.7},"min":{"1min":0.74199999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2130000000000001,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.448}]}]},{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.86799999999999999},"min":{"1min":0.52300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.274,"5min":1.607,"15min":1.607},"last":1.028},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.90300000000000002,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7649999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.879}]},{"osd":1,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.60099999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.647,"5min":1.796,"15min":1.796},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.222,"5min":1.1539999999999999,"15min":1.1499999999999999},"min":{"1min":0.68100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.829,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.92900000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.1279999999999999,"15min":1.0740000000000001},"min":{"1min":0.60099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.123},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.179,"15min":1.137},"min":{"1min":0.64200000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.6299999999999999,"5min":2.399,"15min":2.399},"last":1.321}]},{"osd":4,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.89500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.383,"5min":1.3300000000000001,"15min":1.29},"min":{"1min":1.0660000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":2.141,"15min":2.141},"last":1.159}]},{"osd":5,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.359,"15min":1.3360000000000001},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.849,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.3979999999999999,"15min":1.403},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1779999999999999,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.90400000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.94899999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.827,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.401,"5min":1.3700000000000001,"15min":1.3400000000000001},"min":{"1min":0.85799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0030000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.071}]},{"osd":7,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4450000000000001,"15min":1.4370000000000001},"min":{"1min":0.92000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1299999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.542,"5min":1.4870000000000001,"15min":1.4770000000000001},"min":{"1min":1.099,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.2639999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.85299999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2869999999999999,"5min":2.552,"15min":2.552},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.92700000000000005,"15min":0.95999999999999996},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5649999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.879}]},{"osd":1,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.173,"15min":1.137},"min":{"1min":0.68200000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5509999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.121},"min":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8340000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1519999999999999,"15min":1.161},"min":{"1min":0.63300000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.405,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.139},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.97199999999999998},"min":{"1min":0.48699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.423,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.75600000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3069999999999999,"15min":1.329},"min":{"1min":0.85099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0640000000000001,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.448,"15min":1.4890000000000001},"min":{"1min":0.85899999999999999,"5min":0.755,"15min":0.755},"max":{"1min":1.601,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2949999999999999,"15min":1.2410000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.901,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.391,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.851,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.385}]},{"osd":6,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3799999999999999,"15min":1.3959999999999999},"min":{"1min":0.82499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7390000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.264},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.476,"15min":1.54},"min":{"1min":0.98199999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.962,"5min":4.101,"15min":4.101},"last":1.482}]},{"osd":7,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4810000000000001,"15min":1.498},"min":{"1min":0.90700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.762,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.363},{"interface":"front","average":{"1min":1.367,"5min":1.4650000000000001,"15min":1.488},"min":{"1min":0.86599999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8009999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.4590000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1363968,"data_stored":908989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1060000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":0.97599999999999998},"min":{"1min":0.60199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.554,"5min":2.161,"15min":2.161},"last":0.66300000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.996,"15min":1.026},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.742,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.105,"15min":1.1120000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5429999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1879999999999999},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5009999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.202,"15min":1.206},"min":{"1min":0.65000000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5700000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.625}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.347,"15min":1.304},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5800000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.069},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3500000000000001,"15min":1.3879999999999999},"min":{"1min":0.88600000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.756,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Nov 24 06:17:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3080000000000001,"15min":1.282},"min":{"1min":0.79200000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.544,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.407,"5min":1.3320000000000001,"15min":1.2629999999999999},"min":{"1min":0.80100000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.99199999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4350000000000001,"15min":1.4370000000000001},"min":{"1min":0.94099999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.8460000000000001,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":0.87},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4119999999999999,"15min":1.3520000000000001},"min":{"1min":0.85799999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0859999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.165}]},{"osd":7,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.4490000000000001,"15min":1.4339999999999999},"min":{"1min":0.84099999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8100000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.018},{"interface":"front","average":{"1min":1.462,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.018,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.95,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":0.89100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85599999999999998,"15min":0.93400000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.492,"5min":1.571,"15min":1.571},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4850000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.89400000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.98499999999999999,"15min":1.0089999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4910000000000001,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.095,"15min":1.2030000000000001},"min":{"1min":0.51800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2470000000000001,"5min":2.964,"15min":2.964},"last":1.0309999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3089999999999999,"15min":1.3600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.704,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.091},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.254,"15min":1.3109999999999999},"min":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.859,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.224}]},{"osd":4,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3360000000000001,"15min":1.3300000000000001},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7130000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4199999999999999,"15min":1.5349999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8879999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.544}]},{"osd":5,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.367,"15min":1.4510000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.804,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4350000000000001,"15min":1.4610000000000001},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.718,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.972}]},{"osd":6,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.456,"15min":1.5329999999999999},"min":{"1min":0.94299999999999995,"5min":0.87,"15min":0.87},"max":{"1min":1.869,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.7729999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.528,"15min":1.5409999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8460000000000001,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":2.0489999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.52,"15min":1.601},"min":{"1min":0.94599999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.04,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.613,"15min":1.6619999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.694}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:17:21.086 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-24T06:11:49.178707+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=6, tm_min=11, tm_sec=49, tm_wday=4, tm_yday=328, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=6, tm_min=17, tm_sec=13, tm_wday=4, tm_yday=328, tm_isdst=0) 2023-11-24T06:17:21.086 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-24T06:17:22.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:22.082 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:41.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:17:41.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.320+0000 7f6422809640 1 Processor -- start 2023-11-24T06:17:41.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.320+0000 7f6422809640 1 -- start start 2023-11-24T06:17:41.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.322+0000 7f6422809640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f641c13dfd0 0x7f641c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.322+0000 7f6422809640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f641c0cf050 0x7f641c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.322+0000 7f6422809640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641c0ce7c0 con 0x7f641c06c130 2023-11-24T06:17:41.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.322+0000 7f6422809640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641c0cfa40 con 0x7f641c13dfd0 2023-11-24T06:17:41.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.322+0000 7f6422809640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641c140900 con 0x7f641c0cf050 2023-11-24T06:17:41.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.322+0000 7f6421807640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f641c13dfd0 0x7f641c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.322+0000 7f6421807640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f641c13dfd0 0x7f641c15be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41432/0 (socket says 172.21.15.22:41432) 2023-11-24T06:17:41.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.322+0000 7f6421807640 1 -- 172.21.15.22:0/2867813723 learned_addr learned my addr 172.21.15.22:0/2867813723 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:41.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.323+0000 7f6421807640 1 -- 172.21.15.22:0/2867813723 >> v2:172.21.15.31:3300/0 conn(0x7f641c0cf050 msgr2=0x7f641c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:41.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.323+0000 7f6421807640 1 --2- 172.21.15.22:0/2867813723 >> v2:172.21.15.31:3300/0 conn(0x7f641c0cf050 0x7f641c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.323+0000 7f6421807640 1 -- 172.21.15.22:0/2867813723 >> v1:172.21.15.31:6789/0 conn(0x7f641c06c130 legacy=0x7f641c06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:41.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.323+0000 7f6421807640 1 -- 172.21.15.22:0/2867813723 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c15fa70 con 0x7f641c13dfd0 2023-11-24T06:17:41.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.324+0000 7f6421807640 1 --2- 172.21.15.22:0/2867813723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c13dfd0 0x7f641c15be70 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f641c06e070 tx=0x7f641802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb01fbac925fd8f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:41.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.324+0000 7f6420805640 1 -- 172.21.15.22:0/2867813723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418031870 con 0x7f641c13dfd0 2023-11-24T06:17:41.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.324+0000 7f6420805640 1 -- 172.21.15.22:0/2867813723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64180319d0 con 0x7f641c13dfd0 2023-11-24T06:17:41.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.324+0000 7f6420805640 1 -- 172.21.15.22:0/2867813723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418031d60 con 0x7f641c13dfd0 2023-11-24T06:17:41.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.325+0000 7f6422809640 1 -- 172.21.15.22:0/2867813723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c13dfd0 msgr2=0x7f641c15be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.325+0000 7f6422809640 1 --2- 172.21.15.22:0/2867813723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c13dfd0 0x7f641c15be70 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f641c06e070 tx=0x7f641802b910 comp rx=0 tx=0).stop 2023-11-24T06:17:41.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.325+0000 7f6422809640 1 -- 172.21.15.22:0/2867813723 shutdown_connections 2023-11-24T06:17:41.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.325+0000 7f6422809640 1 --2- 172.21.15.22:0/2867813723 >> v2:172.21.15.31:3300/0 conn(0x7f641c0cf050 0x7f641c0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.325+0000 7f6422809640 1 --2- 172.21.15.22:0/2867813723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c13dfd0 0x7f641c15be70 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.325+0000 7f6422809640 1 -- 172.21.15.22:0/2867813723 >> 172.21.15.22:0/2867813723 conn(0x7f641c06a860 msgr2=0x7f641c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:41.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.325+0000 7f6422809640 1 -- 172.21.15.22:0/2867813723 shutdown_connections 2023-11-24T06:17:41.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.325+0000 7f6422809640 1 -- 172.21.15.22:0/2867813723 wait complete. 2023-11-24T06:17:41.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.327+0000 7f6422809640 1 Processor -- start 2023-11-24T06:17:41.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.327+0000 7f6422809640 1 -- start start 2023-11-24T06:17:41.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.328+0000 7f6422809640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c06c130 0x7f641c134970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.328+0000 7f6422809640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f641c0cf050 0x7f641c157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.328+0000 7f6422809640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f641c13dfd0 0x7f641c0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.328+0000 7f6422809640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c134eb0 con 0x7f641c06c130 2023-11-24T06:17:41.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.328+0000 7f6422809640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c135cf0 con 0x7f641c13dfd0 2023-11-24T06:17:41.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.328+0000 7f6422809640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c157fd0 con 0x7f641c0cf050 2023-11-24T06:17:41.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.328+0000 7f6421807640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c06c130 0x7f641c134970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.328+0000 7f6421807640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c06c130 0x7f641c134970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41444/0 (socket says 172.21.15.22:41444) 2023-11-24T06:17:41.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.328+0000 7f6421807640 1 -- 172.21.15.22:0/1254728021 learned_addr learned my addr 172.21.15.22:0/1254728021 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:41.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6421006640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f641c0cf050 0x7f641c157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6422008640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f641c13dfd0 0x7f641c0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6421807640 1 -- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f641c0cf050 msgr2=0x7f641c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6421807640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f641c0cf050 0x7f641c157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6421807640 1 -- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f641c13dfd0 msgr2=0x7f641c0cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6421807640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f641c13dfd0 0x7f641c0cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6421807640 1 -- 172.21.15.22:0/1254728021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180094d0 con 0x7f641c06c130 2023-11-24T06:17:41.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6421006640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f641c0cf050 0x7f641c157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:41.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6422008640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f641c13dfd0 0x7f641c0cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:41.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f6421807640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c06c130 0x7f641c134970 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6418000c00 tx=0x7f64180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:41.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f64127fc640 1 -- 172.21.15.22:0/1254728021 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641803ad10 con 0x7f641c06c130 2023-11-24T06:17:41.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f64127fc640 1 -- 172.21.15.22:0/1254728021 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641803ae70 con 0x7f641c06c130 2023-11-24T06:17:41.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.329+0000 7f64127fc640 1 -- 172.21.15.22:0/1254728021 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418044610 con 0x7f641c06c130 2023-11-24T06:17:41.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.330+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641c1350e0 con 0x7f641c06c130 2023-11-24T06:17:41.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.330+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641c1356a0 con 0x7f641c06c130 2023-11-24T06:17:41.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.331+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c04e840 con 0x7f641c06c130 2023-11-24T06:17:41.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.332+0000 7f64127fc640 1 -- 172.21.15.22:0/1254728021 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f641804d450 con 0x7f641c06c130 2023-11-24T06:17:41.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.333+0000 7f64127fc640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f640006aff0 0x7f640006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.333+0000 7f64127fc640 1 -- 172.21.15.22:0/1254728021 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f641802d040 con 0x7f641c06c130 2023-11-24T06:17:41.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.334+0000 7f6421006640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f640006aff0 0x7f640006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.334+0000 7f6421006640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f640006aff0 0x7f640006d4b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f640c006fd0 tx=0x7f640c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:41.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.338+0000 7f64127fc640 1 -- 172.21.15.22:0/1254728021 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6418076da0 con 0x7f641c06c130 2023-11-24T06:17:41.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.528+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 --> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f641c15f420 con 0x7f640006aff0 2023-11-24T06:17:41.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.535+0000 7f64127fc640 1 -- 172.21.15.22:0/1254728021 <== mgr.4107 v2:172.21.15.22:6832/913263114 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48440 (secure 0 0 0) 0x7f640c00ae20 con 0x7f640006aff0 2023-11-24T06:17:41.538 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:41.538 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-11-24T06:17:41.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.537+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f640006aff0 msgr2=0x7f640006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.537+0000 7f6422809640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f640006aff0 0x7f640006d4b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f640c006fd0 tx=0x7f640c008040 comp rx=0 tx=0).stop 2023-11-24T06:17:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.537+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c06c130 msgr2=0x7f641c134970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.537+0000 7f6422809640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c06c130 0x7f641c134970 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6418000c00 tx=0x7f64180046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.538+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 shutdown_connections 2023-11-24T06:17:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.538+0000 7f6422809640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f640006aff0 0x7f640006d4b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.538+0000 7f6422809640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f641c13dfd0 0x7f641c0cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.538+0000 7f6422809640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f641c0cf050 0x7f641c157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.538+0000 7f6422809640 1 --2- 172.21.15.22:0/1254728021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f641c06c130 0x7f641c134970 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.538+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 >> 172.21.15.22:0/1254728021 conn(0x7f641c06a860 msgr2=0x7f641c06c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:41.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.538+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 shutdown_connections 2023-11-24T06:17:41.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.538+0000 7f6422809640 1 -- 172.21.15.22:0/1254728021 wait complete. 2023-11-24T06:17:41.560 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2023-11-24T06:17:40.762930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":252460,"kb_used_data":7176,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722260,"statfs":{"total":773094113280,"available":772835594240,"internally_reserved":0,"allocated":7348224,"data_stored":3729704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003522"},"pg_stats":[{"pgid":"1.0","version":"64'119","reported_seq":220,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:21.348476+0000","last_change":"2023-11-24T06:17:21.348573+0000","last_active":"2023-11-24T06:17:21.348476+0000","last_peered":"2023-11-24T06:17:21.348476+0000","last_clean":"2023-11-24T06:17:21.348476+0000","last_became_active":"2023-11-24T06:11:50.971307+0000","last_became_peered":"2023-11-24T06:11:50.971307+0000","last_unstale":"2023-11-24T06:17:21.348476+0000","last_undegraded":"2023-11-24T06:17:21.348476+0000","last_fullsized":"2023-11-24T06:17:21.348476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'119","last_scrub_stamp":"2023-11-24T06:17:21.348302+0000","last_deep_scrub":"64'119","last_deep_scrub_stamp":"2023-11-24T06:17:21.348302+0000","last_clean_scrub_stamp":"2023-11-24T06:17:21.348302+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:17:46.391135+0000","scrub_duration":0.013140773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476809,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1140000000000001,"15min":1.0649999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.149,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1639999999999999,"15min":1.0680000000000001},"min":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.861,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.3799999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1319999999999999,"15min":1.1160000000000001},"min":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.617,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2050000000000001,"15min":1.1279999999999999},"min":{"1min":0.76900000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.079}]},{"osd":2,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.23,"15min":1.159},"min":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8180000000000001,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":1.706},{"interface":"front","average":{"1min":1.391,"5min":1.2969999999999999,"15min":1.341},"min":{"1min":1.0369999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7669999999999999,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.1519999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.349,"15min":1.3169999999999999},"min":{"1min":0.94799999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7669999999999999,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.851},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3799999999999999,"15min":1.349},"min":{"1min":0.91500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.0819999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.339,"15min":1.3049999999999999},"min":{"1min":0.75700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1150000000000002,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.4850000000000001,"15min":1.373},"min":{"1min":0.95399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.9450000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.9359999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.88900000000000001,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.865,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.504,"15min":1.4630000000000001},"min":{"1min":0.82299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.994,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.4570000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.6000000000000001,"15min":1.5620000000000001},"min":{"1min":0.71599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.052,"5min":3.262,"15min":3.262},"last":2.0009999999999999},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.653,"15min":1.6830000000000001},"min":{"1min":1.345,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.206,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.8100000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1363968,"data_stored":908989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1439999999999999,"15min":1.0800000000000001},"min":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.218,"15min":1.1599999999999999},"min":{"1min":0.73099999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6220000000000001,"5min":1.72,"15min":1.72},"last":1.488}]},{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1910000000000001,"15min":1.198},"min":{"1min":0.64900000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.794,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.413},{"interface":"front","average":{"1min":1.331,"5min":1.3149999999999999,"15min":1.294},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.782,"5min":1.847,"15min":1.847},"last":1.161}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.236,"15min":1.2090000000000001},"min":{"1min":0.82399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8129999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2829999999999999,"15min":1.2949999999999999},"min":{"1min":0.85099999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.3109999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3140000000000001,"15min":1.3240000000000001},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6499999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.3879999999999999,"15min":1.3759999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.7829999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.6970000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.258,"15min":1.242},"min":{"1min":0.75600000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.78,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.46,"15min":1.4259999999999999},"min":{"1min":0.88,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.964,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.1040000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.55,"15min":1.532},"min":{"1min":1.097,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.927,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.379},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.7010000000000001,"15min":1.6739999999999999},"min":{"1min":1.2729999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":1.9059999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.528}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.446,"15min":1.494},"min":{"1min":0.92600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8740000000000001,"5min":2.5,"15min":2.5},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.694,"5min":1.758,"15min":1.7390000000000001},"min":{"1min":1.2529999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.9530000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.6479999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0660000000000001,"15min":1.0649999999999999},"min":{"1min":0.66700000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.123,"15min":1.127},"min":{"1min":0.70099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.71,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.367}]},{"osd":1,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1160000000000001,"15min":1.212},"min":{"1min":0.77000000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.123},{"interface":"front","average":{"1min":1.27,"5min":1.272,"15min":1.2589999999999999},"min":{"1min":0.73999999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.907,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.2729999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3129999999999999,"15min":1.319},"min":{"1min":0.82699999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.8380000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3700000000000001,"15min":1.458},"min":{"1min":0.86499999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.754,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.4139999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3680000000000001,"15min":1.3799999999999999},"min":{"1min":0.98099999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.623,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.546},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3380000000000001,"15min":1.454},"min":{"1min":0.746,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8029999999999999,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.3160000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3999999999999999,"15min":1.4710000000000001},"min":{"1min":0.88700000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.79,"5min":2.258,"15min":2.258},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.427,"15min":1.5269999999999999},"min":{"1min":1.095,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9039999999999999,"5min":2.105,"15min":2.105},"last":1.228}]},{"osd":5,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.492,"15min":1.5549999999999999},"min":{"1min":1.0489999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8220000000000001,"5min":2.319,"15min":2.319},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.5940000000000001,"15min":1.6459999999999999},"min":{"1min":1.0800000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9390000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.179}]},{"osd":7,"last update":"Fri Nov 24 06:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.6419999999999999,"15min":1.6850000000000001},"min":{"1min":1.117,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.8560000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.639},{"interface":"front","average":{"1min":1.625,"5min":1.698,"15min":1.7689999999999999},"min":{"1min":1.226,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0329999999999999,"5min":2.669,"15min":2.669},"last":1.611}]}]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.034},{"interface":"front","average":{"1min":1.181,"5min":1.101,"15min":1.091},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1919999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2729999999999999,"15min":1.2949999999999999},"min":{"1min":0.92300000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.212,"15min":1.2769999999999999},"min":{"1min":0.69799999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.73,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.151}]},{"osd":2,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2330000000000001,"15min":1.1970000000000001},"min":{"1min":0.80400000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.748,"5min":2.04,"15min":2.04},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3640000000000001,"15min":1.4059999999999999},"min":{"1min":0.89900000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.839,"5min":2.016,"15min":2.016},"last":1.48}]},{"osd":3,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.242,"15min":1.286},"min":{"1min":0.98099999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.706,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3129999999999999,"15min":1.3480000000000001},"min":{"1min":0.83199999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9690000000000001,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.5389999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3560000000000001,"15min":1.4259999999999999},"min":{"1min":0.70399999999999996,"5min":0.63,"15min":0.63},"max":{"1min":2.0289999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.409,"15min":1.5149999999999999},"min":{"1min":0.79400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9510000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.6599999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5009999999999999,"15min":1.5700000000000001},"min":{"1min":0.68100000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.0739999999999998,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.492,"15min":1.603},"min":{"1min":0.85299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9670000000000001,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.587}]},{"osd":7,"last update":"Fri Nov 24 06:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.423,"15min":1.5369999999999999},"min":{"1min":0.71599999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8999999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.623},{"interface":"front","average":{"1min":1.579,"5min":1.625,"15min":1.7},"min":{"1min":0.74199999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2130000000000001,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":1.796}]}]},{"osd":3,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.86799999999999999},"min":{"1min":0.52300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.274,"5min":1.607,"15min":1.607},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.90300000000000002,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7649999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.60099999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.647,"5min":1.796,"15min":1.796},"last":0.745},{"interface":"front","average":{"1min":1.222,"5min":1.1539999999999999,"15min":1.1499999999999999},"min":{"1min":0.68100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.829,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.093}]},{"osd":2,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.1279999999999999,"15min":1.0740000000000001},"min":{"1min":0.60099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.179,"15min":1.137},"min":{"1min":0.64200000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.6299999999999999,"5min":2.399,"15min":2.399},"last":1.5109999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.89500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6879999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.478},{"interface":"front","average":{"1min":1.383,"5min":1.3300000000000001,"15min":1.29},"min":{"1min":1.0660000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":2.141,"15min":2.141},"last":1.4299999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.359,"15min":1.3360000000000001},"min":{"1min":0.97499999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.849,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.681},{"interface":"front","average":{"1min":1.496,"5min":1.3979999999999999,"15min":1.403},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1779999999999999,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.3140000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.94899999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.827,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.3700000000000001,"15min":1.3400000000000001},"min":{"1min":0.85799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.0030000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.6279999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.4450000000000001,"15min":1.4370000000000001},"min":{"1min":0.92000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1299999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.542,"5min":1.4870000000000001,"15min":1.4770000000000001},"min":{"1min":1.099,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.2639999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.597}]}]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2869999999999999,"5min":2.552,"15min":2.552},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.92700000000000005,"15min":0.95999999999999996},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5649999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.27}]},{"osd":1,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.173,"15min":1.137},"min":{"1min":0.68200000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5509999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.028},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.1020000000000001,"15min":1.121},"min":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8340000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.073}]},{"osd":3,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1519999999999999,"15min":1.161},"min":{"1min":0.63300000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.405,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.48},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.97199999999999998},"min":{"1min":0.48699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.423,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.88}]},{"osd":4,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3069999999999999,"15min":1.329},"min":{"1min":0.85099999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0640000000000001,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.448,"15min":1.4890000000000001},"min":{"1min":0.85899999999999999,"5min":0.755,"15min":0.755},"max":{"1min":1.601,"5min":3.4729999999999999,"15min":3.4729999999999999},"last":1.607}]},{"osd":5,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2949999999999999,"15min":1.2410000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.901,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.391,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.851,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":1.5780000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3799999999999999,"15min":1.3959999999999999},"min":{"1min":0.82499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7390000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":1.363},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.476,"15min":1.54},"min":{"1min":0.98199999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.962,"5min":4.101,"15min":4.101},"last":1.431}]},{"osd":7,"last update":"Fri Nov 24 06:17:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4810000000000001,"15min":1.498},"min":{"1min":0.90700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.762,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.4650000000000001,"15min":1.488},"min":{"1min":0.86599999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8009999999999999,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.5129999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1363968,"data_stored":908989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1060000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.0069999999999999,"15min":0.97599999999999998},"min":{"1min":0.60199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.554,"5min":2.161,"15min":2.161},"last":1.74}]},{"osd":2,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.996,"15min":1.026},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.742,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.105,"15min":1.1120000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5429999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.4810000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1879999999999999},"min":{"1min":0.51500000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5009999999999999,"5min":3.8180000000000001,"15min":3.8180000000000001},"last":0.875},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.202,"15min":1.206},"min":{"1min":0.65000000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5700000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.347,"15min":1.304},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5800000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3500000000000001,"15min":1.3879999999999999},"min":{"1min":0.88600000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.756,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.409}]},{"osd":5,"last update":"Fri Nov 24 06:17:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3080000000000001,"15min":1.282},"min":{"1min":0.79200000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.544,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.3320000000000001,"15min":1.2629999999999999},"min":{"1min":0.80100000000000005,"5min":0.752,"15min":0.752},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.4450000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4350000000000001,"15min":1.4370000000000001},"min":{"1min":0.94099999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.8460000000000001,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4119999999999999,"15min":1.3520000000000001},"min":{"1min":0.85799999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.0859999999999999,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.3600000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.4490000000000001,"15min":1.4339999999999999},"min":{"1min":0.84099999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8100000000000001,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.462,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.018,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.95,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.54}]}]},{"osd":1,"up_from":14,"seq":60129542217,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85599999999999998,"15min":0.93400000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.492,"5min":1.571,"15min":1.571},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4850000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.04}]},{"osd":2,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.98499999999999999,"15min":1.0089999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4910000000000001,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.095,"15min":1.2030000000000001},"min":{"1min":0.51800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2470000000000001,"5min":2.964,"15min":2.964},"last":1.2849999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.3089999999999999,"15min":1.3600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.704,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.48},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.254,"15min":1.3109999999999999},"min":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.859,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4490000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3360000000000001,"15min":1.3300000000000001},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7130000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":1.397},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4199999999999999,"15min":1.5349999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8879999999999999,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1.633}]},{"osd":5,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.367,"15min":1.4510000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.804,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4350000000000001,"15min":1.4610000000000001},"min":{"1min":0.80000000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.718,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.536}]},{"osd":6,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.456,"15min":1.5329999999999999},"min":{"1min":0.94299999999999995,"5min":0.87,"15min":0.87},"max":{"1min":1.869,"5min":2.6869999999999998,"15min":2.6869999999999998},"last":1.704},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.528,"15min":1.5409999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8460000000000001,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":1.663}]},{"osd":7,"last update":"Fri Nov 24 06:17:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.52,"15min":1.601},"min":{"1min":0.94599999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.04,"5min":3.1200000000000001,"15min":3.1200000000000001},"last":1.798},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.613,"15min":1.6619999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.78}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:17:41.563 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-24T06:17:41.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.781+0000 7fc18c96c640 1 Processor -- start 2023-11-24T06:17:41.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.781+0000 7fc18c96c640 1 -- start start 2023-11-24T06:17:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.783+0000 7fc18c96c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc188153ea0 0x7fc1880ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.783+0000 7fc18c96c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc188070850 0x7fc188071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.783+0000 7fc18c96c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880ce650 con 0x7fc188154280 2023-11-24T06:17:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.783+0000 7fc18c96c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc188154710 con 0x7fc188070850 2023-11-24T06:17:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.783+0000 7fc18c96c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18815e0a0 con 0x7fc188153ea0 2023-11-24T06:17:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.783+0000 7fc187fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc188070850 0x7fc188071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.784+0000 7fc1877fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc188153ea0 0x7fc1880ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.784+0000 7fc17ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc188154280 0x7fc18815d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.22:44672/0 (socket says 172.21.15.22:44672) 2023-11-24T06:17:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.784+0000 7fc187fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc188070850 0x7fc188071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41460/0 (socket says 172.21.15.22:41460) 2023-11-24T06:17:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.784+0000 7fc17ffff640 1 -- 172.21.15.22:0/904459020 learned_addr learned my addr 172.21.15.22:0/904459020 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-11-24T06:17:41.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.784+0000 7fc187fff640 1 -- 172.21.15.22:0/904459020 >> v2:172.21.15.31:3300/0 conn(0x7fc188153ea0 msgr2=0x7fc1880ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:41.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.784+0000 7fc187fff640 1 --2- 172.21.15.22:0/904459020 >> v2:172.21.15.31:3300/0 conn(0x7fc188153ea0 0x7fc1880ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.784+0000 7fc187fff640 1 -- 172.21.15.22:0/904459020 >> v1:172.21.15.31:6789/0 conn(0x7fc188154280 legacy=0x7fc18815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.784+0000 7fc187fff640 1 -- 172.21.15.22:0/904459020 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18815e380 con 0x7fc188070850 2023-11-24T06:17:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.786+0000 7fc187fff640 1 --2- 172.21.15.22:0/904459020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 0x7fc188071350 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc1880cfc10 tx=0x7fc18002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1785ee0b55870b9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.786+0000 7fc186ffd640 1 -- 172.21.15.22:0/904459020 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18002cc80 con 0x7fc188070850 2023-11-24T06:17:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.786+0000 7fc186ffd640 1 -- 172.21.15.22:0/904459020 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18002cde0 con 0x7fc188070850 2023-11-24T06:17:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.786+0000 7fc186ffd640 1 -- 172.21.15.22:0/904459020 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180034660 con 0x7fc188070850 2023-11-24T06:17:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.787+0000 7fc18c96c640 1 -- 172.21.15.22:0/904459020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 msgr2=0x7fc188071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.787+0000 7fc18c96c640 1 --2- 172.21.15.22:0/904459020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 0x7fc188071350 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc1880cfc10 tx=0x7fc18002bed0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.787+0000 7fc18c96c640 1 -- 172.21.15.22:0/904459020 shutdown_connections 2023-11-24T06:17:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.787+0000 7fc18c96c640 1 --2- 172.21.15.22:0/904459020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 0x7fc188071350 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.787+0000 7fc18c96c640 1 --2- 172.21.15.22:0/904459020 >> v2:172.21.15.31:3300/0 conn(0x7fc188153ea0 0x7fc1880ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.787+0000 7fc18c96c640 1 -- 172.21.15.22:0/904459020 >> 172.21.15.22:0/904459020 conn(0x7fc1880cec10 msgr2=0x7fc1880cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.787+0000 7fc18c96c640 1 -- 172.21.15.22:0/904459020 shutdown_connections 2023-11-24T06:17:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.787+0000 7fc18c96c640 1 -- 172.21.15.22:0/904459020 wait complete. 2023-11-24T06:17:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.789+0000 7fc18c96c640 1 Processor -- start 2023-11-24T06:17:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.789+0000 7fc18c96c640 1 -- start start 2023-11-24T06:17:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.790+0000 7fc18c96c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 0x7fc18813b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.790+0000 7fc18c96c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188153ea0 0x7fc188156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.790+0000 7fc18c96c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc188154280 0x7fc1881f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.790+0000 7fc18c96c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18813bdf0 con 0x7fc188070850 2023-11-24T06:17:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.790+0000 7fc18c96c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1881f6870 con 0x7fc188153ea0 2023-11-24T06:17:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.790+0000 7fc18c96c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1881f6b50 con 0x7fc188154280 2023-11-24T06:17:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.791+0000 7fc1877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 0x7fc18813b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.791+0000 7fc1877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 0x7fc18813b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41462/0 (socket says 172.21.15.22:41462) 2023-11-24T06:17:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.791+0000 7fc1877fe640 1 -- 172.21.15.22:0/1376170862 learned_addr learned my addr 172.21.15.22:0/1376170862 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.791+0000 7fc1877fe640 1 -- 172.21.15.22:0/1376170862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc188154280 msgr2=0x7fc1881f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.791+0000 7fc1877fe640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc188154280 0x7fc1881f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.791+0000 7fc1877fe640 1 -- 172.21.15.22:0/1376170862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188153ea0 msgr2=0x7fc188156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.791+0000 7fc1877fe640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188153ea0 0x7fc188156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.791+0000 7fc1877fe640 1 -- 172.21.15.22:0/1376170862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009a70 con 0x7fc188070850 2023-11-24T06:17:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.791+0000 7fc1877fe640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 0x7fc18813b8b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc17800e9b0 tx=0x7fc17800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.792+0000 7fc184ff9640 1 -- 172.21.15.22:0/1376170862 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800c9a0 con 0x7fc188070850 2023-11-24T06:17:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.792+0000 7fc184ff9640 1 -- 172.21.15.22:0/1376170862 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17800cb00 con 0x7fc188070850 2023-11-24T06:17:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.792+0000 7fc184ff9640 1 -- 172.21.15.22:0/1376170862 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178013470 con 0x7fc188070850 2023-11-24T06:17:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.792+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc188155a20 con 0x7fc188070850 2023-11-24T06:17:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.792+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc188142340 con 0x7fc188070850 2023-11-24T06:17:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.793+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18804e840 con 0x7fc188070850 2023-11-24T06:17:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.794+0000 7fc184ff9640 1 -- 172.21.15.22:0/1376170862 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc1780135d0 con 0x7fc188070850 2023-11-24T06:17:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.795+0000 7fc184ff9640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc16806aff0 0x7fc16806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.795+0000 7fc184ff9640 1 -- 172.21.15.22:0/1376170862 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc1780898e0 con 0x7fc188070850 2023-11-24T06:17:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.795+0000 7fc17ffff640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc16806aff0 0x7fc16806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.796+0000 7fc17ffff640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc16806aff0 0x7fc16806d4b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc18815d210 tx=0x7fc170007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:41.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.800+0000 7fc184ff9640 1 -- 172.21.15.22:0/1376170862 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc178054a00 con 0x7fc188070850 2023-11-24T06:17:41.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:41.997+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc1881f6d10 con 0x7fc188070850 2023-11-24T06:17:42.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.003+0000 7fc184ff9640 1 -- 172.21.15.22:0/1376170862 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc1780170c0 con 0x7fc188070850 2023-11-24T06:17:42.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.005+0000 7fc184ff9640 1 -- 172.21.15.22:0/1376170862 <== mon.0 v2:172.21.15.22:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc178054a00 con 0x7fc188070850 2023-11-24T06:17:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc16806aff0 msgr2=0x7fc16806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc16806aff0 0x7fc16806d4b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc18815d210 tx=0x7fc170007a40 comp rx=0 tx=0).stop 2023-11-24T06:17:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 msgr2=0x7fc18813b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 0x7fc18813b8b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc17800e9b0 tx=0x7fc17800ee70 comp rx=0 tx=0).stop 2023-11-24T06:17:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 shutdown_connections 2023-11-24T06:17:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7fc16806aff0 0x7fc16806d4b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc188154280 0x7fc1881f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188153ea0 0x7fc188156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 --2- 172.21.15.22:0/1376170862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc188070850 0x7fc18813b8b0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.006+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 >> 172.21.15.22:0/1376170862 conn(0x7fc1880cec10 msgr2=0x7fc1880ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.007+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 shutdown_connections 2023-11-24T06:17:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.007+0000 7fc18c96c640 1 -- 172.21.15.22:0/1376170862 wait complete. 2023-11-24T06:17:42.028 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:17:42.028 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:42.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.238+0000 7f16ae4bb640 1 Processor -- start 2023-11-24T06:17:42.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.239+0000 7f16ae4bb640 1 -- start start 2023-11-24T06:17:42.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.240+0000 7f16ae4bb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16a815d5b0 0x7f16a80d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.240+0000 7f16ae4bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80d14a0 0x7f16a80d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.240+0000 7f16ae4bb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16a80cf7a0 0x7f16a80cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.241+0000 7f16ae4bb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80cf0c0 con 0x7f16a80cf7a0 2023-11-24T06:17:42.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.241+0000 7f16ae4bb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80d1e40 con 0x7f16a815d5b0 2023-11-24T06:17:42.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.241+0000 7f16ae4bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80b01b0 con 0x7f16a80d14a0 2023-11-24T06:17:42.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.241+0000 7f16adcba640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16a80cf7a0 0x7f16a80cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.241+0000 7f16adcba640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16a80cf7a0 0x7f16a80cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41466/0 (socket says 172.21.15.22:41466) 2023-11-24T06:17:42.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.241+0000 7f16adcba640 1 -- 172.21.15.22:0/3063871858 learned_addr learned my addr 172.21.15.22:0/3063871858 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:42.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.241+0000 7f16ad4b9640 1 --2- 172.21.15.22:0/3063871858 >> v2:172.21.15.31:3300/0 conn(0x7f16a815d5b0 0x7f16a80d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.241+0000 7f16accb8640 1 --2- 172.21.15.22:0/3063871858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80d14a0 0x7f16a80d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.242+0000 7f16adcba640 1 -- 172.21.15.22:0/3063871858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80d14a0 msgr2=0x7f16a80d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:42.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.242+0000 7f16adcba640 1 --2- 172.21.15.22:0/3063871858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80d14a0 0x7f16a80d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.242+0000 7f16adcba640 1 -- 172.21.15.22:0/3063871858 >> v2:172.21.15.31:3300/0 conn(0x7f16a815d5b0 msgr2=0x7f16a80d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:42.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.242+0000 7f16adcba640 1 --2- 172.21.15.22:0/3063871858 >> v2:172.21.15.31:3300/0 conn(0x7f16a815d5b0 0x7f16a80d3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.242+0000 7f16adcba640 1 -- 172.21.15.22:0/3063871858 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a815d990 con 0x7f16a80cf7a0 2023-11-24T06:17:42.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.242+0000 7f16ad4b9640 1 --2- 172.21.15.22:0/3063871858 >> v2:172.21.15.31:3300/0 conn(0x7f16a815d5b0 0x7f16a80d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.243+0000 7f16adcba640 1 --2- 172.21.15.22:0/3063871858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80cf7a0 0x7f16a80cfc00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f16a808c9e0 tx=0x7f16a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7d64a31abf331a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.243+0000 7f169ffff640 1 -- 172.21.15.22:0/3063871858 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a002ca70 con 0x7f16a80cf7a0 2023-11-24T06:17:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f169ffff640 1 -- 172.21.15.22:0/3063871858 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f16a002cbd0 con 0x7f16a80cf7a0 2023-11-24T06:17:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f169ffff640 1 -- 172.21.15.22:0/3063871858 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a00343f0 con 0x7f16a80cf7a0 2023-11-24T06:17:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f16ae4bb640 1 -- 172.21.15.22:0/3063871858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80cf7a0 msgr2=0x7f16a80cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/3063871858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80cf7a0 0x7f16a80cfc00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f16a808c9e0 tx=0x7f16a002bed0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f16ae4bb640 1 -- 172.21.15.22:0/3063871858 shutdown_connections 2023-11-24T06:17:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/3063871858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80cf7a0 0x7f16a80cfc00 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/3063871858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80d14a0 0x7f16a80d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/3063871858 >> v2:172.21.15.31:3300/0 conn(0x7f16a815d5b0 0x7f16a80d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f16ae4bb640 1 -- 172.21.15.22:0/3063871858 >> 172.21.15.22:0/3063871858 conn(0x7f16a809c3b0 msgr2=0x7f16a80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f16ae4bb640 1 -- 172.21.15.22:0/3063871858 shutdown_connections 2023-11-24T06:17:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.244+0000 7f16ae4bb640 1 -- 172.21.15.22:0/3063871858 wait complete. 2023-11-24T06:17:42.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.247+0000 7f16ae4bb640 1 Processor -- start 2023-11-24T06:17:42.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.247+0000 7f16ae4bb640 1 -- start start 2023-11-24T06:17:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.248+0000 7f16ae4bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80cf7a0 0x7f16a8149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.248+0000 7f16ae4bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80d14a0 0x7f16a814cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.248+0000 7f16ae4bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a815d5b0 0x7f16a80b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.248+0000 7f16ae4bb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80c93a0 con 0x7f16a80d14a0 2023-11-24T06:17:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.248+0000 7f16ae4bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80c9b70 con 0x7f16a815d5b0 2023-11-24T06:17:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.248+0000 7f16ae4bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80cb8b0 con 0x7f16a80cf7a0 2023-11-24T06:17:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16accb8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80d14a0 0x7f16a814cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16accb8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80d14a0 0x7f16a814cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41470/0 (socket says 172.21.15.22:41470) 2023-11-24T06:17:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16accb8640 1 -- 172.21.15.22:0/823651280 learned_addr learned my addr 172.21.15.22:0/823651280 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-11-24T06:17:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16adcba640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a815d5b0 0x7f16a80b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16ad4b9640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80cf7a0 0x7f16a8149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16accb8640 1 -- 172.21.15.22:0/823651280 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80cf7a0 msgr2=0x7f16a8149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16accb8640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80cf7a0 0x7f16a8149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16accb8640 1 -- 172.21.15.22:0/823651280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a815d5b0 msgr2=0x7f16a80b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16accb8640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a815d5b0 0x7f16a80b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16accb8640 1 -- 172.21.15.22:0/823651280 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a0009b30 con 0x7f16a80d14a0 2023-11-24T06:17:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.249+0000 7f16accb8640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80d14a0 0x7f16a814cc40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f169800d800 tx=0x7f169800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:42.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.250+0000 7f169dffb640 1 -- 172.21.15.22:0/823651280 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698009640 con 0x7f16a80d14a0 2023-11-24T06:17:42.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.250+0000 7f169dffb640 1 -- 172.21.15.22:0/823651280 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f16980097a0 con 0x7f16a80d14a0 2023-11-24T06:17:42.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.250+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a80c95b0 con 0x7f16a80d14a0 2023-11-24T06:17:42.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.250+0000 7f169dffb640 1 -- 172.21.15.22:0/823651280 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698009b50 con 0x7f16a80d14a0 2023-11-24T06:17:42.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.250+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a80cbb50 con 0x7f16a80d14a0 2023-11-24T06:17:42.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.251+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a804e840 con 0x7f16a80d14a0 2023-11-24T06:17:42.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.252+0000 7f169dffb640 1 -- 172.21.15.22:0/823651280 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1698009cb0 con 0x7f16a80d14a0 2023-11-24T06:17:42.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.253+0000 7f169dffb640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f168c06b020 0x7f168c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.253+0000 7f169dffb640 1 -- 172.21.15.22:0/823651280 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1698089d10 con 0x7f16a80d14a0 2023-11-24T06:17:42.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.254+0000 7f16ad4b9640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f168c06b020 0x7f168c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.254+0000 7f16ad4b9640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f168c06b020 0x7f168c06d4e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f16a4006fd0 tx=0x7f16a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:42.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.258+0000 7f169dffb640 1 -- 172.21.15.22:0/823651280 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1698054e40 con 0x7f16a80d14a0 2023-11-24T06:17:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.486+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16a80678d0 con 0x7f16a80d14a0 2023-11-24T06:17:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.486+0000 7f169dffb640 1 -- 172.21.15.22:0/823651280 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f169800b440 con 0x7f16a80d14a0 2023-11-24T06:17:42.489 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-11-24T06:17:42.489 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3364238617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3364238617},{"type":"v1","addr":"172.21.15.31:6835","nonce":3364238617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5539,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2881123182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2881123182},{"type":"v1","addr":"172.21.15.31:6834","nonce":2881123182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37},{"gid":6420,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/1299665813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1299665813},{"type":"v1","addr":"172.21.15.22:6836","nonce":1299665813}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1568499503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1568499503},{"type":"v1","addr":"172.21.15.22:6837","nonce":1568499503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[]} 2023-11-24T06:17:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 37 2023-11-24T06:17:42.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f168c06b020 msgr2=0x7f168c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f168c06b020 0x7f168c06d4e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f16a4006fd0 tx=0x7f16a4008040 comp rx=0 tx=0).stop 2023-11-24T06:17:42.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80d14a0 msgr2=0x7f16a814cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80d14a0 0x7f16a814cc40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f169800d800 tx=0x7f169800dcc0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 shutdown_connections 2023-11-24T06:17:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:6832/913263114,v1:172.21.15.22:6833/913263114] conn(0x7f168c06b020 0x7f168c06d4e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a815d5b0 0x7f16a80b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16a80d14a0 0x7f16a814cc40 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 --2- 172.21.15.22:0/823651280 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a80cf7a0 0x7f16a8149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 >> 172.21.15.22:0/823651280 conn(0x7f16a809c3b0 msgr2=0x7f16a80d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 shutdown_connections 2023-11-24T06:17:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-11-24T06:17:42.489+0000 7f16ae4bb640 1 -- 172.21.15.22:0/823651280 wait complete. 2023-11-24T06:17:42.510 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-24T06:17:42.510 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-24T06:17:42.511 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:17:42.511 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:42.527 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:17:42.527 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:17:42.527 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:42.596 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:17:42.596 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:17:42.596 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:42.620 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:17:42.621 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:17:42.621 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:42.686 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:17:42.687 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-24T06:17:42.687 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-24T06:17:42.687 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:42.736 INFO:tasks.ceph.osd.0:Stopped 2023-11-24T06:17:42.736 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-24T06:17:42.736 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:42.800 INFO:tasks.ceph.osd.1:Stopped 2023-11-24T06:17:42.801 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-24T06:17:42.801 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:42.853 INFO:tasks.ceph.osd.2:Stopped 2023-11-24T06:17:42.853 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-24T06:17:42.854 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:42.912 INFO:tasks.ceph.osd.3:Stopped 2023-11-24T06:17:42.912 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-24T06:17:42.913 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:42.962 INFO:tasks.ceph.osd.4:Stopped 2023-11-24T06:17:42.962 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-24T06:17:42.962 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:43.032 INFO:tasks.ceph.osd.5:Stopped 2023-11-24T06:17:43.032 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-24T06:17:43.032 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:43.108 INFO:tasks.ceph.osd.6:Stopped 2023-11-24T06:17:43.109 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-24T06:17:43.109 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:43.192 INFO:tasks.ceph.osd.7:Stopped 2023-11-24T06:17:43.192 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-24T06:17:43.192 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-24T06:17:43.192 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:43.263 INFO:tasks.ceph.mgr.y:Stopped 2023-11-24T06:17:43.263 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-24T06:17:43.263 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:43.340 INFO:tasks.ceph.mgr.x:Stopped 2023-11-24T06:17:43.341 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-24T06:17:43.341 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-24T06:17:43.341 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:43.392 INFO:tasks.ceph.mon.a:Stopped 2023-11-24T06:17:43.392 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-24T06:17:43.392 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:43.429 INFO:tasks.ceph.mon.b:Stopped 2023-11-24T06:17:43.430 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-24T06:17:43.430 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:43.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-24T06:17:43.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-24T06:17:43.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-24T06:17:43.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-24T06:17:43.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-24T06:17:43.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-24T06:17:43.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-24T06:17:43.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-24T06:17:43.516 INFO:tasks.ceph.mon.c:Stopped 2023-11-24T06:17:43.516 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-24T06:17:43.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-24T06:17:43.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:17:43.638 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-24T06:17:43.896 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:17:43.896 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-24T06:17:44.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:17:44.105 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-24T06:17:44.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:17:44.267 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-24T06:17:44.437 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:17:44.437 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-24T06:17:44.821 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:17:44.821 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-24T06:17:44.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:17:44.959 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-24T06:17:45.097 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:17:45.097 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-24T06:17:45.250 INFO:tasks.ceph:Archiving mon data... 2023-11-24T06:17:45.251 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/data/mon.a.tgz 2023-11-24T06:17:45.251 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2023-11-24T06:17:45.315 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.KL4TiRhzml 2023-11-24T06:17:45.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KL4TiRhzml 2023-11-24T06:17:45.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.KL4TiRhzml 2023-11-24T06:17:45.711 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.KL4TiRhzml is 540KB 2023-11-24T06:17:45.826 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.KL4TiRhzml 2023-11-24T06:17:45.890 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/data/mon.b.tgz 2023-11-24T06:17:45.891 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-11-24T06:17:45.946 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.zNa9pHxdQ5 2023-11-24T06:17:45.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.zNa9pHxdQ5 2023-11-24T06:17:46.218 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.zNa9pHxdQ5 2023-11-24T06:17:46.353 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.zNa9pHxdQ5 is 727KB 2023-11-24T06:17:46.459 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.zNa9pHxdQ5 2023-11-24T06:17:46.512 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/data/mon.c.tgz 2023-11-24T06:17:46.512 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-11-24T06:17:46.559 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.AdG7249MiX 2023-11-24T06:17:46.559 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.AdG7249MiX 2023-11-24T06:17:46.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.AdG7249MiX 2023-11-24T06:17:46.979 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.AdG7249MiX is 727KB 2023-11-24T06:17:47.088 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.AdG7249MiX 2023-11-24T06:17:47.147 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-24T06:17:47.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T06:17:47.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T06:17:47.260 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-24T06:17:47.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T06:17:47.266 DEBUG:teuthology.orchestra.run.smithi031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T06:17:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T06:17:47.380 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T06:17:47.393 INFO:tasks.ceph:Archiving crash dumps... 2023-11-24T06:17:47.394 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/remote/smithi022/crash 2023-11-24T06:17:47.395 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T06:17:47.482 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/remote/smithi031/crash 2023-11-24T06:17:47.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T06:17:47.590 INFO:tasks.ceph:Shutting down logrotate 2023-11-24T06:17:47.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:47.600 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:47.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:47.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:47.981 INFO:tasks.ceph:Compressing logs... 2023-11-24T06:17:47.981 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T06:17:47.991 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T06:17:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93537.log 2023-11-24T06:17:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100579.log 2023-11-24T06:17:48.088 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93537.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93537.log.gz 2023-11-24T06:17:48.088 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111941.log 2023-11-24T06:17:48.089 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100579.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100579.log.gz 2023-11-24T06:17:48.090 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94298.log 2023-11-24T06:17:48.091 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-24T06:17:48.091 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111941.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111941.log.gz 2023-11-24T06:17:48.092 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103550.log 2023-11-24T06:17:48.097 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94556.log 2023-11-24T06:17:48.097 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88751.log 2023-11-24T06:17:48.097 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.3.94556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88591.log 2023-11-24T06:17:48.098 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88751.log: 91.4% -- replaced with /var/log/ceph/ceph-client.3.94556.log.gz 2023-11-24T06:17:48.098 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88751.log.gz 2023-11-24T06:17:48.098 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95933.log 2023-11-24T06:17:48.099 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88591.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88591.log.gz 2023-11-24T06:17:48.099 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88671.log 2023-11-24T06:17:48.101 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100803.log 2023-11-24T06:17:48.101 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94298.log.gz 2023-11-24T06:17:48.101 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97275.log 2023-11-24T06:17:48.101 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103550.log.gz 2023-11-24T06:17:48.101 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100803.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100803.log.gz 2023-11-24T06:17:48.101 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108684.log 2023-11-24T06:17:48.101 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97275.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-24T06:17:48.102 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97275.log.gz 2023-11-24T06:17:48.102 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101747.log 2023-11-24T06:17:48.102 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108684.log.gz 2023-11-24T06:17:48.102 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102616.log 2023-11-24T06:17:48.102 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101747.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101747.log.gz 2023-11-24T06:17:48.102 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97724.log 2023-11-24T06:17:48.105 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102616.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102616.log.gz 2023-11-24T06:17:48.105 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108856.log 2023-11-24T06:17:48.105 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97724.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97724.log.gz 2023-11-24T06:17:48.105 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107676.log 2023-11-24T06:17:48.105 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108856.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108856.log.gz 2023-11-24T06:17:48.105 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103848.log 2023-11-24T06:17:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.1.95933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88631.log 2023-11-24T06:17:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88671.log: 90.9% -- replaced with /var/log/ceph/ceph-client.1.95933.log.gz 2023-11-24T06:17:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88791.log 2023-11-24T06:17:48.107 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88671.log.gz 2023-11-24T06:17:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88631.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.88631.log.gz 2023-11-24T06:17:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T06:17:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88791.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-24T06:17:48.108 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88791.log.gz 2023-11-24T06:17:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-24T06:17:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88711.log 2023-11-24T06:17:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.4.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T06:17:48.108 INFO:teuthology.orchestra.run.smithi031.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-24T06:17:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96737.log 2023-11-24T06:17:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95278.log 2023-11-24T06:17:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88711.log: /var/log/ceph/ceph-client.1.96737.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88711.log.gz 2023-11-24T06:17:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-24T06:17:48.111 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.1.96737.log.gz 2023-11-24T06:17:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.1.95278.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-24T06:17:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.7.log: 89.6% -- replaced with /var/log/ceph/ceph-client.1.95278.log.gz 2023-11-24T06:17:48.113 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107676.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107676.log.gz 2023-11-24T06:17:48.113 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92935.log 2023-11-24T06:17:48.113 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103848.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103848.log.gz 2023-11-24T06:17:48.114 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99978.log 2023-11-24T06:17:48.114 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.92935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108259.log 2023-11-24T06:17:48.114 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92935.log.gz 2023-11-24T06:17:48.114 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106027.log 2023-11-24T06:17:48.114 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99978.log.gz 2023-11-24T06:17:48.114 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108259.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108259.log.gz 2023-11-24T06:17:48.114 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103933.log 2023-11-24T06:17:48.115 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94307.log 2023-11-24T06:17:48.115 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106027.log.gz 2023-11-24T06:17:48.115 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110975.log 2023-11-24T06:17:48.115 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103933.log.gz 2023-11-24T06:17:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-24T06:17:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T06:17:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94052.log 2023-11-24T06:17:48.119 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94307.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94307.log.gz 2023-11-24T06:17:48.119 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95049.log 2023-11-24T06:17:48.119 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108600.log 2023-11-24T06:17:48.119 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110975.log.gz 2023-11-24T06:17:48.119 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100707.log 2023-11-24T06:17:48.120 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95049.log.gz 2023-11-24T06:17:48.120 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109444.log 2023-11-24T06:17:48.120 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108600.log.gz 2023-11-24T06:17:48.120 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102532.log 2023-11-24T06:17:48.120 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100707.log.gz 2023-11-24T06:17:48.122 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-24T06:17:48.122 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.1.94052.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T06:17:48.122 INFO:teuthology.orchestra.run.smithi031.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.1.94052.log.gz 2023-11-24T06:17:48.122 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88831.log 2023-11-24T06:17:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110522.log 2023-11-24T06:17:48.123 INFO:teuthology.orchestra.run.smithi022.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.109444.log.gz 2023-11-24T06:17:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102532.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102532.log.gz 2023-11-24T06:17:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98364.log 2023-11-24T06:17:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99330.log 2023-11-24T06:17:48.124 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110522.log.gz 2023-11-24T06:17:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102490.log 2023-11-24T06:17:48.126 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98364.log.gz 2023-11-24T06:17:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95403.log 2023-11-24T06:17:48.126 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99330.log.gz 2023-11-24T06:17:48.127 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88831.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-24T06:17:48.127 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88831.log.gz 2023-11-24T06:17:48.127 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- 93.6% /var/log/ceph/ceph-client.admin.88551.log 2023-11-24T06:17:48.127 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-24T06:17:48.127 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-24T06:17:48.130 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111467.log 2023-11-24T06:17:48.131 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102490.log.gz 2023-11-24T06:17:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106741.log 2023-11-24T06:17:48.131 INFO:teuthology.orchestra.run.smithi022.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.95403.log.gz 2023-11-24T06:17:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111467.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111467.log.gz 2023-11-24T06:17:48.132 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99834.log 2023-11-24T06:17:48.132 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102733.log 2023-11-24T06:17:48.132 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106741.log.gz 2023-11-24T06:17:48.133 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.88551.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88551.log.gz 2023-11-24T06:17:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92850.log 2023-11-24T06:17:48.136 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99834.log.gz 2023-11-24T06:17:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102733.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.102733.log.gz 2023-11-24T06:17:48.136 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108396.log 2023-11-24T06:17:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.92850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106989.log 2023-11-24T06:17:48.137 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92850.log.gz 2023-11-24T06:17:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105781.log 2023-11-24T06:17:48.137 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108396.log.gz 2023-11-24T06:17:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106989.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106989.log.gz 2023-11-24T06:17:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112380.log 2023-11-24T06:17:48.138 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93705.log 2023-11-24T06:17:48.139 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105781.log.gz 2023-11-24T06:17:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103153.log 2023-11-24T06:17:48.139 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112380.log.gz 2023-11-24T06:17:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93705.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93705.log.gz 2023-11-24T06:17:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98916.log 2023-11-24T06:17:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96981.log 2023-11-24T06:17:48.141 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103153.log.gz 2023-11-24T06:17:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103111.log 2023-11-24T06:17:48.142 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98916.log.gz 2023-11-24T06:17:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96981.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96981.log.gz 2023-11-24T06:17:48.143 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.c.log: 90.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-24T06:17:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92673.log 2023-11-24T06:17:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97233.log 2023-11-24T06:17:48.144 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103111.log.gz 2023-11-24T06:17:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.92673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110933.log 2023-11-24T06:17:48.145 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92673.log.gz 2023-11-24T06:17:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97233.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97233.log.gz 2023-11-24T06:17:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108558.log 2023-11-24T06:17:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110933.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.110933.log.gz 2023-11-24T06:17:48.148 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.109108.log 2023-11-24T06:17:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108558.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108558.log.gz 2023-11-24T06:17:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100537.log 2023-11-24T06:17:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105287.log 2023-11-24T06:17:48.151 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109108.log.gz 2023-11-24T06:17:48.152 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93747.log 2023-11-24T06:17:48.152 INFO:teuthology.orchestra.run.smithi022.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.100537.log.gz 2023-11-24T06:17:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105287.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105287.log.gz 2023-11-24T06:17:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94965.log 2023-11-24T06:17:48.154 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107317.log 2023-11-24T06:17:48.154 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93747.log.gz 2023-11-24T06:17:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99078.log 2023-11-24T06:17:48.156 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94965.log.gz 2023-11-24T06:17:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107317.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107317.log.gz 2023-11-24T06:17:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109024.log 2023-11-24T06:17:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110639.log 2023-11-24T06:17:48.158 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99078.log.gz 2023-11-24T06:17:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106413.log 2023-11-24T06:17:48.160 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109024.log.gz 2023-11-24T06:17:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110639.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110639.log.gz 2023-11-24T06:17:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103424.log 2023-11-24T06:17:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103508.log 2023-11-24T06:17:48.162 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106413.log.gz 2023-11-24T06:17:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107886.log 2023-11-24T06:17:48.163 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103424.log.gz 2023-11-24T06:17:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103508.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103508.log.gz 2023-11-24T06:17:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103645.log 2023-11-24T06:17:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105513.log 2023-11-24T06:17:48.165 INFO:teuthology.orchestra.run.smithi022.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.107886.log.gz 2023-11-24T06:17:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100369.log 2023-11-24T06:17:48.167 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103645.log.gz 2023-11-24T06:17:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105513.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105513.log.gz 2023-11-24T06:17:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111101.log 2023-11-24T06:17:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102817.log 2023-11-24T06:17:48.169 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100369.log.gz 2023-11-24T06:17:48.170 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93957.log 2023-11-24T06:17:48.170 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111101.log.gz 2023-11-24T06:17:48.171 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102817.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102817.log.gz 2023-11-24T06:17:48.171 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104155.log 2023-11-24T06:17:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105901.log 2023-11-24T06:17:48.172 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93957.log.gz 2023-11-24T06:17:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104155.log: gzip -5 --verbose 87.9% -- -- replaced with /var/log/ceph/ceph-client.admin.104155.log.gz /var/log/ceph/ceph-client.admin.112340.log 2023-11-24T06:17:48.173 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-11-24T06:17:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98280.log 2023-11-24T06:17:48.175 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105901.log.gz 2023-11-24T06:17:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112340.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112340.log.gz 2023-11-24T06:17:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92563.log 2023-11-24T06:17:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102901.log 2023-11-24T06:17:48.177 INFO:teuthology.orchestra.run.smithi022.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98280.log.gz 2023-11-24T06:17:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.92563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104241.log 2023-11-24T06:17:48.178 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92563.log.gz 2023-11-24T06:17:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102901.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102901.log.gz 2023-11-24T06:17:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104197.log 2023-11-24T06:17:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104325.log 2023-11-24T06:17:48.181 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104241.log.gz 2023-11-24T06:17:48.182 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102147.log 2023-11-24T06:17:48.182 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104197.log.gz 2023-11-24T06:17:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104325.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104325.log.gz 2023-11-24T06:17:48.183 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112025.log 2023-11-24T06:17:48.185 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106069.log 2023-11-24T06:17:48.185 INFO:teuthology.orchestra.run.smithi022.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102147.log.gz 2023-11-24T06:17:48.186 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97766.log 2023-11-24T06:17:48.186 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112025.log.gz 2023-11-24T06:17:48.187 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104451.log 2023-11-24T06:17:48.187 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106069.log.gz 2023-11-24T06:17:48.188 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97766.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97766.log.gz 2023-11-24T06:17:48.189 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110276.log 2023-11-24T06:17:48.190 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103466.log 2023-11-24T06:17:48.190 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104451.log.gz 2023-11-24T06:17:48.191 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102244.log 2023-11-24T06:17:48.191 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110276.log.gz 2023-11-24T06:17:48.192 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111731.log 2023-11-24T06:17:48.192 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103466.log.gz 2023-11-24T06:17:48.193 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102244.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102244.log.gz 2023-11-24T06:17:48.193 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104721.log 2023-11-24T06:17:48.194 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89076.log 2023-11-24T06:17:48.195 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111731.log.gz 2023-11-24T06:17:48.195 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98196.log 2023-11-24T06:17:48.196 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.89076.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.104721.log.gz 2023-11-24T06:17:48.197 INFO:teuthology.orchestra.run.smithi022.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.89076.log.gz 2023-11-24T06:17:48.197 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100971.log 2023-11-24T06:17:48.198 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98196.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98196.log.gz 2023-11-24T06:17:48.198 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93285.log 2023-11-24T06:17:48.199 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111185.log 2023-11-24T06:17:48.200 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100971.log.gz 2023-11-24T06:17:48.201 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102658.log 2023-11-24T06:17:48.201 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93285.log.gz 2023-11-24T06:17:48.202 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111185.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.111185.log.gz --verbose 2023-11-24T06:17:48.202 INFO:teuthology.orchestra.run.smithi022.stderr: -- /var/log/ceph/ceph-client.admin.104553.log 2023-11-24T06:17:48.203 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110396.log 2023-11-24T06:17:48.203 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102658.log.gz 2023-11-24T06:17:48.204 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95505.log 2023-11-24T06:17:48.205 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104553.log.gz 2023-11-24T06:17:48.205 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110891.log 2023-11-24T06:17:48.206 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110396.log.gz 2023-11-24T06:17:48.207 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95505.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95505.log.gz 2023-11-24T06:17:48.207 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97485.log 2023-11-24T06:17:48.208 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97850.log 2023-11-24T06:17:48.209 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110891.log.gz 2023-11-24T06:17:48.210 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99792.log 2023-11-24T06:17:48.210 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97485.log.gz 2023-11-24T06:17:48.211 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97850.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97850.log.gz 2023-11-24T06:17:48.211 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110681.log 2023-11-24T06:17:48.212 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93369.log 2023-11-24T06:17:48.212 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99792.log.gz 2023-11-24T06:17:48.213 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97191.log 2023-11-24T06:17:48.213 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110681.log.gz 2023-11-24T06:17:48.214 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93369.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93369.log.gz 2023-11-24T06:17:48.215 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100453.log 2023-11-24T06:17:48.216 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109360.log 2023-11-24T06:17:48.216 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97191.log.gz 2023-11-24T06:17:48.217 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101831.log 2023-11-24T06:17:48.217 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100453.log.gz 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109360.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109360.log.gz 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103975.log 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101831.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101831.log.gz 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93960.log 2023-11-24T06:17:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109066.log 2023-11-24T06:17:48.221 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103975.log.gz 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102775.log 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93960.log.gz 2023-11-24T06:17:48.223 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109066.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109066.log.gz 2023-11-24T06:17:48.224 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111143.log 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99708.log 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102775.log.gz 2023-11-24T06:17:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99582.log 2023-11-24T06:17:48.227 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111143.log.gz 2023-11-24T06:17:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99708.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99708.log.gz 2023-11-24T06:17:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99162.log 2023-11-24T06:17:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96813.log 2023-11-24T06:17:48.229 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99582.log.gz 2023-11-24T06:17:48.229 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106803.log 2023-11-24T06:17:48.230 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99162.log.gz 2023-11-24T06:17:48.231 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96813.log: gzip -5 89.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.96813.log.gz -- 2023-11-24T06:17:48.231 INFO:teuthology.orchestra.run.smithi022.stderr: /var/log/ceph/ceph-client.admin.107131.log 2023-11-24T06:17:48.232 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112151.log 2023-11-24T06:17:48.232 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106803.log.gz 2023-11-24T06:17:48.233 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107131.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107131.log.gz 2023-11-24T06:17:48.234 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103340.log 2023-11-24T06:17:48.235 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112151.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112151.log.gz 2023-11-24T06:17:48.236 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98874.log 2023-11-24T06:17:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107997.log 2023-11-24T06:17:48.237 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103340.log.gz 2023-11-24T06:17:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94542.log 2023-11-24T06:17:48.238 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98874.log.gz 2023-11-24T06:17:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107997.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107997.log.gz 2023-11-24T06:17:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96939.log 2023-11-24T06:17:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94542.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94542.log.gz 2023-11-24T06:17:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94288.log 2023-11-24T06:17:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96939.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96939.log.gz 2023-11-24T06:17:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101789.log 2023-11-24T06:17:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94288.log: gzip -5 89.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.94288.log.gz -- 2023-11-24T06:17:48.244 INFO:teuthology.orchestra.run.smithi022.stderr: /var/log/ceph/ceph-client.admin.110564.log 2023-11-24T06:17:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101789.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101789.log.gz 2023-11-24T06:17:48.246 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107844.log 2023-11-24T06:17:48.247 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110564.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110564.log.gz 2023-11-24T06:17:48.247 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95193.log 2023-11-24T06:17:48.248 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107844.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107844.log.gz 2023-11-24T06:17:48.248 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100495.log 2023-11-24T06:17:48.249 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111604.log 2023-11-24T06:17:48.250 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95193.log.gz 2023-11-24T06:17:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100495.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100495.log.gz 2023-11-24T06:17:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97065.log 2023-11-24T06:17:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111604.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111604.log.gz 2023-11-24T06:17:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T06:17:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96771.log 2023-11-24T06:17:48.253 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97065.log.gz 2023-11-24T06:17:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98958.log 2023-11-24T06:17:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96771.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96771.log.gz 2023-11-24T06:17:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111857.log 2023-11-24T06:17:48.256 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T06:17:48.257 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93019.log 2023-11-24T06:17:48.257 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98958.log.gz 2023-11-24T06:17:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111857.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111857.log.gz 2023-11-24T06:17:48.259 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108814.log 2023-11-24T06:17:48.260 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106927.log 2023-11-24T06:17:48.260 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93019.log.gz 2023-11-24T06:17:48.261 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108814.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108814.log.gz 2023-11-24T06:17:48.261 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109276.log 2023-11-24T06:17:48.262 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106927.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106927.log.gz 2023-11-24T06:17:48.262 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98154.log 2023-11-24T06:17:48.264 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108049.log 2023-11-24T06:17:48.264 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109276.log.gz 2023-11-24T06:17:48.265 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98154.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98154.log.gz 2023-11-24T06:17:48.265 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98490.log 2023-11-24T06:17:48.266 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108049.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108049.log.gz 2023-11-24T06:17:48.267 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101705.log 2023-11-24T06:17:48.267 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98034.log 2023-11-24T06:17:48.268 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98490.log.gz 2023-11-24T06:17:48.269 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.96431.log 2023-11-24T06:17:48.269 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101705.log.gz 2023-11-24T06:17:48.270 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98034.log: gzip 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.98034.log.gz -- 2023-11-24T06:17:48.270 INFO:teuthology.orchestra.run.smithi022.stderr: /var/log/ceph/ceph-client.admin.97359.log 2023-11-24T06:17:48.271 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.2.96431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94535.log 2023-11-24T06:17:48.272 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97359.log: 92.0% -- replaced with /var/log/ceph/ceph-client.2.96431.log.gz 2023-11-24T06:17:48.272 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103069.log 2023-11-24T06:17:48.273 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97359.log.gz 2023-11-24T06:17:48.273 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94535.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94535.log.gz 2023-11-24T06:17:48.274 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105739.log 2023-11-24T06:17:48.275 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111059.log 2023-11-24T06:17:48.275 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103069.log.gz 2023-11-24T06:17:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96535.log 2023-11-24T06:17:48.276 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105739.log.gz 2023-11-24T06:17:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111059.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111059.log.gz 2023-11-24T06:17:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108091.log 2023-11-24T06:17:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96577.log 2023-11-24T06:17:48.278 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96535.log.gz 2023-11-24T06:17:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105555.log 2023-11-24T06:17:48.280 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108091.log.gz 2023-11-24T06:17:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96577.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96577.log.gz 2023-11-24T06:17:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111509.log 2023-11-24T06:17:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105555.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105555.log.gz 2023-11-24T06:17:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96687.log 2023-11-24T06:17:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95319.log 2023-11-24T06:17:48.284 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111509.log.gz 2023-11-24T06:17:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94304.log 2023-11-24T06:17:48.285 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96687.log.gz 2023-11-24T06:17:48.286 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106537.log 2023-11-24T06:17:48.286 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95319.log.gz 2023-11-24T06:17:48.287 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94304.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94304.log.gz 2023-11-24T06:17:48.287 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112277.log 2023-11-24T06:17:48.288 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93967.log 2023-11-24T06:17:48.288 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106537.log.gz 2023-11-24T06:17:48.289 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108175.log 2023-11-24T06:17:48.289 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112277.log.gz 2023-11-24T06:17:48.290 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93967.log: gzip -5 87.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.93967.log.gz -- 2023-11-24T06:17:48.290 INFO:teuthology.orchestra.run.smithi022.stderr: /var/log/ceph/ceph-client.admin.110192.log 2023-11-24T06:17:48.291 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98606.log 2023-11-24T06:17:48.292 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108175.log.gz 2023-11-24T06:17:48.292 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102328.log 2023-11-24T06:17:48.293 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110192.log.gz 2023-11-24T06:17:48.293 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99540.log 2023-11-24T06:17:48.294 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98606.log.gz 2023-11-24T06:17:48.294 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94797.log 2023-11-24T06:17:48.295 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102328.log.gz 2023-11-24T06:17:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99540.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99540.log.gz -5 2023-11-24T06:17:48.296 INFO:teuthology.orchestra.run.smithi022.stderr: --verbose -- /var/log/ceph/ceph-client.admin.110234.log 2023-11-24T06:17:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96041.log 2023-11-24T06:17:48.297 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94797.log.gz 2023-11-24T06:17:48.298 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98532.log 2023-11-24T06:17:48.298 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110234.log.gz 2023-11-24T06:17:48.299 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111815.log 2023-11-24T06:17:48.299 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96041.log.gz 2023-11-24T06:17:48.300 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106865.log 2023-11-24T06:17:48.301 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98532.log.gz 2023-11-24T06:17:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111815.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111815.log.gz 2023-11-24T06:17:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110318.log 2023-11-24T06:17:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111689.log 2023-11-24T06:17:48.303 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106865.log.gz 2023-11-24T06:17:48.304 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103256.log 2023-11-24T06:17:48.304 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110318.log.gz 2023-11-24T06:17:48.305 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104595.log 2023-11-24T06:17:48.305 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111689.log.gz 2023-11-24T06:17:48.306 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103256.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103256.log.gz 2023-11-24T06:17:48.307 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100663.log 2023-11-24T06:17:48.307 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104787.log 2023-11-24T06:17:48.308 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104595.log.gz 2023-11-24T06:17:48.309 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100887.log 2023-11-24T06:17:48.309 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100663.log.gz 2023-11-24T06:17:48.310 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104787.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104787.log.gz 2023-11-24T06:17:48.310 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110849.log 2023-11-24T06:17:48.311 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102412.log 2023-11-24T06:17:48.311 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100887.log.gz 2023-11-24T06:17:48.312 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102859.log 2023-11-24T06:17:48.312 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110849.log.gz 2023-11-24T06:17:48.313 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97527.log 2023-11-24T06:17:48.314 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102412.log.gz 2023-11-24T06:17:48.314 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102859.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102859.log.gz 2023-11-24T06:17:48.315 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108898.log 2023-11-24T06:17:48.316 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104019.log 2023-11-24T06:17:48.316 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97527.log.gz 2023-11-24T06:17:48.317 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93453.log 2023-11-24T06:17:48.317 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108898.log.gz 2023-11-24T06:17:48.318 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104019.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104019.log.gz 2023-11-24T06:17:48.318 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97317.log 2023-11-24T06:17:48.319 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93579.log 2023-11-24T06:17:48.320 INFO:teuthology.orchestra.run.smithi031.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-24T06:17:48.320 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93453.log.gz 2023-11-24T06:17:48.321 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97317.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-24T06:17:48.321 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97317.log.gz 2023-11-24T06:17:48.321 INFO:teuthology.orchestra.run.smithi031.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-24T06:17:48.322 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104409.log 2023-11-24T06:17:48.322 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93579.log.gz 2023-11-24T06:17:48.323 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97908.log 2023-11-24T06:17:48.324 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99876.log 2023-11-24T06:17:48.324 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104409.log.gz 2023-11-24T06:17:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97908.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97908.log.gz 2023-11-24T06:17:48.326 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103298.log 2023-11-24T06:17:48.326 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105859.log 2023-11-24T06:17:48.327 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99876.log.gz 2023-11-24T06:17:48.328 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103298.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103298.log.gz 2023-11-24T06:17:48.328 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105655.log 2023-11-24T06:17:48.329 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96897.log 2023-11-24T06:17:48.329 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105859.log.gz 2023-11-24T06:17:48.330 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105655.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105655.log.gz 2023-11-24T06:17:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107760.log 2023-11-24T06:17:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111552.log 2023-11-24T06:17:48.332 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96897.log.gz 2023-11-24T06:17:48.333 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107760.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107760.log.gz 2023-11-24T06:17:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111017.log 2023-11-24T06:17:48.335 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103213.log 2023-11-24T06:17:48.335 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111552.log.gz 2023-11-24T06:17:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111017.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111017.log.gz 2023-11-24T06:17:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100751.log 2023-11-24T06:17:48.338 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109927.log 2023-11-24T06:17:48.338 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103213.log.gz 2023-11-24T06:17:48.340 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100751.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100751.log.gz 2023-11-24T06:17:48.340 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110480.log 2023-11-24T06:17:48.340 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105245.log 2023-11-24T06:17:48.340 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109927.log.gz 2023-11-24T06:17:48.343 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110480.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110480.log.gz 2023-11-24T06:17:48.343 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94543.log 2023-11-24T06:17:48.343 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100845.log 2023-11-24T06:17:48.343 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105245.log.gz 2023-11-24T06:17:48.345 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94543.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.94543.log.gz /var/log/ceph/ceph-client.admin.93149.log 2023-11-24T06:17:48.346 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-11-24T06:17:48.346 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98690.log 2023-11-24T06:17:48.346 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100845.log.gz 2023-11-24T06:17:48.349 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93149.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93149.log.gz 2023-11-24T06:17:48.349 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102985.log 2023-11-24T06:17:48.349 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107936.log 2023-11-24T06:17:48.349 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98690.log.gz 2023-11-24T06:17:48.350 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102985.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102985.log.gz 2023-11-24T06:17:48.350 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105429.log 2023-11-24T06:17:48.353 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110723.log 2023-11-24T06:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107936.log.gz 2023-11-24T06:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105429.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105429.log.gz 2023-11-24T06:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103725.log 2023-11-24T06:17:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97808.log 2023-11-24T06:17:48.355 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110723.log.gz 2023-11-24T06:17:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103725.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103725.log.gz 2023-11-24T06:17:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107193.log 2023-11-24T06:17:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100021.log 2023-11-24T06:17:48.358 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97808.log.gz 2023-11-24T06:17:48.359 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107193.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107193.log.gz 2023-11-24T06:17:48.359 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101566.log 2023-11-24T06:17:48.359 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110150.log 2023-11-24T06:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100021.log.gz 2023-11-24T06:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.101566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110438.log 2023-11-24T06:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110150.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110150.log.gz -5 2023-11-24T06:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104367.log 2023-11-24T06:17:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97682.log 2023-11-24T06:17:48.363 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110438.log.gz 2023-11-24T06:17:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107255.log 2023-11-24T06:17:48.365 INFO:teuthology.orchestra.run.smithi022.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.0.101566.log.gz 2023-11-24T06:17:48.365 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104367.log.gz 2023-11-24T06:17:48.366 INFO:teuthology.orchestra.run.smithi031.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-24T06:17:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109510.log 2023-11-24T06:17:48.367 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97682.log.gz 2023-11-24T06:17:48.367 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107255.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107255.log.gz 2023-11-24T06:17:48.367 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96855.log 2023-11-24T06:17:48.368 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103027.log 2023-11-24T06:17:48.368 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109510.log.gz 2023-11-24T06:17:48.369 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96855.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96855.log.gz 2023-11-24T06:17:48.369 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99246.log 2023-11-24T06:17:48.370 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100327.log 2023-11-24T06:17:48.371 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103027.log.gz 2023-11-24T06:17:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99246.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99246.log.gz 2023-11-24T06:17:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99498.log 2023-11-24T06:17:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102943.log 2023-11-24T06:17:48.373 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100327.log.gz 2023-11-24T06:17:48.374 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99498.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99498.log.gz 2023-11-24T06:17:48.374 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94291.log 2023-11-24T06:17:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106297.log 2023-11-24T06:17:48.376 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102943.log.gz 2023-11-24T06:17:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94291.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94291.log.gz 2023-11-24T06:17:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105387.log 2023-11-24T06:17:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93970.log 2023-11-24T06:17:48.378 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106297.log.gz 2023-11-24T06:17:48.379 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105387.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105387.log.gz 2023-11-24T06:17:48.380 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-24T06:17:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101947.log 2023-11-24T06:17:48.381 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93970.log.gz 2023-11-24T06:17:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111773.log 2023-11-24T06:17:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101947.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101947.log.gz 2023-11-24T06:17:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88946.log 2023-11-24T06:17:48.386 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112067.log 2023-11-24T06:17:48.386 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111773.log.gz 2023-11-24T06:17:48.387 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.88946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105471.log 2023-11-24T06:17:48.387 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88946.log.gz 2023-11-24T06:17:48.389 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112067.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112067.log.gz 2023-11-24T06:17:48.389 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100143.log 2023-11-24T06:17:48.391 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102003.log 2023-11-24T06:17:48.391 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105471.log.gz 2023-11-24T06:17:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100143.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100143.log.gz 2023-11-24T06:17:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106661.log 2023-11-24T06:17:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109192.log 2023-11-24T06:17:48.394 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102003.log.gz 2023-11-24T06:17:48.395 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109150.log 2023-11-24T06:17:48.396 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106661.log.gz 2023-11-24T06:17:48.397 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109192.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.101013.log 2023-11-24T06:17:48.397 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109192.log.gz 2023-11-24T06:17:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88692.log 2023-11-24T06:17:48.399 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109150.log.gz 2023-11-24T06:17:48.399 INFO:teuthology.orchestra.run.smithi031.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-24T06:17:48.400 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101181.log 2023-11-24T06:17:48.400 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101013.log.gz 2023-11-24T06:17:48.402 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.88692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99120.log 2023-11-24T06:17:48.402 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88692.log.gz 2023-11-24T06:17:48.403 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93495.log 2023-11-24T06:17:48.403 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101181.log.gz 2023-11-24T06:17:48.405 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108217.log 2023-11-24T06:17:48.405 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99120.log.gz 2023-11-24T06:17:48.406 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100063.log 2023-11-24T06:17:48.407 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93495.log.gz 2023-11-24T06:17:48.408 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98406.log 2023-11-24T06:17:48.409 INFO:teuthology.orchestra.run.smithi022.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108217.log.gz 2023-11-24T06:17:48.410 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98238.log 2023-11-24T06:17:48.410 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100063.log.gz 2023-11-24T06:17:48.411 INFO:teuthology.orchestra.run.smithi031.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-24T06:17:48.412 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105613.log 2023-11-24T06:17:48.413 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98406.log.gz 2023-11-24T06:17:48.414 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98238.log: gzip 88.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.98238.log.gz -- 2023-11-24T06:17:48.414 INFO:teuthology.orchestra.run.smithi022.stderr: /var/log/ceph/ceph-client.admin.109234.log 2023-11-24T06:17:48.415 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104637.log 2023-11-24T06:17:48.416 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105613.log.gz 2023-11-24T06:17:48.417 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99414.log 2023-11-24T06:17:48.417 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109234.log.gz 2023-11-24T06:17:48.418 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104637.log: gzip 88.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.104637.log.gz -- 2023-11-24T06:17:48.418 INFO:teuthology.orchestra.run.smithi022.stderr: /var/log/ceph/ceph-client.admin.93961.log 2023-11-24T06:17:48.419 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95007.log 2023-11-24T06:17:48.420 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99414.log.gz 2023-11-24T06:17:48.421 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94305.log 2023-11-24T06:17:48.421 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93961.log.gz 2023-11-24T06:17:48.422 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99204.log 2023-11-24T06:17:48.423 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95007.log.gz 2023-11-24T06:17:48.424 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110807.log 2023-11-24T06:17:48.425 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94305.log.gz 2023-11-24T06:17:48.426 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99666.log 2023-11-24T06:17:48.426 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99204.log.gz 2023-11-24T06:17:48.427 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102064.log 2023-11-24T06:17:48.427 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110807.log.gz 2023-11-24T06:17:48.429 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93789.log 2023-11-24T06:17:48.429 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99666.log.gz 2023-11-24T06:17:48.430 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92892.log 2023-11-24T06:17:48.431 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102064.log.gz 2023-11-24T06:17:48.432 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101097.log 2023-11-24T06:17:48.432 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93789.log.gz 2023-11-24T06:17:48.433 INFO:teuthology.orchestra.run.smithi031.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-24T06:17:48.434 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.92892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105203.log 2023-11-24T06:17:48.434 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92892.log.gz 2023-11-24T06:17:48.435 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98322.log 2023-11-24T06:17:48.436 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101097.log.gz 2023-11-24T06:17:48.437 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-11-24T06:17:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m0.391s 2023-11-24T06:17:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m1.528s 2023-11-24T06:17:48.437 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m0.255s 2023-11-24T06:17:48.439 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105203.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105203.log.gz 2023-11-24T06:17:48.439 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98774.log 2023-11-24T06:17:48.440 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98322.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98322.log.gz 2023-11-24T06:17:48.440 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106599.log 2023-11-24T06:17:48.441 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100929.log 2023-11-24T06:17:48.442 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98774.log.gz 2023-11-24T06:17:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106599.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106599.log.gz -5 2023-11-24T06:17:48.443 INFO:teuthology.orchestra.run.smithi022.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94668.log 2023-11-24T06:17:48.444 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102370.log 2023-11-24T06:17:48.445 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100929.log.gz 2023-11-24T06:17:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94668.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94668.log.gz 2023-11-24T06:17:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-24T06:17:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102370.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.102370.log.gz -- 2023-11-24T06:17:48.448 INFO:teuthology.orchestra.run.smithi022.stderr: /var/log/ceph/ceph-client.admin.94839.log 2023-11-24T06:17:48.449 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107466.log 2023-11-24T06:17:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94839.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94839.log.gz 2023-11-24T06:17:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98732.log 2023-11-24T06:17:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111983.log 2023-11-24T06:17:48.456 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107466.log.gz 2023-11-24T06:17:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111899.log 2023-11-24T06:17:48.456 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98732.log.gz 2023-11-24T06:17:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104063.log 2023-11-24T06:17:48.457 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111983.log.gz 2023-11-24T06:17:48.458 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111899.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.111899.log.gz --verbose 2023-11-24T06:17:48.458 INFO:teuthology.orchestra.run.smithi022.stderr: -- /var/log/ceph/ceph-client.admin.97992.log 2023-11-24T06:17:48.459 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92977.log 2023-11-24T06:17:48.459 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104063.log.gz 2023-11-24T06:17:48.460 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97992.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97992.log.gz 2023-11-24T06:17:48.460 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93199.log 2023-11-24T06:17:48.461 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.92977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98832.log 2023-11-24T06:17:48.461 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92977.log.gz 2023-11-24T06:17:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93199.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93199.log.gz 2023-11-24T06:17:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99624.log 2023-11-24T06:17:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93955.log 2023-11-24T06:17:48.465 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98832.log.gz 2023-11-24T06:17:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99624.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99624.log.gz 2023-11-24T06:17:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108940.log 2023-11-24T06:17:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97149.log 2023-11-24T06:17:48.468 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93955.log.gz 2023-11-24T06:17:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108940.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108940.log.gz 2023-11-24T06:17:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95277.log 2023-11-24T06:17:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95937.log 2023-11-24T06:17:48.471 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97149.log.gz 2023-11-24T06:17:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95277.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95277.log.gz 2023-11-24T06:17:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108476.log 2023-11-24T06:17:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.95937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107508.log 2023-11-24T06:17:48.474 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108476.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.95937.log.gz 2023-11-24T06:17:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose 87.5% -- /var/log/ceph/ceph-client.admin.112193.log -- replaced with /var/log/ceph/ceph-client.admin.108476.log.gz 2023-11-24T06:17:48.475 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-11-24T06:17:48.477 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108301.log 2023-11-24T06:17:48.477 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107508.log.gz 2023-11-24T06:17:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107592.log 2023-11-24T06:17:48.478 INFO:teuthology.orchestra.run.smithi022.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112193.log.gz 2023-11-24T06:17:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108301.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108301.log.gz 2023-11-24T06:17:48.480 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98076.log 2023-11-24T06:17:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93327.log 2023-11-24T06:17:48.481 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107592.log.gz 2023-11-24T06:17:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98076.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.98076.log.gz -5 2023-11-24T06:17:48.483 INFO:teuthology.orchestra.run.smithi022.stderr: --verbose -- /var/log/ceph/ceph-client.admin.108726.log 2023-11-24T06:17:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94669.log 2023-11-24T06:17:48.485 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93327.log.gz 2023-11-24T06:17:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108726.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108726.log.gz 2023-11-24T06:17:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101223.log 2023-11-24T06:17:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94661.log 2023-11-24T06:17:48.487 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94669.log.gz 2023-11-24T06:17:48.489 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105064.log 2023-11-24T06:17:48.490 INFO:teuthology.orchestra.run.smithi022.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.101223.log.gz 2023-11-24T06:17:48.490 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108982.log 2023-11-24T06:17:48.491 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94661.log.gz 2023-11-24T06:17:48.492 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.105064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104283.log 2023-11-24T06:17:48.493 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108982.log: 89.8% -- replaced with /var/log/ceph/ceph-client.0.105064.log.gz 2023-11-24T06:17:48.493 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108982.log.gz 2023-11-24T06:17:48.494 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95235.log 2023-11-24T06:17:48.495 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104283.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104283.log.gz 2023-11-24T06:17:48.495 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93061.log 2023-11-24T06:17:48.496 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110071.log 2023-11-24T06:17:48.497 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95235.log.gz 2023-11-24T06:17:48.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-24T06:17:48.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-24T06:17:48.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-24T06:17:48.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-24T06:17:48.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-24T06:17:48.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-24T06:17:48.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-24T06:17:48.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-24T06:17:48.499 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93061.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93061.log.gz 2023-11-24T06:17:48.499 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100411.log 2023-11-24T06:17:48.499 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110071.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-24T06:17:48.500 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110071.log.gz 2023-11-24T06:17:48.501 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99918.log 2023-11-24T06:17:48.501 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100411.log.gz 2023-11-24T06:17:48.502 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105697.log 2023-11-24T06:17:48.505 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99918.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.99918.log.gz --verbose 2023-11-24T06:17:48.505 INFO:teuthology.orchestra.run.smithi022.stderr: -- /var/log/ceph/ceph-client.admin.104679.log 2023-11-24T06:17:48.506 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111425.log 2023-11-24T06:17:48.506 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105697.log.gz 2023-11-24T06:17:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100243.log 2023-11-24T06:17:48.508 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104679.log.gz 2023-11-24T06:17:48.510 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95361.log 2023-11-24T06:17:48.510 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111425.log.gz 2023-11-24T06:17:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100243.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100243.log.gz 2023-11-24T06:17:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104113.log 2023-11-24T06:17:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99750.log 2023-11-24T06:17:48.512 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95361.log.gz 2023-11-24T06:17:48.514 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100621.log 2023-11-24T06:17:48.514 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104113.log.gz 2023-11-24T06:17:48.515 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112422.log 2023-11-24T06:17:48.515 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99750.log.gz 2023-11-24T06:17:48.517 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100621.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100621.log.gz -5 2023-11-24T06:17:48.517 INFO:teuthology.orchestra.run.smithi022.stderr: --verbose -- /var/log/ceph/ceph-client.admin.107634.log 2023-11-24T06:17:48.518 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94923.log 2023-11-24T06:17:48.518 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112422.log.gz 2023-11-24T06:17:48.519 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107634.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107634.log.gz 2023-11-24T06:17:48.520 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103891.log 2023-11-24T06:17:48.521 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93411.log 2023-11-24T06:17:48.521 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94923.log.gz 2023-11-24T06:17:48.522 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103891.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103891.log.gz 2023-11-24T06:17:48.523 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97585.log 2023-11-24T06:17:48.524 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93411.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T06:17:48.524 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93411.log.gz 2023-11-24T06:17:48.526 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107802.log 2023-11-24T06:17:48.526 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97585.log.gz 2023-11-24T06:17:48.528 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106475.log 2023-11-24T06:17:48.529 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107802.log: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T06:17:48.529 INFO:teuthology.orchestra.run.smithi022.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107802.log.gz 2023-11-24T06:17:48.529 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-24T06:17:48.531 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106237.log 2023-11-24T06:17:48.531 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106475.log.gz 2023-11-24T06:17:48.532 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94881.log 2023-11-24T06:17:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106237.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106237.log.gz 2023-11-24T06:17:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97107.log 2023-11-24T06:17:48.536 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94881.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94881.log.gz 2023-11-24T06:17:48.536 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100285.log 2023-11-24T06:17:48.537 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97107.log.gz 2023-11-24T06:17:48.538 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-24T06:17:48.539 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100285.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100285.log.gz 2023-11-24T06:17:48.541 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105985.log 2023-11-24T06:17:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.105985.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97401.log 2023-11-24T06:17:48.546 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101055.log 2023-11-24T06:17:48.546 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105985.log.gz 2023-11-24T06:17:48.549 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97401.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97401.log.gz 2023-11-24T06:17:48.551 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109987.log 2023-11-24T06:17:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101055.log: /var/log/ceph/ceph-client.admin.109987.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.101055.log.gz 2023-11-24T06:17:48.556 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.109788.log 2023-11-24T06:17:48.559 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9%/var/log/ceph/ceph-client.0.109788.log: -- replaced with /var/log/ceph/ceph-client.admin.109987.log.gz 2023-11-24T06:17:48.560 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101139.log 2023-11-24T06:17:48.564 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101139.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110029.log 2023-11-24T06:17:48.565 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.0.109788.log.gz 2023-11-24T06:17:48.566 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101139.log.gz 2023-11-24T06:17:48.568 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106359.log 2023-11-24T06:17:48.571 INFO:teuthology.orchestra.run.smithi022.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-24T06:17:48.573 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106359.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106359.log.gz 2023-11-24T06:17:48.573 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112109.log 2023-11-24T06:17:48.573 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110029.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110029.log.gz 2023-11-24T06:17:48.576 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112109.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112109.log.gz 2023-11-24T06:17:48.577 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92769.log 2023-11-24T06:17:48.578 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95109.log 2023-11-24T06:17:48.579 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.92769.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92769.log.gz 2023-11-24T06:17:48.580 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95109.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-24T06:17:48.580 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95109.log.gz 2023-11-24T06:17:48.581 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97443.log 2023-11-24T06:17:48.583 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102574.log 2023-11-24T06:17:48.584 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97443.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97443.log.gz 2023-11-24T06:17:48.585 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102574.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102574.log.gz 2023-11-24T06:17:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109402.log 2023-11-24T06:17:48.587 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94755.log 2023-11-24T06:17:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109402.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109402.log.gz 2023-11-24T06:17:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102286.log 2023-11-24T06:17:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94755.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94755.log.gz 2023-11-24T06:17:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99372.log 2023-11-24T06:17:48.591 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102286.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102286.log.gz 2023-11-24T06:17:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93241.log 2023-11-24T06:17:48.593 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105329.log 2023-11-24T06:17:48.594 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99372.log.gz 2023-11-24T06:17:48.595 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93241.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98648.log 2023-11-24T06:17:48.595 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93241.log.gz 2023-11-24T06:17:48.597 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101289.log 2023-11-24T06:17:48.597 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105329.log.gz 2023-11-24T06:17:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108770.log 2023-11-24T06:17:48.598 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98648.log.gz 2023-11-24T06:17:48.600 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93968.log 2023-11-24T06:17:48.600 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101289.log.gz 2023-11-24T06:17:48.601 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97950.log 2023-11-24T06:17:48.601 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108770.log.gz 2023-11-24T06:17:48.603 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106195.log 2023-11-24T06:17:48.603 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93968.log.gz 2023-11-24T06:17:48.605 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97950.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.103806.log 2023-11-24T06:17:48.605 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97950.log.gz 2023-11-24T06:17:48.606 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106195.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.106195.log.gz --verbose 2023-11-24T06:17:48.606 INFO:teuthology.orchestra.run.smithi022.stderr: -- /var/log/ceph/ceph-client.admin.94306.log 2023-11-24T06:17:48.608 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107718.log 2023-11-24T06:17:48.608 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103806.log.gz 2023-11-24T06:17:48.609 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93663.log 2023-11-24T06:17:48.609 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94306.log.gz 2023-11-24T06:17:48.611 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95151.log 2023-11-24T06:17:48.611 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107718.log.gz 2023-11-24T06:17:48.612 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93663.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93663.log.gz 2023-11-24T06:17:48.612 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108133.log 2023-11-24T06:17:48.613 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.95151.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95151.log.gz 2023-11-24T06:17:48.614 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99288.log 2023-11-24T06:17:48.616 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97023.log 2023-11-24T06:17:48.616 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108133.log.gz 2023-11-24T06:17:48.617 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94299.log 2023-11-24T06:17:48.617 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99288.log.gz 2023-11-24T06:17:48.619 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108642.log 2023-11-24T06:17:48.619 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97023.log.gz 2023-11-24T06:17:48.620 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.94299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110765.log 2023-11-24T06:17:48.621 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94299.log.gz 2023-11-24T06:17:48.621 INFO:teuthology.orchestra.run.smithi022.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-24T06:17:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108642.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112235.log 2023-11-24T06:17:48.622 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108642.log.gz 2023-11-24T06:17:48.623 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.110765.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110765.log.gz 2023-11-24T06:17:48.626 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93105.log 2023-11-24T06:17:48.627 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.112235.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112235.log.gz 2023-11-24T06:17:48.627 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96729.log 2023-11-24T06:17:48.627 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93105.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93105.log.gz 2023-11-24T06:17:48.628 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93971.log 2023-11-24T06:17:48.628 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106153.log 2023-11-24T06:17:48.629 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96729.log.gz 2023-11-24T06:17:48.630 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107550.log 2023-11-24T06:17:48.630 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93971.log.gz 2023-11-24T06:17:48.631 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106153.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106153.log.gz 2023-11-24T06:17:48.632 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109318.log 2023-11-24T06:17:48.633 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93621.log 2023-11-24T06:17:48.633 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107550.log.gz 2023-11-24T06:17:48.634 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.109318.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109318.log.gz 2023-11-24T06:17:48.634 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99000.log 2023-11-24T06:17:48.636 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.93621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104511.log 2023-11-24T06:17:48.636 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93621.log.gz 2023-11-24T06:17:48.637 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106111.log 2023-11-24T06:17:48.637 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99000.log.gz 2023-11-24T06:17:48.638 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104511.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104511.log.gz 2023-11-24T06:17:48.638 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111227.log 2023-11-24T06:17:48.640 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103382.log 2023-11-24T06:17:48.640 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106111.log.gz 2023-11-24T06:17:48.641 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111227.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111227.log.gz 2023-11-24T06:17:48.641 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-24T06:17:48.643 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103382.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103382.log.gz 2023-11-24T06:17:48.643 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82630.log 2023-11-24T06:17:48.644 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105943.log 2023-11-24T06:17:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.tmp-client.admin.82630.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82630.log.gz 2023-11-24T06:17:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107051.log 2023-11-24T06:17:48.648 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105943.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105943.log.gz 2023-11-24T06:17:48.648 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111647.log 2023-11-24T06:17:48.649 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107051.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107051.log.gz 2023-11-24T06:17:48.650 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111269.log 2023-11-24T06:17:48.652 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98448.log 2023-11-24T06:17:48.652 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111647.log.gz 2023-11-24T06:17:48.653 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.111269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99456.log 2023-11-24T06:17:48.653 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111269.log.gz 2023-11-24T06:17:48.654 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98448.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98448.log.gz 2023-11-24T06:17:48.656 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99456.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99456.log.gz 2023-11-24T06:17:48.668 INFO:teuthology.orchestra.run.smithi022.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-24T06:17:48.699 INFO:teuthology.orchestra.run.smithi022.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-24T06:17:48.783 INFO:teuthology.orchestra.run.smithi022.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-24T06:17:48.816 INFO:teuthology.orchestra.run.smithi022.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-24T06:17:48.817 INFO:teuthology.orchestra.run.smithi022.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-24T06:17:48.822 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-11-24T06:17:48.822 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m0.781s 2023-11-24T06:17:48.822 INFO:teuthology.orchestra.run.smithi022.stderr:user 0m2.098s 2023-11-24T06:17:48.823 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m1.322s 2023-11-24T06:17:48.823 INFO:tasks.ceph:Archiving logs... 2023-11-24T06:17:48.824 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/remote/smithi022/log 2023-11-24T06:17:48.825 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T06:17:49.446 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/remote/smithi031/log 2023-11-24T06:17:49.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T06:17:49.760 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-24T06:17:49.777 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-24T06:17:49.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T06:17:49.786 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T06:17:49.946 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-24T06:17:49.955 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-24T06:17:49.956 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:17:49.965 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:17:50.017 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2023-11-24T06:17:50.026 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2023-11-24T06:17:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:17:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2023-11-24T06:17:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 22 +2129us[+2131us] +/- 74ms 2023-11-24T06:17:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 -1681us[-1678us] +/- 62ms 2023-11-24T06:17:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -89us[ -86us] +/- 94ms 2023-11-24T06:17:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:17:50.037 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:17:50.037 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2023-11-24T06:17:50.037 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 23 +2151us[+2181us] +/- 74ms 2023-11-24T06:17:50.037 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 -1681us[-1651us] +/- 62ms 2023-11-24T06:17:50.037 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -90us[ -59us] +/- 94ms 2023-11-24T06:17:50.038 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:17:50.038 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-24T06:17:50.050 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-24T06:17:50.051 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-24T06:17:50.078 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T06:17:50.373 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T06:17:50.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:17:50.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:17:50.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:17:50.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:17:50.889 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-24T06:17:50.904 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-24T06:17:50.944 INFO:teuthology.task.internal:Duration was 1225.475418 seconds 2023-11-24T06:17:50.945 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-24T06:17:50.975 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-24T06:17:50.976 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T06:17:50.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T06:17:51.162 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:17:51.172 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:17:51.725 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-24T06:17:51.725 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2023-11-24T06:17:51.726 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T06:17:51.807 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2023-11-24T06:17:51.807 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T06:17:51.888 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-24T06:17:51.889 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T06:17:51.895 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T06:17:52.000 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-24T06:17:52.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T06:17:52.006 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T06:17:52.200 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-24T06:17:52.212 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-24T06:17:52.213 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T06:17:52.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T06:17:52.421 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-24T06:17:52.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:17:52.443 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:17:52.558 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2023-11-24T06:17:52.566 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2023-11-24T06:17:52.622 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:17:52.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:17:52.674 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:17:52.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:17:52.735 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-24T06:17:52.747 INFO:teuthology.task.internal:Transferring archived files... 2023-11-24T06:17:52.751 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/remote/smithi022 2023-11-24T06:17:52.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T06:17:52.871 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549/remote/smithi031 2023-11-24T06:17:52.872 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T06:17:52.988 INFO:teuthology.task.internal:Removing archive directory... 2023-11-24T06:17:52.988 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T06:17:52.998 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T06:17:53.093 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-24T06:17:53.105 INFO:teuthology.task.internal:Not uploading archives. 2023-11-24T06:17:53.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-24T06:17:53.155 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-24T06:17:53.155 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T06:17:53.165 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T06:17:53.219 INFO:teuthology.orchestra.run.smithi022.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 06:17 /home/ubuntu/cephtest 2023-11-24T06:17:53.229 INFO:teuthology.orchestra.run.smithi031.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 06:17 /home/ubuntu/cephtest 2023-11-24T06:17:53.232 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-24T06:17:53.243 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-24T06:17:53.311 INFO:teuthology.nuke:Checking targets against current locks 2023-11-24T06:17:53.337 DEBUG:teuthology.nuke:shortname: smithi022 2023-11-24T06:17:53.338 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:17:53.361 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:47:46.131676', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzfUH1Qhkx3UErF1rZEapYX84suSfSoXmfVV9IRb3VCZ7HVR/WVJa0kuNXpwrLyzVFOs9dUYrWxP2fwYTuBjSA='} 2023-11-24T06:17:53.369 DEBUG:teuthology.nuke:shortname: smithi031 2023-11-24T06:17:53.369 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:17:53.394 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465549', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:47:46.133456', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKvyZJSGfP9QNiqWO4NqH+y2mCF+JpOK2PEVDl75av/LvnBOQ4sQuRQSGRUwkmeTRiU6MZ8GgEaMs7ABH+10MZw='} 2023-11-24T06:17:53.425 INFO:teuthology.orchestra.console.smithi022:Power off 2023-11-24T06:17:53.426 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T06:17:53.448 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-11-24T06:17:53.448 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:17:53.464 INFO:teuthology.orchestra.console.smithi031:Power off 2023-11-24T06:17:53.465 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T06:17:53.475 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-11-24T06:17:53.487 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-11-24T06:17:53.488 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:17:53.511 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-24T06:17:57.476 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:17:57.513 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:17:57.586 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-11-24T06:17:57.623 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-24T06:18:01.590 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:01.624 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:01.700 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-11-24T06:18:01.733 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-24T06:18:05.702 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:05.735 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:05.811 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-11-24T06:18:05.845 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-24T06:18:05.913 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-11-24T06:18:05.946 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-11-24T06:18:06.051 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} duration: 1225.4754180908203 failure_reason: 'Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc)' flavor: default mon.a-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 mon.b-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=2b33eb7fea1a4e7493c95c15e3470ce2 status: fail success: false 2023-11-24T06:18:06.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T06:18:06.128 INFO:teuthology.run:FAIL